BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Allsikt//Article Deadline//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
BEGIN:VEVENT
UID:cf2815a39871e4f1fec7bfd5c4579578d587bcc1@allsikt.tech
DTSTAMP:20260722T172137Z
DTSTART;VALUE=DATE:20260722
DTEND;VALUE=DATE:20260723
SUMMARY:New Benchmark Shows Language Models Struggle to Build Full Software Projects
DESCRIPTION:Install ProgramBench via pip and run eval on your agent to benchmark its ability to rebuild executables from scratch.\n\nSource: Reddit r/LocalLLaMA\nOpen: https://allsikt.se/article/programbench-can-we-really-rebuild-huge-binaries-from-scratch-doesn-t-look-like-it-f073c815
URL:https://allsikt.se/article/programbench-can-we-really-rebuild-huge-binaries-from-scratch-doesn-t-look-like-it-f073c815
STATUS:CONFIRMED
TRANSP:TRANSPARENT
END:VEVENT
END:VCALENDAR