We evaluate DeepCode on the PaperBench benchmark (released by OpenAI), a rigorous testbed requiring AI agents to independently reproduce 20 ICML 2024 papers from scratch. The benchmark comprises 8,316 ...

While setting up the project locally as a new contributor, I noticed that both Node.js and Python tooling are present, but the README primarily focuses on Python-based agent development. It’s not ...