Abstract: Recently, large language models (LLMs), those pretrained on code, have demonstrated strong capabilities in generating programs from informal natural language intent. However, LLM -generated ...

Abstract: Large language models (LLMs) continue to be adopted for a multitude of previously manual tasks, with code generation as a prominent use. Multiple commercial models have seen wide adoption ...

[2025-06-01] Many thanks to @aherzinger for implementing and refactoring the Generator and RAG models. [2025-05-30] Huge thanks to @baraayusry for implementing the Online Retriever using CrawAI and ...

We evaluate DeepCode on the PaperBench benchmark (released by OpenAI), a rigorous testbed requiring AI agents to independently reproduce 20 ICML 2024 papers from scratch. The benchmark comprises 8,316 ...