📙Paper: [Code Generation with AlphaCodium From Prompt Engineering to Flow Engineering](https://arxiv.org/abs/2401.08500) 📚Publ...
JumpCoder
📙Paper: JumpCoder 📚Publisher: arxiv 🏠Author Affiliation: Zhejiang University 🔑Public: ✅
CodeAgentBench
🗂️Benchmark Name: CodeAgentBench 📚Publisher: Arxiv 🏠Author Affiliation: Peking University 🔗URL: https://github.com/zkcpku/CodeAgent Number of Instances: 101 Problem Description’s Natur...
OOP
🗂️Benchmark Name: OOP 📚Publisher: Arxiv 🏠Author Affiliation: Wuhan University; The University of Sydney; JD Explore Academy 🔗URL: https://github.com/alphadl/OOP-eval Number of Instances:...
DevEval
🗂️Benchmark Name: DevEval 📚Publisher/Date: Arxiv/2024 🏠Author Affiliation: Peking University 🔗URL: https://github.com/seketeam/DevEval Number of Instances: 2,690 samples from 119 practi...
StableCode
📙Paper: StableCode 📚Publisher: huggingface 🏠Author Affiliation: stabilityai 🔑Public: √ 🌐Architecture Encoder-Decoder Decoder-Only 📏Model Size 3B ...
ToolGen
📙Paper: Teaching Code LLMs to Use Autocompletion Tools in Repository-Level Code Generation 📚Publisher: arxiv 🏠Author Affiliation: Nanyang Technological University; Fudan University
CRUXEval
🗂️Benchmark Name: CRUXEval 📚Publisher: Arxiv 🏠Author Affiliation: MIT; Meta AI Number of Instances: 800 Problem Description’s Natural Language: English Code Solution’s Programming Lang...
AST-T5
📙Paper: AST-T5 📚Publisher: arxiv 🏠Author Affiliation: UC Berkeley; Meta AI 🔑Public: ✅ 🌐Architecture Encoder-Decoder Decoder-Only 📏Model Size 226M ...
WaveCoder
📙Paper: WaveCoder Widespread And Versatile Enhanced Instruction Tuning with Refined Data Generation 📚Publisher: arxiv 🏠Author Affiliation: Microsoft