🗂️Benchmark Name: DevEval 📚Publisher/Date: Arxiv/2024 🏠Author Affiliation: Peking University 🔗URL: https://github.com/seketeam/DevEval Number of Instances: 2,690 samples from 119 practi...

📙Paper: StableCode 📚Publisher: huggingface 🏠Author Affiliation: stabilityai 🔑Public: √ 🌐Architecture Encoder-Decoder Decoder-Only 📏Model Size 3B ...

📙Paper: Teaching Code LLMs to Use Autocompletion Tools in Repository-Level Code Generation 📚Publisher: arxiv 🏠Author Affiliation: Nanyang Technological University; Fudan University

🗂️Benchmark Name: CRUXEval 📚Publisher: Arxiv 🏠Author Affiliation: MIT; Meta AI Number of Instances: 800 Problem Description’s Natural Language: English Code Solution’s Programming Lang...

📙Paper: AST-T5 📚Publisher: arxiv 🏠Author Affiliation: UC Berkeley; Meta AI 🔑Public: ✅ 🌐Architecture Encoder-Decoder Decoder-Only 📏Model Size 226M ...

📙Paper: WaveCoder Widespread And Versatile Enhanced Instruction Tuning with Refined Data Generation 📚Publisher: arxiv 🏠Author Affiliation: Microsoft

🗂️Benchmark Name: TACO 📚Publisher/Date: Arxiv/2023 🏠Author Affiliation: BAAI 🔗URL: https://github.com/FlagOpen/TACO Number of Instances: 26,443 Problem Description’s Natural Language: ...

📙Paper: phi-2 📚Publisher: huggingface 🏠Author Affiliation: Microsoft 🔑Public: √ 🌐Architecture Encoder-Decoder Decoder-Only 📏Model Size 2.7B

📙Paper: AlphaCode 2 Technical Report 📚Publisher: other 🏠Author Affiliation: AlphaCode Team, Google DeepMind 🔑Public: × 🌐Architecture Encoder-Decoder Decoder-Only

📙Paper: Magicoder: Source Code Is All You Need 📚Publisher: arxiv 🏠Author Affiliation: University of Illinois at Urbana-Champaign; Tsinghua University 🔑Public: ✅ 🌐Architecture ...