BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Summary
BigCodeBench evaluates LLM code generation with tasks involving diverse function calls and complex instructions, closer to real development than benchmarks that only test simple snippets.
Why this matters
Covers model and LLM · Relevant to this topic
Source: arXiv cs.AI · arxiv.org