evaluating-code-models

Orchestra-Research/AI-Research-SKILLs/11-evaluation/bigcode-evaluation-harness

12.1k 0TeXDev Tools
PlatformOpenAI Codex

Evaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding abilities, testing multi-language support, or measuring code generation quality. Industry standard from BigCode Project used by HuggingFace leaderboards.

All Skills