Agent 评测

3 条

SWE-bench 这类任务级评测。

#仓库Stars
1SWE-agent/SWE-agent
SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]
21k
2openai/evals
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
20k
3SWE-bench/SWE-bench
SWE-bench: Can Language Models Resolve Real-world Github Issues?
6.2k