III.
Node kind ledger
Page 1 of 1Benchmark
Benchmark records
Browse all Benchmark records in the current atlas snapshot.
Filters & facets1 active · 4 groups
homepageUrl
https://www.swebench.com/ · 2https://github.com/THUDM/AgentBench · 1https://github.com/hendrycks/apps · 1https://os-world.github.io/ · 1https://google-research.github.io/android_world/ · 1https://metr.org/AI_R_D_Evaluation_Report.pdf · 1https://appworld.dev/ · 1https://assistantbench.github.io/ · 1https://the-agent-company.com/ · 1https://agentclinic.github.io/ · 1https://osu-nlp-group.github.io/TravelPlanner/ · 1https://openai.com/index/browsecomp/ · 1
kind
description
General AI Assistants benchmark — real-world agent reasoning tasks.
· 1Hand-written programming problems for evaluating code generation.
· 1MBPP+ from EvalPlus — augmented MBPP with substantially expanded test suites.
· 1Machine learning engineering tasks drawn from Kaggle competitions.
· 1Massive Multitask Language Understanding — 57-subject knowledge benchmark.
· 1Real-world software engineering issues from open-source Python repos.
· 1
targetsKind
| id | displayName | cluster |
|---|---|---|
| benchmark:agentbench | AgentBench | benchmarks |
| benchmark:agentboard | AgentBoard | benchmarks |
| benchmark:agentclinic | AgentClinic | benchmarks |
| benchmark:aider-polyglot | Aider Polyglot | benchmarks |
| benchmark:android-world | AndroidWorld | benchmarks |
| benchmark:appworld | AppWorld | benchmarks |
| benchmark:arc-agi-3 | ARC-AGI 3 | benchmarks |
| benchmark:assistant-bench | AssistantBench | benchmarks |
| benchmark:browse-comp | BrowseComp | benchmarks |
| benchmark:cyber-bench | CyberBench | benchmarks |
| benchmark:gaia | GAIA | benchmarks |
| benchmark:mind2web-2 | Mind2Web 2 | benchmarks |
| benchmark:mle-bench | MLE-bench | benchmarks |
| benchmark:os-world | OSWorld | benchmarks |
| benchmark:re-bench | RE-Bench | benchmarks |
| benchmark:swe-bench | SWE-bench | benchmarks |
| benchmark:swe-bench-multimodal | SWE-bench Multimodal | benchmarks |
| benchmark:swe-bench-verified | SWE-bench Verified | benchmarks |
| benchmark:swe-lancer | SWE-Lancer | benchmarks |
| benchmark:tau-bench | tau-bench | benchmarks |
| benchmark:terminal-bench | Terminal-Bench | benchmarks |
| benchmark:the-agent-company | TheAgentCompany | benchmarks |
| benchmark:toolbench | ToolBench | benchmarks |
| benchmark:travelplanner | TravelPlanner | benchmarks |
| benchmark:visualwebarena | VisualWebArena | benchmarks |
| benchmark:webarena | WebArena | benchmarks |
| benchmark:webvoyager | WebVoyager | benchmarks |
| benchmark:workarena | WorkArena | benchmarks |