II.
Benchmark overview
Reference · livebenchmark:gsm8k
GSM8K overview
GSM8K (OpenAI) is 8.5K linguistically diverse grade-school math word problems requiring multi-step arithmetic reasoning.
Attributes
displayName
GSM8K
homepageUrl
kind
math
targetsKind
ModelVersion
description
GSM8K (OpenAI) is 8.5K linguistically diverse grade-school math word
problems requiring multi-step arithmetic reasoning.
Outgoing edges
covers1
- skill-area:mathematical-reasoning·SkillAreaMathematical Reasoning
Incoming edges
belongs_to_benchmark1
- test-set:gsm8k-test·TestSetGSM8K test split
bounds_subject1
- scope-boundary:gsm8k.scope·ScopeBoundary
for_benchmark2
scored_against2
- eval-result:gsm8k.gemma-2-27b.001·EvalResult
- eval-result:gsm8k.claude-sonnet-4-5.001·EvalResult