II.
Benchmark overview
Reference · livebenchmark:gsm-symbolic
GSM-Symbolic overview
GSM-Symbolic (Apple, 2024) is a symbolic-template variant of GSM8K that programmatically rewrites problems to probe whether models perform genuine reasoning vs. pattern-matching on memorized text.
Attributes
displayName
GSM-Symbolic
homepageUrl
kind
math
targetsKind
ModelVersion
description
GSM-Symbolic (Apple, 2024) is a symbolic-template variant of GSM8K
that programmatically rewrites problems to probe whether models
perform genuine reasoning vs. pattern-matching on memorized text.
Outgoing edges
applies_to1
- domain:mathematics·DomainMathematics
covers1
- skill-area:mathematical-reasoning·SkillAreaMathematical Reasoning
Incoming edges
None.