II.
Benchmark overview
Reference · livebenchmark:m-mmlu
Multilingual MMLU (mMMLU) overview
A multilingual translation of MMLU (Massive Multitask Language Understanding) covering 14 languages, used for evaluating cross- lingual knowledge and reasoning. Released by OpenAI as MMMLU.
Attributes
displayName
Multilingual MMLU (mMMLU)
homepageUrl
kind
model-only
targetsKind
ModelVersion
description
A multilingual translation of MMLU (Massive Multitask Language
Understanding) covering 14 languages, used for evaluating cross-
lingual knowledge and reasoning. Released by OpenAI as MMMLU.
Outgoing edges
applies_to1
- domain:education·DomainEducation
covers1
- skill-area:general-knowledge-reasoning·SkillAreaGeneral Knowledge Reasoning
Incoming edges
None.