Skip to content
Datasets

AfriMMLU (IrokoBench) vs MasakhaNER 2.0

A verified, side-by-side comparison. Both records are status-checked by Wycord, so you are comparing what each actually offers today, not a stale listing.

Category
Datasets
Datasets
Type
Language / NLP
Language / NLP
Country
🌍 Pan-African
🌍 Pan-African
Docs status
Docs live
Docs live
Licensing
Pricing
Free / open
Free / CC-BY-NC 4.0
Verified
Unverified
Verified
Last verified
10 Oct 2026
10 Oct 2026
Tags
nlp, african-languages, question-answering, evaluation, benchmark
nlp, ner, named-entity-recognition, african-languages, token-classification
Summary
Human-translated multiple-choice question-answering evaluation benchmark covering 16 to 17 African languages plus English and French, derived from a subset of MMLU across subjects like maths, geography and law. Distributed as CSV and parquet on HuggingFace and forms part of the IrokoBench suite (MMLU, MGSM, XNLI). Licensed Apache 2.0.
Largest high-quality named-entity-recognition corpus for 20 African languages (incl. Nigerian Pidgin, Hausa, Igbo, Yoruba) with PER/ORG/LOC/DATE tags over news-domain text, totaling ~152,786 rows. Built by the Masakhane community.

AfriMMLU (IrokoBench) vs MasakhaNER 2.0 at a glance

AfriMMLU (IrokoBench) and MasakhaNER 2.0 are both listed under Language / NLP in Wycord's Datasets index.

Both are based in Pan-African.

Both currently show the status "Docs live".

On access, both are marked "No approval needed".

Over the last 30 days Wycord's probes measured 100% uptime for AfriMMLU (IrokoBench) (36 checks) and 100% for MasakhaNER 2.0 (36 checks).

Average response time on live probes was 180 ms for AfriMMLU (IrokoBench) and 242 ms for MasakhaNER 2.0.

Uptime and latency come from Wycord's own probes of each resource's website, documentation and repository, run every six hours.

How they differ

  • Pricing: AfriMMLU (IrokoBench), Free / open; MasakhaNER 2.0, Free / CC-BY-NC 4.0.
  • Verification: AfriMMLU (IrokoBench), Unverified; MasakhaNER 2.0, Verified.
  • Average latency: AfriMMLU (IrokoBench), 180 ms; MasakhaNER 2.0, 242 ms.

Topics

Both are tagged: nlp, african-languages.

Only AfriMMLU (IrokoBench): question-answering, evaluation, benchmark.

Only MasakhaNER 2.0: ner, named-entity-recognition, token-classification.

Common questions

Which has better uptime, AfriMMLU (IrokoBench) or MasakhaNER 2.0?
They are level at 100% over the last 30 days.
Do AfriMMLU (IrokoBench) or MasakhaNER 2.0 need approval before use?
Both are marked "No approval needed".
Is the documentation for AfriMMLU (IrokoBench) and MasakhaNER 2.0 working?
Both show "Docs live" at the last check.
Where are AfriMMLU (IrokoBench) and MasakhaNER 2.0 based?
Both are based in Pan-African.

More comparisons