Skip to content
Wycord
Datasets

AfriMMLU (IrokoBench) vs AfriQA

A verified, side-by-side comparison. Both records are status-checked by Wycord, so you are comparing what each actually offers today, not a stale listing.

AfriMMLU (IrokoBench)AfriQA
Category
Datasets
Datasets
Type
Language / NLP
Language / NLP
Country
🌍 Pan-African
🌍 Pan-African
Docs status
Docs live
Docs live
Licensing
Pricing
Free / open
Free / CC-BY-SA 4.0
Verified
Unverified
Verified
Last verified
10 Oct 2026
10 Oct 2026
Tags
nlp, african-languages, question-answering, evaluation, benchmark
nlp, african-languages, question-answering, cross-lingual, open-retrieval
Links
Website
Website Docs GitHub
Summary
Human-translated multiple-choice question-answering evaluation benchmark covering 16 to 17 African languages plus English and French, derived from a subset of MMLU across subjects like maths, geography and law. Distributed as CSV and parquet on HuggingFace and forms part of the IrokoBench suite (MMLU, MGSM, XNLI). Licensed Apache 2.0.
Cross-lingual open-retrieval question-answering dataset with human-translated QA pairs for 10 African languages (incl. Hausa, Igbo, Yoruba), totaling 12,159 examples across train/validation/test splits. From the Masakhane initiative.

AfriMMLU (IrokoBench) vs AfriQA at a glance

AfriMMLU (IrokoBench) and AfriQA are both listed under Language / NLP in Wycord's Datasets index.

Both are based in Pan-African.

Both currently show the status "Docs live".

On access, both are marked "No approval needed".

Over the last 30 days Wycord's probes measured 100% uptime for AfriMMLU (IrokoBench) (36 checks) and 100% for AfriQA (36 checks).

Average response time on live probes was 180 ms for AfriMMLU (IrokoBench) and 207 ms for AfriQA.

Uptime and latency come from Wycord's own probes of each resource's website, documentation and repository, run every six hours.

How they differ

  • Pricing: AfriMMLU (IrokoBench), Free / open; AfriQA, Free / CC-BY-SA 4.0.
  • Verification: AfriMMLU (IrokoBench), Unverified; AfriQA, Verified.
  • Average latency: AfriMMLU (IrokoBench), 180 ms; AfriQA, 207 ms.

Topics

Both are tagged: nlp, african-languages, question-answering.

Only AfriMMLU (IrokoBench): evaluation, benchmark.

Only AfriQA: cross-lingual, open-retrieval.

Common questions

Which has better uptime, AfriMMLU (IrokoBench) or AfriQA?
They are level at 100% over the last 30 days.
Do AfriMMLU (IrokoBench) or AfriQA need approval before use?
Both are marked "No approval needed".
Is the documentation for AfriMMLU (IrokoBench) and AfriQA working?
Both show "Docs live" at the last check.
Where are AfriMMLU (IrokoBench) and AfriQA based?
Both are based in Pan-African.

More comparisons

Full details: AfriMMLU (IrokoBench)Full details: AfriQA