IrokoBench

IrokoBench is a human-translated evaluation benchmark for 16 typologically diverse African languages covering three tasks: natural language inference (AfriXNLI), knowledge QA (AfriMMLU) and mathematical reasoning (AfriMGSM). It is widely used to measure the performance gap between English and African languages in large language models. It was released by the Masakhane community and published at NAACL 2025.

Category

AI Resources

Pricing

Open

Country

🌍 Pan-African

Last verified

10 Oct 2026

{
  "name": "IrokoBench",
  "slug": "irokobench",
  "category": "AI",
  "country": "Pan-African",
  "docs_status": "LIVE",
  "licensing_required": "NONE",
  "verified": false,
  "last_verified": "2026-10-10",
  "website": "https://huggingface.co/collections/masakhane/irokobench",
  "documentation_url": "https://arxiv.org/abs/2406.03368"
}