Skip to content
Wycord
Research

IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models vs MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition

A verified, side-by-side comparison. Both records are status-checked by Wycord, so you are comparing what each actually offers today, not a stale listing.

IrokoBench: A New Benchmark for African Languages in the Age of Large Language ModelsMasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition
Category
Research
Research
Type
NLP benchmark
NLP benchmark
Country
🌍 Pan-African
🌍 Pan-African
Docs status
Docs live
Docs live
Licensing
Pricing
Free / open
Free / open
Verified
Unverified
Unverified
Last verified
10 Oct 2026
10 Oct 2026
Tags
african-languages, masakhane, nlp-benchmark, llm-evaluation
named-entity-recognition, african-languages, nlp-benchmark, transfer-learning
Links
Website
Website
Summary
IrokoBench is a human-translated evaluation benchmark covering 17 typologically diverse low-resource African languages across three tasks: natural language inference (AfriXNLI), mathematical reasoning (AfriMGSM) and knowledge-based multiple-choice QA (AfriMMLU). The paper evaluates open and proprietary LLMs and documents a large gap between high-resource languages and African languages, with the best open model reaching about 63 percent of GPT-4o performance. It was published at NAACL 2025.
MasakhaNER 2.0 introduces the largest human-annotated named entity recognition dataset for 20 African languages and studies Africa-centric cross-lingual transfer learning. The paper reports that choosing the best transfer language improves zero-shot F1 by an average of 14 points across the 20 languages compared with transferring from English.

IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models vs MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition at a glance

IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models and MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition are both listed under NLP benchmark in Wycord's Research index.

Both are based in Pan-African.

Both currently show the status "Docs live".

On access, both are marked "No approval needed".

Over the last 30 days Wycord's probes measured 100% uptime for IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models (36 checks) and 100% for MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition (36 checks).

Average response time on live probes was 25 ms for IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models and 24 ms for MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition.

Uptime and latency come from Wycord's own probes of each resource's website, documentation and repository, run every six hours.

How they differ

  • Average latency: IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models, 25 ms; MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition, 24 ms.

Topics

Both are tagged: african-languages, nlp-benchmark.

Only IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models: masakhane, llm-evaluation.

Only MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition: named-entity-recognition, transfer-learning.

Common questions

Which has better uptime, IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models or MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition?
They are level at 100% over the last 30 days.
Do IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models or MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition need approval before use?
Both are marked "No approval needed".
Is the documentation for IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models and MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition working?
Both show "Docs live" at the last check.
Where are IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models and MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition based?
Both are based in Pan-African.

More comparisons

Full details: IrokoBench: A New Benchmark for African Languages in the Age of Large Language ModelsFull details: MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition