Simba Speech Series Collection Simba bridges the digital divide with a unified suite for African AI: the largest open-source speech benchmark and models covering 61 languages • 13 items • Updated Feb 12 • 1
Omnilingual MT: Machine Translation for 1,600 Languages Paper • 2603.16309 • Published 17 days ago • 20
Paza Collection Paza is a collection of speech models & benchmarks for low resource languages by the Microsoft Research Africa - Nairobi Lab • 3 items • Updated Mar 2 • 3
HPLT 3.0: Very Large-Scale Multilingual Resources for LLM and MT. Mono- and Bi-lingual Data, Multilingual Evaluation, and Pre-Trained Models Paper • 2511.01066 • Published Nov 2, 2025 • 1
Tamazight Collection https://huggingface.co/Tamazight-NLP • 2 items • Updated Dec 26, 2025 • 1
Faithful Persona-based Conversational Dataset Generation with Large Language Models Paper • 2312.10007 • Published Dec 15, 2023 • 11
Awal -- Community-Powered Language Technology for Tamazight Paper • 2510.27407 • Published Oct 31, 2025 • 1
M5 -- A Diverse Benchmark to Assess the Performance of Large Multimodal Models Across Multilingual and Multicultural Vision-Language Tasks Paper • 2407.03791 • Published Jul 4, 2024 • 2
Massively Multilingual Adaptation of Large Language Models Using Bilingual Translation Data Paper • 2506.00469 • Published May 31, 2025 • 4
Less is More: Recursive Reasoning with Tiny Networks Paper • 2510.04871 • Published Oct 6, 2025 • 513
OLDI and friends Collection This collection groups the datasets that have been featured as part of WMT’s Open Language Data Initiative shared task. • 5 items • Updated 9 days ago • 5
MYTE: Morphology-Driven Byte Encoding for Better and Fairer Multilingual Language Modeling Paper • 2403.10691 • Published Mar 15, 2024 • 1
view article Article Introducing Wikipedia Monthly: Fresh, Clean Wikipedia Dumps for NLP & AI Research Jul 19, 2025 • 7
Synthetic Voice Data for Automatic Speech Recognition in African Languages Paper • 2507.17578 • Published Jul 23, 2025 • 2
The NaijaVoices Dataset: Cultivating Large-Scale, High-Quality, Culturally-Rich Speech Data for African Languages Paper • 2505.20564 • Published May 26, 2025 • 1
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language Paper • 2506.20920 • Published Jun 26, 2025 • 78
MT Quality Estimation Collection Models for reference-free quality estimation of machine translation • 10 items • Updated Jan 29, 2025 • 4
Domain-Specific Translation with Open-Source Large Language Models: Resource-Oriented Analysis Paper • 2412.05862 • Published Dec 8, 2024 • 1