TurkColBERT: A Benchmark of Dense and Late-Interaction Models for Turkish Information Retrieval
Neural information retrieval systems excel in high-resource languages but remain underexplored for morphologically rich, lower-resource languages such as Turkish. Dense bi-encoders currently dominate Turkish IR, yet late-interaction models -- which retain token-level representations for fine-grained matching -- have not been systematically evaluated. We introduce TurkColBERT, the first comprehensive benchmark comparing dense encoders and late-interaction models for Turkish retrieval. Our two-stage adaptation pipeline fine-tunes English and multilingual encoders on Turkish NLI/STS tasks, then converts them into ColBERT-style retrievers using PyLate trained on MS MARCO-TR. We evaluate 10 models across five Turkish BEIR datasets covering scientific, financial, and argumentative domains. Results show strong parameter efficiency: the 1.0M-parameter colbert-hash-nano-tr is 600times smaller than the 600M turkish-e5-large dense encoder while preserving over 71\% of its average mAP. Late-interaction models that are 3--5times smaller than dense encoders significantly outperform them; ColmmBERT-base-TR yields up to +13.8\% mAP on domain-specific tasks. For production-readiness, we compare indexing algorithms: MUVERA+Rerank is 3.33times faster than PLAID and offers +1.7\% relative mAP gain. This enables low-latency retrieval, with ColmmBERT-base-TR achieving 0.54 ms query times under MUVERA. We release all checkpoints, configs, and evaluation scripts. Limitations include reliance on moderately sized datasets (leq50K documents) and translated benchmarks, which may not fully reflect real-world Turkish retrieval conditions; larger-scale MUVERA evaluations remain necessary.
691fda11cce0eb9b6387afb7
Özay Ezerceli
claimed_verified
2025-11-21T08:59:33.793Z
6464e76894327a238f56d7ff
https://cdn-avatars.huggingface.co/v1/production/uploads/6464e76894327a238f56d7ff/U-3iova5yEQgigmmtDBPY.png
Özay Ezerceli
ozayezerceli
user
ozayezerceli
691fda11cce0eb9b6387afb8
Mahmoud El Hussieni
claimed_verified
2025-11-21T08:59:40.868Z
6422eab8e2029ade06eeee2c
https://cdn-avatars.huggingface.co/v1/production/uploads/6422eab8e2029ade06eeee2c/Gai3BHr2WJ0YuhdumqQ_z.png
Mahmud ElHuseyni 🇵🇸
MElHuseyni
user
MElHuseyni
691fda11cce0eb9b6387afb9
Selva Taş
claimed_verified
2025-11-21T08:59:38.921Z
63241e8f0fc33e3d14dd5277
https://cdn-avatars.huggingface.co/v1/production/uploads/63241e8f0fc33e3d14dd5277/QUF4j7L3xZdKRnLRCrA12.jpeg
SELVA TAŞ
selvatas
user
selvatas
691fda11cce0eb9b6387afba
Reyhan Bayraktar
claimed_verified
2025-11-21T08:59:35.611Z
64a52413fa840dd18c2f76fe
https://cdn-avatars.huggingface.co/v1/production/uploads/64a52413fa840dd18c2f76fe/5PD-BHnKm2aQWFZhE7P2I.jpeg
Reyhan Bayraktar
byrayhana
user
byrayhana
691fda11cce0eb9b6387afbb
Fatma Betül Terzioğlu
claimed_verified
2025-11-27T20:40:11.984Z
6879146c99e4f3995ef34ba1
https://cdn-avatars.huggingface.co/v1/production/uploads/6879146c99e4f3995ef34ba1/hIMI-6mopkhA8rmLB1Ij6.jpeg
Betül Terzioğlu
BetulT
user
BetulT
691fda11cce0eb9b6387afbc
Yusuf Çelebi
claimed_verified
2025-11-24T07:58:31.060Z
6899a2c00b1627a0954e728e
https://cdn-avatars.huggingface.co/v1/production/uploads/6899a2c00b1627a0954e728e/yM7wbgPHe_6dkIpHk9o9d.png
Yusuf Çelebi
yusufcelebi
user
yusufcelebi
691fda11cce0eb9b6387afbd
Yağız Asker
claimed_verified
2025-11-21T16:48:57.702Z
68c1577793c24dc99747a7b0
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/FIg_MYFd24wf0uEjHnS1C.png
Yağız Asker
yasker00
user
yasker00
TurkColBERT: A Benchmark of Dense and Late-Interaction Models for Turkish Information Retrieval
Neural information retrieval systems excel in high-resource languages but remain underexplored for morphologically rich, lower-resource languages such as Turkish. Dense bi-encoders currently dominate Turkish IR, yet late-interaction models -- which retain token-level representations for fine-grained matching -- have not been systematically evaluated. We introduce TurkColBERT, the first comprehensive benchmark comparing dense encoders and late-interaction models for Turkish retrieval. Our two-stage adaptation pipeline fine-tunes English and multilingual encoders on Turkish NLI/STS tasks, then converts them into ColBERT-style retrievers using PyLate trained on MS MARCO-TR. We evaluate 10 models across five Turkish BEIR datasets covering scientific, financial, and argumentative domains. Results show strong parameter efficiency: the 1.0M-parameter colbert-hash-nano-tr is 600times smaller than the 600M turkish-e5-large dense encoder while preserving over 71\% of its average mAP. Late-interaction models that are 3--5times smaller than dense encoders significantly outperform them; ColmmBERT-base-TR yields up to +13.8\% mAP on domain-specific tasks. For production-readiness, we compare indexing algorithms: MUVERA+Rerank is 3.33times faster than PLAID and offers +1.7\% relative mAP gain. This enables low-latency retrieval, with ColmmBERT-base-TR achieving 0.54 ms query times under MUVERA. We release all checkpoints, configs, and evaluation scripts. Limitations include reliance on moderately sized datasets (leq50K documents) and translated benchmarks, which may not fully reflect real-world Turkish retrieval conditions; larger-scale MUVERA evaluations remain necessary.
TurkColBERT evaluates dense encoders and late-interaction models for Turkish information retrieval, demonstrating parameter efficiency and superior performance of late-interaction models with faster indexing.
dense bi-encoders late-interaction models token-level representations fine-grained matching TurkColBERT Turkish NLI/STS tasks ColBERT-style retrievers PyLate MS MARCO-TR Turkish BEIR datasets average mAP parameter efficiency colbert-hash-nano-tr turkish-e5-large ColmmBERT-base-TR indexing algorithms MUVERA+Rerank PLAID query times MUVERA