Reproducing and Comparing Distillation Techniques for Cross-Encoders
Paper • 2603.03010 • Published
reproducing-cross-encoders
A set of cross-encoders trained from various backbones and losses for equal comparison
-
-
xpmir/cross-encoder-ettin-150m-infoNCE
Text Classification • 0.1B • Updated • 68 -
xpmir/cross-encoder-ELECTRA-MarginMSE
Text Classification • 0.1B • Updated • 71 -
xpmir/cross-encoder-RoBERTa-Hinge
Text Classification • 0.1B • Updated • 61 -
xpmir/cross-encoder-DeBERTav3-MarginMSE
Text Classification • 0.2B • Updated • 58 -
xpmir/cross-encoder-DeBERTav3-Hinge
Text Classification • 0.2B • Updated • 55 -
xpmir/cross-encoder-RoBERTa-DistillRankNET
Text Classification • 0.1B • Updated • 60 -
xpmir/cross-encoder-ELECTRA-DistillRankNET
Text Classification • 0.1B • Updated • 54 -
xpmir/cross-encoder-ettin-150m-Hinge
Text Classification • 0.1B • Updated • 61 -
xpmir/cross-encoder-DeBERTav3-DistillRankNET
Text Classification • 0.2B • Updated • 54 -
xpmir/cross-encoder-ELECTRA-Hinge
Text Classification • 0.1B • Updated • 57 -
xpmir/cross-encoder-DeBERTav3-BCE
Text Classification • 0.2B • Updated • 60 -
xpmir/cross-encoder-DeBERTav3-ADR-MSE
Text Classification • 0.2B • Updated • 62 -
xpmir/cross-encoder-bert-base-ADR-MSE
Text Classification • 0.1B • Updated • 62 -
xpmir/cross-encoder-ettin-150m-ADR-MSE
Text Classification • 0.1B • Updated • 61 -
xpmir/cross-encoder-ettin-150m-MarginMSE
Text Classification • 0.1B • Updated • 64 -
xpmir/cross-encoder-bert-base-DistillRankNET
Text Classification • 0.1B • Updated • 58 -
xpmir/cross-encoder-bert-base-infoNCE
Text Classification • 0.1B • Updated • 192 -
xpmir/cross-encoder-DeBERTav3-infoNCE
Text Classification • 0.2B • Updated • 62 -
xpmir/cross-encoder-ELECTRA-ADR-MSE
Text Classification • 0.1B • Updated • 52 -
xpmir/cross-encoder-RoBERTa-MarginMSE
Text Classification • 0.1B • Updated • 61 -
xpmir/cross-encoder-bert-base-Hinge
Text Classification • 0.1B • Updated • 60 -
xpmir/cross-encoder-ettin-150m-BCE
Text Classification • 0.1B • Updated • 58 -
xpmir/cross-encoder-bert-base-MarginMSE
Text Classification • 0.1B • Updated • 65 -
xpmir/cross-encoder-RoBERTa-infoNCE
Text Classification • 0.1B • Updated • 58 -
xpmir/cross-encoder-ELECTRA-infoNCE
Text Classification • 0.1B • Updated • 49 -
xpmir/cross-encoder-RoBERTa-BCE
Text Classification • 0.1B • Updated • 61 -
xpmir/cross-encoder-RoBERTa-ADR-MSE
Text Classification • 0.1B • Updated • 58 -
xpmir/cross-encoder-ettin-150m-DistillRankNET
Text Classification • 0.1B • Updated • 59 -
xpmir/cross-encoder-MiniLM-L12-ADR-MSE
Text Classification • 33.4M • Updated • 59 -
xpmir/cross-encoder-ettin-32m-DistillRankNET
Text Classification • 32M • Updated • 108 -
xpmir/cross-encoder-ettin-17m-infoNCE
Text Classification • 16.9M • Updated • 64 -
xpmir/cross-encoder-ettin-68m-DistillRankNET
Text Classification • 68.4M • Updated • 51 -
xpmir/cross-encoder-ettin-17m-Hinge
Text Classification • 16.9M • Updated • 51 -
xpmir/cross-encoder-ettin-68m-MarginMSE
Text Classification • 68.4M • Updated • 62 -
xpmir/cross-encoder-ettin-68m-Hinge
Text Classification • 68.4M • Updated • 62 -
xpmir/cross-encoder-ettin-68m-BCE
Text Classification • 68.4M • Updated • 64 -
xpmir/cross-encoder-ettin-32m-ADR-MSE
Text Classification • 32M • Updated • 55 -
xpmir/cross-encoder-ettin-32m-infoNCE
Text Classification • 32M • Updated • 64 -
xpmir/cross-encoder-MiniLM-L12-DistillRankNET
Text Classification • 33.4M • Updated • 65 -
xpmir/cross-encoder-MiniLM-L12-Hinge
Text Classification • 33.4M • Updated • 57 -
xpmir/cross-encoder-MiniLM-L12-infoNCE
Text Classification • 33.4M • Updated • 58 -
xpmir/cross-encoder-ettin-17m-ADR-MSE
Text Classification • 16.9M • Updated • 62 -
xpmir/cross-encoder-ettin-32m-Hinge
Text Classification • 32M • Updated • 53 -
xpmir/cross-encoder-ettin-68m-infoNCE
Text Classification • 68.4M • Updated • 61 -
xpmir/cross-encoder-ettin-17m-MarginMSE
Text Classification • 16.9M • Updated • 63 -
xpmir/cross-encoder-ettin-68m-ADR-MSE
Text Classification • 68.4M • Updated • 62 -
xpmir/cross-encoder-ettin-32m-BCE
Text Classification • 32M • Updated • 62 -
xpmir/cross-encoder-ettin-17m-DistillRankNET
Text Classification • 16.9M • Updated • 60 -
xpmir/cross-encoder-MiniLM-L12-MarginMSE
Text Classification • 33.4M • Updated • 68 -
xpmir/cross-encoder-MiniLM-L12-BCE
Text Classification • 33.4M • Updated • 58 -
xpmir/cross-encoder-ettin-32m-MarginMSE
Text Classification • 32M • Updated • 59 -
xpmir/cross-encoder-ettin-17m-BCE
Text Classification • 16.9M • Updated • 65 -
xpmir/cross-encoder-ELECTRA-BCE
Text Classification • 0.1B • Updated • 63 -
xpmir/cross-encoder-bert-base-BCE
Text Classification • 0.1B • Updated • 68