🚀 Releasing a new zeroshot-classifier based on ModernBERT! Some key takeaways:
text
🚀 Releasing a new zeroshot-classifier based on ModernBERT! Some key takeaways:
new_line
new_line
- ⚡ Speed & efficiency: It's multiple times faster and uses significantly less memory than DeBERTav3. You can use larger batch sizes and enabling bf16 (instead of fp16) gave me a ~2x speed boost as well
text
- ⚡ Speed & efficiency: It's multiple times faster and uses significantly less memory than DeBERTav3. You can use larger batch sizes and enabling bf16 (instead of fp16) gave me a ~2x speed boost as well
new_line
- 📉 Performance tradeoff: It performs slightly worse than DeBERTav3 on average across my zeroshot classification task collection
text
- 📉 Performance tradeoff: It performs slightly worse than DeBERTav3 on average across my zeroshot classification task collection
new_line
- 🧠 Use cases: I recommend using it for scenarios requiring speed and a larger context window (8k).
text
- 🧠 Use cases: I recommend using it for scenarios requiring speed and a larger context window (8k).
new_line
- 💡 What’s next? I’m preparing a newer version trained on better + longer synthetic data to fully leverage the 8k context window and improve upon the training mix of my older zeroshot-v2.0 models. I also hope that there will be a multilingual variant in the future.
text
- 💡 What’s next? I’m preparing a newer version trained on better + longer synthetic data to fully leverage the 8k context window and improve upon the training mix of my older zeroshot-v2.0 models. I also hope that there will be a multilingual variant in the future.
new_line
new_line
Great work by 
text
Great work by 
https://cdn-avatars.huggingface.co/v1/production/uploads/623e19ff8972a8c030af5277/KTqmARlLjdqMClfLWA-A1.png
https://huggingface.co/answerdotai
answerdotai
org
resource
https://huggingface.co/answerdotai
 !
text
 !
new_line
new_line
If you’re looking for a high-speed zeroshot classifier, give it a try!
text
If you’re looking for a high-speed zeroshot classifier, give it a try!
new_line
new_line
📄 Resources below: 👇
text
📄 Resources below: 👇
new_line
Base model: 
text
Base model: 
https://huggingface.co/MoritzLaurer/ModernBERT-base-zeroshot-v2.0
MoritzLaurer/ModernBERT-base-zeroshot-v2.0
model
resource
https://huggingface.co/MoritzLaurer/ModernBERT-base-zeroshot-v2.0
new_line
Large model: 
text
Large model: 
https://huggingface.co/MoritzLaurer/ModernBERT-large-zeroshot-v2.0
MoritzLaurer/ModernBERT-large-zeroshot-v2.0
model
resource
https://huggingface.co/MoritzLaurer/ModernBERT-large-zeroshot-v2.0
new_line
Updated zeroshot collection: 
text
Updated zeroshot collection: 
https://huggingface.co/collections/MoritzLaurer/zeroshot-classifiers-6548b4ff407bb19ff5c3ad6f
MoritzLaurer/zeroshot-classifiers-6548b4ff407bb19ff5c3ad6f
collection
resource
https://huggingface.co/collections/MoritzLaurer/zeroshot-classifiers-6548b4ff407bb19ff5c3ad6f
new_line
ModernBERT collection with paper: 
text
ModernBERT collection with paper: 
https://huggingface.co/collections/answerdotai/modernbert-67627ad707a4acbf33c41deb
answerdotai/modernbert-67627ad707a4acbf33c41deb
collection
resource
https://huggingface.co/collections/answerdotai/modernbert-67627ad707a4acbf33c41deb
🚀 Releasing a new zeroshot-classifier based on ModernBERT! Some key takeaways:

- ⚡ Speed & efficiency: It's multiple times faster and uses significantly less memory than DeBERTav3. You can use larger batch sizes and enabling bf16 (instead of fp16) gave me a ~2x speed boost as well
- 📉 Performance tradeoff: It performs slightly worse than DeBERTav3 on average across my zeroshot classification task collection
- 🧠 Use cases: I recommend using it for scenarios requiring speed and a larger context window (8k).
- 💡 What’s next? I’m preparing a newer version trained on better + longer synthetic data to fully leverage the 8k context window and improve upon the training mix of my older zeroshot-v2.0 models. I also hope that there will be a multilingual variant in the future.

Great work by https://huggingface.co/answerdotai !

If you’re looking for a high-speed zeroshot classifier, give it a try!

📄 Resources below: 👇
Base model: https://huggingface.co/MoritzLaurer/ModernBERT-base-zeroshot-v2.0
Large model: https://huggingface.co/MoritzLaurer/ModernBERT-large-zeroshot-v2.0
Updated zeroshot collection: https://huggingface.co/collections/MoritzLaurer/zeroshot-classifiers-6548b4ff407bb19ff5c3ad6f
ModernBERT collection with paper: https://huggingface.co/collections/answerdotai/modernbert-67627ad707a4acbf33c41deb
🔥
John6666 jeffboudier prithivMLmods AtAndDev florentgbelidji do-me GordonM