RWKV-6-world-v3 (+3.1T tokens) is our best multilingual 7B model as of now: 
text
RWKV-6-world-v3 (+3.1T tokens) is our best multilingual 7B model as of now: 
https://huggingface.co/BlinkDL/rwkv-6-world
BlinkDL/rwkv-6-world
model
resource
https://huggingface.co/BlinkDL/rwkv-6-world
new_line
new_line
It's 100% RNN and attention-free. MMLU 54.2% (previous world-v2.1 = 47.9%. note: without eval-boosting tricks such as annealing). 
text
It's 100% RNN and attention-free. MMLU 54.2% (previous world-v2.1 = 47.9%. note: without eval-boosting tricks such as annealing). 
new_line
new_line
RWKV-7-world-v4 soon :)
text
RWKV-7-world-v4 soon :)
RWKV-6-world-v3 (+3.1T tokens) is our best multilingual 7B model as of now: https://huggingface.co/BlinkDL/rwkv-6-world

It's 100% RNN and attention-free. MMLU 54.2% (previous world-v2.1 = 47.9%. note: without eval-boosting tricks such as annealing). 

RWKV-7-world-v4 soon :)
🔥
YaTharThShaRma999 prithivMLmods John6666 xi0v ethanker victor jgitsolutions not-lain mxrkai s3nh merve cnmoro Rybens i4never dadu jayomb robb-0 bndp
66a4e3fcf9565635ebdc6e44
/avatars/81947d09c2fe88d8172302631a5f5c31.svg
jhyxwd
jhyxwd
user