The Functionalizer: Lossless Functional Decomposition for Subword Tokenization
Paper • 2609.15991 • Published • 16
Functionalizer-100M
-
-
mrkwanzaa/functionalizer-100M-fineweb-edu-seed1
Text Generation • 97.7M • Updated • 305 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed2
Text Generation • 97.7M • Updated • 317 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed3
Text Generation • 97.7M • Updated • 307 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed4
Text Generation • 97.7M • Updated • 307 -
mrkwanzaa/functionalizer-100M-fineweb-edu-seed5
Text Generation • 97.7M • Updated • 319 -
mrkwanzaa/functionalizer-100M-github-code-python-seed1
Text Generation • 97.7M • Updated • 336 -
mrkwanzaa/functionalizer-100M-github-code-python-seed2
Text Generation • 97.7M • Updated • 334 -
mrkwanzaa/functionalizer-100M-github-code-python-seed3
Text Generation • 97.7M • Updated • 339 -
mrkwanzaa/functionalizer-100M-github-code-python-seed4
Text Generation • 97.7M • Updated • 337 -
mrkwanzaa/functionalizer-100M-github-code-python-seed5
Text Generation • 97.7M • Updated • 336