Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
Sagicc 's Collections
Tokenizer test
Whisper Serbian

Tokenizer test

updated Jun 14

Tokenizers for testing on transformer.js

Upvote
-

  • Running

    Tokenizer Playground

    👁

    Test Serbian on officially supported models, gemma-3, qwen3


  • Sagicc/gemma-3-4b-it-tokenizer

    Updated May 29 • 7

  • Sagicc/qwen3-8b-tokenizer

    Updated May 29 • 7

  • Sagicc/mistral-small-3.1-24b-tokenizer

    Updated May 29
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs