manga-ocr (base), 8-bit GGUF

manga-ocr by Maciej Budyś (kha-white), converted to GGUF with 8-bit weights. It reads Japanese text in manga speech bubbles and other short text: a ViT encoder with a BERT decoder.

Attribution

Changes from the original

  • The PyTorch checkpoint (pytorch_model.bin) is stored as GGUF, under the original tensor names.
  • Two-dimensional .weight matrices of linear layers are quantised to q8_0 (blocks of 32, one scale per block). Where a row's length is not a multiple of 32 it is padded with zeros at the end.
  • Embeddings and other matrices are stored as float16; norms and biases as float32.
  • vocab.txt is the original tokenizer vocabulary, unchanged.
  • No weights were retrained or fine-tuned.

Files

File Size SHA-256
manga.gguf 128,970,912 bytes bcd2bded98a20047bd6dbc758b0c9bf4a74efa1ae6391b2c20f657ab3abec9ec
vocab.txt 24,072 bytes 344fbb6b8bf18c57839e924e2c9365434697e0227fac00b88bb4899b78aa594d

Accuracy

On 40 speech bubbles with hand-checked text, the 8-bit model reads exactly as well as the original float32 model (4.1% character error rate for both).

Downloads last month
78
GGUF
Model size
0.1B params
Architecture
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support