Megalodon-OCR-Sync-0713-AIO-GGUF

Megalodon-OCR-Sync-0713 is a fine-tuned version of the Qwen2.5-VL-3B-Instruct model, optimized for advanced document retrieval, content extraction, and analysis recognition across diverse document types and formats. It is trained on a large dataset of over 200K image-text pairs, including captioning, OCR, and modular document datasets, which enhances its capabilities in context-aware multimodal extraction and linking within complex documents. The model excels at extracting structured and unstructured data such as charts, tables, mathematical expressions, and visual data representations, supporting long document retrieval, LaTeX formatting, and multilingual analysis for use in educational and enterprise scenarios. It also supports visual grounding for device operation and video understanding up to 20+ minutes. While highly effective, the model requires substantial computational resources and may show degraded performance on low-quality inputs or rare languages.

Megalodon-OCR-Sync-0713 [GGUF]

File Name	Quant Type	File Size	File Link
Megalodon-OCR-Sync-0713.f16.gguf	F16	6.18 GB	Download
Megalodon-OCR-Sync-0713.Q2_K.gguf	Q2_K	1.27 GB	Download
Megalodon-OCR-Sync-0713.Q3_K_L.gguf	Q3_K_L	1.71 GB	Download
Megalodon-OCR-Sync-0713.Q3_K_M.gguf	Q3_K_M	1.59 GB	Download
Megalodon-OCR-Sync-0713.Q3_K_S.gguf	Q3_K_S	1.45 GB	Download
Megalodon-OCR-Sync-0713.Q4_K_M.gguf	Q4_K_M	1.93 GB	Download
Megalodon-OCR-Sync-0713.Q4_K_S.gguf	Q4_K_S	1.83 GB	Download
Megalodon-OCR-Sync-0713.Q5_K_M.gguf	Q5_K_M	2.22 GB	Download
Megalodon-OCR-Sync-0713.Q5_K_S.gguf	Q5_K_S	2.17 GB	Download
Megalodon-OCR-Sync-0713.Q6_K.gguf	Q6_K	2.54 GB	Download
Megalodon-OCR-Sync-0713.Q8_0.gguf	Q8_0	3.29 GB	Download
Megalodon-OCR-Sync-0713.IQ4_XS.gguf	IQ4_XS	1.75 GB	Download
Megalodon-OCR-Sync-0713.i1-IQ1_M.gguf	i1-IQ1_M	850 MB	Download
Megalodon-OCR-Sync-0713.i1-IQ1_S.gguf	i1-IQ1_S	791 MB	Download
Megalodon-OCR-Sync-0713.i1-IQ2_M.gguf	i1-IQ2_M	1.14 GB	Download
Megalodon-OCR-Sync-0713.i1-IQ2_S.gguf	i1-IQ2_S	1.06 GB	Download
Megalodon-OCR-Sync-0713.i1-IQ2_XS.gguf	i1-IQ2_XS	1.03 GB	Download
Megalodon-OCR-Sync-0713.i1-IQ2_XXS.gguf	i1-IQ2_XXS	948 MB	Download
Megalodon-OCR-Sync-0713.i1-IQ3_M.gguf	i1-IQ3_M	1.49 GB	Download
Megalodon-OCR-Sync-0713.i1-IQ3_S.gguf	i1-IQ3_S	1.46 GB	Download
Megalodon-OCR-Sync-0713.i1-IQ3_XS.gguf	i1-IQ3_XS	1.39 GB	Download
Megalodon-OCR-Sync-0713.i1-IQ3_XXS.gguf	i1-IQ3_XXS	1.28 GB	Download
Megalodon-OCR-Sync-0713.i1-IQ4_NL.gguf	i1-IQ4_NL	1.83 GB	Download
Megalodon-OCR-Sync-0713.i1-IQ4_XS.gguf	i1-IQ4_XS	1.74 GB	Download
Megalodon-OCR-Sync-0713.i1-Q2_K.gguf	i1-Q2_K	1.27 GB	Download
Megalodon-OCR-Sync-0713.i1-Q2_K_S.gguf	i1-Q2_K_S	1.2 GB	Download
Megalodon-OCR-Sync-0713.i1-Q3_K_L.gguf	i1-Q3_K_L	1.71 GB	Download
Megalodon-OCR-Sync-0713.i1-Q3_K_M.gguf	i1-Q3_K_M	1.59 GB	Download
Megalodon-OCR-Sync-0713.i1-Q3_K_S.gguf	i1-Q3_K_S	1.45 GB	Download
Megalodon-OCR-Sync-0713.i1-Q4_0.gguf	i1-Q4_0	1.83 GB	Download
Megalodon-OCR-Sync-0713.i1-Q4_1.gguf	i1-Q4_1	2 GB	Download
Megalodon-OCR-Sync-0713.i1-Q4_K_M.gguf	i1-Q4_K_M	1.93 GB	Download
Megalodon-OCR-Sync-0713.i1-Q4_K_S.gguf	i1-Q4_K_S	1.83 GB	Download
Megalodon-OCR-Sync-0713.i1-Q5_K_M.gguf	i1-Q5_K_M	2.22 GB	Download
Megalodon-OCR-Sync-0713.i1-Q5_K_S.gguf	i1-Q5_K_S	2.17 GB	Download
Megalodon-OCR-Sync-0713.i1-Q6_K.gguf	i1-Q6_K	2.54 GB	Download
Megalodon-OCR-Sync-0713.mmproj-Q8_0.gguf	mmproj-Q8_0	845 MB	Download
Megalodon-OCR-Sync-0713.mmproj-f16.gguf	mmproj-f16	1.34 GB	Download

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):