Skip to content
ModelListedExternal
Browse files

Megalodon OCR Sync 0713 I1 GGUF

For a convenient overview and download list, visit our model page for this model.

KindOtherBase modelprithivMLmods/Megalodon-OCR-Sync-0713VersionRevision c491494

Model source

Kind
Other
File size
754 MB–2.36 GB
Base model
prithivMLmods/Megalodon-OCR-Sync-0713
Version
vRevision c491494
Updated
Sep 17, 2026
Downloads
593
Tasks
Captioning
Source
Hugging Face

Source description

About

weighted/imatrix quants of https://huggingface.co/prithivMLmods/Megalodon-OCR-Sync-0713

For a convenient overview and download list, visit our model page for this model.

static quants are available at https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-GGUF

This is a vision model - mmproj files (if any) will be in the static repository.

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

LinkTypeSize/GBNotes
GGUFi1-IQ1_S0.9for the desperate
GGUFi1-IQ1_M1.0mostly desperate
GGUFi1-IQ2_XXS1.0
GGUFi1-IQ2_XS1.1
GGUFi1-IQ2_S1.2
GGUFi1-IQ2_M1.2
GGUFi1-Q2_K_S1.3very low quality
GGUFi1-Q2_K1.4IQ3_XXS probably better
GGUFi1-IQ3_XXS1.4lower quality
GGUFi1-IQ3_XS1.5
GGUFi1-Q3_K_S1.6IQ3_XS probably better
GGUFi1-IQ3_S1.6beats Q3_K*
GGUFi1-IQ3_M1.6
GGUFi1-Q3_K_M1.7IQ3_S probably better
GGUFi1-Q3_K_L1.8IQ3_M probably better
GGUFi1-IQ4_XS1.8
GGUFi1-IQ4_NL1.9prefer IQ4_XS
GGUFi1-Q4_01.9fast, low quality
GGUFi1-Q4_K_S1.9optimal size/speed/quality
GGUFi1-Q4_K_M2.0fast, recommended
GGUFi1-Q4_12.1
GGUFi1-Q5_K_S2.3
GGUFi1-Q5_K_M2.3
GGUFi1-Q6_K2.6practically like static Q6_K

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

Sources

1 source
Hugging FacePrimaryVersion c4914941f1b17708f89c286192f413e8d53a5065
huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/tree/c4914941f1b17708f89c286192f413e8d53a5065

Verified Sep 17

Download files

Model artifacts

24 artifacts

Megalodon-OCR-Sync-0713.i1-IQ1_M.gguf

gguf · 811 MB · SHA-256 45c510045095…c429 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-IQ1_S.gguf

gguf · 754 MB · SHA-256 ea640464a196…1fd7 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-IQ2_M.gguf

gguf · 1.06 GB · SHA-256 40fe4c415acc…d8a2 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-IQ2_S.gguf

gguf · 1,013 MB · SHA-256 e1e619d9baed…28d4 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-IQ2_XS.gguf

gguf · 984 MB · SHA-256 31779400117d…2e10 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-IQ2_XXS.gguf

gguf · 904 MB · SHA-256 d90a9ba8b808…0eb6 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-IQ3_M.gguf

gguf · 1.39 GB · SHA-256 dbf177e7de9b…ee39 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-IQ3_S.gguf

gguf · 1.36 GB · SHA-256 e039955bd7ab…c149 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-IQ3_XS.gguf

gguf · 1.30 GB · SHA-256 ee47817cba29…40c8 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-IQ3_XXS.gguf

gguf · 1.19 GB · SHA-256 ef343d9cee80…e954 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-IQ4_NL.gguf

gguf · 1.70 GB · SHA-256 1629ae98ebd6…b839 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-IQ4_XS.gguf

gguf · 1.62 GB · SHA-256 fe2bb9ac9862…b12e · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-Q2_K_S.gguf

gguf · 1.12 GB · SHA-256 89764089275c…da56 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-Q2_K.gguf

gguf · 1.19 GB · SHA-256 b76afdf729fe…44ce · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-Q3_K_L.gguf

gguf · 1.59 GB · SHA-256 9eb8ad67644e…cb1e · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-Q3_K_M.gguf

gguf · 1.48 GB · SHA-256 ff09260122d9…43e6 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-Q3_K_S.gguf

gguf · 1.35 GB · SHA-256 daa76acbe6a0…480a · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-Q4_0.gguf

gguf · 1.70 GB · SHA-256 f319844b6c41…fbbb · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-Q4_1.gguf

gguf · 1.86 GB · SHA-256 b9b415c01cec…0c1e · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-Q4_K_M.gguf

gguf · 1.80 GB · SHA-256 10bf9df1b99f…cf86 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-Q4_K_S.gguf

gguf · 1.71 GB · SHA-256 ebf19e419f77…a9a3 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-Q5_K_M.gguf

gguf · 2.07 GB · SHA-256 9690718282bc…b01f · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-Q5_K_S.gguf

gguf · 2.02 GB · SHA-256 03d1154a03ed…ac57 · Hugging Face

Download file

Megalodon-OCR-Sync-0713.i1-Q6_K.gguf

gguf · 2.36 GB · SHA-256 42efbc2e7ffa…7758 · Hugging Face

Download file

Source excerpts

2 excerpts

--- base_model: prithivMLmods/Megalodon-OCR-Sync-0713 language: - en - zh library_name: transformers mradermacher: readme_rev: 1 quantized_by: mradermacher tags: - text-generation-inference - image-captioning - optical-character-recognition - intelligent-character-recognition - caption - ocr - visual-understanding - art - image-to-text - vlm - table --- ## About <!-- ### quantize_version: 2 --> <!-- ### output_tensor_quantised: 1 --> <!-- ### convert_type: hf --> <!-- ### vocab_type: --> <!-- ### tags: nicoboss --> weighted/imatrix quants of https://huggingface.co/prithivMLmods/Megalodon-OCR-Sync-0713 <!-- provided-files --> ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Megalodon-OCR-Sync-0713-i1-GGUF).*** static quants are available at https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-GGUF **This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-GGUF).** ## Usage If you are unsure how to use GGUF files, refer to one of [TheBloke's READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for more details, including on how to concatenate multi-part files. ## Provided Quants (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/resolve/main/Megalodon-OCR-Sync-0713.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate | | [GGUF](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/resolve/main/Megalodon-OCR-Sync-0713.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate | | [GGUF](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/resolve/main/Megalodon-OCR-Sync-0713.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | | | [GGUF](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/resolve/main/Megalodon-OCR-Sync-0713.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | | | [GGUF](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/resolve/main/Megalodon-OCR-Sync-0713.i1-IQ2_S.gguf) | i1-IQ2_S | 1.2 | | | [GGUF](https://huggingface.co/mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF/resolve/main/Megalodon-OCR-Sync-0713.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | | | [GGU...

Source context: 593 downloads · 1 likes · Pipeline image-to-text · Library transformers · Repo mradermacher/Megalodon-OCR-Sync-0713-i1-GGUF