Skip to content
ModelListedExternal
Browse files

Qwen2.5 VL 3B Abliterated Caption It I1 GGUF

For a convenient overview and download list, visit our model page for this model.

Sourcehuggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF/tree/5f8f5de829fdb27cd6da9da4d5d1f9eb46f985e4
KindOtherBase modelprithivMLmods/Qwen2.5-VL-3B-Abliterated-Caption-itVersionRevision 5f8f5de

Model source

Kind
Other
File size
3.24 MB–2.36 GB
Base model
prithivMLmods/Qwen2.5-VL-3B-Abliterated-Caption-it
Version
vRevision 5f8f5de
Updated
Sep 17, 2026
Downloads
1.1K
Tasks
Captioning
Source
Hugging Face

Source description

About

weighted/imatrix quants of https://huggingface.co/prithivMLmods/Qwen2.5-VL-3B-Abliterated-Caption-it

For a convenient overview and download list, visit our model page for this model.

static quants are available at https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-GGUF

This is a vision model - mmproj files (if any) will be in the static repository.

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

LinkTypeSize/GBNotes
GGUFimatrix0.1imatrix file (for creating your own quants)
GGUFi1-IQ1_S0.9for the desperate
GGUFi1-IQ1_M1.0mostly desperate
GGUFi1-IQ2_XXS1.0
GGUFi1-IQ2_XS1.1
GGUFi1-IQ2_S1.2
GGUFi1-IQ2_M1.2
GGUFi1-Q2_K_S1.3very low quality
GGUFi1-Q2_K1.4IQ3_XXS probably better
GGUFi1-IQ3_XXS1.4lower quality
GGUFi1-IQ3_XS1.5
GGUFi1-Q3_K_S1.6IQ3_XS probably better
GGUFi1-IQ3_S1.6beats Q3_K*
GGUFi1-IQ3_M1.6
GGUFi1-Q3_K_M1.7IQ3_S probably better
GGUFi1-Q3_K_L1.8IQ3_M probably better
GGUFi1-IQ4_XS1.8
GGUFi1-IQ4_NL1.9prefer IQ4_XS
GGUFi1-Q4_01.9fast, low quality
GGUFi1-Q4_K_S1.9optimal size/speed/quality
GGUFi1-Q4_K_M2.0fast, recommended
GGUFi1-Q4_12.1
GGUFi1-Q5_K_S2.3
GGUFi1-Q5_K_M2.3
GGUFi1-Q6_K2.6practically like static Q6_K

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

Sources

1 source
Hugging FacePrimaryVersion 5f8f5de829fdb27cd6da9da4d5d1f9eb46f985e4
huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF/tree/5f8f5de829fdb27cd6da9da4d5d1f9eb46f985e4

Verified Sep 17

Download files

Model artifacts

25 artifacts

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ1_M.gguf

gguf · 811 MB · SHA-256 fa656db0d592…6390 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ1_S.gguf

gguf · 754 MB · SHA-256 d345e1af2a8e…f456 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ2_M.gguf

gguf · 1.06 GB · SHA-256 659480d1f4c0…d385 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ2_S.gguf

gguf · 1,013 MB · SHA-256 15b21aa5d9fc…a9c4 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ2_XS.gguf

gguf · 984 MB · SHA-256 e274d7611fe3…f9b1 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ2_XXS.gguf

gguf · 904 MB · SHA-256 b7710317d0ca…b384 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ3_M.gguf

gguf · 1.39 GB · SHA-256 c559c326822b…f63c · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ3_S.gguf

gguf · 1.36 GB · SHA-256 0acd1e332994…a3be · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ3_XS.gguf

gguf · 1.30 GB · SHA-256 da25394b0bf0…d7a7 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ3_XXS.gguf

gguf · 1.19 GB · SHA-256 a097bc4172ab…e89c · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ4_NL.gguf

gguf · 1.70 GB · SHA-256 7c347375a9b8…4545 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ4_XS.gguf

gguf · 1.62 GB · SHA-256 1e2134098c10…43c3 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-Q2_K_S.gguf

gguf · 1.12 GB · SHA-256 595835c626c0…bdf2 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-Q2_K.gguf

gguf · 1.19 GB · SHA-256 38851e85ce73…5255 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-Q3_K_L.gguf

gguf · 1.59 GB · SHA-256 b4b1cfcc7010…6e5f · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-Q3_K_M.gguf

gguf · 1.48 GB · SHA-256 c9590090347a…4c9c · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-Q3_K_S.gguf

gguf · 1.35 GB · SHA-256 919f044a45c9…99a0 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-Q4_0.gguf

gguf · 1.70 GB · SHA-256 c7df5b6cad8a…207f · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-Q4_1.gguf

gguf · 1.86 GB · SHA-256 6330c7bbf88d…d00d · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-Q4_K_M.gguf

gguf · 1.80 GB · SHA-256 d5215695cb99…a224 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-Q4_K_S.gguf

gguf · 1.71 GB · SHA-256 30e1f2737acb…aa80 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-Q5_K_M.gguf

gguf · 2.07 GB · SHA-256 f5db8c3cf37d…93be · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-Q5_K_S.gguf

gguf · 2.02 GB · SHA-256 40e998462c51…9407 · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.i1-Q6_K.gguf

gguf · 2.36 GB · SHA-256 0164723bf87c…2bcd · Hugging Face

Download file

Qwen2.5-VL-3B-Abliterated-Caption-it.imatrix.gguf

gguf · 3.24 MB · SHA-256 5827466658fd…1fcd · Hugging Face

Download file

Source excerpts

2 excerpts
ReadmeSep 17huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF

--- base_model: prithivMLmods/Qwen2.5-VL-3B-Abliterated-Caption-it language: - en library_name: transformers mradermacher: readme_rev: 1 quantized_by: mradermacher tags: - text-generation-inference - uncensored - image-captioning - vlm - visual-understanding - caption - image-to-text --- ## About <!-- ### quantize_version: 2 --> <!-- ### output_tensor_quantised: 1 --> <!-- ### convert_type: hf --> <!-- ### vocab_type: --> <!-- ### tags: nicoboss --> <!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S --> <!-- ### quants_skip: --> <!-- ### skip_mmproj: --> weighted/imatrix quants of https://huggingface.co/prithivMLmods/Qwen2.5-VL-3B-Abliterated-Caption-it <!-- provided-files --> ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF).*** static quants are available at https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-GGUF **This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-GGUF).** ## Usage If you are unsure how to use GGUF files, refer to one of [TheBloke's READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for more details, including on how to concatenate multi-part files. ## Provided Quants (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen2.5-VL-3B-Abliterated-Caption-it.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate | | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen2.5-VL-3B-Abliterated-Caption-it.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate | | [GGUF](https://huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF/resolve/main/Qwen2.5-VL-3B-Ablit...

NoteSep 17huggingface.co/mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF

Source context: 1086 downloads · 4 likes · Pipeline image-to-text · Library transformers · Repo mradermacher/Qwen2.5-VL-3B-Abliterated-Caption-it-i1-GGUF