Skip to content
ModelListedExternal
Browse files

UI Venus 1.5 8B GGUF

These are quantizations of the model UI-Venus-1.5-8B, using a imatrix created from text\en\medium

Sourcehuggingface.co/noctrex/UI-Venus-1.5-8B-GGUF/tree/044bbaca1184858599d6669a908dd24a4398721e
KindOtherBase modelinclusionAI/UI-Venus-1.5-8BVersionRevision 044bbac

Model source

Kind
Other
File size
5.10 MB–15.3 GB
Base model
inclusionAI/UI-Venus-1.5-8B
Version
vRevision 044bbac
Updated
Sep 25, 2026
Downloads
329
Tasks
Captioning
Source
Hugging Face

Source description

These are quantizations of the model UI-Venus-1.5-8B, using a imatrix created from text_en_medium

Usage Notes:

  • Download the latest llama.cpp to use these quantizations.
  • Try to use the best quality you can run.
  • For the mmproj file, the F32 version is recommended for best results (F32 > BF16 > F16).

Sources

1 source
Hugging FacePrimaryVersion 044bbaca1184858599d6669a908dd24a4398721e
huggingface.co/noctrex/UI-Venus-1.5-8B-GGUF/tree/044bbaca1184858599d6669a908dd24a4398721e

Verified Sep 11

Download files

Model artifacts

11 artifacts

imatrix.gguf

gguf · 5.10 MB · SHA-256 d073f1a8a2f6…fddc · Hugging Face

Download file

mmproj-BF16.gguf

gguf · 1.08 GB · SHA-256 6b0e3244179e…fd4f · Hugging Face

Download file

mmproj-F16.gguf

gguf · 1.08 GB · SHA-256 1a79397d75c8…8a7e · Hugging Face

Download file

mmproj-F32.gguf

gguf · 2.15 GB · SHA-256 5b50086693cd…bb0e · Hugging Face

Download file

UI-Venus-1.5-8B-BF16.gguf

gguf · 15.3 GB · SHA-256 ba85151830ef…abf6 · Hugging Face

Download file

UI-Venus-1.5-8B-IQ4_NL.gguf

gguf · 4.46 GB · SHA-256 b24366cd2349…2086 · Hugging Face

Download file

UI-Venus-1.5-8B-IQ4_XS.gguf

gguf · 4.25 GB · SHA-256 c2760c55bf94…8d79 · Hugging Face

Download file

UI-Venus-1.5-8B-Q4_K_M.gguf

gguf · 4.68 GB · SHA-256 f298fbf63b87…5d6a · Hugging Face

Download file

UI-Venus-1.5-8B-Q5_K_M.gguf

gguf · 5.45 GB · SHA-256 93cc7e0ddda0…4f2e · Hugging Face

Download file

UI-Venus-1.5-8B-Q6_K.gguf

gguf · 6.26 GB · SHA-256 cb01780a025b…0c17 · Hugging Face

Download file

UI-Venus-1.5-8B-Q8_0.gguf

gguf · 8.11 GB · SHA-256 e47242171b47…4b4e · Hugging Face

Download file

Source excerpts

2 excerpts
ReadmeSep 11huggingface.co/noctrex/UI-Venus-1.5-8B-GGUF

--- pipeline_tag: image-to-text base_model: - inclusionAI/UI-Venus-1.5-8B --- These are quantizations of the model [UI-Venus-1.5-8B](https://huggingface.co/inclusionAI/UI-Venus-1.5-8B), using a imatrix created from [text\_en\_medium](https://huggingface.co/datasets/eaddario/imatrix-calibration/blob/main/text_en_medium.parquet) **Usage Notes:** - Download the latest [llama.cpp](https://github.com/ggml-org/llama.cpp) to use these quantizations. - Try to use the best quality you can run. - For the `mmproj` file, the F32 version is recommended for best results (F32 > BF16 > F16).

NoteSep 11huggingface.co/noctrex/UI-Venus-1.5-8B-GGUF

Source context: 329 downloads · 0 likes · Pipeline image-to-text · Repo noctrex/UI-Venus-1.5-8B-GGUF