Skip to content
ModelListedExternal
Download

UI Venus 1.5 30B A3B MXFP4 MoE GGUF

This is a MXFP4MOE quantization of the model UI-Venus-1.5-30B-A3B

KindOtherBase modelinclusionAI/UI-Venus-1.5-30B-A3BVersionRevision c35492c

Model source

Kind
Other
File size
1.01–15.9 GB
Base model
inclusionAI/UI-Venus-1.5-30B-A3B
Version
vRevision c35492c
Updated
Sep 26, 2026
Downloads
19
Tasks
Captioning
Source
Hugging Face

Source description

This is a MXFP4_MOE quantization of the model UI-Venus-1.5-30B-A3B

Usage Notes:

  • Download the latest llama.cpp to use these quantizations.
  • Try to use the best quality you can run.
  • For the mmproj file, the F32 version is recommended for best results (F32 > BF16 > F16).

Sources

1 source
Hugging FacePrimaryVersion c35492ce2bd06059b776f841e9af3a7a5b2fd3cb
huggingface.co/noctrex/UI-Venus-1.5-30B-A3B-MXFP4_MOE-GGUF/tree/c35492ce2bd06059b776f841e9af3a7a5b2fd3cb

Verified Sep 10

Model artifacts

4 artifacts

mmproj-BF16.gguf

gguf · 1.01 GB · SHA-256 c67d2c3a5284…0a41 · Hugging Face

Download

mmproj-F16.gguf

gguf · 1.01 GB · SHA-256 706549846204…7adc · Hugging Face

Download

mmproj-F32.gguf

gguf · 2.01 GB · SHA-256 00584ee78709…9795 · Hugging Face

Download

UI-Venus-1.5-30B-A3B-MXFP4_MOE.gguf

gguf · 15.9 GB · SHA-256 f55a7b11b0ec…bca7 · Hugging Face

Download

Source excerpts

2 excerpts

--- pipeline_tag: image-to-text base_model: - inclusionAI/UI-Venus-1.5-30B-A3B --- This is a MXFP4_MOE quantization of the model [UI-Venus-1.5-30B-A3B](https://huggingface.co/inclusionAI/UI-Venus-1.5-30B-A3B) **Usage Notes:** - Download the latest [llama.cpp](https://github.com/ggml-org/llama.cpp) to use these quantizations. - Try to use the best quality you can run. - For the `mmproj` file, the F32 version is recommended for best results (F32 > BF16 > F16).

Source context: 19 downloads · 0 likes · Pipeline image-to-text · Repo noctrex/UI-Venus-1.5-30B-A3B-MXFP4_MOE-GGUF