Skip to content
ModelListedExternal
Download

Gemma 4 E2B It GGUF

Using non-standard (forked) [LLaMA C++][llm] release [b8838][llm-rel] for quantization.

KindOtherBase modelgoogle/gemma-4-E2B-itVersionRevision 4b14102

Model source

Kind
Other
File size
5.38 MB–8.67 GB
Base model
google/gemma-4-E2B-it
Version
vRevision 4b14102
Updated
Sep 15, 2026
Downloads
850
Source
Hugging Face

Source excerpt

Using non-standard (forked) [LLaMA C++][llm] release [b8838][llm-rel] for quantization.

Sources

1 source
Hugging FacePrimaryVersion 4b1410236c61a6e90a0829b6a918f2542b776a07
huggingface.co/eaddario/gemma-4-E2B-it-GGUF/tree/4b1410236c61a6e90a0829b6a918f2542b776a07

Verified Sep 15

Model artifacts

11 artifacts

gemma-4-E2B-it-F16.gguf

gguf · 8.67 GB · SHA-256 9f2e0e10a0e1…3571 · Hugging Face

Download

gemma-4-E2B-it-Q2_K.gguf

gguf · 1.37 GB · SHA-256 9b4179759fd7…0d41 · Hugging Face

Download

gemma-4-E2B-it-Q3_K.gguf

gguf · 1.91 GB · SHA-256 724954cd17db…c1e6 · Hugging Face

Download

gemma-4-E2B-it-Q4_K.gguf

gguf · 2.45 GB · SHA-256 317df6aa59ee…e91f · Hugging Face

Download

gemma-4-E2B-it-Q5_K.gguf

gguf · 2.99 GB · SHA-256 a9738c6bc5d2…acbd · Hugging Face

Download

gemma-4-E2B-it-Q6_K.gguf

gguf · 3.53 GB · SHA-256 a36a075a92e8…63ff · Hugging Face

Download

gemma-4-E2B-it-Q7_K.gguf

gguf · 4.07 GB · SHA-256 3c83e9a3ac3f…8147 · Hugging Face

Download

gemma-4-E2B-it-Q8_0.gguf

gguf · 4.61 GB · SHA-256 6304653c205c…1caa · Hugging Face

Download

imatrix/imatrix-gemma-4-E2B-it-medium.gguf

gguf · 5.38 MB · SHA-256 3d0773815633…d78d · Hugging Face

Download

mmproj-gemma-4-E2B-it-F16.gguf

gguf · 940 MB · SHA-256 3397f2e15859…8f71 · Hugging Face

Download

mmproj-gemma-4-E2B-it-F32.gguf

gguf · 1.77 GB · SHA-256 eecefcbadf51…6d80 · Hugging Face

Download

Source excerpts

2 excerpts

--- base_model: - google/gemma-4-E2B-it datasets: - eaddario/imatrix-calibration language: - en license: - apache-2.0 pipeline_tag: any-to-any tags: - gguf - quant - experimental - target_bpw --- # Experimental global target bits‑per‑weight quantization of [google/gemma-4-E2B-it][base] Using **non-standard** (forked) [LLaMA C++][llm] release [b8838][llm-rel] for quantization. Original model: [google/gemma-4-E2B-it][mdl] From the original model creators: > <div align="center"> > <img src=https://ai.google.dev/gemma/images/gemma4_banner.png> > </div> > > <p align="center"> > <a href="https://huggingface.co/collections/google/gemma-4" target="_blank">Hugging Face</a> | > <a href="https://github.com/google-gemma" target="_blank">GitHub</a> | > <a href="https://blog.google/innovation-and-ai/technology/developers-tools/gemma-4/" target="_blank">Launch Blog</a> | > <a href="https://ai.google.dev/gemma/docs/core" target="_blank">Documentation</a> > <br> > <b>License</b>: <a href="https://ai.google.dev/gemma/docs/gemma_4_license" target="_blank">Apache 2.0</a> | <b>Authors</b>: <a href="https://deepmind.google/models/gemma/" target="_blank">Google DeepMind</a> > </p> > > Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on small models) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages. > > Featuring both Dense and Mixture-of-Experts (MoE) architectures, Gemma 4 is well-suited for tasks like text generation, coding, and reasoning. The models are available in four distinct sizes: **E2B**, **E4B**, **26B A4B**, and **31B**. Their diverse sizes make them deployable in environments ranging from high-end phones to laptops and servers, democratizing access to state-of-the-art AI. > > Gemma 4 introduces key **capability and architectural advancements**: > > * **Reasoning** – All models in the family are designed as highly capable reasoners, with configurable thinking modes. > > * **Extended Multimodalities** – Processes Text, Image with variable aspect ratio and resolution support (all models), Video, and Audio (featured natively on the E2B and E4B models). > > * **Diverse & Efficient Architectur...

Source context: 850 downloads · 0 likes · Pipeline any-to-any · Repo eaddario/gemma-4-E2B-it-GGUF