ModelListedExternal

Tinman Gemma4 Companion GGUF

GGUF quantized versions of TinmanLabSL/gemma4-companion-merged.

Sourcehuggingface.co/Tinman-Lab/Tinman-gemma4-companion-gguf/tree/562285344d12b64e9017adbd72d3c6d927e98c7a

KindOtherBase modelTinman-Lab/Tinman-gemma4-companion-mergedVersionRevision 5622853

Model source

Kind: Other
File size: 4.94–13.9 GB
Base model: Tinman-Lab/Tinman-gemma4-companion-merged
Version: vRevision 5622853
Updated: Sep 26, 2026
Downloads: 1.2K
Source: Hugging Face

Source description

Gemma 4 E4B Companion — GGUF Quantizations

GGUF quantized versions of TinmanLabSL/gemma4-companion-merged.

See the main model card for full details on training, system prompts, and deployment.

Available Quantizations

File	Quant	Size	Quality	Use Case
`gemma4-companion-bf16.gguf`	BF16	14 GB	Lossless	Reference / re-quantization
`gemma4-companion-Q8_0.gguf`	Q8_0	7.5 GB	Near-lossless	Desktop with ample RAM
`gemma4-companion-Q4_K_M.gguf`	Q4_K_M	5.0 GB	Good	Recommended for most users

Usage

llama.cpp

./llama-cli -m gemma4-companion-Q4_K_M.gguf -cnv \
  -p "You are a warm, caring companion..."

LM Studio / GPT4All

Load the GGUF file directly from the UI.

System Prompts

See main model card for companion, roleplay, and assistant mode system prompts.

Sources

1 source

Hugging FacePrimaryVersion 562285344d12b64e9017adbd72d3c6d927e98c7a

huggingface.co/Tinman-Lab/Tinman-gemma4-companion-gguf/tree/562285344d12b64e9017adbd72d3c6d927e98c7a

Verified Sep 26

Model artifacts

3 artifacts

gemma4-companion-bf16.gguf

gguf · 13.9 GB · SHA-256 8a17b9e47dd4…b969 · Hugging Face

Download

gemma4-companion-Q4_K_M.gguf

gguf · 4.94 GB · SHA-256 c0498cd5f208…39b2 · Hugging Face

Download

gemma4-companion-Q8_0.gguf

gguf · 7.43 GB · SHA-256 2241a21e6b7c…e25f · Hugging Face

Download

Source excerpts

2 excerpts

ReadmeSep 26huggingface.co/Tinman-Lab/Tinman-gemma4-companion-gguf

--- license: apache-2.0 base_model: - TinmanLabSL/gemma4-companion-merged tags: - gguf - gemma4 - companion - roleplay - uncensored - quantized pipeline_tag: any-to-any --- # Gemma 4 E4B Companion — GGUF Quantizations GGUF quantized versions of [TinmanLabSL/gemma4-companion-merged](https://huggingface.co/TinmanLabSL/gemma4-companion-merged). See the [main model card](https://huggingface.co/TinmanLabSL/gemma4-companion-merged) for full details on training, system prompts, and deployment. ## Available Quantizations | File | Quant | Size | Quality | Use Case | |------|-------|------|---------|----------| | `gemma4-companion-bf16.gguf` | BF16 | 14 GB | Lossless | Reference / re-quantization | | `gemma4-companion-Q8_0.gguf` | Q8_0 | 7.5 GB | Near-lossless | Desktop with ample RAM | | `gemma4-companion-Q4_K_M.gguf` | Q4_K_M | 5.0 GB | Good | **Recommended** for most users | ## Usage ### llama.cpp ```bash ./llama-cli -m gemma4-companion-Q4_K_M.gguf -cnv \ -p "You are a warm, caring companion..." ``` ### LM Studio / GPT4All Load the GGUF file directly from the UI. ## System Prompts See [main model card](https://huggingface.co/TinmanLabSL/gemma4-companion-merged#-mode-system--system-prompt-toggle) for companion, roleplay, and assistant mode system prompts.

NoteSep 26huggingface.co/Tinman-Lab/Tinman-gemma4-companion-gguf

Source context: 1191 downloads · 2 likes · Pipeline any-to-any · Repo Tinman-Lab/Tinman-gemma4-companion-gguf