Skip to content
ModelListedExternal
Download

Whisper Small GGUF

Run accurate, fully local speech-to-text dictation in Unsloth Studio. Whisper Small provides better transcription quality than Tiny or Base while remaining practical for everyday local dictation.

KindOtherBase modelunslothai/whisper-smallVersionWhisper smallCgrade

Model source

Kind
Other
File size
465 MB
Base model
unslothai/whisper-small
Version
vWhisper small
Updated
Oct 31, 2026
Source
Hugging Face

Source description

Whisper Small F16 for Unsloth Studio

Run accurate, fully local speech-to-text dictation in Unsloth Studio. Whisper Small provides better transcription quality than Tiny or Base while remaining practical for everyday local dictation.

Run in Unsloth Studio

  1. Install or update Unsloth Studio.
  2. Open Settings > Voice.
  3. Open the local dictation model picker and select Whisper Small.
  4. Let Studio download and cache the model.
  5. Use the microphone button in the chat composer to dictate locally.

The model runs on your device through whisper.cpp. Your recorded audio does not need to be sent to a hosted transcription service.

Model file

  • whisper-small.bin: native F16 model for whisper.cpp
  • Download size: approximately 488 MB
  • Best for: improved accuracy with moderate local resource use

whisper.cpp uses a custom GGML binary format for Whisper. The model file is therefore named .bin, not .gguf, even though this repository follows the common -GGUF repository naming convention.

No low-bit quantization was applied. Matrix weights are stored as F16, while tensors that whisper.cpp requires in F32 remain F32.

Manual whisper.cpp usage

whisper-cli -m whisper-small.bin -f audio.wav

Integrity

  • Source model.safetensors SHA-256: 1d7734884874f1a1513ed9aa760a4f8e97aaa02fd6d93a3a85d27b2ae9ca596b
  • Converted model SHA-256: cfd85d74dc730828cef4e13ae65898d9dc6f695fd00394f4399f7310e73cf505
  • Conversion tool: ggml-org/whisper.cpp commit 080bbbe85230f624f0b52127f1ae1218247989f9

The converted model was loaded by whisper.cpp and passed an end-to-end transcription test.

Sources

1 source
Hugging FacePrimaryVersion 39fb18046418b7c262cbebb40b46c2277b456476
huggingface.co/unslothai/whisper-small-GGUF/tree/39fb18046418b7c262cbebb40b46c2277b456476

Verified Oct 31

Model artifacts

1 artifact

whisper-small.bin

bin · 465 MB · SHA-256 cfd85d74dc73…f505 · Hugging Face

Download file

Source excerpts

2 excerpts

--- base_model: unslothai/whisper-small license: apache-2.0 library_name: whisper.cpp pipeline_tag: automatic-speech-recognition tags: - whisper - whisper.cpp - ggml - f16 - unsloth-studio - unsloth --- # Whisper Small F16 for Unsloth Studio Run accurate, fully local speech-to-text dictation in [Unsloth Studio](https://unsloth.ai/docs). Whisper Small provides better transcription quality than Tiny or Base while remaining practical for everyday local dictation. ## Run in Unsloth Studio 1. Install or update [Unsloth Studio](https://unsloth.ai/docs). 2. Open **Settings > Voice**. 3. Open the local dictation model picker and select **Whisper Small**. 4. Let Studio download and cache the model. 5. Use the microphone button in the chat composer to dictate locally. The model runs on your device through `whisper.cpp`. Your recorded audio does not need to be sent to a hosted transcription service. ## Model file - `whisper-small.bin`: native F16 model for `whisper.cpp` - Download size: approximately 488 MB - Best for: improved accuracy with moderate local resource use `whisper.cpp` uses a custom GGML binary format for Whisper. The model file is therefore named `.bin`, not `.gguf`, even though this repository follows the common `-GGUF` repository naming convention. No low-bit quantization was applied. Matrix weights are stored as F16, while tensors that `whisper.cpp` requires in F32 remain F32. ## Manual whisper.cpp usage ```bash whisper-cli -m whisper-small.bin -f audio.wav ``` ## Integrity - Source `model.safetensors` SHA-256: `1d7734884874f1a1513ed9aa760a4f8e97aaa02fd6d93a3a85d27b2ae9ca596b` - Converted model SHA-256: `cfd85d74dc730828cef4e13ae65898d9dc6f695fd00394f4399f7310e73cf505` - Conversion tool: `ggml-org/whisper.cpp` commit `080bbbe85230f624f0b52127f1ae1218247989f9` The converted model was loaded by `whisper.cpp` and passed an end-to-end transcription test.

Source context: 0 downloads · 0 likes · Pipeline automatic-speech-recognition · Library whisper.cpp · Repo unslothai/whisper-small-GGUF