Skip to content
ModelListedExternal
Download

Omnivoice Onnx Int8hq

higgs-audio-2-community

Sourcehuggingface.co/ct03/omnivoice-onnx-int8hq/tree/65c840ba966f4b50cd6bd73f234fb1eba72f9a16
KindOtherBase modelk2-fsa/OmniVoiceVersionRevision 65c840b

Model source

Kind
Other
File size
226 KB–1.28 MB
Base model
k2-fsa/OmniVoice
Version
vRevision 65c840b
Updated
Sep 19, 2026
Downloads
41
Tasks
Audio
Source
Hugging Face

Source description

OmniVoice ONNX (INT8-HQ) — CPU inference

INT8-HQ ONNX export of k2-fsa/OmniVoice, optimized to run on CPU with onnxruntime (no GPU, no PyTorch needed at inference time).

  • Multilingual TTS (646 languages incl. Vietnamese) + zero-shot voice cloning + voice design.
  • 24 kHz output, 8 codebooks, frame rate 75.
  • INT8-HQ: cosine > 0.9999 vs FP32, perceptually almost indistinguishable.

Components

FolderRoleSize
omnivoice_lm_int8_hq/Diffusion LM (INT8-HQ, audio head kept FP32)~611 MB
audio_tokenizer_decoder_int8/tokens → 24 kHz waveform~82 MB
audio_tokenizer_encoder_int8/reference audio → codec tokens (voice cloning)~378 MB
tokenizer.json, config.jsontext tokenizer + configsmall

Each model is model.onnx + model.onnx_data (ONNX external data) — download both files.

ONNX I/O

ModelInputOutput
LMinput_ids[batch,8,seq] int64; audio_mask[batch,seq] bool; attention_mask[batch,1,seq,seq] bool; position_ids[batch,seq] int64logits[batch,8,seq,1025] f32
Encoderaudio[batch,1,num_samples] f32 @24kHzaudio_codes[batch,8,num_frames] int64
Decoderaudio_codes[batch,8,num_frames] int64audio[batch,1,num_samples] f32

Inference

The sampling loop (diffusion + CFG) runs in Python; the LM / encoder / decoder run via ONNX. Reference inference code: AFun9/Omnivoice-onnx (infer_onnx.py). Example:

python infer_onnx.py --variant int8hq --num-step 16 --only demo_voice_clone

Performance (CPU)

RTF ~3–7 depending on the CPU (i9-14900KF ~2.8–6.7; slower CPUs are slower). Suitable for batch / offline use, not real-time. Increase --num-step for higher quality (slower).

License

This export bundles two components under different licenses — you must comply with both:

  • Diffusion LM (omnivoice_lm_int8_hq/): derived from Qwen3-0.6B / OmniVoice — Apache-2.0.
  • Audio tokenizer (audio_tokenizer_*_int8/): derived from Higgs Audio 2 (Boson AI) — Boson Higgs Audio 2 Community License (based on the Meta Llama 3 Community License); see LICENSE. It includes an acceptable-use policy and Llama-style terms.

Because it contains the Higgs Audio 2 component, the repo license is declared as other. This is an ONNX export + quantization only — weights are unchanged; all rights belong to the original authors (k2-fsa/OmniVoice, Boson AI, Qwen).

Sources

1 source
Hugging FacePrimaryVersion 65c840ba966f4b50cd6bd73f234fb1eba72f9a16
huggingface.co/ct03/omnivoice-onnx-int8hq/tree/65c840ba966f4b50cd6bd73f234fb1eba72f9a16

Verified Sep 19

Model artifacts

3 artifacts

audio_tokenizer_decoder_int8/model.onnx

onnx · 226 KB · SHA-256 58833acb4e01…7d30 · Hugging Face

Download

audio_tokenizer_encoder_int8/model.onnx

onnx · 501 KB · SHA-256 7876269f66f3…803c · Hugging Face

Download

omnivoice_lm_int8_hq/model.onnx

onnx · 1.28 MB · SHA-256 4a79b508bf2c…944e · Hugging Face

Download

Source excerpts

2 excerpts
ReadmeSep 19huggingface.co/ct03/omnivoice-onnx-int8hq

--- language: - vi - en - zh - multilingual pipeline_tag: text-to-speech tags: - tts - onnx - int8 - voice-cloning - omnivoice - cpu library_name: onnxruntime base_model: k2-fsa/OmniVoice license: other license_name: higgs-audio-2-community license_link: LICENSE --- # OmniVoice ONNX (INT8-HQ) — CPU inference **INT8-HQ ONNX** export of [k2-fsa/OmniVoice](https://huggingface.co/k2-fsa/OmniVoice), optimized to run **on CPU** with `onnxruntime` (no GPU, no PyTorch needed at inference time). - Multilingual TTS (646 languages incl. **Vietnamese**) + zero-shot **voice cloning** + voice design. - **24 kHz** output, 8 codebooks, frame rate 75. - INT8-HQ: cosine > 0.9999 vs FP32, perceptually almost indistinguishable. ## Components | Folder | Role | Size | |---|---|---| | `omnivoice_lm_int8_hq/` | Diffusion LM (INT8-HQ, audio head kept FP32) | ~611 MB | | `audio_tokenizer_decoder_int8/` | tokens → 24 kHz waveform | ~82 MB | | `audio_tokenizer_encoder_int8/` | reference audio → codec tokens (voice cloning) | ~378 MB | | `tokenizer.json`, `config.json` | text tokenizer + config | small | > Each model is `model.onnx` + `model.onnx_data` (ONNX external data) — download **both** files. ## ONNX I/O | Model | Input | Output | |---|---|---| | **LM** | `input_ids[batch,8,seq]` int64; `audio_mask[batch,seq]` bool; `attention_mask[batch,1,seq,seq]` bool; `position_ids[batch,seq]` int64 | `logits[batch,8,seq,1025]` f32 | | **Encoder** | `audio[batch,1,num_samples]` f32 @24kHz | `audio_codes[batch,8,num_frames]` int64 | | **Decoder** | `audio_codes[batch,8,num_frames]` int64 | `audio[batch,1,num_samples]` f32 | ## Inference The sampling loop (diffusion + CFG) runs in Python; the LM / encoder / decoder run via ONNX. Reference inference code: [AFun9/Omnivoice-onnx](https://github.com/AFun9/Omnivoice-onnx) (`infer_onnx.py`). Example: ```bash python infer_onnx.py --variant int8hq --num-step 16 --only demo_voice_clone ``` ## Performance (CPU) RTF ~3–7 depending on the CPU (i9-14900KF ~2.8–6.7; slower CPUs are slower). Suitable for batch / offline use, not real-time. Increase `--num-step` for higher quality (slower). ## License This export bundles **two components under different licenses** — you must comply with **both**: - **Diffusion LM** (`omnivoice_lm_int8_hq/`): derived from Qwen3-0.6B / OmniVoice — **Apache-2.0**. - **Audio tokenizer** (`audio_tokeniz...

NoteSep 19huggingface.co/ct03/omnivoice-onnx-int8hq

Source context: 41 downloads · 2 likes · Pipeline text-to-speech · Library onnxruntime · Repo ct03/omnivoice-onnx-int8hq