Skip to content
ModelListedExternal
Download

Whisper Large v3 Turbo Mizonal3 E3 Lus v2026.06

> Disclaimer / Notice: Details for these are in Peer Review and publications of the paper will be made available soon for more details.

KindText modelBase modelopenai/whisper-large-v3-turboVersionmodelBgrade

Model source

Kind
Text model
File size
3.01 GB
Base model
openai/whisper-large-v3-turbo
Version
vmodel
Updated
Oct 19, 2026
Downloads
9
Source
Hugging Face

Source description

Mizo Automatic Speech Recognition (ASR) Models v3.0

Disclaimer / Notice: Details for these are in Peer Review and publications of the paper will be made available soon for more details.

whisper-large-v3-turbo-mizonal3-E3-lus-v2026.06

This model is a fine-tuned version of openai/whisper-large-v3-turbo on the MiZonal v3.0 dataset.

It achieves the following results on the evaluation set:

  • Wer: 14.1847
  • Cer: 2.7327
  • Real Time Factor: 0.0546

Quick Inference

import torch
import librosa
from transformers import WhisperProcessor, WhisperForConditionalGeneration

device = "cuda" if torch.cuda.is_available() else "cpu"

processor = WhisperProcessor.from_pretrained("andrewbawitlung/whisper-large-v3-turbo-mizonal3-E3-lus-v2026.06")
model = WhisperForConditionalGeneration.from_pretrained("andrewbawitlung/whisper-large-v3-turbo-mizonal3-E3-lus-v2026.06").to(device)

audio, sr = librosa.load("your_audio.wav", sr=16000)
input_features = processor(audio, sampling_rate=16000, return_tensors="pt").input_features.to(device)

with torch.no_grad():
    predicted_ids = model.generate(input_features, max_new_tokens=256)

transcription = processor.batch_decode(predicted_ids, skip_special_tokens=True)[0]
print(transcription)

Model description

Experiment Configurations

This repository is part of a series of experiments. The different configurations are:

  • E1 (Baseline): Standard training configuration.
  • E2 (Noise): Training with background noise augmentation.
  • E3 (Speed): Training with speed perturbation augmentation.
  • E4 (SpecAug): Training with SpecAugment (time and frequency masking).
  • E5 (Combined): Training with a combination of all augmentations.

All Models in this Family

ExperimentHugging Face Repository
E1 (Baseline)andrewbawitlung/whisper-large-v3-turbo-mizonal3-E1-lus-v2026.06
E2 (Noise)andrewbawitlung/whisper-large-v3-turbo-mizonal3-E2-lus-v2026.06
E3 (Speed)andrewbawitlung/whisper-large-v3-turbo-mizonal3-E3-lus-v2026.06
E4 (SpecAug)andrewbawitlung/whisper-large-v3-turbo-mizonal3-E4-lus-v2026.06
E5 (Combined)andrewbawitlung/whisper-large-v3-turbo-mizonal3-E5-lus-v2026.06

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 1e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: OptimizerNames.ADAMW_TORCH_FUSED
  • lr_scheduler_type: SchedulerType.LINEAR
  • num_epochs: 8

Training results

stepepochtrain_losseval_losseval_wereval_cerlearning_rategrad_norm
2500.30360.45240.441630.38827.12474.98e-0610.7001
5000.60720.28720.323921.84494.87529.98e-068.0670
7500.91070.19440.278618.78953.98479.59e-064.7649
10001.21370.12110.268920.69676.14939.18e-064.6896
12501.51730.10100.258118.73116.03628.77e-064.2444
15001.82090.07400.245820.32698.87058.36e-063.2823
17502.12390.04730.259817.38833.54647.95e-063.7458
20002.42740.04020.267416.44454.13847.54e-062.7577
22502.73100.03340.273515.88013.33097.13e-062.9316
25003.03400.02080.277015.01413.18076.72e-061.7462
27503.33760.01880.279415.02383.20726.31e-061.9191
30003.64120.01330.276915.89963.72495.90e-061.2823
32503.94470.01390.293215.13093.38215.49e-062.2204
35004.24770.00840.298415.11143.22135.08e-060.8746
37504.55130.00800.294914.98493.43864.67e-061.8859
40004.85490.00690.299414.45953.07114.26e-061.2093
42505.15790.00340.297914.36222.99513.85e-060.9255
45005.46140.00320.298414.66383.62953.44e-060.0719
47505.76500.00240.304113.92432.86263.03e-060.0865
50006.06800.00160.307913.95352.85732.61e-060.0794
52506.37160.00160.303713.71022.83432.20e-060.1663
55006.67520.00060.307113.96323.41741.79e-060.5288
57506.97870.00110.313414.35243.52521.38e-060.0395
60007.28170.00120.313114.08973.51469.73e-070.0409
62507.58530.00040.313013.45722.76725.63e-070.0160
65007.88890.00060.314413.46702.77071.53e-070.0153

Sources

1 source

Model artifacts

1 artifact

model.safetensors

safetensors · 3.01 GB · SHA-256 dbf5086d4631…9795 · Hugging Face

Download file

Source excerpts

3 excerpts

--- language: - lus license: apache-2.0 pipeline_tag: automatic-speech-recognition base_model: openai/whisper-large-v3-turbo tags: - generated_from_trainer datasets: - andrewbawitlung/MiZonal-v3.0 metrics: - wer - cer model-index: - name: whisper-large-v3-turbo-mizonal3-E3-lus-v2026.06 results: - task: name: Automatic Speech Recognition type: automatic-speech-recognition dataset: name: MiZonal v3.0 type: andrewbawitlung/MiZonal-v3.0 config: default split: test metrics: - name: Wer type: wer value: 14.1847 - name: Cer type: cer value: 2.7327 - name: Real Time Factor type: rtf value: 0.0546 --- ![Mizo Automatic Speech Recognition (ASR) Models v3.0](banner.jpg) > **Disclaimer / Notice:** Details for these are in Peer Review and publications of the paper will be made available soon for more details. # whisper-large-v3-turbo-mizonal3-E3-lus-v2026.06 This model is a fine-tuned version of [openai/whisper-large-v3-turbo](https://huggingface.co/openai/whisper-large-v3-turbo) on the **MiZonal v3.0** dataset. It achieves the following results on the evaluation set: - Wer: 14.1847 - Cer: 2.7327 - Real Time Factor: 0.0546 ## Quick Inference ```python import torch import librosa from transformers import WhisperProcessor, WhisperForConditionalGeneration device = "cuda" if torch.cuda.is_available() else "cpu" processor = WhisperProcessor.from_pretrained("andrewbawitlung/whisper-large-v3-turbo-mizonal3-E3-lus-v2026.06") model = WhisperForConditionalGeneration.from_pretrained("andrewbawitlung/whisper-large-v3-turbo-mizonal3-E3-lus-v2026.06").to(device) audio, sr = librosa.load("your_audio.wav", sr=16000) input_features = processor(audio, sampling_rate=16000, return_tensors="pt").input_features.to(device) with torch.no_grad(): predicted_ids = model.generate(input_features, max_new_tokens=256) transcription = processor.batch_decode(predicted_ids, skip_special_tokens=True)[0] print(transcription) ``` ## Model description ### Experiment Configurations This repository is part of a series of experiments. The different configurations are: - **E1 (Baseline):** Standard training configuration. - **E2 (Noise):** Training with background noise augmentation. - **E3 (Speed):** Training with speed perturbation augmentation. - **E4 (SpecAug):** Training with SpecAugment (time and frequency masking). - **E5 (Combined):** Training with a combination of all...

Source context: 9 downloads · 0 likes · Pipeline automatic-speech-recognition · Repo andrewbawitlung/whisper-large-v3-turbo-mizonal3-E3-lus-v2026.06

Source context: 39 downloads · 0 likes · Pipeline automatic-speech-recognition · Repo andrewbawitlung/whisper-large-v3-turbo-mizonal3-E3-lus-v2026.06