Skip to content
ModelListedExternal
Download

Whisper Large v3 Turbo Mizonal3 E5 Lus v2026.06

> Disclaimer / Notice: Details for these are in Peer Review and publications of the paper will be made available soon for more details.

KindText modelBase modelopenai/whisper-large-v3-turboVersionmodelBgrade

Model source

Kind
Text model
File size
3.01 GB
Base model
openai/whisper-large-v3-turbo
Version
vmodel
Updated
Oct 19, 2026
Downloads
25
Source
Hugging Face

Source description

Mizo Automatic Speech Recognition (ASR) Models v3.0

Disclaimer / Notice: Details for these are in Peer Review and publications of the paper will be made available soon for more details.

whisper-large-v3-turbo-mizonal3-E5-lus-v2026.06

This model is a fine-tuned version of openai/whisper-large-v3-turbo on the MiZonal v3.0 dataset.

It achieves the following results on the evaluation set:

  • Wer: 13.8215
  • Cer: 2.6263
  • Real Time Factor: 0.0540

Quick Inference

import torch
import librosa
from transformers import WhisperProcessor, WhisperForConditionalGeneration

device = "cuda" if torch.cuda.is_available() else "cpu"

processor = WhisperProcessor.from_pretrained("andrewbawitlung/whisper-large-v3-turbo-mizonal3-E5-lus-v2026.06")
model = WhisperForConditionalGeneration.from_pretrained("andrewbawitlung/whisper-large-v3-turbo-mizonal3-E5-lus-v2026.06").to(device)

audio, sr = librosa.load("your_audio.wav", sr=16000)
input_features = processor(audio, sampling_rate=16000, return_tensors="pt").input_features.to(device)

with torch.no_grad():
    predicted_ids = model.generate(input_features, max_new_tokens=256)

transcription = processor.batch_decode(predicted_ids, skip_special_tokens=True)[0]
print(transcription)

Model description

Experiment Configurations

This repository is part of a series of experiments. The different configurations are:

  • E1 (Baseline): Standard training configuration.
  • E2 (Noise): Training with background noise augmentation.
  • E3 (Speed): Training with speed perturbation augmentation.
  • E4 (SpecAug): Training with SpecAugment (time and frequency masking).
  • E5 (Combined): Training with a combination of all augmentations.

All Models in this Family

ExperimentHugging Face Repository
E1 (Baseline)andrewbawitlung/whisper-large-v3-turbo-mizonal3-E1-lus-v2026.06
E2 (Noise)andrewbawitlung/whisper-large-v3-turbo-mizonal3-E2-lus-v2026.06
E3 (Speed)andrewbawitlung/whisper-large-v3-turbo-mizonal3-E3-lus-v2026.06
E4 (SpecAug)andrewbawitlung/whisper-large-v3-turbo-mizonal3-E4-lus-v2026.06
E5 (Combined)andrewbawitlung/whisper-large-v3-turbo-mizonal3-E5-lus-v2026.06

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 1e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: OptimizerNames.ADAMW_TORCH_FUSED
  • lr_scheduler_type: SchedulerType.LINEAR
  • num_epochs: 8

Training results

stepepochtrain_losseval_losseval_wereval_cerlearning_rategrad_norm
2500.22770.63240.464031.77977.33674.98e-0612.9801
5000.45540.39510.316523.90785.12629.98e-069.2164
7500.68310.29090.273419.90854.12259.70e-069.4305
10000.91070.22160.250118.06953.75149.40e-067.3999
12501.13840.15710.226316.06503.28679.10e-065.7364
15001.36610.13840.238815.92883.29738.79e-067.9211
17501.59380.12670.228515.31583.24608.49e-066.6193
20001.82150.10260.230415.23793.12778.19e-064.8834
22502.04920.06860.232315.82173.97057.89e-062.6450
25002.27690.06810.226714.93633.16127.59e-065.5804
27502.50460.06320.233414.63462.98287.29e-064.5015
30002.73220.05920.237713.93402.78316.98e-063.9216
32502.95990.05230.239813.95352.90156.68e-061.9478
35003.18760.03860.242514.74173.04466.38e-062.8374
37503.41530.03660.251914.41082.85206.08e-063.2853
40003.64300.03240.256014.47892.97045.78e-063.7112
42503.87070.03340.245713.35992.70535.47e-064.6839
45004.09840.02700.249113.73942.87505.17e-061.2767
47504.32600.02500.248013.24322.71064.87e-062.7142
50004.55370.02490.255513.53512.74774.57e-061.4408
52504.78140.02190.258214.04113.04814.27e-062.2743
55005.00910.02300.257213.03882.68943.97e-064.3055
57505.23680.01910.259513.89512.90323.66e-061.9485
60005.46450.01720.261713.00962.67713.36e-062.3269
62505.69220.01670.255613.21402.79013.06e-061.3072
65005.91990.01590.259112.65932.70182.76e-061.2552
67506.14750.01440.265313.09722.62762.46e-061.5865
70006.37520.01270.257812.76642.55872.15e-061.7085
72506.60290.00980.267212.84422.58871.85e-060.7853
75006.83060.01160.259812.55232.48801.55e-060.7284
77507.05830.01050.260312.68852.54631.25e-061.8309
80007.28600.00850.262812.55232.48099.48e-072.5387
82507.51370.00870.262812.68852.53576.46e-071.0704
85007.74130.00570.261012.58152.51983.44e-070.9892
87507.96900.00910.262812.56202.52694.23e-080.6342

Sources

1 source

Model artifacts

1 artifact

model.safetensors

safetensors · 3.01 GB · SHA-256 0f2ba2cd564c…8051 · Hugging Face

Download file

Source excerpts

3 excerpts

--- language: - lus license: apache-2.0 pipeline_tag: automatic-speech-recognition base_model: openai/whisper-large-v3-turbo tags: - generated_from_trainer datasets: - andrewbawitlung/MiZonal-v3.0 metrics: - wer - cer model-index: - name: whisper-large-v3-turbo-mizonal3-E5-lus-v2026.06 results: - task: name: Automatic Speech Recognition type: automatic-speech-recognition dataset: name: MiZonal v3.0 type: andrewbawitlung/MiZonal-v3.0 config: default split: test metrics: - name: Wer type: wer value: 13.8215 - name: Cer type: cer value: 2.6263 - name: Real Time Factor type: rtf value: 0.0540 --- ![Mizo Automatic Speech Recognition (ASR) Models v3.0](banner.jpg) > **Disclaimer / Notice:** Details for these are in Peer Review and publications of the paper will be made available soon for more details. # whisper-large-v3-turbo-mizonal3-E5-lus-v2026.06 This model is a fine-tuned version of [openai/whisper-large-v3-turbo](https://huggingface.co/openai/whisper-large-v3-turbo) on the **MiZonal v3.0** dataset. It achieves the following results on the evaluation set: - Wer: 13.8215 - Cer: 2.6263 - Real Time Factor: 0.0540 ## Quick Inference ```python import torch import librosa from transformers import WhisperProcessor, WhisperForConditionalGeneration device = "cuda" if torch.cuda.is_available() else "cpu" processor = WhisperProcessor.from_pretrained("andrewbawitlung/whisper-large-v3-turbo-mizonal3-E5-lus-v2026.06") model = WhisperForConditionalGeneration.from_pretrained("andrewbawitlung/whisper-large-v3-turbo-mizonal3-E5-lus-v2026.06").to(device) audio, sr = librosa.load("your_audio.wav", sr=16000) input_features = processor(audio, sampling_rate=16000, return_tensors="pt").input_features.to(device) with torch.no_grad(): predicted_ids = model.generate(input_features, max_new_tokens=256) transcription = processor.batch_decode(predicted_ids, skip_special_tokens=True)[0] print(transcription) ``` ## Model description ### Experiment Configurations This repository is part of a series of experiments. The different configurations are: - **E1 (Baseline):** Standard training configuration. - **E2 (Noise):** Training with background noise augmentation. - **E3 (Speed):** Training with speed perturbation augmentation. - **E4 (SpecAug):** Training with SpecAugment (time and frequency masking). - **E5 (Combined):** Training with a combination of all...

Source context: 25 downloads · 0 likes · Pipeline automatic-speech-recognition · Repo andrewbawitlung/whisper-large-v3-turbo-mizonal3-E5-lus-v2026.06

Source context: 32 downloads · 0 likes · Pipeline automatic-speech-recognition · Repo andrewbawitlung/whisper-large-v3-turbo-mizonal3-E5-lus-v2026.06