Skip to content
ModelListedExternal
Browse files

Deepfake Multimodal Weights

Trained weights for Multi-ModelDeepfakeDetection, a CLI that scores a video for manipulation by fusing three independent modalities (visual frames, audio track, spoken transcript).

KindOtherBase modelprithivMLmods/deepfake-detector-model-v1VersionClf ep6 torchscriptBgrade

Model source

Kind
Other
File size
774 KB–354 MB
Base model
prithivMLmods/deepfake-detector-model-v1
Version
vClf ep6 torchscript
Updated
Oct 19, 2026
Source
Hugging Face

Source description

Multi-Modal Deepfake Detection — trained weights

Trained weights for Multi-Model_Deepfake_Detection, a CLI that scores a video for manipulation by fusing three independent modalities (visual frames, audio track, spoken transcript).

Do not download these files by hand — clone the GitHub repo and run python download_weights.py, which places every file where config.yaml expects it.

Contents

FileRoleVal metric
video_model_colab_ft/SigLIP ViT, full fine-tune on FaceForensics++ (c23) face cropsAUC 0.861 / frame, 0.939 / video
clf_ep6_torchscript.ptMLP over WavLM-base-plus embeddings (WaveFake + JSUT)AUC 0.999
text_model/head_best.ptLinear head over DistilBERT for transcript claim scoring (FibVID)AUC 0.909
fusion_model.pklHistGradientBoosting meta-classifier over the three probabilitiesAUC 0.998 (simulated joint data)

Validation methodology and known limitations (audio language confound, simulated fusion training data) are documented in the project README.

Licensing

Code and these trained heads: MIT. The video model is a fine-tune of prithivMLmods/deepfake-detector-model-v1 and retains its upstream terms. Training datasets are not redistributed here: FaceForensics++ requires a signed EULA; WaveFake is CC BY-SA; JSUT is for research use.

Sources

1 source
Hugging FacePrimaryVersion 41bbedbf52849e4aaffa6bddd716f4ca678a9311
huggingface.co/AUA27/deepfake-multimodal-weights/tree/41bbedbf52849e4aaffa6bddd716f4ca678a9311

Verified Oct 19

Download files

Model artifacts

3 artifacts

clf_ep6_torchscript.pt

pt · 1.77 MB · SHA-256 b8a70485cbb9…f0dd · Hugging Face

Download file

text_model/head_best.pt

pt · 774 KB · SHA-256 a0f54a57ec48…95a0 · Hugging Face

Download file

video_model_colab_ft/model.safetensors

safetensors · 354 MB · SHA-256 9c93e5cb93c9…9c25 · Hugging Face

Download file

Source excerpts

2 excerpts

--- license: mit base_model: prithivMLmods/deepfake-detector-model-v1 tags: - deepfake-detection - multimodal - video-classification - audio-classification --- # Multi-Modal Deepfake Detection — trained weights Trained weights for [Multi-Model_Deepfake_Detection](https://github.com/aua27/Multi-Model_Deepfake_Detection), a CLI that scores a video for manipulation by fusing three independent modalities (visual frames, audio track, spoken transcript). **Do not download these files by hand** — clone the GitHub repo and run `python download_weights.py`, which places every file where `config.yaml` expects it. ## Contents | File | Role | Val metric | |---|---|---| | `video_model_colab_ft/` | SigLIP ViT, full fine-tune on FaceForensics++ (c23) face crops | AUC 0.861 / frame, 0.939 / video | | `clf_ep6_torchscript.pt` | MLP over WavLM-base-plus embeddings (WaveFake + JSUT) | AUC 0.999 | | `text_model/head_best.pt` | Linear head over DistilBERT for transcript claim scoring (FibVID) | AUC 0.909 | | `fusion_model.pkl` | HistGradientBoosting meta-classifier over the three probabilities | AUC 0.998 (simulated joint data) | Validation methodology and known limitations (audio language confound, simulated fusion training data) are documented in the [project README](https://github.com/aua27/Multi-Model_Deepfake_Detection#known-limitations). ## Licensing Code and these trained heads: MIT. The video model is a fine-tune of [prithivMLmods/deepfake-detector-model-v1](https://huggingface.co/prithivMLmods/deepfake-detector-model-v1) and retains its upstream terms. Training datasets are **not** redistributed here: FaceForensics++ requires a signed EULA; WaveFake is CC BY-SA; JSUT is for research use.

Source context: 0 downloads · 0 likes · Pipeline audio-classification · Repo AUA27/deepfake-multimodal-weights