LTX 2.3 22b IC LoRA Helium

--- base_model: - Lightricks/LTX-2.3 base_model_relation: adapter language: - en license: other license_name: ltx-2-community-license license_link: https://github.com/Lightricks/LTX-2/blob/main/LICENSE pipeline_tag: any-to-any tags: - ltx-video - ltx-2 - lora - ic-lora - audio-ic-lora - helium - pitch - audio - experimental - proof-of-concept --- # LTX-2.3 22B "Helium": an audio-only IC-LoRA (experimental, proof of concept) Last updated: 2026-05-31 An IC-LoRA for LTX-2.3-22B (distilled) where the in-context reference is **only audio**: no image, no video, no init frame. The model still generates audio and video jointly, but the only thing you hand it as a reference is an audio file. I trained it on a narrow, measurable task (a voiced tone is meant to steer the pitch of the generated speech, the "helium" idea), and in practice the audio reference visibly steers the whole output: a voice or a music track shifts the speaker's identity, the setting, even the era. That broader transfer is the interesting part. The pitch task was just a clean probe for whether an audio-only reference could do anything at all. > **Status:** evaluated a few different ways, and it clearly produces interesting effects, the audio reference steers speaker identity, scene, and era. It has *not* been through a rigorous, controlled test, and the specific pitch-tracking it was trained for is not cleanly confirmed. Treat the examples below as illustrative single takes, not benchmarks. ## Model Files - `lora_weights_step_02000.safetensors`: the final checkpoint (2000 steps). - `lora_weights_step_01500.safetensors`: an earlier checkpoint, about 8% apart by weight norm, included to compare. Both are clean (960 finite bf16 tensors each). - [`ltx2_audio_reference.yaml`](ltx2_audio_reference.yaml): the training config. - [`data_recipe.md`](data_recipe.md): how the dataset was built. - Training fork: [fblissjr/LTX-2 @ audio-guidance-iclora-vtv](https://github.com/fblissjr/LTX-2/tree/audio-guidance-iclora-vtv) (the `audio_reference` strategy). ## Model Details - **Base Model:** LTX-2.3-22B distilled (`ltx-2.3-22b-distilled-1.1`), a *joint* audio-video model (which matters for the caveats). - **Control Type:** **Audio.** One in-context audio reference, no image and no video. The model generates both modalities; only the reference is audio-only. - **What's adapted:** the audio stack only (`...

Source context: 0 downloads · 4 likes · Pipeline any-to-any · Repo fbjr/LTX-2.3-22b-IC-LoRA-Helium