Qwen3 World Model Test
This is a Multimodal World Model architecture based on the Joint-Embedding Predictive Architecture (JEPA). It fuses the reasoning power of Qwen3-VL-4B-Thinking with the visual latent space of Stable Diffusion VAE.
Model source
- Kind
- Other
- File size
- 263 MB
- Base model
- Qwen/Qwen3-VL-4B-Thinking
- Version
- vRevision 6f10278
- Updated
- Sep 26, 2026
- Downloads
- 3
- Tasks
- Captioning
- Source
- Hugging Face
Source description
Qwen3-VL JEPA World Model
This is a Multimodal World Model architecture based on the Joint-Embedding Predictive Architecture (JEPA). It fuses the reasoning power of Qwen3-VL-4B-Thinking with the visual latent space of Stable Diffusion VAE.
🧠 Architecture
- Thinking Engine:
Qwen/Qwen3-VL-4B-Thinking - Visual Perception:
runwayml/stable-diffusion-v1-5(VAE) - World Modeling: Designed to predict the next latent state of a scene.
🛠 Status
This repository contains the structural fuse. The predictors are currently randomly initialized and require training on sequential image data to function as a world model.
Sources
1 source
Sources
1 sourceVerified Sep 10
Model artifacts
1 artifact
Model artifacts
1 artifactSource excerpts
2 excerpts
Source excerpts
2 excerpts--- language: en license: apache-2.0 library_name: transformers tags: - multimodal - jepa - world-model - qwen3 - vision base_model: Qwen/Qwen3-VL-4B-Thinking pipeline_tag: image-to-text --- # Qwen3-VL JEPA World Model This is a **Multimodal World Model** architecture based on the **Joint-Embedding Predictive Architecture (JEPA)**. It fuses the reasoning power of **Qwen3-VL-4B-Thinking** with the visual latent space of **Stable Diffusion VAE**. ## 🧠 Architecture - **Thinking Engine:** `Qwen/Qwen3-VL-4B-Thinking` - **Visual Perception:** `runwayml/stable-diffusion-v1-5` (VAE) - **World Modeling:** Designed to predict the next latent state of a scene. ## 🛠 Status This repository contains the **structural fuse**. The predictors are currently randomly initialized and require training on sequential image data to function as a world model.
Source context: 3 downloads · 1 likes · Pipeline image-to-text · Library transformers · Repo burnboom/Qwen3_world_model_test
