Skip to content
ModelListedExternal
Browse files

Sapiens2 Pretrain 0.8b

sapiens2-license

KindOtherVersionRevision 384662dBgrade

Model source

Kind
Other
File size
3.03 GB
Version
vRevision 384662d
Updated
Oct 22, 2026
Downloads
247
Source
Hugging Face

Source description

Sapiens2-0.8B

Sapiens2 is a family of high-resolution vision transformers pretrained on 1 billion human images — designed for human-centric tasks such as pose estimation, body-part segmentation, surface normals, and pointmaps.

This repository contains the 0.8B parameter pretrained backbone. It produces dense per-patch features suitable for fine-tuning downstream task heads.

Model Details

  • Developed by: Meta
  • Model type: Vision Transformer
  • License: Sapiens2 License
  • Task: pretrain
  • Format: safetensors
  • File: sapiens2_0.8b_pretrain.safetensors

Quick Start

Install the Sapiens2 repo (pip install -e .).

import torch
from huggingface_hub import hf_hub_download
from safetensors.torch import load_file
from sapiens.backbones.standalone.sapiens2 import Sapiens2

# Build the model and load the pretrained checkpoint
model = Sapiens2(arch="sapiens2_0.8b", img_size=(1024, 768), patch_size=16).eval().cuda()  # img_size is (H, W)
ckpt_path = hf_hub_download(repo_id="facebook/sapiens2-pretrain-0.8b", filename="sapiens2_0.8b_pretrain.safetensors")
model.load_state_dict(load_file(ckpt_path))

# Forward pass on a single image (RGB; ImageNet normalization recommended)
x = torch.randn(1, 3, 1024, 768).cuda()
with torch.no_grad():
    features = model(x)[0]  # dense backbone features: (B, num_tokens, embed_dim)

Model Card

FieldValue
ArchitectureSapiens2 ViT (RoPE, GQA, SwiGLU, RMSNorm, QK-norm)
Parameters0.818 B
FLOPs2.592 T
Embedding dim1280
Layers32
Attention heads16
Pretraining resolution1024 × 768 (H × W)
Patch size16
Pretraining data1B human images

Sapiens2 Family

ModelParamsFLOPsEmbed dimLayersHeads
Sapiens2-0.1B0.114 B0.342 T7681212
Sapiens2-0.4B0.398 B1.260 T10242416
Sapiens2-0.8B (this)0.818 B2.592 T12803216
Sapiens2-1B1.462 B4.715 T15364024
Sapiens2-1B-4K1.607 B—15364024
Sapiens2-5B5.071 B15.722 T24325632

See the Sapiens2 Collection for all variants and downstream task checkpoints (pose, segmentation, normals, pointmaps).

Intended Use

  • Feature extraction for human-centric downstream tasks
  • Initialization for fine-tuning task heads (pose, segmentation, normals, pointmap)
  • Research on human-centric vision

License

Released under the Sapiens2 License.

Citation

@article{khirodkarsapiens2,
  title={Sapiens2},
  author={Khirodkar, Rawal and Wen, He and Martinez, Julieta and Dong, Yuan and Su, Zhaoen and Saito, Shunsuke},
  journal={arXiv preprint arXiv:2604.21681},
  year={2026}
}

Sources

1 source
Hugging FacePrimaryVersion 384662dfaa2e0540d497bf2efa1e106f9350ceae
huggingface.co/facebook/sapiens2-pretrain-0.8b/tree/384662dfaa2e0540d497bf2efa1e106f9350ceae

Verified Oct 22

Download files

Model artifacts

2 artifacts

model.safetensors

safetensors · 3.03 GB · SHA-256 a628d3e56aec…a8cc · Hugging Face

Download file

sapiens2_0.8b_pretrain.safetensors

safetensors · 3.03 GB · SHA-256 a628d3e56aec…a8cc · Hugging Face

Download file

Source excerpts

3 excerpts

--- license: other license_name: sapiens2-license license_link: https://github.com/facebookresearch/sapiens2/blob/main/LICENSE.md pipeline_tag: image-feature-extraction library_name: sapiens2 tags: - sapiens - sapiens2 - vision-transformer - human-centric - pretrained-backbone - feature-extraction - transformers --- # Sapiens2-0.8B Sapiens2 is a family of high-resolution vision transformers pretrained on **1 billion human images** — designed for human-centric tasks such as pose estimation, body-part segmentation, surface normals, and pointmaps. This repository contains the **0.8B parameter pretrained backbone**. It produces dense per-patch features suitable for fine-tuning downstream task heads. - 📄 **Paper:** [arXiv:2604.21681](https://arxiv.org/pdf/2604.21681) - 🌐 **Project Page:** [rawalkhirodkar.github.io/sapiens2](https://rawalkhirodkar.github.io/sapiens2) - 💻 **Code:** [github.com/facebookresearch/sapiens2](https://github.com/facebookresearch/sapiens2) ## Model Details - **Developed by:** Meta - **Model type:** Vision Transformer - **License:** [Sapiens2 License](https://github.com/facebookresearch/sapiens2/blob/main/LICENSE.md) - **Task:** pretrain - **Format:** safetensors - **File:** `sapiens2_0.8b_pretrain.safetensors` ## Quick Start Install the [Sapiens2 repo](https://github.com/facebookresearch/sapiens2) (`pip install -e .`). ```python import torch from huggingface_hub import hf_hub_download from safetensors.torch import load_file from sapiens.backbones.standalone.sapiens2 import Sapiens2 # Build the model and load the pretrained checkpoint model = Sapiens2(arch="sapiens2_0.8b", img_size=(1024, 768), patch_size=16).eval().cuda() # img_size is (H, W) ckpt_path = hf_hub_download(repo_id="facebook/sapiens2-pretrain-0.8b", filename="sapiens2_0.8b_pretrain.safetensors") model.load_state_dict(load_file(ckpt_path)) # Forward pass on a single image (RGB; ImageNet normalization recommended) x = torch.randn(1, 3, 1024, 768).cuda() with torch.no_grad(): features = model(x)[0] # dense backbone features: (B, num_tokens, embed_dim) ``` ## Model Card | Field | Value | |-------|-------| | Architecture | Sapiens2 ViT (RoPE, GQA, SwiGLU, RMSNorm, QK-norm) | | Parameters | 0.818 B | | FLOPs | 2.592 T | | Embedding dim | 1280 | | Layers | 32 | | Attention heads | 16 | | Pretraining resolution | 1024 × 768 (H × W) | | Patch size | 16 | | Pr...

Source context: 247 downloads · 3 likes · Pipeline image-feature-extraction · Library sapiens2 · Repo facebook/sapiens2-pretrain-0.8b

Source context: 424 downloads · 3 likes · Pipeline image-feature-extraction · Library sapiens2 · Repo facebook/sapiens2-pretrain-0.8b