Embodied Foundation Models
-
NVIDIA Cosmos 3 Edge
Hugging Face: https://huggingface.co/nvidia/Cosmos3-Edge, https://huggingface.co/collections/nvidia/cosmos3
GitHub: https://github.com/nvidia/cosmos
Website: https://research.nvidia.com/labs/cosmos-lab/cosmos3/
White paper: https://research.nvidia.com/labs/cosmos-lab/cosmos3/technical-report.pdfDeveloper: NVIDIA
Released: July 2026
Variants: Cosmos3-Edge, Cosmos3-Edge-Policy-DROID
Parameters: 4B
Context: Reasoner: 256,000 tokens / Generator text input: 4,096 tokens
Architecture: Mixture-of-Transformers, two towers: an autoregressive transformer for text, a diffusion transformer for image/video/action generation
License: OpenMDW 1.1
Modalities: Text + Image + Video + Action trajectory in / Text + Image + Video + Action out
Formats: safetensors via Hugging Face, PyTorch (NVIDIA-proprietary inference only, BF16)
Runs on: NVIDIA consumer GPU (Linux), Jetson (Linux) -
Tencent Hy-Embodied-RxBrain-1.0
Hugging Face: https://huggingface.co/tencent/Hy-Embodied-RxBrain-1.0
GitHub: https://github.com/Tencent-Hunyuan/Hy-Embodied-RxBrain-1.0
Website: https://tairos.tencent.com/openSourceModels/hy-embodied-rxbrain-1.0
Technical report: https://arxiv.org/abs/2607.14187Developer: Tencent Robotics X, Futian Laboratory, Tencent Hy Team
Released: July 2026
Parameters: ~6.2B
Architecture: Unified Mixture-of-Transformers, modality-specific text, vision, and generation pathways
License: Apache 2.0
Modalities: Text + Image + Video
Runs on: NVIDIA GPU, CUDA 12.x, Linux recommended
Formats: safetensors
On disk: 12.42GB safetensors -
NVIDIA Isaac GR00T N1.7
Hugging Face: https://huggingface.co/nvidia/GR00T-N1.7-3B, https://huggingface.co/collections/nvidia/gr00t-n17
GitHub: https://github.com/NVIDIA/Isaac-GR00T
Website: https://developer.nvidia.com/isaac/gr00t
Docs: https://huggingface.co/blog/nvidia/gr00t-n1-7Developer: NVIDIA
Released: April 2026
Variants: N1, N1.5, N1.6, N1.7
Parameters: 3B
Architecture: Dual-system VLA pairing a Cosmos-Reason2-2B vision-language backbone for task/subtask reasoning with a flow-matching diffusion transformer conditioned on the reasoning output
License: NVIDIA Open Model License Agreement
Modalities: RGB camera frames + language instruction + robot proprioception in / continuous robot action vectors out
Runs on: Desktop GPU, Datacenter GPU, or NVIDIA Jetson edge modules; NVIDIA only
Formats: safetensors, 2 shards
On disk: 6.91GB -
NVIDIA Cosmos Reason 2
Hugging Face: https://huggingface.co/nvidia/Cosmos-Reason2-8B, https://huggingface.co/nvidia/Cosmos-Reason2-2B, https://huggingface.co/nvidia/Cosmos-Reason2-32B
Website: https://build.nvidia.com/nvidia/cosmos-reason2-8b
Docs: https://huggingface.co/blog/nvidia/nvidia-cosmos-reason-2-brings-advanced-reasoningDeveloper: NVIDIA
Released: January 2026
Variants: 2B, 8B, 32B
Parameters: 8.77B (8B tier)
Architecture: Qwen3-VL fine-tune post-trained for physical-AI reasoning
License: NVIDIA Open Model License Agreement
Modalities: Image/video + text in / spatio-temporal reasoning, trajectory, point, and bounding-box predictions out
Runs on: NVIDIA GPU
Formats: safetensors, 4 shards (8B tier)
On disk: 17.53GB (8B tier) -
Unitree UnifoLM-VLA-0
Hugging Face: https://huggingface.co/unitreerobotics/Unifolm-VLM-Base, https://huggingface.co/unitreerobotics/Unifolm-VLA-Base, https://huggingface.co/unitreerobotics/Unifolm-VLA-Libero
GitHub: https://github.com/unitreerobotics/unifolm-vla
Website: https://unigen-x.github.io/unifolm-vla.github.ioDeveloper: Unitree Robotics
Released: January 2026
Variants: VLM-Base, VLA-Base, VLA-LIBERO
Architecture: Qwen2.5-VL-7B backbone with a diffusion-transformer flow-matching action head; continued pretraining fuses 2D/3D spatial understanding with action-chunking prediction and forward/inverse dynamics constraints
Modalities: Multi-view RGB + robot state + language instruction in / continuous manipulation actions out
Formats: PyTorch checkpoint
On disk: VLA-Base 18.98GB -
Alibaba DAMO RynnBrain 1.1
Hugging Face: https://huggingface.co/Alibaba-DAMO-Academy/RynnBrain1.1-2B, https://huggingface.co/Alibaba-DAMO-Academy/RynnBrain1.1-9B, https://huggingface.co/Alibaba-DAMO-Academy/RynnBrain1.1-122B-A10B
GitHub: https://github.com/alibaba-damo-academy/RynnBrain
Technical report: https://arxiv.org/abs/2602.14979Developer: Alibaba DAMO Academy
Released: July 2026
Variants: 2B, 9B, 122B-A10B
Parameters: 9.41B (9B checkpoint)
Architecture: Decoder-only vision-language transformer (dense 2B/9B, sparse-MoE 122B-A10B) on a Qwen3.5 base
License: Apache License 2.0
Modalities: Image/video + language in / spatial/3D grounding, contact-point and affordance predictions, task planning out
Formats: safetensors
On disk: 18.82GB (9B checkpoint) -
Black Forest Labs FLUX 3 Action
Hugging Face: https://huggingface.co/black-forest-labs/flux-3-action-base, https://huggingface.co/black-forest-labs/flux-3-action-droid, https://huggingface.co/black-forest-labs/flux-3-action-so101
GitHub: https://github.com/black-forest-labs/flux-action
Website: https://bfl.ai/models/flux-3-action
Docs: https://docs.bfl.ai/flux_3/flux3_action_overviewDeveloper: Black Forest Labs
Released: September 2026
Variants: Base / DROID / SO-101
Parameters: 7B
Architecture: Diffusion-transformer world action model derived from the multimodal FLUX 3 backbone, with joint future-video and action prediction
License: FLUX Kommunity License v1.0
Modalities: Text + Multi-view RGB + Robot state in / Video + Action out
Runs on: NVIDIA GPU (Linux), about 32GB VRAM for BF16 or 24GB with FP8r and text-encoder offload
Formats: safetensors, LeRobot and FLUX Action inference -
OpenWAM-alpha
Hugging Face: https://huggingface.co/OpenWAM/OpenWAM-Alpha-Pretrain-Foundation-Model, https://huggingface.co/collections/OpenWAM/openwam-alpha
GitHub: https://github.com/OpenWAM-Official/OpenWAM
Website: https://openwam-official.github.io/
Technical report: https://arxiv.org/abs/2609.07398Developer: OpenWAM-Official
Released: September 2026
Variants: Pretrain-Foundation-Model / Sim fine-tunes (LIBERO, RoboTwin, RoboCasa365, RoboCasa-GR1, RoboDojo, EBench, VLABench) / Real fine-tunes (Dexterous-Hand-Wuji, RoboDojo-ARX-X5, RoboDojo-Piper, RoboDojo-Piper-X, Single-Arm-Franka)
Parameters: Video DiT 5B / ActionDiT 1B
Architecture: Dual-system world-action model: a pretrained Wan2.2-TI2V-5B video DiT and a dedicated ActionDiT coupled through joint self-attention with a mutual attention mask, on a frozen Wan2.2-VAE
License: Apache-2.0
Modalities: Multi-view RGB + language instruction + proprioceptive state in / future video + action chunk out (80-D unified action space)
Runs on: NVIDIA datacenter GPUs, 8 x 80 GB recommended for training (CUDA 12.8); no inference requirement published
Formats: safetensors
On disk: Pretrain-Foundation-Model 24.81GB -
OLA Dimensions UniWAM
Hugging Face: https://huggingface.co/chenpyyy/UniWAM-base, https://huggingface.co/collections/chenpyyy/uniwam
GitHub: https://github.com/UniWAM/UniWAM
Website: https://uniwam.github.io
Technical report: https://arxiv.org/abs/2610.02054Developer: OLA Dimensions, HKUST(GZ)
Released: October 2026
Variants: UniWAM-base / UniWAM-robotwin-clean / UniWAM-libero / UniWAM-libero-plus
Parameters: 8B
Architecture: Mixture-of-Transformers, three experts: a Qwen3-VL-2B-Instruct physical reasoner, a Wan2.2-TI2V-5B world generator, a flow-matching action predictor; joint multimodal attention
License: Apache-2.0
Modalities: Camera images + proprioceptive state + language instruction in / physical language + future video + action chunk out
Runs on: NVIDIA datacenter GPUs, post-training published on 8 x H100; no inference requirement published
Formats: PyTorch (DeepSpeed checkpoint)
On disk: UniWAM-base 16.05GB -
InternRobotics InternW0-Delta
Hugging Face: https://huggingface.co/InternRobotics/InternW0-Delta-Base, https://huggingface.co/InternRobotics/InternW0-Delta-Libero, https://huggingface.co/InternRobotics/InternW0-Delta-RoboTwin, https://huggingface.co/InternRobotics/InternW0-Delta-RoboDojo
GitHub: https://github.com/InternRobotics/InternW0-Delta
Website: https://internrobotics.github.io/InternW0-Delta/
Technical report: https://arxiv.org/abs/2609.31394Developer: Shanghai AI Laboratory (InternRobotics)
Released: September 2026
Variants: Base / Libero / RoboTwin / RoboDojo
Architecture: World-action model: a pretrained Wan2.2-TI2V-5B video expert and an ActionDiT action expert coupled through 30 directed Mixture-of-Transformers blocks, with a frozen RynnBrain1.1-2B VLM conditioning the action expert and training-only 4D distillation
License: MIT
Modalities: Multi-view RGB + language instruction + proprioceptive state in / action chunk out (canonical 80-D action space)
Runs on: NVIDIA GPU (Linux, CUDA); no inference requirement published
Formats: PyTorch (.pt)
On disk: 12.42GB per checkpoint (Base pretrain.pt) -
Alibaba DAMO RynnValue
Hugging Face: https://huggingface.co/Alibaba-DAMO-Academy/RynnValue-8B-Quantile, https://huggingface.co/Alibaba-DAMO-Academy/RynnValue-4B-Quantile, https://huggingface.co/Alibaba-DAMO-Academy/RynnValue-8B, https://huggingface.co/Alibaba-DAMO-Academy/RynnValue-4B
GitHub: https://github.com/alibaba-damo-academy/RynnValue
Website: https://alibaba-damo-academy.github.io/RynnValue.github.io/
Technical report: https://arxiv.org/abs/2608.09853Developer: Alibaba DAMO Academy
Released: August 2026
Variants: RynnValue-4B, RynnValue-8B, RynnValue-4B-Quantile, RynnValue-8B-Quantile
Parameters: 5.14B (4B checkpoints), 9.57B (8B checkpoints)
Architecture: RynnBrain backbone on the Qwen3-VL architecture; absolute and relative distributional value heads (fixed-bin or 256-bin quantile) plus a language head; predicts remaining time to task completion per frame
License: Apache License 2.0
Modalities: Image/video + language in / per-frame remaining-time value in seconds, video analysis text out
Runs on: Desktop GPU, single GPU with 24GB+ memory for the 8B model in bf16
Formats: safetensors
On disk: 10.29GB (4B checkpoints), 19.15GB (8B checkpoints) -
Alibaba DAMO RynnWorld-Latent
Hugging Face: https://huggingface.co/Alibaba-DAMO-Academy/RynnWorld-Latent
GitHub: https://github.com/alibaba-damo-academy/RynnWorld-Latent
Website: https://alibaba-damo-academy.github.io/RynnWorld-Latent.github.io/Developer: Alibaba DAMO Academy
Released: October 2026
Parameters: 3.46B
Architecture: Full fine-tune of NVIDIA Cosmos3-Edge (Mixture-of-Transformers, Nemotron-2B backbone, SigLIP2 vision tower) into a latent-action-conditioned video world model; rectified-flow video generation on a frozen Wan2.2 VAE; 608-dimension RynnLAM latent actions shared by human and robot video
Modalities: First-frame image + Latent action sequence in / Video out
Formats: safetensors
On disk: 20.75GB safetensors (4 shards, BF16 weights plus F32 EMA copy) -
Xiaomi Robotics Xiaomi-Robotics-U0
Hugging Face: https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0, https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0-FlashAR, https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0-4B, https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0-Sequence, https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0-4B-Sequence
GitHub: https://github.com/XiaomiRobotics/Xiaomi-Robotics-U0
Website: http://robotics.xiaomi.com/xiaomi-robotics-u0.html
Technical report: https://arxiv.org/abs/2607.11643Developer: Xiaomi Robotics
Released: July 2026
Variants: U0, U0-FlashAR, U0-4B, U0-Sequence, U0-4B-Sequence
Parameters: 34B (U0, U0-Sequence), 4B (U0-4B, U0-4B-Sequence)
Architecture: Autoregressive transformer initialized from EMU3.5; shared discrete visual tokenizer, single next-token objective across text and image sequences; FlashAR decodes visual tokens in anti-diagonal groups; Sequence checkpoints interleave subtask text and observations
License: Apache-2.0
Modalities: Text + Image + Video
Runs on: U0-4B variants: Desktop GPU / U0, U0-Sequence, U0-FlashAR: Datacenter GPU, vendor benchmark on one NVIDIA H20
Formats: safetensors
On disk: 68.21GB (U0, U0-Sequence), 75.02GB (U0-FlashAR), 10.16GB (U0-4B, U0-4B-Sequence) -
TeleAI SMART-VLA
Hugging Face: https://huggingface.co/TeleEmbodied/SMART-VLA
GitHub: https://github.com/TeleHuman/PRTS
Website: https://teamillusion-smart.github.io/
Technical report: https://arxiv.org/abs/2610.07652Developer: TeleAI (China Telecom)
Released: October 2026
Parameters: 4.44B
Architecture: PRTS-architecture VLA on a Qwen3-VL-4B-Instruct backbone with a flow-matching DiT action head, pretrained on synthetic articulated-object manipulation data
License: MIT
Modalities: Camera images + language instruction in / 50-step action chunk (up to 32 action dimensions) out
Formats: safetensors (BF16, 2 shards)
On disk: 9.67GB (two safetensors shards) -
Microsoft Rho
Hugging Face: https://huggingface.co/microsoft/rho-base, https://huggingface.co/collections/microsoft/rho
GitHub: https://github.com/microsoft/rhobotics
Website: https://microsoft.github.io/rhobotics/
Technical report: https://arxiv.org/abs/2609.38164Developer: Microsoft Research
Released: September 2026
Variants: rho-base / rho-yam-box / rho-ur-ai-trainer / rho-fr3-duo / rho-libero / rho-roboeval
Parameters: 5B (Phi-Phy VLM 4.68B / flow-matching action expert 542M)
Architecture: Vision-language-action model: a physically grounded Phi-family VLM (Phi-Phy) with a 12-block flow-matching action expert that cross-attends to a VLM decoder layer, midtrained per embodiment
License: MIT
Modalities: Multi-camera images + language instruction + robot state in / action chunk out (up to 50 steps in pretraining)
Runs on: NVIDIA GPU (Linux, CUDA; FlashAttention 2 by default); no VRAM requirement published
Formats: safetensors (BF16, 3 shards)
On disk: rho-base 10.50GB -
Meta FAIR RoboJEPA
GitHub: https://github.com/facebookresearch/robo_jepa
Website: https://robojepa.github.io
Technical report: https://arxiv.org/abs/2610.10515Developer: Meta FAIR
Released: October 2026
Variants: 22M / 50M / 100M / 300M / 1B / 2B / 4B / 8B / 8B DROID 720p (3 views)
Parameters: 22M to 8B predictors on a frozen V-JEPA 2.1 ViT-G/384 encoder
Architecture: Action-conditioned JEPA latent world model: a transformer predictor over frozen V-JEPA 2.1 features, with latent CEM/MPC planning toward a goal image and an optional diffusion video decoder
License: CC BY-NC-SA 4.0
Modalities: Camera video + action sequence in / predicted future latent states out (optional decoded video); no action head, actions come from latent MPC planning
Runs on: NVIDIA GPU (CUDA 12.6), one GPU per model size for evaluation; no VRAM requirement published
Formats: PyTorch (.pth.tar) from dl.fbaipublicfiles.com
On disk: 8B 29.99GB, 1B 4.07GB, 300M 1.24GB (300k-step checkpoints), plus V-JEPA 2.1 ViT-G/384 encoder 30.24GB -
DeepCybo PhysBrain 1.5
Hugging Face: https://huggingface.co/DeepCybo/PhysBrain1.5-8B, https://huggingface.co/DeepCybo/PhysBrain1.5-2B
GitHub: https://github.com/DeepCybo-PhysAI/PhysBrain-1.5
Website: https://deepcybo-physai.github.io/PhysBrain-1.5/
Technical report: https://arxiv.org/abs/2609.14973Developer: DeepCybo, Zhongguancun Academy, Zhongguancun Institute of Artificial Intelligence
Released: September 2026
Variants: 2B, 8B
Parameters: 2.16B (2B checkpoint), 8.90B (8B checkpoint)
Context: 262,144 tokens
Architecture: Qwen3-VL backbone extended with action and visual-state tokens; one shared autoregressive transformer, single next-token objective, no task-specific heads; ActionPiece action tokens with one action codebook across robot setups
Modalities: Text + Image + Video + Action history in / Text + Spatial grounding + Action chunk + Future-state image, depth map, robot mask out
Runs on: 2B: Laptop, Desktop GPU / 8B: Desktop GPU
Formats: safetensors
On disk: 4.32GB (2B checkpoint), 17.81GB (8B checkpoint) -
Metacognition NavGPT3
Hugging Face: https://huggingface.co/Metacognition-AI/NavGPT3-8B, https://huggingface.co/Metacognition-AI/NavGPT3-4B
GitHub: https://github.com/metacognitionai/NavGPT-3
Website: https://metacognitionai.github.io/NavGPT3/
Technical report: https://arxiv.org/abs/2610.10787Developer: Metacognition
Released: October 2026
Variants: 4B, 8B
Parameters: 4.44B (4B checkpoint), 8.77B (8B checkpoint)
Architecture: Qwen3-VL fine-tune with a two-layer MLP action head on the last prompt token’s hidden state; one 3,072-token visual budget shared across a four-view, up to 16-step image history
License: GNU Affero General Public License v3.0
Modalities: Text + Four-view RGB image history in / 8 waypoints (x, y, theta) out
Runs on: NVIDIA GPU (Linux)
Formats: safetensors
On disk: 9.66GB (4B checkpoint), 17.54GB (8B checkpoint)
