Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
Menu
  1. Home
  2. AI & Software
  3. Embodied Foundation Models

Embodied Foundation Models

Scheduled Pinned Locked Moved AI & Software
embodiedfoundation modelsrobotics
19 Posts 1 Posters 270 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • montezM Offline
    montezM Offline
    montez
    wrote last edited by
    #9

    OpenWAM-alpha

    Hugging Face: https://huggingface.co/OpenWAM/OpenWAM-Alpha-Pretrain-Foundation-Model, https://huggingface.co/collections/OpenWAM/openwam-alpha
    GitHub: https://github.com/OpenWAM-Official/OpenWAM
    Website: https://openwam-official.github.io/
    Technical report: https://arxiv.org/abs/2609.07398

    Developer: OpenWAM-Official
    Released: September 2026
    Variants: Pretrain-Foundation-Model / Sim fine-tunes (LIBERO, RoboTwin, RoboCasa365, RoboCasa-GR1, RoboDojo, EBench, VLABench) / Real fine-tunes (Dexterous-Hand-Wuji, RoboDojo-ARX-X5, RoboDojo-Piper, RoboDojo-Piper-X, Single-Arm-Franka)
    Parameters: Video DiT 5B / ActionDiT 1B
    Architecture: Dual-system world-action model: a pretrained Wan2.2-TI2V-5B video DiT and a dedicated ActionDiT coupled through joint self-attention with a mutual attention mask, on a frozen Wan2.2-VAE
    License: Apache-2.0
    Modalities: Multi-view RGB + language instruction + proprioceptive state in / future video + action chunk out (80-D unified action space)
    Runs on: NVIDIA datacenter GPUs, 8 x 80 GB recommended for training (CUDA 12.8); no inference requirement published
    Formats: safetensors
    On disk: Pretrain-Foundation-Model 24.81GB

    1 Reply Last reply
    0
    • montezM Offline
      montezM Offline
      montez
      wrote last edited by
      #10

      OLA Dimensions UniWAM

      Hugging Face: https://huggingface.co/chenpyyy/UniWAM-base, https://huggingface.co/collections/chenpyyy/uniwam
      GitHub: https://github.com/UniWAM/UniWAM
      Website: https://uniwam.github.io
      Technical report: https://arxiv.org/abs/2610.02054

      Developer: OLA Dimensions, HKUST(GZ)
      Released: October 2026
      Variants: UniWAM-base / UniWAM-robotwin-clean / UniWAM-libero / UniWAM-libero-plus
      Parameters: 8B
      Architecture: Mixture-of-Transformers, three experts: a Qwen3-VL-2B-Instruct physical reasoner, a Wan2.2-TI2V-5B world generator, a flow-matching action predictor; joint multimodal attention
      License: Apache-2.0
      Modalities: Camera images + proprioceptive state + language instruction in / physical language + future video + action chunk out
      Runs on: NVIDIA datacenter GPUs, post-training published on 8 x H100; no inference requirement published
      Formats: PyTorch (DeepSpeed checkpoint)
      On disk: UniWAM-base 16.05GB

      1 Reply Last reply
      0
      • montezM Offline
        montezM Offline
        montez
        wrote last edited by
        #11

        InternRobotics InternW0-Delta

        Hugging Face: https://huggingface.co/InternRobotics/InternW0-Delta-Base, https://huggingface.co/InternRobotics/InternW0-Delta-Libero, https://huggingface.co/InternRobotics/InternW0-Delta-RoboTwin, https://huggingface.co/InternRobotics/InternW0-Delta-RoboDojo
        GitHub: https://github.com/InternRobotics/InternW0-Delta
        Website: https://internrobotics.github.io/InternW0-Delta/
        Technical report: https://arxiv.org/abs/2609.31394

        Developer: Shanghai AI Laboratory (InternRobotics)
        Released: September 2026
        Variants: Base / Libero / RoboTwin / RoboDojo
        Architecture: World-action model: a pretrained Wan2.2-TI2V-5B video expert and an ActionDiT action expert coupled through 30 directed Mixture-of-Transformers blocks, with a frozen RynnBrain1.1-2B VLM conditioning the action expert and training-only 4D distillation
        License: MIT
        Modalities: Multi-view RGB + language instruction + proprioceptive state in / action chunk out (canonical 80-D action space)
        Runs on: NVIDIA GPU (Linux, CUDA); no inference requirement published
        Formats: PyTorch (.pt)
        On disk: 12.42GB per checkpoint (Base pretrain.pt)

        1 Reply Last reply
        0
        • montezM Offline
          montezM Offline
          montez
          wrote last edited by
          #12

          Alibaba DAMO RynnValue

          Hugging Face: https://huggingface.co/Alibaba-DAMO-Academy/RynnValue-8B-Quantile, https://huggingface.co/Alibaba-DAMO-Academy/RynnValue-4B-Quantile, https://huggingface.co/Alibaba-DAMO-Academy/RynnValue-8B, https://huggingface.co/Alibaba-DAMO-Academy/RynnValue-4B
          GitHub: https://github.com/alibaba-damo-academy/RynnValue
          Website: https://alibaba-damo-academy.github.io/RynnValue.github.io/
          Technical report: https://arxiv.org/abs/2608.09853

          Developer: Alibaba DAMO Academy
          Released: August 2026
          Variants: RynnValue-4B, RynnValue-8B, RynnValue-4B-Quantile, RynnValue-8B-Quantile
          Parameters: 5.14B (4B checkpoints), 9.57B (8B checkpoints)
          Architecture: RynnBrain backbone on the Qwen3-VL architecture; absolute and relative distributional value heads (fixed-bin or 256-bin quantile) plus a language head; predicts remaining time to task completion per frame
          License: Apache License 2.0
          Modalities: Image/video + language in / per-frame remaining-time value in seconds, video analysis text out
          Runs on: Desktop GPU, single GPU with 24GB+ memory for the 8B model in bf16
          Formats: safetensors
          On disk: 10.29GB (4B checkpoints), 19.15GB (8B checkpoints)

          1 Reply Last reply
          0
          • montezM Offline
            montezM Offline
            montez
            wrote last edited by
            #13

            Alibaba DAMO RynnWorld-Latent

            Hugging Face: https://huggingface.co/Alibaba-DAMO-Academy/RynnWorld-Latent
            GitHub: https://github.com/alibaba-damo-academy/RynnWorld-Latent
            Website: https://alibaba-damo-academy.github.io/RynnWorld-Latent.github.io/

            Developer: Alibaba DAMO Academy
            Released: October 2026
            Parameters: 3.46B
            Architecture: Full fine-tune of NVIDIA Cosmos3-Edge (Mixture-of-Transformers, Nemotron-2B backbone, SigLIP2 vision tower) into a latent-action-conditioned video world model; rectified-flow video generation on a frozen Wan2.2 VAE; 608-dimension RynnLAM latent actions shared by human and robot video
            Modalities: First-frame image + Latent action sequence in / Video out
            Formats: safetensors
            On disk: 20.75GB safetensors (4 shards, BF16 weights plus F32 EMA copy)

            1 Reply Last reply
            0
            • montezM Offline
              montezM Offline
              montez
              wrote last edited by
              #14

              Xiaomi Robotics Xiaomi-Robotics-U0

              Hugging Face: https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0, https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0-FlashAR, https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0-4B, https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0-Sequence, https://huggingface.co/XiaomiRobotics/Xiaomi-Robotics-U0-4B-Sequence
              GitHub: https://github.com/XiaomiRobotics/Xiaomi-Robotics-U0
              Website: http://robotics.xiaomi.com/xiaomi-robotics-u0.html
              Technical report: https://arxiv.org/abs/2607.11643

              Developer: Xiaomi Robotics
              Released: July 2026
              Variants: U0, U0-FlashAR, U0-4B, U0-Sequence, U0-4B-Sequence
              Parameters: 34B (U0, U0-Sequence), 4B (U0-4B, U0-4B-Sequence)
              Architecture: Autoregressive transformer initialized from EMU3.5; shared discrete visual tokenizer, single next-token objective across text and image sequences; FlashAR decodes visual tokens in anti-diagonal groups; Sequence checkpoints interleave subtask text and observations
              License: Apache-2.0
              Modalities: Text + Image + Video
              Runs on: U0-4B variants: Desktop GPU / U0, U0-Sequence, U0-FlashAR: Datacenter GPU, vendor benchmark on one NVIDIA H20
              Formats: safetensors
              On disk: 68.21GB (U0, U0-Sequence), 75.02GB (U0-FlashAR), 10.16GB (U0-4B, U0-4B-Sequence)

              1 Reply Last reply
              0
              • montezM Offline
                montezM Offline
                montez
                wrote last edited by
                #15

                TeleAI SMART-VLA

                Hugging Face: https://huggingface.co/TeleEmbodied/SMART-VLA
                GitHub: https://github.com/TeleHuman/PRTS
                Website: https://teamillusion-smart.github.io/
                Technical report: https://arxiv.org/abs/2610.07652

                Developer: TeleAI (China Telecom)
                Released: October 2026
                Parameters: 4.44B
                Architecture: PRTS-architecture VLA on a Qwen3-VL-4B-Instruct backbone with a flow-matching DiT action head, pretrained on synthetic articulated-object manipulation data
                License: MIT
                Modalities: Camera images + language instruction in / 50-step action chunk (up to 32 action dimensions) out
                Formats: safetensors (BF16, 2 shards)
                On disk: 9.67GB (two safetensors shards)

                1 Reply Last reply
                0
                • montezM Offline
                  montezM Offline
                  montez
                  wrote last edited by
                  #16

                  Microsoft Rho

                  Hugging Face: https://huggingface.co/microsoft/rho-base, https://huggingface.co/collections/microsoft/rho
                  GitHub: https://github.com/microsoft/rhobotics
                  Website: https://microsoft.github.io/rhobotics/
                  Technical report: https://arxiv.org/abs/2609.38164

                  Developer: Microsoft Research
                  Released: September 2026
                  Variants: rho-base / rho-yam-box / rho-ur-ai-trainer / rho-fr3-duo / rho-libero / rho-roboeval
                  Parameters: 5B (Phi-Phy VLM 4.68B / flow-matching action expert 542M)
                  Architecture: Vision-language-action model: a physically grounded Phi-family VLM (Phi-Phy) with a 12-block flow-matching action expert that cross-attends to a VLM decoder layer, midtrained per embodiment
                  License: MIT
                  Modalities: Multi-camera images + language instruction + robot state in / action chunk out (up to 50 steps in pretraining)
                  Runs on: NVIDIA GPU (Linux, CUDA; FlashAttention 2 by default); no VRAM requirement published
                  Formats: safetensors (BF16, 3 shards)
                  On disk: rho-base 10.50GB

                  1 Reply Last reply
                  0
                  • montezM Offline
                    montezM Offline
                    montez
                    wrote last edited by
                    #17

                    Meta FAIR RoboJEPA

                    GitHub: https://github.com/facebookresearch/robo_jepa
                    Website: https://robojepa.github.io
                    Technical report: https://arxiv.org/abs/2610.10515

                    Developer: Meta FAIR
                    Released: October 2026
                    Variants: 22M / 50M / 100M / 300M / 1B / 2B / 4B / 8B / 8B DROID 720p (3 views)
                    Parameters: 22M to 8B predictors on a frozen V-JEPA 2.1 ViT-G/384 encoder
                    Architecture: Action-conditioned JEPA latent world model: a transformer predictor over frozen V-JEPA 2.1 features, with latent CEM/MPC planning toward a goal image and an optional diffusion video decoder
                    License: CC BY-NC-SA 4.0
                    Modalities: Camera video + action sequence in / predicted future latent states out (optional decoded video); no action head, actions come from latent MPC planning
                    Runs on: NVIDIA GPU (CUDA 12.6), one GPU per model size for evaluation; no VRAM requirement published
                    Formats: PyTorch (.pth.tar) from dl.fbaipublicfiles.com
                    On disk: 8B 29.99GB, 1B 4.07GB, 300M 1.24GB (300k-step checkpoints), plus V-JEPA 2.1 ViT-G/384 encoder 30.24GB

                    1 Reply Last reply
                    0
                    • montezM Offline
                      montezM Offline
                      montez
                      wrote last edited by
                      #18

                      DeepCybo PhysBrain 1.5

                      Hugging Face: https://huggingface.co/DeepCybo/PhysBrain1.5-8B, https://huggingface.co/DeepCybo/PhysBrain1.5-2B
                      GitHub: https://github.com/DeepCybo-PhysAI/PhysBrain-1.5
                      Website: https://deepcybo-physai.github.io/PhysBrain-1.5/
                      Technical report: https://arxiv.org/abs/2609.14973

                      Developer: DeepCybo, Zhongguancun Academy, Zhongguancun Institute of Artificial Intelligence
                      Released: September 2026
                      Variants: 2B, 8B
                      Parameters: 2.16B (2B checkpoint), 8.90B (8B checkpoint)
                      Context: 262,144 tokens
                      Architecture: Qwen3-VL backbone extended with action and visual-state tokens; one shared autoregressive transformer, single next-token objective, no task-specific heads; ActionPiece action tokens with one action codebook across robot setups
                      Modalities: Text + Image + Video + Action history in / Text + Spatial grounding + Action chunk + Future-state image, depth map, robot mask out
                      Runs on: 2B: Laptop, Desktop GPU / 8B: Desktop GPU
                      Formats: safetensors
                      On disk: 4.32GB (2B checkpoint), 17.81GB (8B checkpoint)

                      1 Reply Last reply
                      0
                      • montezM Offline
                        montezM Offline
                        montez
                        wrote last edited by
                        #19

                        Metacognition NavGPT3

                        Hugging Face: https://huggingface.co/Metacognition-AI/NavGPT3-8B, https://huggingface.co/Metacognition-AI/NavGPT3-4B
                        GitHub: https://github.com/metacognitionai/NavGPT-3
                        Website: https://metacognitionai.github.io/NavGPT3/
                        Technical report: https://arxiv.org/abs/2610.10787

                        Developer: Metacognition
                        Released: October 2026
                        Variants: 4B, 8B
                        Parameters: 4.44B (4B checkpoint), 8.77B (8B checkpoint)
                        Architecture: Qwen3-VL fine-tune with a two-layer MLP action head on the last prompt token’s hidden state; one 3,072-token visual budget shared across a four-view, up to 16-step image history
                        License: GNU Affero General Public License v3.0
                        Modalities: Text + Four-view RGB image history in / 8 waypoints (x, y, theta) out
                        Runs on: NVIDIA GPU (Linux)
                        Formats: safetensors
                        On disk: 9.66GB (4B checkpoint), 17.54GB (8B checkpoint)

                        1 Reply Last reply
                        0
                        ↳

                        OBJECTS Forum

                        Join the conversation

                        Create an account to return to your place in the thread, follow new replies, bookmark useful posts, and upvote contributions you value.

                        Have something to add? Your perspective can make this thread better.

                        Register Login
                        Reply
                        • Reply as topic
                        Log in to reply
                        • Oldest to Newest
                        • Newest to Oldest
                        • Most Votes


                        • Login

                        • Don't have an account? Register

                        • Login or register to search.
                        • First post
                          Last post
                        • 0
                          • Categories
                          • Recent
                          • Tags
                          • Popular
                          • Users