MEKAWIRE
ExpertenarXiv

NAVA-WAM: Aktionspolitik direkt aus Beobachtungsvideos vortrainieren

Zhaochong An, Fei Zhang, Menglin Jia, Duncan Frost, Zijian Zhou, Yikai Wang, Xudong Wang, Aditya Patel, Belinda Zeng, Tao Xiang, Serge Belongie, Amir Bar, Sen He
In 30 Sekunden

NAVA-WAM ist ein Preprint eines Weltaktionsmodells, das eine Aktionspolitik ohne Aktionslabels direkt aus Beobachtungsvideos vortrainiert. In Simulation erreicht es auf LIBERO 99,0 Prozent und auf LIBERO-Plus 83,5 Prozent Erfolg, auf RoboTwin 2.0 Clean 88,5 und Random 73,6 Prozent; in realen Versuchen kommt es auf 93,3 Prozent gegenüber 66,7 Prozent für DreamZero und 53,3 Prozent für π0.5. Die Arbeit zeigt, dass native Action-Prior-Pretraining Aktionslabel-Kosten senken und die Generalisierung von Weltaktionsmodellen verbessern kann.

Forschungsfrage

Können reine Beobachtungsvideos eine Aktionspolitik direkt und ohne Zwischenrepräsentation oder latente Aktionsmodelle vortrainieren?

Problem

Weltaktionsmodelle koppeln visuelle Dynamik und Aktionsvorhersage, sind aber auf teure, schwer standardisierbare aktionsannotierte Roboterdaten angewiesen. Beobachtungsvideos sind reichlich vorhanden, werden bisher aber nur indirekt über visuelle Repräsentationen oder separate latente Aktionsmodelle genutzt, was Transferengpässe und Zusatzaufwand verursacht.

Bisheriger Ansatz

Zwei Paradigmen dominieren. Repräsentationslernen, etwa V-JEPA 2, VPP oder Masquerade, trainiert zuerst visuelle Merkmale und erst danach eine Politik; die Verbindung zu Aktionen entsteht spät und indirekt. Latent-Action-Lernen, etwa LAPO, LAPA, Motus oder RepWAM, inferiert aktionsähnliche Variablen aus Videos und erfordert eine zusätzliche Modellierungsstufe sowie Architektur- oder Optimierungsrestriktionen, um Shortcut-Lösungen zu vermeiden; dies kann den latenten Aktionsraum einschränken.

Neuer Ansatz

NAVA-WAM verwendet eine Mixture-of-Transformers-Architektur aus einem eingefrorenen Video-DiT, initialisiert aus Wan2.2-5B, und einem 1B großen Action-DiT. In der ersten Stufe wird nur der Action-DiT mit reiner Video-Flow-Matching-Supervision auf Beobachtungsübergängen optimiert, wobei transition-structured Joint Attention die Action-Token in die Vorhersage des künftigen Zustands einbindet. Die zweite Stufe trainiert Video- und Action-Stream gemeinsam mit aktionsannotierten Demonstrationen über Video-Action-Flow-Matching; asymmetrische Aufmerksamkeit entkoppelt den visuellen Zweig vom iterativen Action-Denoising und ermöglicht eine effiziente Action-only-Inferenz mit visuellem Cache.

Ergebnisse

Auf LIBERO erreicht NAVA-WAM 99,0 Prozent und auf LIBERO-Plus 83,5 Prozent; der stärkste LIBERO-Wert liegt bei 99,2 Prozent von Being-H0.7. Auf RoboTwin 2.0 erreicht NAVA-WAM 88,5 Prozent Clean und 73,6 Prozent Random; gegenüber dem stärksten Baseline-Wert verbessert es Clean um 3,5 Punkte und Random um 17,9 Punkte. Real auf einem Franka FR3 gelingen 14 von 15 Versuchen, also 93,3 Prozent, DreamZero erreicht 10 von 15, also 66,7 Prozent, und π0.5 8 von 15, also 53,3 Prozent. In Ablationen mit 25 Demos pro Aufgabe liegt NAVA-WAM bei 72,0 Prozent gegenüber 60,6 Prozent für repräsentationsbasiertes und 65,0 Prozent für latentaktionsbasiertes Pretraining; mit 25 Demos übertrifft es alle Baseline-Varianten mit 50 Demos. Ridge-Regression auf Aktionsrelevanz liefert R² von 0,329 bei voller Probendatenbasis gegenüber 0,203 für CoMo und 0,154 für DynaMo. Die Inference kostet 4,30 TFLOPs pro Aktionschunk bei 73,6 Prozent Random-Erfolg, vergleichbar mit Image-WAM mit 4,09 TFLOPs und 37,6 Prozent.

Grenzen

Der Beitrag ist ein Preprint ohne dokumentierte Begutachtung. Die reale Evaluation umfasst nur drei Aufgaben mit fünf Versuchen auf einem einzelnen Franka FR3; es gibt keine Angaben zu weiteren Embodiments. Rechenaufwand und Datenmengen für das Pretraining werden im Paper nicht vollständig quantifiziert. Eine explizite Limitations-Sektion fehlt; die Robustheit gegenüber sicherheitskritischen oder langen Horizonten ist im Paper nicht berichtet.

Bedeutung für die Branche

Robotikunternehmen und Hersteller von Weltmodellen könnten die Methode nutzen, um aus vorhandenen Beobachtungsvideos günstigere Aktionspolitiken zu lernen; die verbesserte Label-Effizienz ist kurzfristig für Simulations- und Manipulationsaufgaben relevant. Innerhalb von ein bis drei Jahren könnte der Ansatz in physische Roboterprodukte einfließen, sofern Modellgewichte oder reproduzierbare Trainingsrezepte offengelegt werden und die Ergebnisse auf mehreren Robotertypen sowie in längeren Aufgaben bestätigt werden. Voraussetzung ist außerdem eine Validierung der Sicherheit und der Inferenzlatenz in produktiven Umgebungen.

Vollständige Studie

Native Action-Prior Learning from Videos for World Action Models

Zhaochong An, Fei Zhang, Menglin Jia, Duncan Frost, Zijian Zhou, Yikai Wang, Xudong Wang, Aditya Patel, Belinda Zeng, Tao Xiang, Serge Belongie, Amir Bar, Sen He

Veröffentlicht unter CC BY 4.0. Wiedergabe mit Namensnennung, Original unter arXiv:2610.03391 (PDF).

Abstract

World action models integrate future visual dynamics with robot action prediction, but their scalability remains limited by the need for action-annotated robot trajectories. Observation-only videos contain rich evidence about interaction dynamics, but existing approaches typically use them either to pretrain visual representations that must later be adapted for control, or to infer latent actions that are subsequently grounded to robot commands. We present NAVA-WAM, which introduces native action-prior learning by directly pretraining the action policy from observation-only videos, avoiding indirect representation-to-control transfer or a separate latent-action model. Our training consists of two stages. First, we pretrain on observation-only videos, where future-video flow-matching supervision over visual transitions is propagated through transition-structured joint attention to optimize the Action-DiT and learn action-relevant priors. Second, we use action-labeled demonstrations to post-train the Action-DiT for robot control through joint video–action flow matching, while asymmetric attention decouples the visual branch from iterative action denoising and enables efficient action-only inference. Extensive experiments show that NAVA-WAM consistently outperforms prior approaches under both in-distribution and out-of-distribution settings, while demonstrating strong action-label efficiency and effective real-robot generalization. These results establish native action-prior learning as an effective approach to directly pretrain action policies from observation-only videos, providing a scalable path beyond action-labeled robot data.

††

1 Introduction

World action models (WAMs) (Zhu et al., 2025; Li et al., 2025; Ye et al., 2026c; Li et al., 2026a; Bi et al., 2026a) incorporate future visual dynamics into action learning, with strong potential to improve policy generalization. However, scaling WAMs remains challenging because they rely on action-annotated robot trajectories that are costly to collect and hard to standardize across embodiments. In contrast, large-scale observation-only videos provide abundant information about physical interactions and state transitions without action labels. The key challenge is therefore how to leverage such videos to learn priors that effectively improve action policy learning.

Existing approaches largely follow two paradigms for exploiting observation-only videos. Vision representation learning first learns visual or predictive representations from videos and then trains an action policy on top of them using action-labeled robot demonstrations (Nair et al., 2023; Hu et al., 2025; Assran et al., 2025; Sun et al., 2026). Because the learned video prior remains encoded in a vision-centric representation, its connection to executable actions is established only during downstream robot training, introducing an indirect representation-to-control transfer. Latent-action learning instead infers action-like variables from visual transitions and uses them as intermediate supervision for subsequent policy learning (Schmidt and Jiang, 2024; Ye et al., 2025; Chen et al., 2025b; Bu et al., 2025b; Bi et al., 2026a; Chen et al., 2026b). While more action-oriented, this paradigm requires an additional latent-action modeling stage and relies on complex architectural or optimization constraints (Yang et al., 2026b; Wang et al., 2026b; Zhang et al., 2026d) to avoid shortcut solutions in which the latent action simply copies information from the target observation. These constraints increase modeling complexity and can restrict the expressiveness of the latent-action space, thereby limiting the supervision provided to the policy and impairing its control learning.

These limitations motivate a simple question: Can observation-only videos directly optimize an action policy without relying on an intermediate interface? We answer this question with NAVA-WAM, which introduces native action-prior learning for world action models. As illustrated in Fig. 1, instead of first learning a separate visual representation or latent-action space and then using it in policy training, NAVA-WAM uses future-video prediction to directly pretrain the action policy. This creates a direct learning path from scalable observation-only videos to the action policy, avoiding intermediate representation constraints and enabling more effective policy learning.

Figure 1: Paradigms of leveraging observation-only videos for robot policy learning. (1) Vision representation learning first learns visual representations from videos within a vision encoder and then trains an action policy on top, introducing an indirect representation-to-control transfer. (2) Latent-action learning extracts latent actions from visual transitions as intermediate supervision for policy learning, introducing an additional modeling stage and a potential representational bottleneck. (3) Native action-prior learning directly uses video dynamics to optimize the action policy, avoiding additional intermediate interfaces and representational bottlenecks.

Specifically, NAVA-WAM adopts a joint Mixture-of-Transformers (MoT) architecture (Liang et al., 2024), comprising a Video-DiT and an Action-DiT that interact through joint attention while retaining modality-specific parameters. During action-free pre-training, the Video-DiT is frozen and the Action-DiT is optimized solely through future-video flow-matching supervision. Our transition-structured joint attention allows the Action-DiT to model visual transitions while participating in future-state prediction, enabling the video objective to directly optimize the action policy. In this way, the Action-DiT learns action-relevant priors directly from visual transitions without requiring an intermediate interface. During downstream post-training, we jointly optimize the video and action streams on action-labeled robot demonstrations through video–action flow matching, adapting the pretrained Action-DiT to embodiment-specific control. We make cross-stream attention asymmetric to decouple the visual stream from the evolving action sample, allowing its representations to be cached and enabling efficient action-only inference without explicitly generating future videos.

We evaluate NAVA-WAM on the simulation benchmarks LIBERO/LIBERO-Plus (Liu et al., 2023; Fei et al., 2025) and RoboTwin 2.0 (Chen et al., 2025a) under both in-distribution and out-of-distribution settings, demonstrating superior performance across both regimes. We further deploy NAVA-WAM on a physical Franka FR3, achieving 93.3\% success across tabletop manipulation tasks, compared with 66.7\% for DreamZero (Ye et al., 2026c) and 53.3\% for \pi_{0.5} (Physical Intelligence et al., 2025). Controlled experiments show that native action-prior learning consistently outperforms representation-based and latent-action-based approaches across action-label budgets, with larger gains in low-budget regimes. Together, these results demonstrate that native action-prior learning can effectively leverage observation-only videos to learn action priors, improving generalization and action-label efficiency.

2 Related Work

2.1 World Action Models

Direct visuomotor policies learn observation-to-action mappings across tasks and embodiments (Brohan et al., 2023; Team et al., 2024; Liu et al., 2025), while vision–language–action (VLA) models further leverage semantic priors from large-scale vision–language pre-training (Zitkovich et al., 2023; Kim et al., 2024; Black et al., 2024a; Physical Intelligence et al., 2025; Bjorck et al., 2025; Gemini Robotics Team et al., 2025; Team et al., 2026; Zhang et al., 2026a; Shin et al., 2026; Zhang et al., 2026f; Yang et al., 2026a). Their primary objective, however, remains conditional action prediction, leaving environment dynamics to be learned implicitly. With recent advances in video modeling (An et al., 2026a; Qiao et al., 2026; An et al., 2026b), world action models (WAMs) instead explicitly couple action learning with predictive modeling of future visual evolution. Existing WAMs can be broadly categorized into cascaded and joint architectures. Cascaded WAMs first extract predictive information from a video or world model and then use it to drive a separate action module (Du et al., 2023; Black et al., 2024b; Ko et al., 2024). Some methods explicitly generate future observations, visual subgoals, or motion cues before action prediction (Bharadhwaj et al., 2025; Zhou et al., 2024; Chen et al., 2026d; Li et al., 2026b; Lou et al., 2026; Wang et al., 2026a), while others condition policies on predictive intermediate representations without explicit pixel generation (Hu et al., 2025; Zhang et al., 2026e; Yan et al., 2026; Su et al., 2026; Luo et al., 2026b). Joint WAMs model future observations and actions within a shared architecture, enabling direct interaction between visual and action representations (Zhu et al., 2025; Li et al., 2025; Kim et al., 2026; Ye et al., 2026a; Huang et al., 2026b; Bi et al., 2026b). DreamZero and LingBot-VA (Ye et al., 2026c; Li et al., 2026a) jointly perform future visual prediction and action generation during closed-loop control, whereas Fast-WAM (Yuan et al., 2026) retains future-video prediction as training-time supervision while performing action-only inference. Dyna-2 (Dyna Robotics, 2026) further shows that adding human videos through co-training improves cross-embodiment generalization. NAVA-WAM follows the joint WAM paradigm with action-only inference, while enabling the action-generating expert to be directly pretrained from observation-only videos.

2.2 Learning from Observation-Only Videos

Observation-only videos provide scalable supervision for physical interactions and state transitions without action annotations. Existing robot learning approaches primarily leverage them through two paradigms. Vision representation learning learns visual or predictive representations from videos and uses them during downstream policy learning (Sun et al., 2026; Lin et al., 2026a; Feng et al., 2026; Nair et al., 2023; Goswami et al., 2025; Zhang et al., 2026b; Zhang et al., 2026c; Liang et al., 2026; Ren et al., 2026). VPP (Hu et al., 2025) conditions policies on predictive video features, and Masquerade (Lepert et al., 2025) learns visual representations through future robot-keypoint prediction. V-JEPA 2 and JEPA-VLA (Assran et al., 2025; Miao et al., 2026) use predictive video representations for planning and VLA learning. Such approaches retain video-derived knowledge in visual representations whose connection to executable actions is established only during downstream policy training, resulting in an indirect representation-to-control transfer. Latent-action learning instead infers action-like variables from visual transitions as intermediate supervision for policy learning (Bruce et al., 2024; Chen et al., 2025b; Nikulin et al., 2025; Bu et al., 2025b; Tharwat et al., 2025; Chen et al., 2026b; Liu et al., 2026; Lin et al., 2026b; Wan et al., 2026; Lee et al., 2026; Luo et al., 2026a). LAPO (Schmidt and Jiang, 2024) learns latent actions with a latent-to-action decoder, while LAPA (Ye et al., 2025) pretrains a VLA through discrete latent-action prediction before grounding them to robot actions. Motus (Bi et al., 2026a) incorporates optical-flow motion cues, while RepWAM and LingBot-VA 2.0 (Wang et al., 2026b; Zhang et al., 2026d) learn transition-oriented action representations in semantic visual spaces. However, these methods introduce an additional latent-action modeling stage and require architectural or optimization constraints to prevent shortcut solutions (Gao et al., 2026; Huang et al., 2026a; Yang et al., 2026b; Wang et al., 2026b; Zhang et al., 2026d; Chen et al., 2026a), which can constrain the learned latent-action space and the supervision it provides to the policy. In contrast, NAVA-WAM introduces native action-prior learning to learn transition priors directly within the action policy, providing a direct path from scalable observation-only videos to action policy pre-training.

3 Method

We present NAVA-WAM, a world action model that learns action-relevant priors directly within the robot policy from observation-only videos, without relying on an intermediate interface. Our method is illustrated in Fig. 2. Sec. 3.1 introduces the problem formulation and model architecture. Sec. 3.2 presents native action-prior pre-training from observation-only videos, and Sec. 3.3 describes downstream post-training and inference.

Figure 2: Overview of NAVA-WAM. During native action-prior pre-training, the Action-DiT is optimized solely through future-video supervision, learning action-relevant priors directly from observation-only videos. During post-training, the Video-DiT and Action-DiT are jointly optimized on action-labeled robot demonstrations using video and action flow-matching objectives, adapting the pretrained Action-DiT to continuous robot control. At inference, NAVA-WAM denoises only robot actions without explicitly generating future videos, enabling efficient closed-loop control.

3.1 Preliminaries

Problem formulation.

Let o_{t} denote the visual observation at time t, l the language instruction, and q_{t} the current proprioceptive state. A robot policy \mathcal{P}_{\theta} predicts a continuous action chunk a_{t:t+H-1}\in\mathbb{R}^{H\times d_{a}} over a horizon of H steps according to

\mathcal{P}_{\theta}\left(a_{t:t+H-1}\mid o_{t},l,q_{t}\right).
(1)

We consider two sources of training data. The observation-only dataset \mathcal{D}_{v}=\{(o_{0:T},l)\} contains videos and language descriptions without action annotations. The action-labeled robot dataset \mathcal{D}_{r}=\{(o_{0:T},l,q,a_{0:T-1})\} additionally provides proprioceptive states q and continuous robot actions a_{0:T-1}. A frozen spatiotemporal VAE E (Wan et al., 2025) encodes each video clip into latent visual states z_{0:K}=E(o_{0:T}), where each adjacent pair (z_{k-1},z_{k}) defines a visual state transition indexed by k. Our goal is to leverage the abundant action-free transitions in \mathcal{D}_{v} to pretrain the action policy before adapting it to embodiment-specific control using \mathcal{D}_{r}.

World action model architecture.

We instantiate \mathcal{P}_{\theta} as a Mixture-of-Transformers (MoT) (Liang et al., 2024) comprising a pretrained Video-DiT with parameters \theta_{V} and an Action-DiT with parameters \theta_{A}. The Video-DiT models visual dynamics, while the Action-DiT generates continuous robot actions. The two experts retain modality-specific parameters while exchanging information through joint attention. Each expert independently constructs its queries, keys, and values. Queries from modality m\in\{V,A\} attend jointly to the keys and values from both streams:

H_{m}=\operatorname{Attn}\!\left(Q_{m},[K_{V};K_{A}],[V_{V};V_{A}]\right).
(2)

Together, the two experts form a unified architecture for modeling visual dynamics and robot actions.

3.2 Native Action-Prior Pre-training

Observation-only videos capture visual state transitions that reveal the consequences of physical interactions, providing a rich and scalable source for learning action-relevant priors. Our goal is to improve WAM training by introducing a pre-training stage that learns action priors from such videos, while keeping the model architecture consistent with downstream WAM training and making only minimal changes. To this end, we propose native action-prior pre-training, which directly exploits transitions in \mathcal{D}_{v} to pretrain the action policy without introducing an intermediate interface.

Concretely, we retain the same MoT architecture used for downstream WAM training. During pre-training, action tokens are not supervised by robot actions; instead, we structure joint attention around visual transitions and optimize the Action-DiT solely through future-video supervision. This enables the action policy itself to acquire action priors directly from observation-only videos.

Inverse-forward dynamics modeling with attention.

We motivate action-prior learning through an inverse–forward dynamics factorization (Schmidt and Jiang, 2024; Ye et al., 2025). Given two adjacent states z_{k-1} and z_{k}, inverse dynamics extracts a transition-dependent variable r_{k}, while forward dynamics uses r_{k} together with the preceding state to predict the future state:

r_{k}=q(z_{k-1},z_{k}),\qquad\hat{z}_{k}=f(z_{k-1},r_{k}).
(3)

Rather than introducing separate inverse and forward models (Cui et al., 2024; Wang et al., 2026b; Zhang et al., 2026d; Yang et al., 2026b), we realize an analogous information flow implicitly within the policy through transition-structured joint attention.

For each transition z_{k-1}\rightarrow z_{k}, we construct a segment containing the clean preceding state z_{k-1}, a noised version of the future state z_{k}, denoted z_{k,\tau_{v}} at timestep \tau_{v}, and the corresponding group of Action-DiT tokens x_{k}^{a}, as illustrated in Fig. 2. Transition segments are isolated by the attention mask (detailed in Appendix B.3). Within each segment, clean preceding-state queries attend only to the clean state, whereas noised-future and action queries interact with all three token groups.

Under this transition-structured mask, the Action-DiT attention is given by

H_{A,k}=\operatorname{Attn}\!\left(Q_{A,k},[K_{V,k-1};K_{V,k,\tau_{v}};K_{A,k}],[V_{V,k-1};V_{V,k,\tau_{v}};V_{A,k}]\right).
(4)

The Action-DiT jointly accesses the preceding and future visual states and forms an internal representation of their transition. This information flow is analogous to inverse dynamics in Eq. 3, while keeping the transition representation implicit rather than materializing explicit latent actions.

Conversely, the noised future-state tokens attend to both visual states and the corresponding Action-DiT representations:

H_{V,k,\tau_{v}}=\operatorname{Attn}\!\left(Q_{V,k,\tau_{v}},[K_{V,k-1};K_{V,k,\tau_{v}};K_{A,k}],[V_{V,k-1};V_{V,k,\tau_{v}};V_{A,k}]\right).
(5)

This interaction parallels forward dynamics in Eq. 3, where future-state prediction depends on both the preceding state and a transition representation. Here, the Action-DiT accesses the future state only through its noised version z_{k,\tau_{v}}, precluding the trivial shortcut of directly copying the clean prediction target z_{k} (Garrido et al., 2026; Ye et al., 2025). See Appendix A for formal analysis. Together, Eqs. 4 and 5 realize an implicit inverse–forward interaction within the joint transformer, with the Action-DiT modeling the transition between adjacent visual states.

Pre-training formulation.

We use standard flow matching for future-video prediction (Lipman et al., 2023). For each target future state z_{k}, we sample \epsilon_{k}^{v}\sim\mathcal{N}(0,I) and a flow timestep \tau_{v}\in[0,1], and construct

\displaystyle z_{k,\tau_{v}} \\ \displaystyle=(1-\tau_{v})z_{k}+\tau_{v}\epsilon_{k}^{v}, \\ \displaystyle u_{k}^{v} \\ \displaystyle=\epsilon_{k}^{v}-z_{k},
(6)

where \tau_{v}=0 and \tau_{v}=1 correspond to the data and noise endpoints, respectively, and u_{k}^{v} is the target velocity. For the corresponding Action-DiT input, we independently sample \epsilon_{k}^{a}\sim\mathcal{N}(0,I) with the action timestep at \tau_{a}=1.

For each transition, the Video-DiT receives [z_{k-1},z_{k,\tau_{v}}], while the Action-DiT receives \epsilon_{k}^{a}. We freeze the pretrained Video-DiT, \theta_{V}=\bar{\theta}_{V}, and optimize only the Action-DiT parameters \theta_{A}. With stream-wise timesteps \bm{\tau}=(\tau_{v},1), the pre-training objective is

\mathcal{L}_{\mathrm{pre}}=\mathbb{E}\!\left[\sum_{k=1}^{K}w(\tau)\left\|v^{v}_{\bar{\theta}_{V},\theta_{A}}\!\left([z_{k-1},z_{k,\tau_{v}}],\epsilon_{k}^{a},\bm{\tau}\mid l\right)-u_{k}^{v}\right\|_{2}^{2}\right].
(7)

Through transition-structured joint attention, future-video prediction depends on the Action-DiT representations. Because the Video-DiT is frozen, minimizing the future-video objective directly updates \theta_{A} through the joint-attention pathway. This direct optimization of the Action-DiT from visual transitions constitutes our native action-prior learning, allowing action-relevant priors to emerge without a separate transfer interface.

3.3 Post-training and Inference

Action-labeled robot demonstrations provide direct supervision for embodiment-specific continuous control. We post-train on \mathcal{D}_{r} to ground the action priors learned from observation-only videos to executable robot actions. We retain the transition-based structure from pre-training while adapting the cross-stream interaction to direct action supervision and efficient inference.

Asymmetric transition attention.

During native action-prior pre-training, future-video tokens attend to Action-DiT representations through Eq. 5, allowing the video objective to propagate supervision into the Action-DiT. During post-training, action labels become available and the Action-DiT receives direct supervision. We therefore make the visual stream independent of the action stream while retaining visual conditioning for the Action-DiT. This asymmetric interaction enables the visual representations to be cached and reused throughout action denoising at inference.

Specifically, as shown in Fig. 2, Video-DiT queries attend only to the visual stream:

H_{V}=\operatorname{Attn}\!\left(Q_{V},K_{V},V_{V}\right),
(8)

while Action-DiT queries continue to attend to both visual and action streams:

H_{A}=\operatorname{Attn}\!\left(Q_{A},[K_{V};K_{A}],[V_{V};V_{A}]\right).
(9)
Post-training formulation.

We jointly train the visual and action streams using standard flow matching. For each transition z_{k-1}\rightarrow z_{k} and its corresponding continuous action chunk a_{k}, we independently sample \epsilon_{k}^{v},\epsilon_{k}^{a}\sim\mathcal{N}(0,I) and flow timesteps \tau_{v},\tau_{a}\in[0,1], and construct

\displaystyle z_{k,\tau_{v}} \\ \displaystyle=(1-\tau_{v})z_{k}+\tau_{v}\epsilon_{k}^{v}, \\ \displaystyle u_{k}^{v} \\ \displaystyle=\epsilon_{k}^{v}-z_{k}, \\ \displaystyle a_{k,\tau_{a}} \\ \displaystyle=(1-\tau_{a})a_{k}+\tau_{a}\epsilon_{k}^{a}, \\ \displaystyle u_{k}^{a} \\ \displaystyle=\epsilon_{k}^{a}-a_{k}.
(10)

With \bm{\tau}=(\tau_{v},\tau_{a}), the post-training objective is \mathcal{L}_{\mathrm{post}}=\lambda_{v}\mathcal{L}_{\mathrm{FM}}^{v}+\lambda_{a}\mathcal{L}_{\mathrm{FM}}^{a}, where

\mathcal{L}_{\mathrm{FM}}^{m}=\mathbb{E}\!\left[\sum_{k=1}^{K}w_{m}(\tau_{m})\left\|v_{\theta_{V},\theta_{A}}^{m}\!\left([z_{k-1},z_{k,\tau_{v}}],a_{k,\tau_{a}},\bm{\tau}\mid l,q\right)-u_{k}^{m}\right\|_{2}^{2}\right],\qquad m\in\{v,a\}.
(11)

Here, \lambda_{v} and \lambda_{a} weight the visual and action objectives, respectively. The video objective adapts the visual expert to downstream robot observations, while the action objective grounds the pretrained Action-DiT to embodiment-specific continuous control.

Inference.

Asymmetric attention makes the Video-DiT independent of the evolving action sample. We initialize the future-video and action streams with Gaussian noise and evaluate them at the first denoising step. During this forward pass, we cache the Video-DiT keys and values at each layer \ell:

\mathcal{C}_{V}=\{K_{\ell}^{V},V_{\ell}^{V}\}_{\ell=1}^{L}.
(12)

Subsequent denoising steps integrate only the action flow while reusing the visual cache \mathcal{C}_{V}:

\frac{da_{\tau_{a}}}{d\tau_{a}}=v_{\theta_{A}}^{a}\!\left(a_{\tau_{a}},\tau_{a}\mid\mathcal{C}_{V},l,q\right),\qquad\tau_{a}:1\rightarrow 0.
(13)

Thus, after the initial joint forward pass, iterative denoising runs only through the Action-DiT, enabling efficient closed-loop control without explicitly generating future videos.

4 Experiments

We evaluate NAVA-WAM on standard simulation benchmarks under both in-domain (ID) and out-of-domain (OOD) settings, and further validate its deployment on a physical robot.

4.1 Experimental Setup

NAVA-WAM initializes the Video-DiT from Wan2.2-5B (Wan et al., 2025) and uses a 1B-parameter Action-DiT with hidden dimension 1{,}024 (Li et al., 2026a; Yuan et al., 2026). Native action-prior pre-training uses observation-only videos from Open X-Embodiment (O’Neill et al., 2024), AgiBotWorld (Bu et al., 2025a), and EgoDex (Hoque et al., 2026). For downstream adaptation, we optimize the video and action streams with \lambda_{v}=\lambda_{a}=1. More details are provided in Appendix B.

Table 1: Results on LIBERO/LIBERO-Plus (left) and RoboTwin 2.0 (right). We report average success rate (%). LIBERO and RoboTwin Clean measure in-domain performance, while LIBERO-Plus and RoboTwin Random evaluate out-of-domain generalization. Best results are shown in bold.
  • Direct action policies
    LIBERO
    Keine Daten
    LIBERO-Plus
    Keine Daten
  • \pi_{0} (2024a)
    LIBERO
    94.1
    LIBERO-Plus
    53.6
  • \pi_{0}-FAST (2025)
    LIBERO
    85.5
    LIBERO-Plus
    61.6
  • StarVLA-\alpha (2026b)
    LIBERO
    96.5
    LIBERO-Plus
    77.0
  • \pi_{0.5} (2025)
    LIBERO
    96.9
    LIBERO-Plus
    77.4
  • ABot-M0 (2026c)
    LIBERO
    98.6
    LIBERO-Plus
    80.5
  • World action models
    LIBERO
    Keine Daten
    LIBERO-Plus
    Keine Daten
  • JEPA-VLA (2026)
    LIBERO
    96.4
    LIBERO-Plus
    25.6
  • Fast-WAM (2026)
    LIBERO
    97.6
    LIBERO-Plus
    51.5
  • Image-WAM (2026e)
    LIBERO
    98.4
    LIBERO-Plus
    83.1
  • Being-H0.7 (2026b)
    LIBERO
    99.2
    LIBERO-Plus
    82.1
  • NAVA-WAM
    LIBERO
    99.0
    LIBERO-Plus
    83.5
Figure 3: Real-robot evaluation on a Franka FR3. Left: success rate over five trials per task and average success over all 15 trials. Right: NAVA-WAM rollouts for the three evaluation tasks, shown from third-person and wrist-camera views. NAVA-WAM achieves 93.3\% average success and correctly follows the spatial relation in T1, where both baselines fail across all trials.

Simulation evaluation. We evaluate on two simulation benchmark families. LIBERO and LIBERO-Plus. LIBERO (Liu et al., 2023) contains four 10-task suites, while LIBERO-Plus (Fei et al., 2025) extends them with seven distribution shifts. Following Zhang et al. (2026e) and Yuan et al. (2026), we train on 50 LIBERO demonstrations per task and evaluate on LIBERO (ID) and LIBERO-Plus (OOD). RoboTwin 2.0. We train exclusively on 50 Clean-domain demonstrations per task from RoboTwin 2.0 (Chen et al., 2025a) and use no Random-domain demonstrations. Following Chen et al. (2026c), we evaluate in both Clean and Random domains, treating Random as the OOD setting.

Real-robot evaluation. We additionally deploy NAVA-WAM post-trained on DROID (Khazatsky et al., 2024) on a physical Franka FR3 arm without task-specific fine-tuning. We evaluate three tabletop manipulation tasks with five trials each and compare against \pi_{0.5} (Physical Intelligence et al., 2025) and the DreamZero-DROID policy (Ye et al., 2026c). Additional details are in Appendix C.5.

Table 2: Ablation studies on RoboTwin 2.0. (a) Comparison of observation-only pre-training methods under varying action-label budgets. (b) Action relevance of learned representations, measured by ridge-regression R^{2} to ground-truth actions under different probe-data budgets. (c) Inference compute per action chunk and Random-domain performance. Best results are shown in bold.
  • Pre-training method
    Demos / task
    10
    25
    50
  • No pre-training
    Demos / task
    60.5
    67.6
    69.7
  • Representation-based
    Demos / task
    58.2
    60.6
    68.1
  • Latent-action-based
    Demos / task
    61.6
    65.0
    71.2
  • Ours
    Demos / task
    66.5
    72.0
    73.6
Figure 4: Attention of learned action representations. We visualize attention from action representations to visual tokens on held-out data, overlaid on the current and next input observations. Our pretrained Action-DiT attends to interaction-relevant regions and aligns with observed motion, while the CoMo latent-action baseline shows more diffuse attention over static regions.

4.2 Main Results

Simulation results. Tab. 1 shows that NAVA-WAM achieves 99.0\% success on LIBERO and 83.5\% on LIBERO-Plus, maintaining strong performance under substantial distribution shifts. On RoboTwin 2.0, NAVA-WAM reaches 88.5\% on Clean and 73.6\% on Random. Compared with the strongest baseline, NAVA-WAM improves success by 3.5 points on Clean and 17.9 points on Random, while exhibiting a much smaller Clean-to-Random performance drop. Together, these results show that native action-prior learning preserves strong in-domain control while substantially improving generalization under visual and environmental distribution shifts.

Real-robot results. As shown in Fig. 3, NAVA-WAM succeeds in 14/15 trials (93.3\%), compared with 10/15 (66.7\%) for DreamZero and 8/15 (53.3\%) for \pi_{0.5}. The largest difference occurs on T1, which requires placing a cube on the left side of a bowl: NAVA-WAM succeeds in 4/5 trials, whereas both baselines fail in all five trials. These results complement the simulation benchmarks and demonstrate that the learned action prior transfers effectively to physical robot deployment.

Figure 5: Qualitative visualization of motion transfer across domains. Each example transfers the transition encoded by a source pair (Source: current \rightarrow Source: next) to a different target observation. The source transition specifies the underlying motion cue (orange arrows), which is applied to Target: current to obtain Target: transfer. The Overlay visualizes the transferred state relative to the current target observation, while Target: real shows the corresponding real transition (blue arrows). Across simulation, real-world, and sim-to-real examples, the transferred states follow the source motion despite substantial changes in visual appearance and scene configuration.

4.3 Ablation Studies

We conduct ablations on RoboTwin 2.0 to analyze native action-prior learning and its impact on downstream control. Unless otherwise specified, all variants follow the same training and evaluation protocol and differ only in the component under study.

Figure 6: Scaling observation-only pre-training data. Success across data scales at different action-label budgets.
Observation-only pre-training method and action-label efficiency.

We compare different methods for leveraging observation-only videos under the same downstream protocol. As shown in Tab. 2(a), NAVA-WAM consistently outperforms representation-based and latent-action-based pre-training (Yang et al., 2026b) across all action-label budgets. With 25 demonstrations per task, it achieves 72.0% success versus 60.6% and 65.0%, respectively. Moreover, NAVA-WAM with only 25 demonstrations surpasses all baselines trained with 50, demonstrating both more effective observation-only pre-training and improved action-label efficiency.

Observation-only data scale.

We study how scaling observation-only pre-training data affects downstream generalization. As shown in Fig. 6, Random-domain success consistently improves with corpus size under both action-label budgets, demonstrating that native action-prior learning benefits from more observation-only data.

Action relevance of learned representations.

We probe the action relevance of representations learned from observation-only videos: Video-DiT features from vision representation learning, inferred latent actions from latent-action learning (Cui et al., 2024; Yang et al., 2026b), and Action-DiT features from native action-prior learning. In Tab. 2(b), NAVA-WAM achieves the highest R^{2} across all probe-data budgets. Fig. 4 further provides complementary qualitative evidence: our Action-DiT focuses on interaction-relevant regions such as the gripper and manipulated objects, whereas the latent-action baseline (Yang et al., 2026b) exhibits more diffuse attention over static regions. Together, these results indicate that native action-prior learning encodes transition-relevant action information directly within the Action-DiT.

Qualitative motion transfer.

Fig. 5 analyzes the action prior learned by our pretrained Action-DiT. Given a source transition, we extract its Action-DiT activations and transfer them to a different target observation to predict the corresponding next state (Garrido et al., 2026; Todd et al., 2024). Across simulation, real-world, and sim-to-real examples, the transferred states reproduce the source motion despite substantial changes in appearance and scene configuration. These results show that native action-prior learning captures transferable action priors beyond the specific visual content of the source transition.

Inference efficiency.

Tab. 2(c) compares the inference compute across methods. NAVA-WAM requires 4.30 TFLOPs, comparable to Image-WAM (4.09 TFLOPs) and Fast-WAM (3.56 TFLOPs), while achieving substantially higher Random-domain success at 73.6\%. This demonstrates that our model achieves strong out-of-domain generalization with low inference overhead.

5 Conclusion

We present NAVA-WAM, which introduces native action-prior learning for world action models, directly pre-training the action policy from observation-only videos without relying on an intermediate interface. By learning action-relevant priors from visual transitions and adapting them to robot control with action-labeled demonstrations, NAVA-WAM unifies action-free pre-training and downstream policy learning within a single model. Experiments demonstrate strong generalization in simulation and real-robot deployment, with efficient action-only inference. Overall, our results suggest that directly learning action priors from scalable observation-only videos offers a simple and effective path toward scaling world action models beyond costly action-labeled robot data.

Acknowledgements

We would like to thank Tian Xie (Meta AI), Shanlin Sun (Meta AI), and Hyojun Go (ETH Zurich) for their constructive feedback on this project. Zhaochong An and Serge Belongie are supported by funding from the Pioneer Centre for AI, DNRF grant number P1.

References

  1. An et al. (2026a) Z. An, M. Jia, H. Qiu, Z. Zhou, X. Huang, Z. Liu, W. Ren, K. Kahatapitiya, D. Liu, S. He, et al. Onestory: coherent multi-shot video generation with adaptive memory. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 16173–16184.
  2. An et al. (2026b) Z. An, O. Kupyn, T. Uscidda, A. Colaco, K. Ahuja, S. Belongie, M. Gonzalez-Franco, and M. Tintore Gazulla Vggrpo: towards world-consistent video generation with 4d latent reward. In European Conference on Computer Vision, pp. 305–322.
  3. Assran et al. (2025) M. Assran, A. Bardes, D. Fan, Q. Garrido, R. Howes, M. Muckley, A. Rizvi, C. Roberts, K. Sinha, A. Zholus, et al. V-jepa 2: self-supervised video models enable understanding, prediction and planning. arXiv preprint arXiv:2506.09985.
  4. Bharadhwaj et al. (2025) H. Bharadhwaj, D. Dwibedi, A. Gupta, S. Tulsiani, C. Doersch, T. Xiao, D. Shah, F. Xia, D. Sadigh, and S. Kirmani Gen2Act: human video generation in novel scenarios enables generalizable robot manipulation. In Conference on Robot Learning,
  5. Bi et al. (2026a) H. Bi, H. Tan, S. Xie, Z. Wang, S. Huang, H. Liu, R. Zhao, Y. Feng, C. Xiang, Y. Rong, et al. Motus: a unified latent action world model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 35101–35113.
  6. Bi et al. (2026b) H. Bi, Z. Zhou, Y. Tang, J. Pang, S. Huang, H. Liu, R. Wang, S. Huang, Y. Wang, Y. Cheng, et al. Motus2: a self-evolving general world model for dexterous manipulation. arXiv preprint arXiv:2608.30237.
  7. Bjorck et al. (2025) J. Bjorck, F. Castañeda, N. Cherniadev, X. Da, R. Ding, L. Fan, Y. Fang, D. Fox, F. Hu, S. Huang, et al. GR00T N1: an open foundation model for generalist humanoid robots. arXiv preprint arXiv:2503.14734.
  8. Black et al. (2024a) K. Black, N. Brown, D. Driess, A. Esmail, M. Equi, C. Finn, N. Fusai, L. Groom, K. Hausman, B. Ichter, et al. \pi_{0}: a vision-language-action flow model for general robot control. arXiv preprint arXiv:2410.24164.
  9. Black et al. (2024b) K. Black, M. Nakamoto, P. Atreya, H. Walke, C. Finn, A. Kumar, and S. Levine Zero-shot robotic manipulation with pre-trained image-editing diffusion models. In International Conference on Learning Representations, Vol. 2024, pp. 33431–33452.
  10. Brohan et al. (2023) A. Brohan, N. Brown, J. Carbajal, Y. Chebotar, J. Dabis, C. Finn, K. Gopalakrishnan, K. Hausman, A. Herzog, J. Hsu, et al. RT-1: robotics transformer for real-world control at scale. In Robotics: Science and Systems,
  11. Bruce et al. (2024) J. Bruce, M. D. Dennis, A. Edwards, J. Parker-Holder, Y. Shi, E. Hughes, M. Lai, A. Mavalankar, R. Steigerwald, C. Apps, et al. Genie: generative interactive environments. In International conference on machine learning,
  12. Bu et al. (2025a) Q. Bu, J. Cai, L. Chen, X. Cui, Y. Ding, S. Feng, S. Gao, X. He, X. Hu, X. Huang, et al. Agibot world colosseo: a large-scale manipulation platform for scalable and intelligent embodied systems. arXiv preprint arXiv:2503.06669.
  13. Bu et al. (2025b) Q. Bu, Y. Yang, J. Cai, S. Gao, G. Ren, M. Yao, P. Luo, and H. Li UniVLA: learning to act anywhere with task-centric latent actions. In Robotics: Science and Systems,
  14. Chen et al. (2026a) G. Chen, Q. Shao, T. Cui, Z. Zhou, W. Mao, L. Yang, M. Wang, Y. Yang, H. Chen, and Y. Yue Learning a unified latent action space from videos with action-centric cycle consistency. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 12871–12880.
  15. Chen et al. (2026b) J. Chen, K. Wang, K. Chen, S. Chen, F. Gao, W. Tang, Z. Li, W. Liu, Z. Yao, B. Li, et al. Lawam: latent world action models for efficient dynamics-aware robot policies. arXiv preprint arXiv:2606.15768.
  16. Chen et al. (2026c) J. Chen, P. Jia, Q. Wuwu, J. Liu, M. Du, C. Fan, X. Chi, H. Chen, C. Bai, Z. Qian, et al. MV-WAM: manifold-aware world action model with value augmentation. arXiv preprint arXiv:2606.21088.
  17. Chen et al. (2025a) T. Chen, Z. Chen, B. Chen, Z. Cai, Y. Liu, Z. Li, Q. Liang, X. Lin, Y. Ge, Z. Gu, et al. RoboTwin 2.0: a scalable data generator and benchmark with strong domain randomization for robust bimanual robotic manipulation. arXiv preprint arXiv:2506.18088.
  18. Chen et al. (2025b) Y. Chen, Y. Ge, Y. Li, Y. Ge, M. Ding, Y. Shan, and X. Liu Moto: latent motion token as the bridging language for robot manipulation. In Proceedings of the IEEE/CVF international conference on computer vision,
  19. Chen et al. (2026d) Y. Chen, P. Li, Y. Xu, Q. Ma, J. Yang, K. Wang, J. Yang, D. An, H. Guan, G. Liu, et al. FlowWAM: optical flow as a unified action representation for world action models. arXiv preprint arXiv:2607.13017.
  20. Chi et al. (2025) C. Chi, Z. Xu, S. Feng, E. Cousineau, Y. Du, B. Burchfiel, R. Tedrake, and S. Song Diffusion policy: visuomotor policy learning via action diffusion. The International Journal of Robotics Research 44 (10-11), pp. 1684–1704.
  21. Cui et al. (2024) Z. J. Cui, H. Pan, A. Iyer, S. Haldar, and L. Pinto DynaMo: in-domain dynamics pretraining for visuo-motor control. In Advances in Neural Information Processing Systems, Vol. 37.
  22. Du et al. (2023) Y. Du, S. Yang, B. Dai, H. Dai, O. Nachum, J. Tenenbaum, D. Schuurmans, and P. Abbeel Learning universal policies via text-guided video generation. Advances in neural information processing systems 36, pp. 9156–9172.
  23. Dyna Robotics (2026) Dyna Robotics Dyna-2: a 1-million-hour scaling law for world-action models. Note: https://www.dyna.co/dyna-2
  24. Fei et al. (2025) S. Fei, S. Wang, J. Shi, Z. Dai, J. Cai, P. Qian, L. Ji, X. He, S. Zhang, Z. Fei, et al. LIBERO-Plus: in-depth robustness analysis of vision-language-action models. arXiv preprint arXiv:2510.13626.
  25. Feng et al. (2026) Y. Feng, W. Zhang, Y. Wang, H. Luo, H. Yuan, S. Zheng, and Z. Lu Spatial-aware vla pretraining through visual-physical alignment from human videos. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 712–723.
  26. Gao et al. (2026) S. Gao, W. Liang, K. Zheng, A. Malik, S. Ye, S. Yu, W. Tseng, Y. Dong, K. Mo, C. Lin, et al. Dreamdojo: a generalist robot world model from large-scale human videos. In International Conference on Machine Learning,
  27. Garrido et al. (2026) Q. Garrido, T. Nagarajan, B. Terver, N. Ballas, Y. LeCun, and M. Rabbat Learning latent action world models in the wild. In International Conference on Machine Learning,
  28. Gemini Robotics Team et al. (2025) Gemini Robotics Team, S. Abeyruwan, J. Ainslie, J. Alayrac, M. G. Arenas, T. Armstrong, A. Balakrishna, R. Baruch, M. Bauza, M. Blokzijl, et al. Gemini robotics: bringing AI into the physical world. arXiv preprint arXiv:2503.20020.
  29. Goswami et al. (2025) R. G. Goswami, A. Bar, D. Fan, T. Yang, G. Zhou, P. Krishnamurthy, M. Rabbat, F. Khorrami, and Y. LeCun World models for learning dexterous hand-object interactions from human videos. arXiv preprint arXiv:2512.13644.
  30. Hoque et al. (2026) R. Hoque, P. Huang, D. Yoon, J. Zhang, et al. Egodex: learning dexterous manipulation from large-scale egocentric video. In International Conference on Learning Representations, Vol. 2026, pp. 4218–4237.
  31. Hu et al. (2025) Y. Hu, Y. Guo, P. Wang, X. Chen, Y. Wang, J. Zhang, K. Sreenath, C. Lu, and J. Chen Video prediction policy: a generalist robot policy with predictive visual representations. In International Conference on Machine Learning,
  32. Hu et al. (2026) Y. Hu, J. Zhang, Y. Luo, Y. Guo, X. Chen, X. Sun, K. Feng, Q. Lu, S. Chen, Y. Zhang, et al. Bagelvla: enhancing long-horizon manipulation via interleaved vision-language-action generation. arXiv preprint arXiv:2602.09849.
  33. Huang et al. (2026a) H. Huang, S. Yenamandra, A. Majumdar, E. Aljalbout, T. Nagarajan, T. Yang, A. Rai, M. Rabbat, L. Fei-Fei, J. Wu, et al. Cross-embodiment robot foundation world models with latent actions. In International Conference on Machine Learning,
  34. Huang et al. (2026b) Z. Huang, J. Zhang, H. Liu, C. Zhang, R. Cheng, and L. Zhang Learning transferable dynamics priors from action to world modeling. In European Conference on Computer Vision, pp. 430–449.
  35. Khazatsky et al. (2024) A. Khazatsky, K. Pertsch, S. Nair, A. Balakrishna, S. Dasari, S. Karamcheti, S. Nasiriany, M. K. Srirama, L. Y. Chen, K. Ellis, et al. Droid: a large-scale in-the-wild robot manipulation dataset. arXiv preprint arXiv:2403.12945.
  36. Kim et al. (2026) M. J. Kim, Y. Gao, T. Lin, Y. Lin, Y. Ge, G. Lam, P. Liang, S. Song, M. Liu, C. Finn, et al. Cosmos policy: fine-tuning video models for visuomotor control and planning. In International Conference on Learning Representations,
  37. Kim et al. (2024) M. J. Kim, K. Pertsch, S. Karamcheti, T. Xiao, A. Balakrishna, S. Nair, R. Rafailov, E. Foster, G. Lam, P. Sanketi, et al. Openvla: an open-source vision-language-action model. arXiv preprint arXiv:2406.09246.
  38. Ko et al. (2024) P. Ko, J. Mao, Y. Du, S. Sun, and J. B. Tenenbaum Learning to act from actionless videos through dense correspondences. In International Conference on Learning Representations, Vol. 2024, pp. 40938–40958.
  39. Lee et al. (2026) J. M. Lee, D. Lee, S. Ju, T. Cho, J. W. Koo, L. Zhao, S. Hong, and J. Lee MVP-lam: learning action-centric latent action via cross-viewpoint reconstruction. In International Conference on Machine Learning,
  40. Lepert et al. (2025) M. Lepert, J. Fang, and J. Bohg Masquerade: learning from in-the-wild human videos using data-editing. arXiv preprint arXiv:2508.09976.
  41. Li et al. (2026a) L. Li, Q. Zhang, Y. Luo, S. Yang, R. Wang, F. Han, M. Yu, Z. Gao, N. Xue, X. Zhu, et al. Causal world modeling for robot control. arXiv preprint arXiv:2601.21998.
  42. Li et al. (2025) S. Li, Y. Gao, D. Sadigh, and S. Song Unified video action model. In Robotics: Science and Systems,
  43. Li et al. (2026b) Z. Li, P. Wu, X. Han, R. Cai, and Y. Du Structured 4d latent predictive model for robot planning. In International Conference on Machine Learning,
  44. Liang et al. (2026) Q. Liang, B. Cai, M. Lai, S. Zhuang, T. Lin, Y. Qin, Y. Ye, J. Liang, and R. Xu Bootstrap dynamic-aware 3d visual representation for scalable robot learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 13419–13429.
  45. Liang et al. (2024) W. Liang, L. Yu, L. Luo, S. Iyer, N. Dong, C. Zhou, G. Ghosh, M. Lewis, W. Yih, L. Zettlemoyer, et al. Mixture-of-transformers: a sparse and scalable architecture for multi-modal foundation models. arXiv preprint arXiv:2411.04996.
  46. Lin et al. (2026a) Y. Lin, J. He, S. Bao, C. Zhao, Y. Li, X. Wang, Y. Wang, C. Chi, and J. Zhang JEPA-wam: learning vision-language-action policies with joint-embedding world modeling. arXiv preprint arXiv:2608.09381.
  47. Lin et al. (2026b) Y. Lin, H. Li, Y. Li, H. Shen, Y. Zhao, C. Shao, and J. Zhang From pixels to tokens: a systematic study of latent action supervision for vision-language-action models. In International Conference on Machine Learning,
  48. Lipman et al. (2023) Y. Lipman, R. T. Q. Chen, H. Ben-Hamu, M. Nickel, and M. Le Flow matching for generative modeling. In International Conference on Learning Representations,
  49. Liu et al. (2023) B. Liu, Y. Zhu, C. Gao, Y. Feng, Q. Liu, Y. Zhu, and P. Stone LIBERO: benchmarking knowledge transfer for lifelong robot learning. Advances in Neural Information Processing Systems 36, pp. 44776–44791.
  50. Liu et al. (2026) M. Liu, B. Jia, J. Huang, J. Zhang, and S. Huang Lara: latent action representation alignment for vision-language-action models. In International Conference on Machine Learning,
  51. Liu et al. (2025) S. Liu, L. Wu, B. Li, H. Tan, H. Chen, Z. Wang, K. Xu, H. Su, and J. Zhu RDT-1B: a diffusion foundation model for bimanual manipulation. In International Conference on Learning Representations, Vol. 2025, pp. 29982–30009.
  52. Lou et al. (2026) Y. Lou, X. Chi, X. Zhang, Z. Qian, C. Li, R. Zhang, Y. Lyu, G. Song, C. Fu, H. Xu, et al. Mask world model: predicting what matters for robust robot policy learning. In International Conference on Machine Learning,
  53. Luo et al. (2026a) H. Luo, Y. Wang, W. Zhang, H. Yuan, Y. Feng, H. Xu, S. Zheng, and Z. Lu Joint-aligned latent action: towards scalable vla pretraining in the wild. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,
  54. Luo et al. (2026b) H. Luo, W. Zhang, Y. Feng, S. Zheng, H. Xu, C. Xu, Z. Xi, Y. Fu, and Z. Lu Being-h0. 7: a latent world-action model from egocentric videos. arXiv preprint arXiv:2605.00078.
  55. Miao et al. (2026) S. Miao, N. Feng, J. Wu, Y. Lin, X. He, D. Li, and M. Long JEPA-VLA: video predictive embedding is needed for VLA models. arXiv preprint arXiv:2602.11832.
  56. Nair et al. (2023) S. Nair, A. Rajeswaran, V. Kumar, C. Finn, and A. Gupta R3M: a universal visual representation for robot manipulation. In Conference on Robot Learning, Vol. 205, pp. 892–909.
  57. Nikulin et al. (2025) A. Nikulin, I. Zisman, D. Tarasov, N. Lyubaykin, A. Polubarov, I. Kiselev, and V. Kurenkov Latent action learning requires supervision in the presence of distractors. In International Conference on Machine Learning,
  58. O’Neill et al. (2024) A. O’Neill, A. Rehman, A. Maddukuri, A. Gupta, A. Padalkar, A. Lee, A. Pooley, A. Gupta, A. Mandlekar, A. Jain, et al. Open x-embodiment: robotic learning datasets and RT-X models. In IEEE International Conference on Robotics and Automation, pp. 6892–6903.
  59. Pertsch et al. (2025) K. Pertsch, K. Stachowicz, B. Ichter, D. Driess, S. Nair, Q. Vuong, O. Mees, C. Finn, and S. Levine FAST: efficient action tokenization for vision-language-action models. arXiv preprint arXiv:2501.09747.
  60. Physical Intelligence et al. (2025) Physical Intelligence, K. Black, N. Brown, J. Darpinian, K. Dhabalia, D. Driess, A. Esmail, M. Equi, C. Finn, N. Fusai, et al. \pi_{0.5}: a vision-language-action model with open-world generalization. arXiv preprint arXiv:2504.16054.
  61. Qiao et al. (2026) F. Qiao, Z. An, Z. Xiong, S. Belongie, and N. Jacobs Track2View: 4d-consistent camera-controlled video generation via paired 3d point tracks. arXiv preprint arXiv:2606.15534.
  62. Ren et al. (2026) Z. Ren, Y. Wei, X. Yu, G. Luo, Y. Zhao, B. Kang, J. Feng, and X. Jin Videoworld 2: learning transferable knowledge from real-world videos. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,
  63. Schmidt and Jiang (2024) D. Schmidt and M. Jiang Learning to act without actions. In International Conference on Learning Representations, Vol. 2024, pp. 9379–9395.
  64. Shin et al. (2026) J. Shin, J. Won, K. Lee, H. Jang, and D. Kim Dual-stream diffusion for world-model augmented vision-language-action model. In International Conference on Machine Learning,
  65. Shou et al. (2026) Q. Shou, F. Zhu, S. Chen, P. Yan, Z. Yan, Y. Miao, X. Pang, Z. Hong, R. Shi, H. Huang, et al. HALO: a unified vision-language-action model for embodied multimodal chain-of-thought reasoning. arXiv preprint arXiv:2602.21157.
  66. Su et al. (2026) Y. Su, S. Chen, H. Shi, M. Liu, Z. Zhang, N. Huang, W. Zhong, Z. Zhu, Y. Liu, and X. Liu World guidance: world modeling in condition space for action generation. In International Conference on Machine Learning,
  67. Sun et al. (2026) J. Sun, W. Zhang, Z. Qi, S. Ren, Z. Liu, H. Zhu, G. Sun, X. Jin, and Z. Chen Vla-jepa: enhancing vision-language-action model with latent world model. In European Conference on Computer Vision, pp. 478–497.
  68. Team et al. (2024) O. M. Team, D. Ghosh, H. Walke, K. Pertsch, K. Black, O. Mees, S. Dasari, J. Hejna, T. Kreiman, C. Xu, et al. Octo: an open-source generalist robot policy. arXiv preprint arXiv:2405.12213.
  69. Team et al. (2026) X. R. Team, J. Guo, P. Jin, J. Li, P. Li, Y. Li, F. Liu, W. Peng, O. Qin, Y. Su, et al. Xiaomi-robotics-1: scaling vision-language-action models with over 100k hours of real-world trajectories. arXiv preprint arXiv:2607.15330.
  70. Tharwat et al. (2025) B. Tharwat, Y. Nasser, A. Abouzeid, and I. Reid Latent action pretraining through world modeling. arXiv preprint arXiv:2509.18428.
  71. Todd et al. (2024) E. Todd, M. Li, A. Sen Sharma, A. Mueller, B. Wallace, and D. Bau Function vectors in large language models. In International conference on learning representations, Vol. 2024, pp. 17282–17333.
  72. Wan et al. (2026) S. Wan, X. Hu, X. Zhou, L. Yuan, L. Gan, and D. Zhan Multi-view consistent latent action learning for world modeling and control. In International Conference on Machine Learning,
  73. Wan et al. (2025) T. Wan, A. Wang, B. Ai, B. Wen, C. Mao, C. Xie, D. Chen, F. Yu, H. Zhao, J. Yang, et al. Wan: open and advanced large-scale video generative models. arXiv preprint arXiv:2503.20314.
  74. Wang et al. (2026a) J. Wang, Y. Jiang, T. He, J. Sun, Q. Zhang, J. He, J. Cao, Z. Gan, M. Sun, Q. Shao, et al. MVISTA-4d: view-consistent 4d world model with test-time action inference for robotic manipulation. In International Conference on Machine Learning,
  75. Wang et al. (2026b) J. Wang, Q. Zhang, S. Yang, Y. Luo, Y. Shen, Z. Wu, Y. Jiang, and Y. Xu RepWAM: world action modeling with representation visual-action tokenizers. arXiv preprint arXiv:2606.13674.
  76. Wu and Gao (2026) Z. Wu and J. Gao OSCAR: omni-embodiment action-conditioned world model for robotics. arXiv preprint arXiv:2606.04463.
  77. Yan et al. (2026) H. Yan, Z. Zhong, J. Zhu, J. He, W. Yuan, W. Song, X. Gong, Y. Cai, G. Zhao, X. Yan, et al. S-vam: shortcut video-action model by self-distilling geometric and semantic foresight. In European Conference on Computer Vision,
  78. Yang et al. (2026a) F. Yang, D. Di, L. Tang, X. Zhang, L. Fan, H. Li, W. Chen, T. Su, and B. Ma Chain of world: world model thinking in latent motion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6675–6684.
  79. Yang et al. (2026b) J. Yang, Y. Shi, H. Zhu, M. Liu, K. Ma, Y. Wang, G. Wu, T. He, and L. Wang Como: learning continuous latent motion from internet videos for scalable robot learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 42352–42363.
  80. Yang et al. (2026c) Y. Yang, S. Zeng, T. Lin, X. Chang, D. Qi, J. Xiao, H. Liu, R. Chen, Y. Chen, D. Huo, et al. ABot-M0: VLA foundation model for robotic manipulation with action manifold learning. arXiv preprint arXiv:2602.11236.
  81. Ye et al. (2026a) A. Ye, B. Wang, C. Ni, G. Huang, G. Zhao, H. Li, H. Li, J. Li, J. Lv, J. Liu, et al. GigaWorld-policy: an efficient action-centered world–action model. arXiv preprint arXiv:2603.17240.
  82. Ye et al. (2026b) J. Ye, N. Gao, S. Yang, J. Zheng, Z. Wang, Y. Chen, P. Chen, Y. Chen, S. Liu, and J. Jia StarVLA-\alpha: reducing complexity in vision-language-action systems. arXiv preprint arXiv:2604.11757.
  83. Ye et al. (2026c) S. Ye, Y. Ge, K. Zheng, S. Gao, S. Yu, G. Kurian, S. Indupuru, Y. L. Tan, C. Zhu, J. Xiang, et al. World action models are zero-shot policies. arXiv preprint arXiv:2602.15922.
  84. Ye et al. (2025) S. Ye, J. Jang, B. Jeon, S. J. Joo, J. Yang, B. Peng, A. Mandlekar, R. Tan, Y. Chao, B. Y. Lin, et al. Latent action pretraining from videos. In International Conference on Learning Representations, Vol. 2025, pp. 28213–28239.
  85. Yuan et al. (2026) T. Yuan, Z. Dong, Y. Liu, and H. Zhao Fast-wam: do world action models need test-time future imagination?. arXiv preprint arXiv:2603.16666.
  86. Zhang et al. (2026a) H. Zhang, L. Xiang, H. Lin, Z. Huang, M. Wang, D. Zhong, Y. Dong, Y. Wu, Y. Rao, D. Zhang, et al. Hy-embodied-0.5-vla: from vision-language-action models to a real-world robot learning stack. arXiv preprint arXiv:2606.14409.
  87. Zhang et al. (2025) J. Zhang, Y. Guo, Y. Hu, X. Chen, X. Zhu, and J. Chen UP-VLA: a unified understanding and prediction model for embodied agents. arXiv preprint arXiv:2501.18867.
  88. Zhang et al. (2026b) J. Zhang, Y. Hu, Y. Guo, X. Chen, Y. Liu, W. Chen, C. Lu, and J. Chen UniJEPA: enhancing robot policy via unified continuous and discrete representation learning. In International Conference on Machine Learning,
  89. Zhang et al. (2026c) K. Zhang, T. Niu, T. Liu, C. Guo, Z. Xu, Q. Hu, and W. Ding DiffuView: multi-view diffusion pretraining for 3d aware robotic manipulation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 23601–23611.
  90. Zhang et al. (2026d) Q. Zhang, L. Li, L. Zhang, S. Yang, Y. Luo, S. Li, R. Wang, J. Wang, J. Shao, G. Xu, et al. Native video-action pretraining for generalizable robot control. arXiv preprint arXiv:2607.08639.
  91. Zhang et al. (2026e) Y. Zhang, W. Zhang, Z. Qi, H. Zhang, H. Lin, J. Zhang, Y. Mu, X. Yang, W. Zeng, and X. Jin ImageWAM: do world action models really need video generation, or just image editing?. arXiv preprint arXiv:2606.19531.
  92. Zhang et al. (2026f) Z. Zhang, S. Yang, Q. Hu, L. J. Huang, J. Hou, Y. Sun, Y. Lu, and S. Han Foreact: steering your vla with efficient visual foresight planning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,
  93. Zhou et al. (2024) S. Zhou, Y. Du, J. Chen, Y. Li, D. Yeung, and C. Gan RoboDreamer: learning compositional world models for robot imagination. In International Conference on Machine Learning,
  94. Zhu et al. (2025) C. Zhu, R. Yu, S. Feng, B. Burchfiel, P. Shah, and A. Gupta Unified world models: coupling video and action diffusion for pretraining on large robotic datasets. In Robotics: Science and Systems,
  95. Zitkovich et al. (2023) B. Zitkovich, T. Yu, S. Xu, P. Xu, T. Xiao, F. Xia, J. Wu, P. Wohlhart, S. Welker, A. Wahid, others, B. Zitkovich, T. Yu, S. Xu, P. Xu, T. Xiao, F. Xia, J. Wu, P. Wohlhart, S. Welker, A. Wahid, Q. Vuong, V. Vanhoucke, H. Tran, R. Soricut, A. Singh, J. Singh, P. Sermanet, P. R. Sanketi, G. Salazar, M. S. Ryoo, K. Reymann, K. Rao, K. Pertsch, I. Mordatch, H. Michalewski, Y. Lu, S. Levine, L. Lee, T. E. Lee, I. Leal, Y. Kuang, D. Kalashnikov, R. Julian, N. J. Joshi, A. Irpan, B. Ichter, J. Hsu, A. Herzog, K. Hausman, K. Gopalakrishnan, C. Fu, P. Florence, C. Finn, K. A. Dubey, D. Driess, T. Ding, K. M. Choromanski, X. Chen, Y. Chebotar, J. Carbajal, N. Brown, A. Brohan, M. G. Arenas, and K. Han RT-2: vision-language-action models transfer web knowledge to robotic control. In Conference on Robot Learning,

Appendix A Theoretical Analysis of Native Action-Prior Learning

We provide a simplified theoretical analysis of why the Action-DiT pathway captures transition information and how future-state corruption prevents a direct target copying shortcut. Following the notation in Sec. 3.2, consider a transition from the preceding visual state z_{k-1} to the future state z_{k}. During pre-training, the Action-DiT does not directly observe the clean future state z_{k}, but instead accesses its noised version

z_{k,\tau}=(1-\tau)z_{k}+\tau\epsilon_{k}^{v},\qquad\epsilon_{k}^{v}\sim\mathcal{N}(0,I),
(14)

as defined in Eq. 6. We abstract the transition representation formed by the Action-DiT as

r_{k}=E(z_{k-1},z_{k,\tau}),
(15)

and consider predicting the clean future state from the preceding state and this representation,

\hat{z}_{k}=D(z_{k-1},r_{k}).
(16)

This abstraction isolates the information carried through the Action-DiT pathway while suppressing the architectural details of the joint transformer.

The action pathway captures transition information.

We first characterize the predictive value of the transition representation r_{k}. Define the Bayes-optimal prediction errors

\displaystyle\mathcal{L}_{z} \\ \displaystyle=\mathbb{E}\!\left[\left\|z_{k}-\mathbb{E}[z_{k}\mid z_{k-1}]\right\|_{2}^{2}\right], \\ \displaystyle\mathcal{L}_{z,r} \\ \displaystyle=\mathbb{E}\!\left[\left\|z_{k}-\mathbb{E}[z_{k}\mid z_{k-1},r_{k}]\right\|_{2}^{2}\right].
(17) (18)
Proposition A.1 (Predictive value of the transition representation).

The reduction in Bayes-optimal future-state prediction error from conditioning on r_{k} is

\mathcal{L}_{z}-\mathcal{L}_{z,r}=\mathbb{E}\!\left[\left\|\mathbb{E}[z_{k}\mid z_{k-1},r_{k}]-\mathbb{E}[z_{k}\mid z_{k-1}]\right\|_{2}^{2}\right]\geq 0.
(19)

Thus, r_{k} is useful to the extent that it captures information about the future state beyond what is already predictable from the preceding state z_{k-1}.

Proof.

Let

m_{k-1}=\mathbb{E}[z_{k}\mid z_{k-1}],\qquad m_{k-1,r}=\mathbb{E}[z_{k}\mid z_{k-1},r_{k}].
(20)

We decompose

z_{k}-m_{k-1}=(z_{k}-m_{k-1,r})+(m_{k-1,r}-m_{k-1}).
(21)

The two terms are orthogonal in expectation because

\mathbb{E}[z_{k}-m_{k-1,r}\mid z_{k-1},r_{k}]=0.
(22)

Therefore,

\mathbb{E}\|z_{k}-m_{k-1}\|_{2}^{2}=\mathbb{E}\|z_{k}-m_{k-1,r}\|_{2}^{2}+\mathbb{E}\|m_{k-1,r}-m_{k-1}\|_{2}^{2},
(23)

which yields Eq. 19. ∎

Future corruption prevents a target-copying shortcut.

If the Action-DiT directly observed the clean future state z_{k}, the prediction objective would admit the degenerate shortcut

r_{k}=z_{k},\qquad D(z_{k-1},r_{k})=r_{k},
(24)

which achieves zero prediction error by directly transmitting the prediction target, without requiring the action pathway to capture a meaningful transition representation. Instead, our attention construction exposes the Action-DiT only to the Gaussian-corrupted future state z_{k,\tau}.

Proposition A.2 (Gaussian corruption prevents exact target copying).

Assume

z_{k}\mid z_{k-1}\sim\mathcal{N}\!\left(\mu(z_{k-1}),\Sigma\right),\qquad\Sigma\succ 0,
(25)

and let r_{k}=E(z_{k-1},z_{k,\tau}) be any representation computed from the corrupted future state in Eq. 14. Then

\mathcal{L}_{z,r}\geq\mathbb{E}\!\left[\left\|z_{k}-\mathbb{E}[z_{k}\mid z_{k-1},z_{k,\tau}]\right\|_{2}^{2}\right].
(26)

Moreover, for any \tau>0,

\operatorname{Cov}(z_{k}\mid z_{k-1},z_{k,\tau})=\left(\Sigma^{-1}+\frac{(1-\tau)^{2}}{\tau^{2}}I\right)^{-1},
(27)

and therefore

\mathcal{L}_{z,r}\geq\operatorname{tr}\left[\left(\Sigma^{-1}+\frac{(1-\tau)^{2}}{\tau^{2}}I\right)^{-1}\right]>0.
(28)

Hence, at any non-zero corruption level, the clean future state cannot be transmitted perfectly through the transition representation r_{k}.

Proof.

Because r_{k} is computed from (z_{k-1},z_{k,\tau}), conditioning on (z_{k-1},r_{k}) cannot provide more information about z_{k} than conditioning directly on (z_{k-1},z_{k,\tau}). Therefore,

\mathcal{L}_{z,r}\geq\mathbb{E}\!\left[\left\|z_{k}-\mathbb{E}[z_{k}\mid z_{k-1},z_{k,\tau}]\right\|_{2}^{2}\right].
(29)

Under the Gaussian assumption in Eq. 25 and the corruption process in Eq. 14, standard Gaussian conditioning gives

\operatorname{Cov}(z_{k}\mid z_{k-1},z_{k,\tau})=\left(\Sigma^{-1}+\frac{(1-\tau)^{2}}{\tau^{2}}I\right)^{-1}.
(30)

The minimum mean-squared prediction error is the trace of this conditional covariance. Since \Sigma\succ 0 and \tau>0, the conditional covariance is positive definite, yielding the strictly positive lower bound in Eq. 28. ∎

Together, Propositions A.1 and A.2 characterize the complementary roles of the transition representation and future-state corruption. Future prediction encourages the Action-DiT pathway to capture information about the transition beyond what is available from the preceding state, while future corruption prevents the objective from being solved by the trivial shortcut of directly transmitting the clean prediction target.

Appendix B Additional Implementation Details

This section provides additional implementation details for native action-prior pre-training, downstream post-training, benchmark evaluation, and action-only inference.

B.1 Native Action-Prior Pre-training

Pre-training data.

We train on 235{,}790 observation-only manipulation episodes totaling 1{,}054.3 hours of video from Open X-Embodiment (O’Neill et al., 2024), AgiBotWorld (Bu et al., 2025a), and EgoDex (Hoque et al., 2026). For AgiBotWorld and EgoDex, we follow the OSCAR curation procedure (Wu and Gao, 2026), filtering short or low-quality interactions based on camera motion, manipulator activity, and hand visibility, followed by near-duplicate removal using visual and manipulator-trajectory similarity. Videos are divided into non-overlapping 65-frame clips, rendered on a 448\times 448 canvas, and temporally subsampled with a stride of 4, yielding approximately 1.41M training clips. Each clip is encoded by the frozen spatiotemporal VAE into five latent blocks, resulting in approximately 7.0M latent blocks for pre-training.

Optimization.

Native action-prior pre-training uses only the future-video flow-matching objective in Eq. 7. As described in Sec. 3.2, the Video-DiT, text encoder, and VAE remain frozen, while only the Action-DiT is optimized. We train for 14{,}000 optimization steps on 128 GPUs using bf16 mixed precision and AdamW with \beta_{1}=0.9, \beta_{2}=0.95, and weight decay 10^{-2}. We use a fixed learning rate of 1\times 10^{-4} and a global batch size of 512.

Table 3: Downstream training hyperparameters on LIBERO. We first perform action-free target-domain cold start and subsequently jointly post-train the Video-DiT and Action-DiT using action-labeled demonstrations.
  • Trainable
    Cold Start
    Video-DiT
    Joint Post-training
    Video-DiT + Action-DiT
  • Action horizon
    Cold Start
    —
    Joint Post-training
    16
  • Learning rate
    Cold Start
    4\times 10^{-5} (video)
    Joint Post-training
    1\times 10^{-4} (video), 2\times 10^{-4} (action)
  • Epochs
    Cold Start
    5
    Joint Post-training
    10
  • Scheduler
    Cold Start
    cosine, 5\% warm-up
    Joint Post-training
    Keine Daten
  • Global batch size
    Cold Start
    256
    Joint Post-training
    Keine Daten
  • Observation
    Cold Start
    224\times 448 composite (agent-view + wrist-view)
    Joint Post-training
    Keine Daten
Table 4: Downstream training hyperparameters on RoboTwin 2.0. We first perform action-free target-domain cold start and subsequently jointly post-train the Video-DiT and Action-DiT using Clean-domain demonstrations.
  • Trainable
    Cold Start
    Video-DiT
    Joint Post-training
    Video-DiT + Action-DiT
  • Action horizon
    Cold Start
    —
    Joint Post-training
    16
  • Learning rate
    Cold Start
    2\times 10^{-4} (video)
    Joint Post-training
    1\times 10^{-4} (video), 3\times 10^{-4} (action)
  • Epochs
    Cold Start
    1
    Joint Post-training
    5
  • Scheduler
    Cold Start
    cosine, 5\% warm-up
    Joint Post-training
    Keine Daten
  • Global batch size
    Cold Start
    1024
    Joint Post-training
    Keine Daten
  • Observation
    Cold Start
    384\times 320 composite (head-view + two wrist-views)
    Joint Post-training
    Keine Daten

B.2 Downstream Post-training

For downstream adaptation, we first perform an action-free cold start to adapt the Video-DiT to the target visual domain, following Chen et al. (2026c). During this stage, the pretrained Action-DiT remains frozen, while the Video-DiT is optimized using future-video flow matching on target-domain videos without action labels. This stage serves solely as target-domain visual initialization and introduces no additional action supervision. We then unfreeze both experts and jointly post-train the Video-DiT and Action-DiT using Eq. 11 with \lambda_{v}=\lambda_{a}=1.

For both LIBERO and RoboTwin 2.0, downstream training is initialized from the same checkpoint pretrained with native action-prior learning. Benchmark-specific cold-start and joint post-training configurations are summarized in Tabs. 3 and 4, respectively.

B.3 Detailed Transition-Structured Attention Masks

Fig. 7 provides a detailed visualization of the transition-structured attention masks introduced in Sec. 3.2. For a sequence of visual transitions, we construct one segment for each transition, where segment k contains the clean preceding state z_{k-1}, the noised future state z_{k,\tau_{v}}, and the corresponding Action-DiT token group x_{k}^{a}. Different segments are fully isolated from one another, ensuring that each segment models its corresponding transition without accessing information from other transitions.

Within each segment, the clean preceding-state queries attend only to themselves. During pre-training, the noised-future and action-token queries attend to all token groups within the segment, allowing future-video supervision to propagate through the Action-DiT. During post-training, noised-future video queries attend only to visual tokens, while action queries retain access to both visual and action tokens, yielding the asymmetric interaction described in Sec. 3.3.

Figure 7: Transition-structured attention masks. The pre-training mask (left) and post-training mask (right) are shown for three consecutive transition segments S_{1}–S_{3}. Each segment contains a clean preceding visual state, a noised future state, and the corresponding Action-DiT tokens, with attention isolated across segments. Pre-training allows noised-future and action-token queries to attend to all tokens within their segment, whereas during post-training, noised-future video queries attend only to visual tokens.

B.4 Benchmark and Evaluation Details

Baselines.

We compare NAVA-WAM with representative action policies and recent world action models reported in Tab. 1. For RoboTwin 2.0, baseline results follow the Clean-to-Random evaluation reported by MV-WAM (Chen et al., 2026c). Unless otherwise specified, all other baseline results are taken from the corresponding papers.

LIBERO.

LIBERO (Liu et al., 2023) is built on the robosuite simulator and comprises four task suites covering different manipulation and generalization settings. LIBERO-Spatial varies the spatial relationships between objects, LIBERO-Object varies the object category to be manipulated, and LIBERO-Goal fixes the objects and their spatial arrangement while varying the task goal. The fourth suite, LIBERO-Long, focuses on long-horizon tasks that combine these factors. Each suite contains ten tasks with 50 demonstrations per task. Following the standard protocol (Zhang et al., 2026e; Yuan et al., 2026), we train a single multi-task policy on all 40 tasks using 50 demonstrations per task, totaling 2{,}000 trajectories, and evaluate each task over 50 rollouts with a 7-D action space.

LIBERO-Plus.

LIBERO-Plus (Fei et al., 2025) reconstructs the 40 LIBERO evaluation tasks under controlled perturbations along seven factors: object layout, camera viewpoints, robot initial states, language instructions, lighting conditions, background textures, and sensor noise. The full benchmark comprises 10{,}030 test-only task instances. We use no LIBERO-Plus trajectories for training and directly evaluate the policy post-trained on the original LIBERO demonstrations. Following Zhang et al. (2026e), we perform one rollout per instance and report the macro-averaged success rate across perturbation types and task suites in Sec. C.3.

RoboTwin 2.0.

RoboTwin 2.0 (Chen et al., 2025a) provides bimanual manipulation tasks under Clean and domain-randomized conditions. It applies structured domain randomization along five axes: task-irrelevant distractor objects, background textures, lighting conditions, tabletop height, and language instructions. We evaluate the 50-task multi-task setting and, following Chen et al. (2026c), train exclusively on 50 Clean-domain demonstrations per task, totaling 2{,}500 action-labeled trajectories. No Random-domain demonstrations are used for training, making the Random domain an OOD evaluation relative to Clean-domain training. We evaluate 100 rollouts per task under both conditions with a 14-D action space.

B.5 Action-Only Inference

The asymmetric transition attention introduced in Sec. 3.3 makes the Video-DiT independent of the evolving action sample, allowing its representations to be reused across action-denoising steps. At each replanning step, we initialize the future-video and action streams with independent Gaussian noise and perform a single joint forward pass at \tau_{v}=\tau_{a}=1. During this pass, we cache the layer-wise Video-DiT keys and values. All subsequent denoising steps evaluate only the Action-DiT while reusing the cached visual representations.

We integrate the action flow using S=10 uniform Euler steps for both LIBERO and RoboTwin 2.0. The future-video latent is neither iteratively denoised nor decoded, and the visual cache is recomputed once at each replanning step. Algorithm 1 summarizes the inference procedure.

Algorithm 1 Action-only inference with cached Video-DiT representations

Appendix C Additional Experimental Results

This section provides additional analyses of native action-prior pre-training, qualitative visualizations of learned transition priors, detailed benchmark breakdowns, and RoboTwin 2.0 policy rollouts.

C.1 Analysis of Native Action-Prior Pre-training

Figure 8: Native action-prior pre-training dynamics. Training and held-out future-video flow-matching losses over pre-training. The training curve shows the raw per-step loss (faint) and its exponential moving average (solid), while the held-out loss is evaluated periodically without smoothing. Figure 9: Future-video prediction after native action-prior pre-training. Predictions on four held-out egocentric manipulation clips. Each example shows the ground-truth sequence (GT) and the corresponding prediction from NAVA-WAM (Ours) across block stacking, two-handed assembly, cloth folding, and card manipulation.
Pre-training dynamics.

Fig. 9 shows the training and held-out future-video flow-matching losses throughout native action-prior pre-training. Both losses decrease rapidly during the first few thousand optimization steps and continue to decline gradually thereafter, indicating stable optimization.

Figure 10: Additional qualitative visualizations of motion transfer across domains. Each example transfers the transition encoded by a source pair (Source: current \rightarrow Source: next) to a different target observation. The source transition specifies the underlying motion cue (orange arrows), which is applied to Target: current to obtain Target: transfer. The Overlay visualizes the transferred state relative to the current target observation, while Target: real shows the corresponding real transition (blue arrows). Across simulation, real-world, and sim-to-real examples, the transferred states follow the source motion despite substantial changes in visual appearance and scene configuration.
Future-video prediction.

Fig. 9 visualizes future-video predictions on held-out egocentric manipulation clips after native action-prior pre-training. Each temporally subsampled clip contains 17 frames and is encoded into 5 VAE latent blocks. The first block is kept clean, while each subsequent block is independently denoised from Gaussian noise using 10 flow-matching steps. The predictions show that the model captures both hand motion and the evolution of manipulated objects across diverse interactions, indicating that the pretrained Action-DiT effectively supports visual-transition prediction.

C.2 Qualitative Analysis of Learned Transition Priors

Fig. 10 provides additional motion-transfer examples complementing Fig. 5. Across source–target pairs with substantial differences in scene appearance, layout, and camera viewpoint, the transferred target states follow the motion specified by the corresponding source transitions in simulation, real-world, and sim-to-real settings. These examples suggest that the pretrained Action-DiT captures transition-relevant action information that transfers across visual domains.

C.3 Detailed Benchmark Results

We report per-suite, per-perturbation, and per-task results underlying the aggregate success rates in Tab. 1.

LIBERO.

Tab. 5 reports success rates across the four LIBERO suites. NAVA-WAM performs consistently across all suites and achieves 99.0\% success on LIBERO-Long, where several compared methods show their largest performance drop.

Table 5: Per-suite success rates (%) on LIBERO. All methods are trained on 50 demonstrations per task and evaluated over 50 rollouts per task. Avg. denotes the macro-average across the four task suites. Baselines with available per-suite results are reported. The best result in each column is shown in bold.
  • Direct action policies
    Spatial
    Keine Daten
    Object
    Keine Daten
    Goal
    Keine Daten
    Long
    Keine Daten
    Avg.
    Keine Daten
  • \pi_{0} (2024a)
    Spatial
    96.8
    Object
    98.8
    Goal
    95.8
    Long
    85.2
    Avg.
    94.1
  • \pi_{0.5} (2025)
    Spatial
    98.8
    Object
    98.2
    Goal
    98.0
    Long
    92.4
    Avg.
    96.9
  • World action models
    Spatial
    Keine Daten
    Object
    Keine Daten
    Goal
    Keine Daten
    Long
    Keine Daten
    Avg.
    Keine Daten
  • Fast-WAM (2026)
    Spatial
    98.2
    Object
    100.0
    Goal
    97.0
    Long
    95.2
    Avg.
    97.6
  • Image-WAM (2026e)
    Spatial
    97.2
    Object
    99.2
    Goal
    98.8
    Long
    98.4
    Avg.
    98.4
  • NAVA-WAM
    Spatial
    98.8
    Object
    99.6
    Goal
    98.6
    Long
    99.0
    Avg.
    99.0
Table 6: Per-perturbation success rates (%) on LIBERO-Plus. Each column averages over the four LIBERO task suites, and Avg. denotes the macro-average across the seven perturbation types. No LIBERO-Plus trajectories are used for training. The best result in each column is shown in bold.
  • \pi_{0} (2024a)
    Camera
    13.8
    Robot
    6.0
    Language
    58.8
    Light
    85.0
    Background
    81.4
    Noise
    79.0
    Layout
    68.9
    Avg.
    53.6
  • \pi_{0}-FAST (2025)
    Camera
    65.1
    Robot
    21.6
    Language
    61.0
    Light
    73.2
    Background
    73.2
    Noise
    74.4
    Layout
    68.8
    Avg.
    61.6
  • Fast-WAM (2026)
    Camera
    16.4
    Robot
    44.5
    Language
    68.9
    Light
    78.2
    Background
    53.7
    Noise
    37.7
    Layout
    60.7
    Avg.
    51.5
  • Image-WAM (2026e)
    Camera
    80.8
    Robot
    50.3
    Language
    91.4
    Light
    98.1
    Background
    85.5
    Noise
    93.8
    Layout
    80.5
    Avg.
    83.1
  • NAVA-WAM
    Camera
    72.8
    Robot
    65.6
    Language
    93.8
    Light
    97.9
    Background
    82.8
    Noise
    84.8
    Layout
    87.1
    Avg.
    83.5
LIBERO-Plus.

Tab. 6 reports success rates across the seven LIBERO-Plus perturbation types, with baseline results taken from Zhang et al. (2026e). NAVA-WAM performs best on robot-initialization, language, and object-layout shifts, reaching 65.6\%, 93.8\%, and 87.1\%, respectively. Image-WAM performs better on camera, lighting, background, and sensor-noise perturbations. Overall, NAVA-WAM achieves the highest macro-average success rate, demonstrating strong out-of-domain generalization across diverse perturbations.

RoboTwin 2.0.

Tab. 7 reports success rates across all 50 RoboTwin 2.0 tasks. NAVA-WAM achieves the best or tied-best Random-domain performance on 44 of the 50 tasks and the best or tied-best Clean-domain performance on 32 tasks. Its aggregate Clean-to-Random performance drop is also substantially smaller than those of the compared baselines, indicating stronger robustness to the Random-domain shift.

Table 7: Per-task success rates (%) on RoboTwin 2.0. All methods are trained exclusively on Clean-domain demonstrations and evaluated in both the Clean and Random (Rand.) domains. Baseline per-task results are taken from MV-WAM (Chen et al., 2026c). The final row reports the average across all 50 tasks. The best result for each task and domain is shown in bold.
  • —
    DP
    Clean
    Rand.
    RDT
    Clean
    Rand.
    \pi_{0}
    Clean
    Rand.
    UP-VLA
    Clean
    Rand.
    BagelVLA
    Clean
    Rand.
    HALO
    Clean
    Rand.
    Fast-WAM
    Clean
    Rand.
    MV-WAM
    Clean
    Rand.
    Ours
    Clean
    Rand.
  • Adjust Bottle
    DP
    97.0
    0.0
    RDT
    81.0
    75.0
    \pi_{0}
    90.0
    56.0
    UP-VLA
    100.0
    17.0
    BagelVLA
    100.0
    14.0
    HALO
    97.0
    9.0
    Fast-WAM
    95.0
    0.0
    MV-WAM
    83.0
    65.0
    Ours
    100.0
    97.5
  • Beat Block Hammer
    DP
    42.0
    0.0
    RDT
    77.0
    37.0
    \pi_{0}
    43.0
    21.0
    UP-VLA
    66.0
    16.0
    BagelVLA
    87.0
    16.0
    HALO
    96.0
    11.0
    Fast-WAM
    74.0
    2.0
    MV-WAM
    75.0
    53.0
    Ours
    100.0
    42.5
  • Blocks Ranking RGB
    DP
    0.0
    0.0
    RDT
    3.0
    0.0
    \pi_{0}
    19.0
    5.0
    UP-VLA
    38.0
    0.0
    BagelVLA
    84.0
    4.0
    HALO
    94.0
    7.0
    Fast-WAM
    0.0
    1.0
    MV-WAM
    99.0
    88.0
    Ours
    100.0
    92.5
  • Blocks Ranking Size
    DP
    1.0
    0.0
    RDT
    0.0
    0.0
    \pi_{0}
    7.0
    1.0
    UP-VLA
    21.0
    0.0
    BagelVLA
    45.0
    2.0
    HALO
    58.0
    2.0
    Fast-WAM
    38.0
    0.0
    MV-WAM
    63.0
    43.0
    Ours
    70.0
    60.0
  • Click Alarmclock
    DP
    61.0
    5.0
    RDT
    61.0
    12.0
    \pi_{0}
    63.0
    11.0
    UP-VLA
    69.0
    41.0
    BagelVLA
    85.0
    20.0
    HALO
    83.0
    14.0
    Fast-WAM
    100.0
    38.0
    MV-WAM
    90.0
    24.0
    Ours
    100.0
    100.0
  • Click Bell
    DP
    54.0
    0.0
    RDT
    80.0
    9.0
    \pi_{0}
    44.0
    3.0
    UP-VLA
    54.0
    72.0
    BagelVLA
    100.0
    35.0
    HALO
    100.0
    10.0
    Fast-WAM
    100.0
    22.0
    MV-WAM
    95.0
    43.0
    Ours
    100.0
    90.0
  • Dump Bin Bigbin
    DP
    49.0
    0.0
    RDT
    64.0
    32.0
    \pi_{0}
    83.0
    24.0
    UP-VLA
    81.0
    35.0
    BagelVLA
    91.0
    51.0
    HALO
    93.0
    28.0
    Fast-WAM
    96.0
    3.0
    MV-WAM
    92.0
    61.0
    Ours
    97.5
    77.5
  • Grab Roller
    DP
    98.0
    0.0
    RDT
    74.0
    43.0
    \pi_{0}
    96.0
    80.0
    UP-VLA
    99.0
    28.0
    BagelVLA
    99.0
    41.0
    HALO
    95.0
    57.0
    Fast-WAM
    95.0
    4.0
    MV-WAM
    100.0
    94.0
    Ours
    100.0
    100.0
  • Handover Block
    DP
    10.0
    0.0
    RDT
    45.0
    14.0
    \pi_{0}
    45.0
    8.0
    UP-VLA
    4.0
    0.0
    BagelVLA
    38.0
    0.0
    HALO
    81.0
    36.0
    Fast-WAM
    5.0
    0.0
    MV-WAM
    83.0
    19.0
    Ours
    82.5
    70.0
  • Handover Mic
    DP
    53.0
    0.0
    RDT
    90.0
    31.0
    \pi_{0}
    98.0
    13.0
    UP-VLA
    45.0
    0.0
    BagelVLA
    75.0
    8.0
    HALO
    96.0
    61.0
    Fast-WAM
    100.0
    0.0
    MV-WAM
    99.0
    86.0
    Ours
    95.0
    100.0
  • Hanging Mug
    DP
    8.0
    0.0
    RDT
    23.0
    16.0
    \pi_{0}
    11.0
    3.0
    UP-VLA
    4.0
    0.0
    BagelVLA
    12.0
    1.0
    HALO
    48.0
    5.0
    Fast-WAM
    32.0
    0.0
    MV-WAM
    46.0
    16.0
    Ours
    45.0
    27.5
  • Lift Pot
    DP
    39.0
    0.0
    RDT
    72.0
    9.0
    \pi_{0}
    84.0
    36.0
    UP-VLA
    20.0
    0.0
    BagelVLA
    87.0
    32.0
    HALO
    95.0
    34.0
    Fast-WAM
    89.0
    0.0
    MV-WAM
    100.0
    46.0
    Ours
    97.5
    60.0
  • Move Can Pot
    DP
    39.0
    0.0
    RDT
    25.0
    12.0
    \pi_{0}
    58.0
    21.0
    UP-VLA
    48.0
    0.0
    BagelVLA
    78.0
    0.0
    HALO
    94.0
    15.0
    Fast-WAM
    85.0
    7.0
    MV-WAM
    87.0
    24.0
    Ours
    95.0
    25.0
  • Move Pillbottle Pad
    DP
    1.0
    0.0
    RDT
    8.0
    0.0
    \pi_{0}
    21.0
    1.0
    UP-VLA
    51.0
    7.0
    BagelVLA
    92.0
    1.0
    HALO
    76.0
    26.0
    Fast-WAM
    92.0
    1.0
    MV-WAM
    90.0
    34.0
    Ours
    100.0
    85.0
  • Move Playingcard Away
    DP
    47.0
    0.0
    RDT
    43.0
    11.0
    \pi_{0}
    53.0
    22.0
    UP-VLA
    79.0
    13.0
    BagelVLA
    92.0
    30.0
    HALO
    89.0
    53.0
    Fast-WAM
    99.0
    2.0
    MV-WAM
    98.0
    89.0
    Ours
    100.0
    92.5
  • Move Stapler Pad
    DP
    1.0
    0.0
    RDT
    2.0
    0.0
    \pi_{0}
    0.0
    2.0
    UP-VLA
    8.0
    0.0
    BagelVLA
    27.0
    0.0
    HALO
    45.0
    19.0
    Fast-WAM
    35.0
    0.0
    MV-WAM
    24.0
    11.0
    Ours
    65.0
    47.5
  • Open Laptop
    DP
    49.0
    0.0
    RDT
    59.0
    32.0
    \pi_{0}
    85.0
    46.0
    UP-VLA
    86.0
    21.0
    BagelVLA
    96.0
    37.0
    HALO
    89.0
    37.0
    Fast-WAM
    90.0
    8.0
    MV-WAM
    94.0
    59.0
    Ours
    92.5
    67.5
  • Open Microwave
    DP
    5.0
    0.0
    RDT
    37.0
    20.0
    \pi_{0}
    80.0
    50.0
    UP-VLA
    2.0
    7.0
    BagelVLA
    0.0
    0.0
    HALO
    86.0
    24.0
    Fast-WAM
    44.0
    1.0
    MV-WAM
    50.0
    2.0
    Ours
    35.0
    5.0
  • Pick Diverse Bottles
    DP
    6.0
    0.0
    RDT
    2.0
    0.0
    \pi_{0}
    27.0
    6.0
    UP-VLA
    52.0
    18.0
    BagelVLA
    83.0
    34.0
    HALO
    76.0
    17.0
    Fast-WAM
    69.0
    4.0
    MV-WAM
    81.0
    50.0
    Ours
    90.0
    57.5
  • Pick Dual Bottles
    DP
    24.0
    0.0
    RDT
    42.0
    13.0
    \pi_{0}
    57.0
    12.0
    UP-VLA
    82.0
    31.0
    BagelVLA
    93.0
    56.0
    HALO
    82.0
    30.0
    Fast-WAM
    76.0
    9.0
    MV-WAM
    93.0
    56.0
    Ours
    100.0
    75.0
  • Place A2B Left
    DP
    2.0
    0.0
    RDT
    3.0
    1.0
    \pi_{0}
    31.0
    1.0
    UP-VLA
    74.0
    4.0
    BagelVLA
    79.0
    12.0
    HALO
    68.0
    8.0
    Fast-WAM
    76.0
    1.0
    MV-WAM
    90.0
    69.0
    Ours
    95.0
    77.5
  • Place A2B Right
    DP
    13.0
    0.0
    RDT
    1.0
    1.0
    \pi_{0}
    27.0
    6.0
    UP-VLA
    56.0
    1.0
    BagelVLA
    81.0
    11.0
    HALO
    52.0
    9.0
    Fast-WAM
    84.0
    3.0
    MV-WAM
    87.0
    68.0
    Ours
    92.5
    90.0
  • Place Bread Basket
    DP
    14.0
    0.0
    RDT
    10.0
    2.0
    \pi_{0}
    17.0
    4.0
    UP-VLA
    63.0
    20.0
    BagelVLA
    90.0
    29.0
    HALO
    90.0
    26.0
    Fast-WAM
    96.0
    4.0
    MV-WAM
    92.0
    71.0
    Ours
    92.5
    90.0
  • Place Bread Skillet
    DP
    11.0
    0.0
    RDT
    5.0
    1.0
    \pi_{0}
    23.0
    1.0
    UP-VLA
    71.0
    16.0
    BagelVLA
    91.0
    26.0
    HALO
    85.0
    23.0
    Fast-WAM
    85.0
    3.0
    MV-WAM
    90.0
    60.0
    Ours
    92.5
    87.5
  • Place Burger Fries
    DP
    72.0
    0.0
    RDT
    50.0
    27.0
    \pi_{0}
    80.0
    4.0
    UP-VLA
    97.0
    26.0
    BagelVLA
    99.0
    11.0
    HALO
    99.0
    37.0
    Fast-WAM
    96.0
    8.0
    MV-WAM
    90.0
    79.0
    Ours
    100.0
    100.0
  • Place Can Basket
    DP
    18.0
    0.0
    RDT
    19.0
    6.0
    \pi_{0}
    41.0
    5.0
    UP-VLA
    20.0
    0.0
    BagelVLA
    63.0
    0.0
    HALO
    68.0
    34.0
    Fast-WAM
    58.0
    0.0
    MV-WAM
    80.0
    44.0
    Ours
    80.0
    60.0
  • Place Cans Plasticbox
    DP
    40.0
    0.0
    RDT
    6.0
    5.0
    \pi_{0}
    34.0
    2.0
    UP-VLA
    66.0
    24.0
    BagelVLA
    94.0
    5.0
    HALO
    98.0
    47.0
    Fast-WAM
    93.0
    2.0
    MV-WAM
    99.0
    48.0
    Ours
    97.5
    90.0
  • Place Container Plate
    DP
    41.0
    0.0
    RDT
    78.0
    17.0
    \pi_{0}
    88.0
    45.0
    UP-VLA
    86.0
    48.0
    BagelVLA
    100.0
    58.0
    HALO
    96.0
    22.0
    Fast-WAM
    98.0
    17.0
    MV-WAM
    96.0
    86.0
    Ours
    97.5
    77.5
  • Place Dual Shoes
    DP
    8.0
    0.0
    RDT
    4.0
    4.0
    \pi_{0}
    15.0
    0.0
    UP-VLA
    45.0
    0.0
    BagelVLA
    57.0
    0.0
    HALO
    15.0
    3.0
    Fast-WAM
    24.0
    0.0
    MV-WAM
    42.0
    24.0
    Ours
    80.0
    52.5
  • Place Empty Cup
    DP
    37.0
    0.0
    RDT
    56.0
    7.0
    \pi_{0}
    37.0
    11.0
    UP-VLA
    74.0
    27.0
    BagelVLA
    97.0
    34.0
    HALO
    95.0
    28.0
    Fast-WAM
    98.0
    10.0
    MV-WAM
    92.0
    86.0
    Ours
    100.0
    85.0
  • Place Fan
    DP
    3.0
    0.0
    RDT
    12.0
    2.0
    \pi_{0}
    20.0
    10.0
    UP-VLA
    31.0
    1.0
    BagelVLA
    62.0
    5.0
    HALO
    62.0
    9.0
    Fast-WAM
    75.0
    1.0
    MV-WAM
    76.0
    42.0
    Ours
    85.0
    80.0
  • Place Mouse Pad
    DP
    0.0
    0.0
    RDT
    1.0
    0.0
    \pi_{0}
    7.0
    1.0
    UP-VLA
    27.0
    0.0
    BagelVLA
    46.0
    14.0
    HALO
    51.0
    12.0
    Fast-WAM
    71.0
    0.0
    MV-WAM
    73.0
    34.0
    Ours
    85.0
    57.5
  • Place Object Basket
    DP
    15.0
    0.0
    RDT
    33.0
    17.0
    \pi_{0}
    16.0
    2.0
    UP-VLA
    56.0
    1.0
    BagelVLA
    66.0
    3.0
    HALO
    89.0
    25.0
    Fast-WAM
    50.0
    2.0
    MV-WAM
    93.0
    78.0
    Ours
    80.0
    65.0
  • Place Object Scale
    DP
    1.0
    0.0
    RDT
    1.0
    0.0
    \pi_{0}
    10.0
    0.0
    UP-VLA
    36.0
    4.0
    BagelVLA
    71.0
    0.0
    HALO
    55.0
    5.0
    Fast-WAM
    80.0
    0.0
    MV-WAM
    91.0
    53.0
    Ours
    82.5
    77.5
  • Place Object Stand
    DP
    22.0
    0.0
    RDT
    15.0
    5.0
    \pi_{0}
    36.0
    11.0
    UP-VLA
    76.0
    24.0
    BagelVLA
    87.0
    21.0
    HALO
    84.0
    33.0
    Fast-WAM
    95.0
    12.0
    MV-WAM
    93.0
    72.0
    Ours
    97.5
    75.0
  • Place Phone Stand
    DP
    13.0
    0.0
    RDT
    15.0
    6.0
    \pi_{0}
    35.0
    7.0
    UP-VLA
    32.0
    0.0
    BagelVLA
    61.0
    2.0
    HALO
    91.0
    10.0
    Fast-WAM
    85.0
    0.0
    MV-WAM
    79.0
    52.0
    Ours
    85.0
    72.5
  • Place Shoe
    DP
    23.0
    0.0
    RDT
    35.0
    7.0
    \pi_{0}
    28.0
    6.0
    UP-VLA
    76.0
    12.0
    BagelVLA
    90.0
    29.0
    HALO
    70.0
    18.0
    Fast-WAM
    83.0
    7.0
    MV-WAM
    91.0
    79.0
    Ours
    95.0
    97.5
  • Press Stapler
    DP
    6.0
    0.0
    RDT
    41.0
    24.0
    \pi_{0}
    62.0
    29.0
    UP-VLA
    79.0
    56.0
    BagelVLA
    94.0
    58.0
    HALO
    92.0
    64.0
    Fast-WAM
    58.0
    19.0
    MV-WAM
    99.0
    45.0
    Ours
    90.0
    67.5
  • Put Bottles Dustbin
    DP
    22.0
    0.0
    RDT
    21.0
    4.0
    \pi_{0}
    54.0
    13.0
    UP-VLA
    7.0
    0.0
    BagelVLA
    42.0
    10.0
    HALO
    80.0
    13.0
    Fast-WAM
    83.0
    2.0
    MV-WAM
    93.0
    43.0
    Ours
    87.5
    75.0
  • Put Object Cabinet
    DP
    42.0
    0.0
    RDT
    33.0
    18.0
    \pi_{0}
    68.0
    18.0
    UP-VLA
    7.0
    0.0
    BagelVLA
    52.0
    0.0
    HALO
    59.0
    8.0
    Fast-WAM
    41.0
    0.0
    MV-WAM
    45.0
    25.0
    Ours
    50.0
    37.5
  • Rotate QRcode
    DP
    13.0
    0.0
    RDT
    50.0
    5.0
    \pi_{0}
    68.0
    15.0
    UP-VLA
    56.0
    2.0
    BagelVLA
    81.0
    21.0
    HALO
    69.0
    11.0
    Fast-WAM
    76.0
    0.0
    MV-WAM
    79.0
    40.0
    Ours
    90.0
    70.0
  • Scan Object
    DP
    9.0
    0.0
    RDT
    4.0
    1.0
    \pi_{0}
    18.0
    1.0
    UP-VLA
    47.0
    23.0
    BagelVLA
    77.0
    32.0
    HALO
    73.0
    24.0
    Fast-WAM
    77.0
    4.0
    MV-WAM
    81.0
    59.0
    Ours
    85.0
    67.5
  • Shake Bottle Horizontally
    DP
    59.0
    18.0
    RDT
    84.0
    51.0
    \pi_{0}
    99.0
    51.0
    UP-VLA
    100.0
    68.0
    BagelVLA
    100.0
    73.0
    HALO
    100.0
    66.0
    Fast-WAM
    100.0
    41.0
    MV-WAM
    100.0
    97.0
    Ours
    100.0
    100.0
  • Shake Bottle
    DP
    65.0
    8.0
    RDT
    74.0
    45.0
    \pi_{0}
    97.0
    60.0
    UP-VLA
    98.0
    54.0
    BagelVLA
    100.0
    74.0
    HALO
    98.0
    73.0
    Fast-WAM
    100.0
    49.0
    MV-WAM
    100.0
    98.0
    Ours
    100.0
    100.0
  • Stack Blocks Three
    DP
    0.0
    0.0
    RDT
    2.0
    0.0
    \pi_{0}
    17.0
    0.0
    UP-VLA
    8.0
    0.0
    BagelVLA
    45.0
    5.0
    HALO
    96.0
    37.0
    Fast-WAM
    0.0
    0.0
    MV-WAM
    97.0
    51.0
    Ours
    97.5
    87.5
  • Stack Blocks Two
    DP
    7.0
    0.0
    RDT
    21.0
    2.0
    \pi_{0}
    42.0
    1.0
    UP-VLA
    61.0
    0.0
    BagelVLA
    95.0
    6.0
    HALO
    100.0
    60.0
    Fast-WAM
    2.0
    0.0
    MV-WAM
    100.0
    75.0
    Ours
    100.0
    95.0
  • Stack Bowls Three
    DP
    63.0
    0.0
    RDT
    51.0
    17.0
    \pi_{0}
    66.0
    24.0
    UP-VLA
    42.0
    1.0
    BagelVLA
    63.0
    13.0
    HALO
    92.0
    25.0
    Fast-WAM
    77.0
    1.0
    MV-WAM
    86.0
    68.0
    Ours
    80.0
    62.5
  • Stack Bowls Two
    DP
    61.0
    0.0
    RDT
    76.0
    30.0
    \pi_{0}
    91.0
    41.0
    UP-VLA
    69.0
    12.0
    BagelVLA
    90.0
    52.0
    HALO
    98.0
    49.0
    Fast-WAM
    96.0
    11.0
    MV-WAM
    90.0
    81.0
    Ours
    97.5
    90.0
  • Stamp Seal
    DP
    2.0
    0.0
    RDT
    1.0
    0.0
    \pi_{0}
    3.0
    4.0
    UP-VLA
    34.0
    2.0
    BagelVLA
    77.0
    8.0
    HALO
    60.0
    21.0
    Fast-WAM
    68.0
    0.0
    MV-WAM
    73.0
    30.0
    Ours
    90.0
    52.5
  • Turn Switch
    DP
    36.0
    1.0
    RDT
    35.0
    15.0
    \pi_{0}
    27.0
    23.0
    UP-VLA
    43.0
    26.0
    BagelVLA
    49.0
    30.0
    HALO
    65.0
    27.0
    Fast-WAM
    56.0
    17.0
    MV-WAM
    62.0
    65.0
    Ours
    55.0
    67.5
  • Average
    DP
    28.0
    0.6
    RDT
    34.5
    13.7
    \pi_{0}
    46.4
    16.3
    UP-VLA
    52.9
    15.2
    BagelVLA
    75.3
    20.5
    HALO
    80.5
    26.4
    Fast-WAM
    71.9
    6.3
    MV-WAM
    84.0
    55.7
    Ours
    88.5
    73.6
Figure 11: Qualitative NAVA-WAM rollouts on RoboTwin 2.0. We show seven successful rollouts (top) spanning diverse manipulation skills and two representative failures (bottom). Each row contains four temporal keyframes, with the head-camera view on the left and the two wrist-camera views stacked on the right. The row header gives the RoboTwin task description, and the final keyframe is outlined in blue for success and red for failure. All examples are from the Random (OOD) domain.

C.4 Qualitative RoboTwin 2.0 Rollouts

Fig. 11 presents representative NAVA-WAM rollouts from the RoboTwin 2.0 Random domain. All examples are drawn from the same evaluation setting as Tab. 7, where the policy is trained exclusively on Clean-domain demonstrations and evaluated under domain randomization unseen during training. Each Random-domain rollout therefore constitutes an out-of-domain evaluation under variations in distractor objects, background textures, lighting, tabletop height, and language instructions. Videos of these rollouts are provided in our Project Page.

Successful rollouts.

The successful rollouts span diverse manipulation skills in RoboTwin 2.0. Handover Mic and Lift Pot require bimanual coordination, with the former transferring an object between the two arms and the latter synchronously lifting an object with both grippers. Place Dual Shoes combines bimanual manipulation with a terminal pose constraint, requiring both shoes to be placed inside the shoebox with the prescribed orientation. Place Bread Skillet requires precise single-arm placement into a small container, while Open Laptop requires manipulating an articulated object along its hinge. Blocks Ranking RGB and Stack Blocks Three are long-horizon multi-object tasks that require grounding color references and executing multiple consecutive pick-and-place operations without disturbing previously placed blocks. Across these tasks, NAVA-WAM completes the instructed behaviors despite substantial variation in distractors, appearance, and scene configuration.

Failure cases.

The two representative failures occur during fine-grained grasping and contact-rich manipulation. In Move Can Pot, the reaching motion knocks the can over instead of establishing a stable grasp; the arm then executes the transport motion with an empty gripper without re-attempting the grasp, and the episode eventually reaches its step limit. In Hanging Mug, the policy completes the initial pick sub-goal, lifting the mug with the left arm and placing it beside the rack, but the right arm fails to continue the task by lifting the mug onto the rack, and the episode eventually reaches its step limit.

Together, these cases suggest that failures can arise during fine-grained, contact-rich interactions even when the target object and overall task progression are correctly identified. In both examples, the policy fails to recover from a local execution error, causing it to propagate into task failure.

C.5 Real-Robot Evaluation Details

To evaluate real-world transfer, we further post-train NAVA-WAM on DROID (Khazatsky et al., 2024) and directly deploy the resulting policy on a physical Franka FR3 robot following Ye et al. (2026c). DROID is a large-scale in-the-wild manipulation dataset containing approximately 76K teleoperated trajectories across diverse tasks and environments. No additional fine-tuning is performed on the evaluation tasks or physical test environment.

Table 8: Real-robot success rates and inference cost. We report successful trials out of five runs per task on a Franka FR3, with Avg. denoting the success rate across all 15 trials. T1: move the cube to the left side of the bowl; T2: put the banana in the box; T3: put the blue cube on the red cube. ms / call denotes the server-side wall-clock latency per policy call on a single H100. The best result in each column is shown in bold.
  • Model
    ms / call \downarrow
    Successful trials \uparrow
    T1
    T2
    T3
    Avg (%) \uparrow
  • \pi_{0.5} (Physical Intelligence et al., 2025)
    195.7
    Successful trials \uparrow
    0/5
    5/5
    3/5
    53.3
  • DreamZero (Ye et al., 2026c)
    3523.9
    Successful trials \uparrow
    0/5
    5/5
    5/5
    66.7
  • NAVA-WAM
    379.2
    Successful trials \uparrow
    4/5
    5/5
    5/5
    93.3
DROID post-training.

Starting from the native action-prior pretrained checkpoint, we post-train NAVA-WAM on DROID following the training setup of DreamZero (Ye et al., 2026c). We use a global batch size of 256, a cosine learning-rate schedule with 5\% warm-up, and a learning rate of 5\times 10^{-5} for both experts. The policy predicts action chunks with a horizon of 32, and visual inputs are processed at a resolution of 352\times 640.

Deployment setup.

The policy receives one wrist-camera view and two third-person RGB views, composited into the same 352\times 640 visual input used during DROID post-training. NAVA-WAM predicts 32-step absolute joint-position action chunks, of which the first 24 steps are executed open-loop before replanning. The robot controller runs at 15 Hz, and each trial is capped at 1{,}000 control steps.

Tasks and baselines.

We evaluate three tabletop manipulation tasks with five trials per task: T1, move the cube to the left side of the bowl; T2, put the banana in the box; and T3, put the blue cube on the red cube. We compare against \pi_{0.5} (Physical Intelligence et al., 2025) and the released DreamZero-DROID checkpoint (Ye et al., 2026c). All policies use the same observation pipeline, communication protocol, and 15 Hz joint-position controller. The scene is manually reset to a random nominal layout before each trial. Each policy retains its own action parameterization and deployment horizon. \pi_{0.5} predicts 24 relative-action steps and executes the first 8 before replanning, DreamZero predicts and executes 24 absolute-action steps, and NAVA-WAM predicts 32 absolute-action steps and executes the first 24.

Detailed task analysis.

As summarized in Tab. 8, NAVA-WAM succeeds in 14 of 15 trials (93.3\%), compared with 10/15 (66.7\%) for DreamZero and 8/15 (53.3\%) for \pi_{0.5}. All three policies solve T2 in all five trials, showing that each policy can complete the basic manipulation under our deployment setup.

The largest difference occurs on T1, which requires grounding the instructed spatial relation: NAVA-WAM succeeds in 4/5 trials, whereas both baselines fail in all five trials. Inspection of the baseline rollouts suggests that these failures are not primarily caused by object localization or grasping. In all ten baseline trials, the cube is successfully localized and grasped, but neither baseline ultimately places it to the left of the bowl. DreamZero instead moves the cube toward the bowl and terminates with it either inside the bowl or still held above it, while \pi_{0.5} places the cube to the right of the bowl or inside it. On T3, both NAVA-WAM and DreamZero succeed in all five stacking trials, while \pi_{0.5} succeeds in three. In its two failed trials, \pi_{0.5} places the blue cube beside the red cube rather than on top of it. These results demonstrate that NAVA-WAM transfers effectively to physical robot deployment without task-specific fine-tuning.

Inference cost.

We additionally report the server-side latency of one policy call on a single H100. NAVA-WAM requires 379.2 ms per call, compared with 195.7 ms for \pi_{0.5} and 3523.9 ms for DreamZero. Because the policies execute different numbers of actions before replanning, per-call latency alone does not fully reflect the effective deployment cost. Normalizing by the number of executed actions per replanning step yields 15.8 ms per executed action for NAVA-WAM, 24.5 ms for \pi_{0.5}, and 146.8 ms for DreamZero.

Appendix D Limitations

First, NAVA-WAM can still struggle with challenging tasks that require precise grasping, complex interactions, and other fine-grained contact-rich manipulation. Fine-grained control and complex-instruction understanding therefore remain limitations that warrant further investigation. Second, the policy currently lacks an explicit mechanism for recovering from local execution errors. Developing mechanisms that enable the policy to identify such failures and recover during execution is an important direction for future work.