Encore、少数デモを探索の事前情報にするエージェント型ロボット操作政策
Encoreは、少数の遠隔操作デモを構造化エビデンスに変換し、コーディングエージェントが分析コードを書きながら政策プログラムを反復開発する枠組みである。LIBERO-PROの摂動60セルでK=3が96.3%、K=0が94.9%の封印済み成功率を達成し、実機のバイマニュアル2タスクでは各10試行中9成功した。本論文はプレプリントであり、デモがエージェントの探索を加速し戦略を伝達することを示した。
ロボティクスとフィジカルAIの最新論文と、それぞれが産業にもたらす意味。
Encoreは、少数の遠隔操作デモを構造化エビデンスに変換し、コーディングエージェントが分析コードを書きながら政策プログラムを反復開発する枠組みである。LIBERO-PROの摂動60セルでK=3が96.3%、K=0が94.9%の封印済み成功率を達成し、実機のバイマニュアル2タスクでは各10試行中9成功した。本論文はプレプリントであり、デモがエージェントの探索を加速し戦略を伝達することを示した。
arXivプレプリント。本研究は、ロボットの摩耗や可搬重量などに起因する実行誤差でVLAポリシーが失敗する問題に対し、命令と実行運動の残差を自己教師信号としてポリシーを展開時に適応させる自己補償型VLAを提案した。RoboStressという関節レベル誤差モデルを組み合わせたシミュレーションベンチマークで評価し、π0.5では平均成功率が49.1%から56.6%に、実機2台では各アームで30ポイント以上向上した。未見物体でも効果が確認された。
Embodied systems must make knowledge acquired during one encounter usable in another despite changes in viewpoint, motion, and illumination. Yet aggregate cross-video accuracy conflates failures of local perception with failures to preserve observation identity, establish correspondence, and compose evidence, obscuring whether local video understanding actually transfers.
We propose a QCQP-representable IMU pre-integration factor that enables certifiable estimation with pre-integrated inertial measurements. To the best of our knowledge, this is the first work to directly incorporate IMU pre-integration into certifiable estimation.
While contact-rich manipulation requires deliberate regulation of interaction forces, recent approaches to robot manipulation learning predominantly represent actions as target positions or poses. Even methods that incorporate force sensing either use it solely as an observation or, when predicting forces as part of the output, rely on a hybrid force controller.
Large language models (LLMs) are increasingly used as high-level planners in robot navigation, but their outputs may become unreliable when instructions are ambiguous, unsupported by the environment, or semantically inconsistent. This paper presents a Risk-Aware Semantic Grounding framework for trustworthy LLM-based robot planning.
In this preprint, the authors build an onboard perception pipeline that lets a lightweight Explorer robot find minerals in underground mines from free-text prompts and hand compact, oriented 3D inspection targets to a heavier Inspector robot. Field tests in a test mine and an active magnesite mine detected two mineral types without retraining and condensed about 38,000 raw mineral points into a few dozen polygons, roughly two orders of magnitude smaller. This matters because autonomous mining inspection requires no mine-specific labels and low-bandwidth robot-to-robot handover.
Vision-language models can coordinate long-horizon robot manipulation, yet successful task reasoning still depends on whether local physical interactions produce the intended effects. We study how repeated interaction can improve this capability without updating the base model.
Grinding and sanding are fundamental processes in industrial robotic surface finishing. However, physical trials are expensive and consume workpieces, making reproducible experiments difficult.
Robots deployed in the physical world must be able to improve beyond their initial training as they encounter new situations and failures. For this improvement to scale across tasks, it must make effective use of experience without requiring human demonstration of each correction.
Diffusion and flow-matching Vision-Language-Action (VLA) policies generate action chunks through iterative denoising, incurring substantial inference latency that severely limits real-time robotic control. Existing acceleration methods treat an action chunk as a monolithic computational unit, ignoring a crucial physical reality of receding-horizon control: actions are generated jointly but consumed sequentially, resulting in inherently heterogeneous execution urgencies.
Video-based policy learning is particularly promising, as it illustrates target behaviors without requiring action annotations or embodiment-matched demonstrations. A central challenge is deciding what information should be transferred from the video to the robot.
When interacting with an unfamiliar deformable material, a robot lacks prior knowledge of its physical properties and how it will respond to applied forces and motion. Rapid online identification is therefore essential for reliable manipulation.
Robotic foundation models (RFMs) are increasingly capable of general-purpose manipulation, yet reliable physical interaction remains challenging in contact-rich settings. We present FP2, a lightweight downstream interface that equips task-adapted RFMs with explicit force control while preserving their action-generation capability.
Simulated manipulation benchmarks are the standard tool for evaluating vision-language-action (VLA) policies and the acceleration methods that reduce their inference latency for on-robot deployment. On these benchmarks, we observe that some training-free acceleration methods, which approximate the baseline policy's computation, achieve higher measured success rates than the baseline itself.
World-action models (WAMs) jointly predict how a scene will evolve and how an agent should act, however joint generation alone does not necessarily impose a shared geometric constraint on these predictions. We present PhysWAM, a unified world-action model for autonomous driving that co-denoises multiview video, metric depth, and ego motion within a single flow-matching transformer.
Test-time adaptation for vision-language navigation (TTA-VLN) enables pretrained policies to adapt online to unseen environments using only test-time observations and interaction history. However, distribution shifts can distort local action preferences and lead to off-course decisions.
Improving robot policies on new tasks without collecting additional expert demonstrations remains a central challenge in robot learning. World action models (WAMs) use broad video priors to jointly predict future videos and actions, offering a potential source of supervision for adapting to new tasks.
DROMは、少数の専門家デモをDynamic Movement Primitivesで拡張し、単一の言語条件付き拡散モデルにより17種類のロボット操作スキルを学習・実行するフレームワークである。本論文はプレプリントであり、Franka Emika PandaとFANUC CRX25iaおよびMuJoCoシミュレーションで評価し、Motion Planning DiffusionとBehavior Cloningを上回る性能を示した。この手法は、限られたデータから複数スキルを獲得し、自然言語による長期タスク実行を可能にする点で産業応用に寄与する。
Vision-language-action (VLA) models typically operate on RGB images produced by a fixed camera image signal processor (ISP), leaving the imaging pipeline outside the learning and evaluation loop. We systematically examine the consequences of this overlooked design choice across five fundamental ISP dimensions: gain, sensor noise, chromatic response, tonal response, and bit depth.
論文は arXiv のロボティクス分野から取得しています。当社の要約が未作成の場合は、要旨の冒頭を表示します。