MEKAWIRE
研究

论文

机器人与具身智能领域的最新论文,以及每篇对产业的意义。

64 篇论文
主题全部Manipulation 62VLA 43Navigation 24Learning 23Robotics 22Perception 20Humanoid 13Safety 9Locomotion 8Simulation 8World Action Models 4World-action model 3Aerial 2Aerial manipulation 2Dexterous manipulation 2Sim-to-Real Manipulation 2Social Navigation 2Vision-Language Navigation 2World models 23D Assembly 13DGS dataset 15G Simulation 1AMR Operations 1Active vision manipulation 1Adaptive MPC 1Adaptive action horizons 1Adaptive intervention 1Aerial Manipulation 1Aerial navigation 1Agricultural Robotics 1Articulation Estimation 1Autonomous Driving 1Autonomous Exploration 1Battery-aware RL 1Belief-space planning 1Bimanual Manipulation 1Byzantine localization 1Canal inspection 1Co-speech Humanoid 1Compositional Manipulation 1Construction navigation 1Contact-Rich Manipulation 1Contact-rich Manipulation 1Continual reinforcement learning on top of robot foundation models 1Continuum sensing 1Cross-embodiment transfer of humanoid whole-body controllers 1Curriculum RL 1Dexterous Manipulation 1Distributed Manipulation 1Distribution Shift 1Driving Simulation 1Efficient VIO 1Egocentric data 1Egocentric video 1Embodied Agents 1Embodied policy 1Empowerment MPC 1Endoscopic navigation 1Endovascular robotics 1Evaluating robot world models against real executions 1Event-camera VO 1Exoskeletons 1Failure recovery 1Federated 3D Perception 1Fisheye detection 1Floorplan SLAM 1Geometry-aware manipulation 1Grasping 1Grounding 1Humanoid Control 1Humanoid RL 1Humanoid Tool Use 1Humanoid control 1Humanoid loco-manipulation 1Humanoid safety 1Humanoid whole-body control 1Imitation Learning 1JEPA World Models 1Lab automation 1Laboratory Manipulation 1Latent World Models 1Legged Manipulation 1LiDAR Security 1Lifelong RL 1MAPF 1MAV guidance 1Manipulation LfD 1Manipulation Safety 1Marine simulation 1Memory-centric VLA 1Miniature Locomotion 1Mining Perception 1Mobile manipulation 1Model-based RL 1Monocular SSC 1Motion Planning 1Multi-Agent RL 1Multi-Robot Exploration 1Multi-Robot Manipulation 1Multi-UAV Exploration 1Multi-UAV State Estimation 1Multi-agent RL 1Multi-agent motion planning 1Multi-camera odometry 1Multi-fidelity RL 1Multi-robot manipulation 1Multi-skill Manipulation 1Multi-view perception 1Multimodal simulation 1Navigation & Mapping 1Object Pose Estimation 1Object Search 1Panoramic 3D Detection 1Panoramic segmentation 1Pedestrian tracking 1PersonNav 1Planning 1Policy 1Policy Optimization 1Preference Learning 1Quadruped locomotion 1Real-time VLA 1Real-to-sim 1Reinforcement learning for industrial assembly 1Representation alignment 1Robot-Use Agents 1Runtime Verification 1Safe Generative Planning 1Safe RL-MPC 1Safe VLA 1Safety monitoring 1Safety-critical control 1Sim-to-real Navigation 1Sim-to-real manipulation 1Simulation geometry 1Skill Discovery 1Social navigation 1Soft Pneumatic Actuators 1Soft manipulation 1Sonar SLAM 1Streaming 3D reconstruction 1Submovement decomposition 1Surgical 1Surgical robotics 1Tactile 1Tactile Exploration 1Tactile VLA 1Temporal manipulation 1Terrain traversability 1Text-to-3D Policy 1Tool Co-Design 1Trajectory Correction 1Traversability 1UAV Navigation 1UAV Swarms 1UAV traffic monitoring 1Underwater Robotics 1Underwater active mapping 1Underwater perception 1Unified world-action model 1VLA Conditioning 1VLA Defense 1VLA Robustness 1VLA evaluation 1VLA manipulation 1VLA robustness 1Video world models 1Visual Generalization 1Visual Grounding 1Visual Reward Models 1Visuomotor Fusion 1Visuotactile manipulation 1World Models 1World-Action Models 1
暂无中文版,显示英文原文。
按技术筛选:VLA 视觉语言动作模型,清除
arXiv
VLA Conditioning进阶

EC-VLA与VA-VLA:用EMG和视觉标注替代语言,杂乱场景任务完成度大幅提升

Edward W. Staley, Connor O. Pyles, Rahul Hingorani, Frank Camargo, Griffin Milsap, Jared Markowitz, Matthew S. Fifer, Michael Wolmetz

这是一篇预印本,未经同行评审。作者将8通道EMG包络或视觉分割标注作为连续条件,替换VLA模型中固定的描述性语言提示,分别微调SmolVLA与π0.5。在SO-101真机方块抓取和RoboCasa仿真16项任务中,两种模型在杂乱分布外场景均显著超越语言基线,其中EC-VLA杂乱场景成功率从30%升至50%,VA-VLA从11%升至20%。结果表明非语言模态可作为VLA任务条件的有效补充。

arXiv
Unified world-action model专业

UniWAM统一世界-动作模型:融合物理推理、视觉生成与动作预测,LIBERO与RoboTwin刷新SOTA

Jiayi Chen, Wenxuan Song, Jingbo Wang, Shuai Zhou, Xicheng Gong, Zehua Fan, Ziyang Zhou, Junwu E, Haodong Yan, Fuhao Li, Qize Yu, Xu Huang, Pengwei Wang, Wen Chen, Shunbo Zhou, Haoang Li

UniWAM是一个统一世界-动作模型,将物理推理、视觉生成和动作预测集成在单一混合Transformer架构中,并在约1万小时人类与机器人数据及829万VQA样本上预训练。该预印本在LIBERO、RoboTwin等基准上取得SOTA,真机实验指令跟随与长程任务也优于π0.5和Motus。其重要之处在于展示了人类-机器人联合预训练的对数线性扩展规律,为通用机器人模型提供数据与架构路径。

arXiv
VLA Robustness进阶

仅成功率不够:输入扰动如何改变VLA模型成功轨迹行为

Sophie Higham, Riccardo Andrea Izzo, Matteo Matteucci, Alessandro Suglia

这篇预印本提出了一个与基准无关的行为鲁棒性评估框架,在LIBERO和LIBERO-Plus上补充任务成功率之外的轨迹行为指标。研究发现,输入扰动会改变成功轨迹的执行行为,即使不同模型的成功率相近,其行为退化程度也可能差异很大。因此仅用任务成功率评估鲁棒性会掩盖部署相关的行为变化。

arXiv
Manipulation专业

DynaHarness动态物理执行框架将LIBERO-Pro成功率从17.5%提升至75.2%

Haoyuan Deng, Jiebin Liu, Tengxiao Zhang, Langning Yan, Hongye Cao, Ziwei Wang

本文为预印本。DynaHarness通过动态物理执行合同连接慢速语义推理和快速物理治理,在LIBERO-Pro新增800个状态上取得75.2%成功率,冻结π0.5策略仅17.5%。同一技能库下,完整动态执行74.0%,对比一次性重规划63.9%,显示对已有能力进行实时监控、替换和恢复的价值。

arXiv
Manipulation Safety进阶

Multi-Link 安全过滤:五椭球护臂与光流追踪降低 VLA 策略碰撞率

Yatharth Agarwal, Vijay Raghunathan

这是一篇预印本。研究者为预训练 VLA 策略加装无需训练的多连杆安全过滤,用五个椭球覆盖夹爪、手腕和前臂,并通过稀疏光流追踪移动障碍物。在六个仿真移动障碍条件下,碰撞率从 65.62% 降到 27.27%,安全成功率从 29.35% 升到 50.43%;边缘 CPU 上屏障求解 p99 仅 2.2 毫秒,真机测试触碰次数从 11/16 降至 3/16。

arXiv
Safe VLA专业

FailBank:将运行时反馈变为 VLA 策略的持久自我进化

Mingyue Cui, Zheyuan Liu, Yihan Zhu, Zheyuan Zhang, Meng Jiang

FailBank 是一个四阶段自进化框架,将运行时 CBF 屏蔽的修正建议转化为学习记录,用于持续更新视觉-语言-动作模型,而无需在部署时使用屏蔽。在 VLA-Arena 静态障碍套件上,FailBank 在两个骨干模型上分别将任务成功率提高 8.5 和 6.9 个百分点,同时将策略诱导累积成本降低 35.6% 和 23.8%。与运行时屏蔽 AEGIS 相比,成功率分别提高 25.4 和 9.5 个百分点。本文为预印本,尚未经过同行评审。

arXiv
Memory-centric VLA进阶

Optimus-R:记忆中心VLA框架实现低数据适应与终身学习

Zaijing Li, Rui Shao, Bing Hu, Haoyu Zhang, Dongmei Jiang, Liqiang Nie

本文提出预印本方法Optimus-R,一个记忆中心的视觉语言动作模型框架,将机器人适应任务转化为显式的查询技能记忆调优,而非反复更新模型参数。在LIBERO、CALVIN、RoboTwin 2.0仿真基准及真实机器人上,Optimus-R在低数据适应、跨域迁移和终身学习中均优于基线π0.5,显著缓解灾难性遗忘。该框架通过内联记忆接口、查询技能记忆库和轻量桥接适配机制,为机器人持续学习提供了高效路径。

arXiv
VLA专业

VLA 模型存在指令-动作绑定缺陷,ECT 训练将反事实成功率从 36% 提升至 59%

Hung-Jen Chen, Yu-Hsun Hou, Yan-Hong Chen, Yan-Fu Chen, Binghua Cai, Min Sun, Chun-Yi Lee

这篇预印本论文诊断了视觉-语言-动作(VLA)模型的一种特定失败模式:指令-动作绑定,即模型能对语言和视觉作出反应,却无法将二者结合起来选择当前任务所需动作。作者提出 Equivariant Counterfactual Training(ECT),通过补充同指令、不同场景、不同动作的成对演示并按对训练,在 LIBERO-PRO 上将 π0.5 的平均 Swap 成功率从 36% 提升至 59%,在真实 UR5e 上将未见位置成功率从 3/40 提高到 35/40。该工作解释了现有数据为何允许这种捷径,并为改进机器人指令跟随提供了训练原则。

arXiv
World-action model进阶

Magic-W0:面向物理智能的结构化世界动作基础模型

Xuhua Chen, Zhenhan Yin, Yuan Zhang, Lingfeng Zhang, He Zheng, Tong Mu, Shun Zuo, Dian Zhou, Di Wu, Xuan Zhou, Shaojie Wan, Rongtian Shen, Qiulong Xu, Yiduo Li, Yinglong Wang, Yanqian Wang, Kun Wang, Tao ZhangMagiclab Robotics Inc. (Magic-Lab Team)

机器人企业MagicLab发布预印本,介绍34亿参数的机器人模型Magic-W0,它在决定动作的同时预测场景三维结构会如何运动、动作结束后场景应呈现什么状态。在10月3日的修订版中,它以平均36.75分登上RoboDojo-Sim榜首,但仅领先第二名0.48分;在五项真机任务上以94.6%对91.8%胜过Physical Intelligence的π0.5。

arXiv
Grounding专业

GroundingPI:以视觉基元构建4B接地基础模型,34项基准平均73.68%超越GPT-6 Astra

Qize Yu, Lianrui Fan, Boyu Chen, Jiaqi Liang, Xini Ding, Yue Chen, Zetian Song, Yuran Wang, Yi Zou, Kaixuan Wang, Tianxing Chen, Wenxuan Song, Bohan Zhou, Mingleyang Li, Siqiao Huang, Yuqi Ye, Caigao Jiang, Wei Wei, Ruihai Wu, Hang Zhang

这是一篇预印本论文。作者提出 GroundingPI,一个基于点和边界框等视觉基元的 4B 参数接地基础模型,在 34 个接地基准上达到 73.68% 平均得分,超过更大的 GPT-6 Astra(71.54%)。该模型作为视觉骨干用于机器人操作和自动驾驶时,在 RoboTwin 2.0 全部四个分布外设置中优于所有主流骨干,相对最强基线最高提升 24.8%,并在 RoboCasa-GR1 上以 50% 演示数据超过其他基线用 75% 数据的表现。这项工作表明专门的接地预训练可成为物理智能的感知基础,尤其适合系统1的快速执行。

arXiv
Aerial Manipulation专业

合成监督与场景图组合实现跨站点空中操作,MPAR对齐执行进度

Weixiang Guo, Rui Jin, Haotian Jin, Xinhang Xu, Ruiyang Liu, Haoran Zhao, Yi Wang, Weiqi Gai, Kun Cao, Lihua Xie

该预印本提出统一框架,将局部全身VLA行为组合为场景级空中操作。在仿真中完成21/50个跨站点任务(42.0%),物理平台验证了2/5次取水浇花任务。关键贡献包括无需真实平台演示的合成训练、MPAR对齐异步动作块,以及场景图引导的可行交接与拓扑转移。

arXiv
Preference Learning专业

PrefPI:偏好引导策略迭代,让预训练机器人策略闯入分布外行为

Seungeun Rho, Wontaek Kim, Danfei Xu, Sehoon Ha

这篇arXiv预印本提出了PrefPI,一种仅用相对偏好反馈、迭代式引导预训练生成式机器人策略移出其初始有效支持范围的框架。它通过偏好条件生成建模与分类器无关引导(CFG)放大偏好信号,在真机上仅用150条偏好标注轨迹就将物体搬运高度从10.7厘米提升到19.8厘米。该方法为机器人行为对齐用户偏好提供了轻量级路径。

arXiv
VLA进阶

ChunkTrust:利用动作专家证据自适应调整机器人策略的执行时域

Fanding Huang, Jingyan Jiang, Shifeng Bao, Mingkang Pu, Shiwei Li, Jing Xu, Shijia Xu, Guanbo Huang, Chenghao Gu, Yuzhi Huang, Chenxin Li, Faisal Nadeem Khan, Huan Yang, Yan Wang, Cheng Chi, Zhi WangTsinghua University, Beijing Academy of Artificial Intelligence (BAAI), Renmin University of China, Shenzhen Technology University, Hefei University of Technology, Jiangnan University, Chongqing University, The Chinese University of Hong Kong

机器人AI模型每次预测一段未来动作,执行多少步之后再重新观察环境,过去大多由工程师手动设为固定值。清华大学、北京智源人工智能研究院(BAAI)等机构发布的这篇预印本提出一个即插即用模块,在运行中自动决定这一步数,无需重新训练,就提升了Physical Intelligence和英伟达现有模型在仿真和真实双臂机器人上的成功率。

arXiv
Real-time VLA专业

两阶段非均匀Flow去噪把VLA推理从61.6毫秒压到22.0毫秒,真机叠衣验证实时执行方法

Di Wu, Rongtian Shen, Ping Liu, Yan Shen, Zhenhan Yin, Shun Zuo, Xuhua Chen, He Zheng, Lingfeng Zhang, Jianglin Zhang, Tao Zhang

这是一篇arXiv预印本,尚未经过同行评审。作者以π0.5为基线,在双臂真机上测量了从相机、本体感知到命令响应的端到端延迟,并提出两阶段非均匀Flow Matching去噪,把推理步数从10步减到2步,模型推理时间从61.557毫秒降到21.956毫秒。在30次叠衣真机试验中,训练型方法Legato和免训练方法Temporal Smoothing表现最好;把两阶段去噪与这两种方法结合,推理成本大幅下降,但任务成功率有小幅回落。

arXiv
Embodied policy专业

EWAM统一具身模型实现语义、视觉预测、动作的内部递进分工

Hao Wang, Jiajun Wen, Jingzhi Liu, Shuoshuo Xue, Zhiliang Chen, Min Lin, Yicheng Chang, Xiaoyu Guo, Yukang Zhuo, Zheng Chong, Yunshuang Nie, Jian Zhang, Weijia Liufu, Qingman Wu, Heming Xu, Bingchang Song, Dantong Wu, Zhiyuan Wang, Hang Xu, Jianhua Han

EWAM是一种以动作流为核心的一体化具身模型,通过非对称联合注意力让动作token在每层读取语义、当前视觉、预测未来和动作信息。在RoboTwin clean-to-random测试中达到72.1%,LIBERO平均98.8%,并在多个真实机器人上超过VLA、WAM和混合基线。该预印本显示统一训练可诱导从语义理解、视觉预测到动作生成的内部有序计算,且人类自我中心数据可提升跨具身迁移和真实场景鲁棒性。

arXiv
VLA专业

MotorMind: Scaffolding General Vision Language Models for Zero-Shot Robot Manipulation

Bingxuan Li, Siqi Song, Yizhuo Wu, Jiarui Yao, Tong Zhang, Huan Zhang

Vision-language-action (VLA) models have advanced robotic manipulation, but their zero-shot generalization in new tasks and environments remains limited, and their reliance on specialized training keeps them from benefiting directly from rapidly advancing general-purpose vision-language models (VLMs). In parallel, recent agentic robotic systems leverage VLMs for high-level reasoning or coding agents for robot control, but often depend on extensive external models and tools, introducing additional complexity and cost.

arXiv
VLA专业

WayFinder: Hierarchical Visual-Language-Action for Zero-Shot Waypoint Generation and Low-Level Kinematic Control

Timothy K Johnsen, Marco Levorato

Visual Language Action (VLA) models offer unprecedented generalization for autonomous robots; however, their real-world deployment is frequently bottlenecked by unreliable execution and the prohibitive computational cost of fine-tuning for specific robot embodiments and tasks. To bridge this gap, we propose WayFinder, an end-to-end, closed-loop hierarchical VLA framework that circumvents the need for fine-tuning by decoupling high-level task reasoning from low-level kinematic control.

arXiv
VLA robustness专业

Self-Compensating VLA利用执行残差在线补偿机器人误差,RoboStress压力测试

Sohyun Lee, Yoonjae Baek, Jaesang Won, Jinnyeong Kim, Kang Hyunwoo, Seung-Hwan Baek, Ivan Laptev, Suha Kwak

这篇预印本提出自补偿VLA,在部署时利用指令与实际运动残差在线微调LoRA,让策略预补偿机器人执行误差。在RoboStress仿真基准和两台Piper机械臂上,该方法平均任务成功率相比基线提升超过30个百分点(真机),并在未见物体上保持提升。这为提升VLA在真实机器人上的长期可靠性提供了不依赖任务奖励的部署期适应方案。

arXiv
VLA专业

Urgent Actions Go First: Urgency-Aware Denoising for Real-Time VLA Control

Zibo Wang, Haochen Han, Pengzhen Ren, Mingtong Dai, Fangming Liu

Diffusion and flow-matching Vision-Language-Action (VLA) policies generate action chunks through iterative denoising, incurring substantial inference latency that severely limits real-time robotic control. Existing acceleration methods treat an action chunk as a monolithic computational unit, ignoring a crucial physical reality of receding-horizon control: actions are generated jointly but consumed sequentially, resulting in inherently heterogeneous execution urgencies.

arXiv
VLA专业

Faster and Better? Benchmark Bugs and Design Limitations Distort the Evaluation of Vision-Language-Action Acceleration

Qiwei Chen, Kaijun Zhou, Nuohui Shi, Zhiyang Li, Yuxuan Feng, Jinyu Gu

Simulated manipulation benchmarks are the standard tool for evaluating vision-language-action (VLA) policies and the acceleration methods that reduce their inference latency for on-robot deployment. On these benchmarks, we observe that some training-free acceleration methods, which approximate the baseline policy's computation, achieve higher measured success rates than the baseline itself.

主题页

论文来自 arXiv 机器人领域。尚未生成摘要的论文,显示摘要开头部分。