Keep the Effect, Drop the Actor: Programmable Effect-to-Execution World-Action Models
PEWAM is a preprint describing a 71.5M-parameter world-action model that compiles robot demonstrations into editable “effect programs”—3D object keypoint trajectories, grasp contact points, and final scene configuration—rather than actor-specific motions. On held-out LIBERO-Goal tasks, one program from a single demonstration completes 40 of 90 episodes, while the same backbone under goal-image or language conditioning and prior demonstration-conditioned methods complete at most 19. This matters because turning demonstrations into coordinate-based programs enables editing and cross-robot-arm reuse, a potential route to more flexible robot programming.