VLA evaluationIntermediate
ManiPhysicsBench: Physics-Based Assessment of Object Preservation in VLA Manipulation
This preprint introduces ManiPhysicsBench, a simulation-based benchmark that scores vision-language-action manipulation policies on object preservation, not just task completion. It combines a curated 91-object material property library with post-rollout physics-solver damage checks in LIBERO and SimplerEnv; public VLAs average 13.5% safe success versus 48.3% task success on one platform. The work matters because real-world deployment of fragile-object handling depends on not damaging goods, yet current benchmarks ignore this risk.