Belief-Overlap Partial Inversion: Object-Centric Flow Replanning for Humanoid Loco-Manipulation
People often learn how an unfamiliar object moves through a small exploratory push, using its response to guide their next motion. Inspired by this behavior, we study humanoids pushing carts whose mass and caster stiffness are initially unknown.
From the abstract. Our summary is in progress.
Full paper
Belief-Overlap Partial Inversion: Object-Centric Flow Replanning for Humanoid Loco-Manipulation
Published under CC BY 4.0. Reproduced with attribution; original at arXiv:2610.13087 (PDF).
Abstract
People often learn how an unfamiliar object moves through a small exploratory push, using its response to guide their next motion. Inspired by this behavior, we study humanoids pushing carts whose mass and caster stiffness are initially unknown. Our object-centric framework closes online estimation, flow-based planning, and whole-body control into a loop, creating a tension: replacing the plan whenever the belief shifts disrupts the maneuver under way, while keeping it strands the robot on a path its evidence has ruled out. Belief-Overlap Partial Inversion (BOPI) scales revision to agreement, inverting the flow under the old belief only as far as the beliefs disagree before reconstructing under the new one. Across 18 simulated goals it lowers pooled final position and yaw error by roughly 33% and 47% against fixed-depth replanning, and on hardware it translates and turns a non-holonomic cart.
†
I Introduction
People rarely commit to a way of moving an unfamiliar object before testing it; a short push reveals whether it rolls freely, resists, or veers off line, and the plan is adjusted before the motion has finished. We pursue this ability in humanoids pushing carts whose mass and caster stiffness are unknown at the outset [3, 4, 5]. What is at stake is the path and not merely the effort: an omnidirectional cart can be driven laterally to its goal, whereas a constrained rear axle admits only a curved approach, so the geometry of the maneuver is settled by a property the robot cannot observe until it is already pushing.
Our framework treats the cart, rather than the robot, as the thing being planned for. A recurrent estimator maintains a belief over the cart’s physical properties, a conditional flow planner generates a timed object trajectory conditioned on that belief, and a whole-body controller tracks that trajectory while preserving grasp and balance. Because motion is what produces evidence, the three components close a loop in which every correction arrives mid-maneuver, and that timing is the difficulty: regenerating the plan from each new belief, on top of noisy pose estimates, perturbs the very trajectory the controller is following, while refusing to regenerate leaves the robot committed to a path its own measurements no longer support. Building on plan-reuse methods [1, 6, 7], we ask: how much should a new estimate change the robot’s plan?
Belief-Overlap Partial Inversion (BOPI) answers with the beliefs themselves. As the replanning component of our framework, it partially reverses plan generation under the old belief and reconstructs under the updated one, with the depth of reversal set by how far the two beliefs overlap: when successive beliefs agree the plan is barely disturbed, and as they diverge more of it is rewritten. The rule requires no per-situation tuning, and the change it induces in the encoded plan vanishes as the overlap approaches one.
Experiments span a controlled nonlinear benchmark, where BOPI attains higher task success with smaller cumulative plan changes, and 18 goals in G1–Dex3 simulation. Figure shows object-centric control across cart types (A–D), real-robot translation and turning (E–J), and simulation replay of recorded plans and updates (K–P).
Our contributions are: (i) an object-centric estimation–planning–control framework that adapts cart trajectories while tracking continues; (ii) BOPI, its belief-adaptive replanning method, with an exact-integration bound under which the encoded plan change vanishes as belief overlap approaches one; and (iii) simulation and hardware evaluations showing lower goal error in simulation and lower final position and tracking error on hardware.
II Related work
II-A Object-centric loco-manipulation
Loco-manipulation couples locomotion with manipulation through whole-body control [8, 9, 5, 10, 11, 12]. A recurring move is to state the task on the object rather than on the robot. Mittal et al. [13] plan interactions with articulated objects in unknown scenes; Omnigrasp [14] and MaskedManipulator [15] drive simulated humanoids from desired object motion; ResMimic [16] adds an object-conditioned residual to a general motion tracker; and OmniContact [17] chains contact-level skills for generalizable loco-manipulation. We share the object-level specification with this line of work and differ in what happens afterwards: the object trajectory is not fixed once issued but revised as the object’s properties are inferred.
II-B Cart pushing under unknown dynamics
Cart pushing is the classical instance of that coupling. Harada et al. [18] derive walking motion for pushing manipulation, Scholz et al. [19] treat the cart as a movable obstacle during mobile-manipulator navigation, and Hawley and Suleiman [20, 3] control a humanoid pushing a loaded cart and later navigate with it under SLAM. Because the cart’s response turns on parameters the robot cannot see, several works estimate them while pushing: Sun et al. [21] identify cart parameters online, Foster et al. [4] keep inertial estimates physically consistent for humanoid loco-manipulation, Zhang et al. [22] optimize the push pose and reject disturbances without an accurate dynamic model, and Sriganesh et al. [23] couple estimation with planning for quadrupedal pedipulation. Our question is orthogonal to how the estimate is formed: we ask what the planner should do with it once it moves.
II-C Cross-embodiment control
Differences in physical properties or morphology change a system’s dynamics and constraints, the concern of cross-embodiment control [24, 25, 26, 27, 28]. Rather than adapting control of the robot itself, we study how the object’s path within the robot–object system should change as its properties are inferred.
II-D Adaptive planning
Once properties are inferred [29, 30, 31], the plan has to follow. Diffusion and flow models [32, 33, 34, 35, 36] generate trajectories that can be regenerated under a new condition, and several methods reuse the previous solution instead of discarding it. SDEdit [37] noises an input and denoises it under the new condition; Replanning with Diffusion Models (RDM) [1] applies this to replanning by adding a fixed proportion of noise to the current plan before reconstruction. FlowEdit [2] avoids inversion altogether, editing a trajectory by integrating the difference between the flow fields the old and new conditions induce, while DDIM [38] supplies the deterministic inversion such methods rely on. A parallel line decides when to re-solve rather than how much of the old solution to keep, through real-time chunking [6, 7, 39] and noise-space steering [40]. What none of these supplies is a principled setting for the amount of revision: RDM’s noise level is a fixed hyperparameter, and FlowEdit’s edit follows from the field difference alone. BOPI ties that amount to the overlap between the beliefs that produced the two plans, so the plan changes as much as the evidence has.
III Method
Our framework separates object planning from whole-body control (Fig. 2). The planner specifies where the cart should move and when it should reach each pose. The whole-body controller follows this trajectory while maintaining balance and hand contact. As interaction reveals more about the cart, BOPI updates the remaining path to better reach the goal.
III-A Object trajectories and the flow planner
We represent a timed object trajectory as \tau=\{(p_{h},t_{h})\}_{h=0}^{H-1}. Each of its H waypoints records planar position and yaw in p_{h}, together with the elapsed physical time t_{h}. The user specifies a fixed final position and yaw g^{\mathrm{W}} in a world frame maintained by localization. At each replanning step, we express this goal as g: the remaining displacement and heading change needed to reach it from the estimated current object pose. Our experiments use SE(2) goals, but the formulation permits other goal representations with an appropriately conditioned flow.
An estimator uses interaction history to infer a belief q(\theta) over a vector \theta of object physical properties, such as mass and caster stiffness. The belief mean c(q)=\mu_{q}, together with the goal g, conditions the flow model.
A fixed encoder A converts the trajectory into normalized coordinates x=A(\tau). A conditional rectified flow [34, 35] uses flow time \lambda=0 for noise and \lambda=1 for a plan. The intermediate encoding x_{\lambda} evolves according to the flow field v_{\varphi}, with network parameters \varphi, as dx_{\lambda}/d\lambda=v_{\varphi}(x_{\lambda},\lambda\mid g,c(q)). We denote integration from flow time a to b, starting at x with g and c(q) fixed, by \Phi_{q}^{a\rightarrow b}(x;g). A fresh plan’s encoding is \Phi_{q}^{0\rightarrow 1}(\epsilon;g), where \epsilon\sim\mathcal{N}(0,I) and I is the identity matrix.
III-B Belief-Overlap Partial Inversion
BOPI repairs the remaining plan using the same trained flow. Let x_{o} encode this plan, q_{o} denote its stored belief, and q_{n} the updated belief.
Overlap determines depth
We measure agreement between the beliefs with their Bhattacharyya coefficient [41, 42]. For continuous densities,
\displaystyle\rho \\ \displaystyle=\operatorname{BC}(q_{o},q_{n})=\int\sqrt{q_{o}(\theta)q_{n}(\theta)}\,d\theta, \\ \displaystyle d \\ \displaystyle=1-\rho,\qquad\lambda_{\star}=\rho.The overlap \rho lies between zero and one. We stop the backward integration at \lambda_{\star}=\rho, so it covers a distance d=1-\rho in flow time. Similar beliefs give a shallow reversal; less overlap allows a deeper one. This depth is the squared Hellinger distance and requires no extra threshold or repair-specific training.
Reverse the old plan, then reconstruct
We reverse x_{o} from flow time 1 to \rho under q_{o}, obtaining z_{\rho}. We then reconstruct from z_{\rho} under q_{n}:
\boxed{z_{\rho}=\Phi_{q_{o}}^{1\rightarrow\rho}(x_{o};g),\qquad x_{n}=\Phi_{q_{n}}^{\rho\rightarrow 1}(z_{\rho};g).}Both steps use the same g. The intermediate state is a trajectory encoding, not a physical pose for the robot to visit. No fresh noise is added. At \rho=1, both integrations have zero length and the plan stays unchanged. At \rho=0, they perform full inversion and reconstruction; values between these extremes give partial repair.
Size of a repair
The following bound describes how much the encoded plan can change under exact integration. Write v_{i}(\cdot,\lambda)=v_{\varphi}(\cdot,\lambda\mid g,c(q_{i})) for i\in\{o,n\}.
Proposition 1 (Exact-flow repair)
Suppose the solutions exist on [\rho,1]. On a common region containing their paths, assume both fields are L-Lipschitz in encoded state, bounded in norm by V, and satisfy \|v_{n}-v_{o}\|_{2}\leq\Delta_{v}, uniformly on [\rho,1], with L,V,\Delta_{v}\geq 0. Then
\|x_{n}-x_{o}\|_{2}\leq\min\!\left\{2Vd,\;d\Delta_{v}\exp(Ld)\right\}.Here L bounds sensitivity to the input encoding, V bounds the field magnitude, and \Delta_{v} bounds the difference caused by changing the belief.
Proof:
Each integration travels at most Vd in encoded space, giving the first bound, \|x_{n}-x_{o}\|_{2}\leq 2Vd. For the second bound, run the old flow forward from z_{\rho}. By uniqueness, this returns x_{o}. The new flow starts from the same z_{\rho}, so the distance e(\lambda) between the two forward solutions satisfies e(\rho)=0 and e^{\prime}\leq Le+\Delta_{v} almost everywhere. Grönwall’s inequality gives
\|x_{n}-x_{o}\|_{2}=e(1)\leq\Delta_{v}\int_{\rho}^{1}e^{L(1-s)}\,ds\leq d\Delta_{v}e^{Ld}.Taking the smaller of the two bounds proves Eq. (3). ∎
Under these uniform bounds, the change in the encoded plan approaches zero as belief overlap approaches one.
III-C Applying updates while tracking continues
While tracking continues, the estimator updates the belief q_{n}. Before repair, we resample the remaining path into H waypoints p_{h} in the current estimated cart frame, matching the flow model’s input representation. BOPI revises the remaining timed path using the stored belief q_{o} and updated belief q_{n}, following Eq. (2), while keeping the final goal g^{\mathrm{W}} unchanged. We preserve the first four resampled waypoints to reduce abrupt changes when updating path.
III-D Cart-pushing implementation
Belief representation
Gated recurrent unit (GRU) ensembles predict the mean and uncertainty of rear-caster stiffness k_{\mathrm{r}} and cart mass m_{\mathrm{cart}} in standardized log coordinates: \log k_{\mathrm{r}} and \log(1+m_{\mathrm{cart}}). Here k_{\mathrm{r}} denotes rear-caster swivel stiffness (\mathrm{N\,m/rad}): small values allow the rear wheels to steer freely, while large values approximate a locked rear axle. We average the property estimates across models. Let q_{i,j}=\mathcal{N}(\mu_{i,j},\sigma_{i,j}^{2}) denote the old (i=o) or updated (i=n) belief for property j. Its mean is \mu_{i,j} and its standard deviation is \sigma_{i,j}>0. We compute \rho=\prod_{j}\operatorname{BC}(q_{o,j},q_{n,j}) using the analytic Gaussian overlap [42].
Generating training trajectories
For each physical-property setting \theta, an analytic teacher optimizes a sequence of cart-frame controls \mathbf{u} (forward/lateral velocity and yaw rate) and duration T:
\min_{\mathbf{u},T}\quad T+\sum_{r}w_{r}C_{r}(\mathbf{u},T;\theta),subject to the goal pose, specified boundary velocities, and limits on motion and force/torque. Each cost term C_{r}, indexed by r, sums a normalized squared quantity over time: predicted hand force, force rate, acceleration, lateral velocity, yaw rate, or sideways velocity at an axle. The weights satisfy w_{r}\geq 0. Mass changes the force and torque needed to accelerate the cart. Larger caster stiffness increases the penalty on sideways axle motion and reduces its allowed magnitude.
Training the flow
We convert each teacher trajectory into H=32 timed waypoints (p_{h},t_{h}) for flow training. A temporal U-Net [32, 33], using GroupNorm [43] and FiLM conditioning [44], predicts the flow field.
We use the standard flow-matching loss [34, 35], with training interpolation x_{\lambda}=(1-\lambda)\epsilon+\lambda x. The expectation is over training examples (x,g,c(q)) and independent \epsilon\sim\mathcal{N}(0,I), \lambda\sim\mathcal{U}[0,1]:
\mathcal{L}_{\mathrm{FM}}=\mathbb{E}\!\left[\|v_{\varphi}(x_{\lambda},\lambda\mid g,c(q))-(x-\epsilon)\|_{2}^{2}\right].We also add a condition-smoothness loss to encourage similar flow predictions for nearby physical-property inputs. With c=c(q), we perturb only c, keeping x_{\lambda}, \lambda, and g fixed:
\displaystyle\mathcal{L}_{\mathrm{smooth}}=\mathbb{E}\Bigl[\bigl\| \\ \displaystyle v_{\varphi}(x_{\lambda},\lambda\mid g,c+\delta) \\ \displaystyle-v_{\varphi}(x_{\lambda},\lambda\mid g,c)\bigr\|_{2}^{2}\Bigr].Here \delta\sim\mathcal{N}(0,\sigma_{c}^{2}I), with \sigma_{c}\simeq 0.0041 in standardized physical-property coordinates. The total loss is \mathcal{L}=\mathcal{L}_{\mathrm{FM}}+0.1\mathcal{L}_{\mathrm{smooth}}. All compared methods use this same trained flow.
Object-centric whole-body control
The controller maps incoming timed waypoints (p_{h},t_{h}) and robot observations to targets for all joints except the fingers. Inputs include joint positions and velocities, base angular velocity, gravity direction, previous actions, gait phase, hand targets, hand and handle geometry, and an eight-step observation history.
We train the controller with PPO in mjlab [45, 46]. Its main task rewards encourage accurate cart position and heading:
r_{\mathrm{track}}=15\exp\!\left(-\frac{\|e_{p}\|_{2}^{2}}{0.15^{2}}\right)+20\exp\!\left(-\frac{e_{\psi}^{2}}{0.30^{2}}\right)\mathpunct{.}Here e_{p} and e_{\psi} measure planar position (m) and wrapped heading (rad) differences from the current target interpolated from the timed waypoints (p_{h},t_{h}). Supporting terms encourage stable grasping, balance, wheel contact, and terminal settling, while penalizing excessive speed and sideways wheel slip. We combine these with FALCON’s locomotion rewards [9] and will release the complete reward specification and training configuration with our code.
IV Experiments
IV-A Evaluation protocol and baselines
We compare BOPI with four baselines:
- RDM adds noise to the old plan at a fixed depth, then reconstructs it under the updated belief [1] (Fig. 2B).
- FlowEdit performs inversion-free repair using the difference between new- and old-conditioned flow fields evaluated at paired noisy states [2] (Fig. 2C).
- Fresh FM generates a complete plan from fresh Gaussian noise under the updated belief.
- Retain keeps the initial plan unchanged.
H.- BOPI (Ours)
- \mathbf{54.9\pm 14.6}
- 0.189
- 0.116
- 0.704
- 2.144
- RDM
- 40.0\pm 6.1
- 0.283
- 0.211
- 2.212
- 8.617
- FlowEdit
- 12.6\pm 3.7
- 1.043
- 0.367
- 4.026
- 9.260
- Fresh FM
- 4.0\pm 0.9
- 1.567
- 0.422
- 23.631
- 21.045
- Retain
- 2.4\pm 0.3
- 2.090
- 0.491
- N/A
- N/A
180^{\circ} and return to the starting position (B). Color indicates stiffness; bold curves mark its extremes.IV-B Controlled toy problem
Setup
We study plan repair on a controlled Duffing oscillator [47], \ddot{x}=x-x^{3}-\beta\dot{x}+0.43u, with position x, velocity \dot{x}, control u\in[-1,1], and damping \beta\sim\mathcal{U}[0.04,0.42]. Flows learn optimized controls for moving from (x,\dot{x})=(-1,0) to (1,0) over 10 seconds. Each trial starts with a teacher plan for \beta=0.04. Scripted equal-variance Gaussian beliefs first correct the damping, then fluctuate with correlated noise (belief/noise standard deviation 0.03, correlation 0.95). At 4 Hz, methods revise the full plan but execute only future controls. RDM uses the fixed midpoint flow restart time \lambda=0.50. Terminal success requires |x-1|<0.12 and |\dot{x}|<0.15. We evaluate each method on 256 trials per flow across four independently trained flows.
Results
An incorrect damping estimate makes the initial plan unreliable: retaining it succeeds in only 2.4% of trials, compared with 97.2% when planning with true damping. BOPI improves success over fixed-depth RDM by 14.8\pm 10.4 percentage points, while reducing cumulative plan changes by 68.2% and final speed error by 45.1% (Table I). Figure 3 shows a representative successful BOPI rollout.
IV-C Belief-conditioned flow generation
In the toy problem, beliefs about damping guide control generation; for cart pushing, beliefs about mass and wheel constraints guide the generation of timed cart trajectories. Figure 4 shows how wheel constraints change the paths: nearly free rear casters allow direct lateral motion and near-in-place rotation, whereas a constrained rear axle produces curved lateral paths and wider turning maneuvers. Beyond path shape, the plans also adapt their timing: for example, at m_{\mathrm{cart}}=18.3\,\mathrm{kg}, increasing rear-caster stiffness extends the lateral plan’s duration from 5.11 to 9.42\,\mathrm{s}. Separately, the increase in mass belief from 3.3 to 18.3\,\mathrm{kg} at k_{\rm r}=2000 increases in the lateral plan length by 8.5\,\mathrm{cm}.
0.8\,\mathrm{m} forward travel, 0.6\,\mathrm{m} reverse travel without changing heading, and a 45^{\circ} rolling turn. Panel A compares tracking across masses and wheel constraints. In an example execution with a 20\,\mathrm{kg} cart (B), body–cart distance changes during turning while tracking error remains low, illustrating that the robot can follow the object’s path without maintaining a fixed body–cart offset.- Translation
- 0.349 / 0.163
- 0.625 / 0.561
- 0.637 / 0.590
- 0.870 / 1.039
- 0.927 / 0.330
- Rotation
- 0.109 / 0.150
- 0.134 / 0.195
- 0.251 / 0.693
- 0.754 / 1.209
- 0.286 / 0.306
- Translation + rotation
- 0.209 / 0.205
- 0.296 / 0.336
- 0.240 / 0.228
- 0.835 / 1.165
- 0.495 / 0.329
- Translation + rotation (wrong mass)
- 0.105 / 0.039
- 0.163 / 0.139
- 0.277 / 0.129
- 1.353 / 1.114
- 0.352 / 0.115
- Pooled
- 0.179 / 0.152
- 0.267 / 0.286
- 0.295 / 0.349
- 0.936 / 1.149
- 0.465 / 0.277
0.5\,\mathrm{m} in both directions.IV-D Humanoid cart-pushing simulation
IV-D1 Simulation setup
We evaluate all methods in the mjlab [46] G1–Dex3 environment, using a whole-body controller while the robot grasps the cart with both hands. At each reset, we randomize the robot posture and handle height over a range of 0.78–1.00\,\mathrm{m}, then use inverse kinematics to place both hands on the handle. During controller training, we also sample episodes without a cart so that the deployed policy remains stable when contact is not established.
IV-D2 Belief estimator
The belief estimator predicts cart mass and rear-wheel constraint from interaction history. After four seconds of interaction, the estimator distinguishes free from constrained rear wheels with 91.5\%–98.4\% accuracy and estimates cart mass with approximately 1\,\mathrm{kg} mean absolute error on held-out trajectories.
Figure 5 illustrates how updated estimates guide BOPI’s path repairs. In the illustrated rollout, the cart reaches the goal with mean position and yaw errors of 0.036\,\mathrm{m} and 0.007\,\mathrm{rad}.
IV-D3 Object-centric whole-body control
Across masses and wheel constraints, our controller follows cart waypoints with a mean RMS position error of 6.53\,\mathrm{cm} over 8 trials (Fig. 6A). Object-centric tracking allows the robot to adjust its position relative to the cart during turning while continuing to track the cart’s waypoints (Fig. 6B).
IV-D4 End-to-end planning results
We evaluate 18 goals (32 seeds each): one-meter left/right translations; \pm 60^{\circ} or \pm 90^{\circ} rotations ending at the starting position; one-meter left/right/forward/backward translations with \pm 90^{\circ} turns; and one-meter left/right translations with \pm 45^{\circ} turns under an incorrect mass belief. Directions are relative to the initial pushing direction. The first three categories incorrectly assume freely steering rear wheels; wrong-mass tasks use an omnidirectional cart with an assumed mass of 3.3\,\mathrm{kg} instead of 18.3\,\mathrm{kg}. We compute cart position and yaw errors from ground-truth poses against the fixed goal g^{\mathrm{W}}, averaging over each rollout’s final two seconds and then across all rollouts. Replanning is scheduled at 5 Hz; RDM’s restart time \lambda=0.25 was selected by a development sweep.
Table II shows that retaining the incorrect initial plan leaves substantial final position and yaw errors (0.465\,\mathrm{m} / 0.277\,\mathrm{rad}), while repeatedly replacing it with Fresh FM yields even larger errors (0.936\,\mathrm{m} / 1.149\,\mathrm{rad}). BOPI instead scales revision to belief agreement, achieving the lowest errors in every category (0.179\,\mathrm{m} / 0.152\,\mathrm{rad} overall, approximately 33\% / 47\% below RDM and 39\% / 56\% below FlowEdit). Fig. 7 provides further evidence: BOPI makes smaller changes between successive plans, producing consistent replanned trajectories as the robot progresses toward the goal. Together, these results favor adapting the plan to updated estimates while limiting unnecessary changes to the path the robot is following.
- BOPI (Ours)
- \mathbf{6.48} \mathbf{\pm 3.48}
- 1.64 \pm 1.52
- \mathbf{7.20} \mathbf{\pm 1.41}
- \mathbf{3.89} \mathbf{\pm 0.59}
- RDM
- 7.35 \pm 2.98
- \mathbf{1.17} \mathbf{\pm 1.23}
- 8.98 \pm 1.93
- 3.98 \pm 0.60
- FlowEdit
- 30.64 \pm 40.41
- 17.33 \pm 31.83
- 16.44 \pm 13.47
- 6.73 \pm 5.06
- Fresh FM
- 43.32 \pm 29.40
- 21.08 \pm 16.04
- 13.01 \pm 3.70
- 6.60 \pm 1.36
- Retain
- 85.48 \pm 12.11
- 5.37 \pm 4.63
- 40.58 \pm 5.25
- 7.22 \pm 0.85
90^{\circ} clockwise turn returning to the starting position (F–J). Corresponding BOPI photos appear in Fig. (E–J). Light curves show five estimated cart trajectories; solid curves and shading show their time-aligned mean and pointwise 95\% confidence regions. Squares mark the mean at each trajectory’s end. All paths share display-only smoothing (\sigma=0.20\,\mathrm{s}). Tables IV and IV compare complete trials.IV-D5 Adaptive-repair ablation
We further test a key design choice: whether to first invert the current plan (flow inversion) or directly add noise, as in RDM (forward noising). Both use belief overlap to set the depth and reconstruct under the updated belief. Across the same 18 goals with 64 seeds, forward noising increases mean final position and yaw errors by 18.2\% and 20.9\%, respectively, compared with flow inversion. This suggests that BOPI benefits not only from adapting the revision depth, but also from reversing the old plan through the learned flow rather than perturbing it with fresh noise.
IV-E Real-robot experiments
Figure (A–D) shows adaptable object-centric control across wheeled objects. We test two goals on a non-holonomic shopping cart: move one meter left (Fig. E–G), or turn 90^{\circ} clockwise and return to the starting position (Fig. H–J), with five trials per method and goal. All methods start from the same plan, generated under the incorrect assumption that the rear casters swivel freely. For hardware safety, we reduce the replanning rate to 1 Hz.
Tables IV and IV report mean \pm sample standard deviation. Final errors measure distance and heading difference to the goal; tracking RMS measures deviation from the commanded cart trajectory. Metrics use odometry estimates.
Retaining the incorrect initial plan leads to large final position errors (54.23\,\mathrm{cm} on average). Fresh FM uses updated estimates but repeatedly replaces the plan, exhibiting more variable paths (Fig. 8D,I) and excessive leaning and sideways leg extension (Fig. 9). BOPI instead scales revision to belief agreement, achieving lower mean final position error and both tracking RMS errors than RDM and FlowEdit on both tasks (mean final position error: 5.78\,\mathrm{cm} versus 8.59\,\mathrm{cm} for RDM and 19.47\,\mathrm{cm} for FlowEdit). Together, these results highlight the value of incorporating new evidence while limiting disruption to ongoing motion when manipulating objects with initially unknown physical properties.
V Conclusion
We presented an object-centric framework for humanoid cart pushing that combines online property estimation, flow-based planning, and whole-body control. BOPI, its replanning component, uses belief overlap to determine how far to reverse plan generation before reconstructing the timed waypoints under updated estimates. This lets the planner incorporate new evidence while the controller follows the object’s path and adjusts the robot’s body configuration. Experiments support both the repair mechanism and its use in closed-loop loco-manipulation. BOPI achieves higher success with smaller plan changes in the controlled benchmark and reduces mean final position and yaw errors by approximately 33% and 47% relative to fixed-depth RDM across 18 simulated goals. On a real non-holonomic cart, BOPI performs translation and turning with lower mean final position and tracking errors than the compared baselines. Together, these results support our central insight: effective replanning should incorporate new evidence while preserving useful parts of the current plan. Extending the framework beyond planar cart pushing to three-dimensional goals and non-wheeled objects is a next step toward humanoids that learn to manipulate any unfamiliar objects through interaction.