Dual-arm Cooperation for Tabletop Wiping with Temporal Object Removal
We devise a dual-arm cooperative planning framework for wiping table surface in the presence of scattered objects. Unlike conventional surface-cleaning strategies that only cover free areas and detour around obstacles, our framework explicitly assigns one arm to rearrange objects while the other performs coverage wiping, thereby enabling access to previously obstructed regions.
From the abstract. Our summary is in progress.
Full paper
Dual-arm Cooperation for Tabletop Wiping with Temporal Object Removal
Published under CC BY 4.0. Reproduced with attribution; original at arXiv:2610.19527 (PDF).
Abstract
We devise a dual-arm cooperative planning framework for wiping table surface in the presence of scattered objects. Unlike conventional surface-cleaning strategies that only cover free areas and detour around obstacles, our framework explicitly assigns one arm to rearrange objects while the other performs coverage wiping, thereby enabling access to previously obstructed regions. Specifically, we first construct a set of wiping and object-rearrangement action primitives. Based on these primitives, we introduce Geo-MILP, a geometry-aware task planner formulated as milp (milp). By integrating lbbd (lbbd), Geo-MILP iteratively optimizes action sequencing and timing to resolve geometric conflicts, promoting efficient cooperation between wiping and object rearrangement. We then employ komo (komo) to generate smooth, collision-free motions to ensure feasible execution. Simulation and physical experiments demonstrate that the proposed framework not only increases reachable coverage by enabling access to obstructed areas, but also significantly improves time efficiency compared to tamp (tamp) baselines, reducing planning time by up to 9\times and execution makespan by approximately 40\%.
I Introduction
Wiping a tabletop surface to remove dust, stains, or liquid spills is a common domestic chore, and automating this task with service robots is highly desirable [1, 2]. Effective wiping requires the robot’s end effector to thoroughly cover the entire planar surface. This could be accomplished by solving a coverage problem [3, 4, 5] in robotics, which has been extensively studied in the cpp (cpp) literature [6, 7, 8, 9]. CPP-based methods have achieved great success in applications such as robotic vacuum cleaning [10, 7, 8], surface inspection and polishing [11, 12, 13, 14], where obstacles are typically modeled as static occupancy to be avoided.
However, in real-world domestic settings, desks, kitchen counters, and workbenches are often scattered with everyday objects that partially occlude the tabletop surface. When standard CPP is directly applied in such situation, the robot’s end effector is instructed to detour around objects, leaving large portions of the surface uncleaned (see Fig. 1(a)). Moreover, such detouring motions increase the risk of collisions and lead to inefficient trajectories. As a result, achieving complete, safe, and efficient surface coverage in cluttered tabletop environments remains a challenging open problem.
To address this problem, we leverage a dual-arm robot that incorporates temporary object removal to clear obstructions. In particular, one arm performs coverage wiping while the other temporarily removes obstructing objects by picking them up and placing them back after the corresponding surface region has been wiped. This cooperated behavior enables the robot to reach regions that would otherwise be inaccessible. In principle, such behavior can be formulated within a tamp (tamp) framework [15, 16, 17], where symbolic actions such as pick, place and others are defined at the task level and instantiated into continuous motions after proper sequencing.
However, directly applying conventional TAMP to this problem is often suboptimal for tabletop wiping. Standard TAMP frameworks typically focus on generating feasible sequences of symbolic actions, relying heavily on the assumption of atomic actions and instantaneous state transitions. Under this discrete modeling paradigm, the system state is updated instantaneously between action steps, making it especially difficult to represent the continuous temporal overlap required for coordinated execution. Consequently, without an explicit mechanism to coordinate motion duration, the two arms are forced to operate sequentially rather than concurrently [18, 19, 17], leaving one arm idle while the other performs its task, as shown in Fig. 1(b). This not only increases the overall task completion time but also prevents the robot from fully exploiting the advantages of bimanual cooperation. Although TAMP provides a natural formalism for dual-arm tabletop wiping, an additional mechanism is required to coordinately plan bimanual actions to achieve efficient and complete surface coverage.
In this work, we propose a dual-arm cooperative planning framework that explicitly reasons about concurrent wiping and temporary object removal to achieve efficient and complete tabletop cleaning. Our approach first constructs a set of primitive actions for wiping and object handling, and formulates a milp (milp) problem to optimize their sequencing and temporal coordination, promoting concurrency between the two arms (see Fig. 1(c)). Crucially, to ensure physical feasibility in cluttered environments, we incorporate a lbbd (lbbd) strategy that iteratively refines the MILP schedule using geometric feedback from the motion planner. The resulting high-level plan is then refined using komo (komo) to generate smooth, collision-free motions that are physically feasible for execution on a real robot. The simulation and physical experiment demonstrate that our framework achieves significantly larger surface coverage while reducing task completion time compared to conventional TAMP approaches.
I-A Related Work
Surface cleaning has long been studied as a coverage problem in robotics. Classical cpp has succeeded in static surface cleaning tasks like floor and window wiping [6, 7]. However, tabletop wiping introduces manipulable clutter. Existing approaches predominantly treat obstacles as immutable constraints, focusing on passive collision avoidance that inevitably leaves occluded regions uncleaned [8, 20, 21, 3, 10]. To guarantee maximal coverage, our formulation integrates CPP with active, reversible object rearrangement to explicitly recover obstructed workspace.
Bimanual Manipulation research has extensively explored safe motion synchronization [22, 1] and compliance [23, 24, 25], but it primarily focuses on collision-free execution. Relying solely on low-level coordination limits overall efficiency due to the lack of proactive action scheduling [26, 27]. To overcome the limitations of purely reactive coordination, our approach elevates dual-arm synchronization to the task planning level. By explicitly optimizing the timing of wiping and rearrangement, we maximize bimanual concurrency rather than merely avoiding collisions.
Task and Motion Planning seeks to formally integrate discrete high-level reasoning and continuous low-level control [16]. In standard TAMP implementations, the task planning layer typically relies on symbolic planners (e.g., PDDL-based [18], VKC-based [17]) to resolve causal dependencies [28, 29]. However, a fundamental limitation of these approaches is the assumption of atomic actions and instantaneous state transitions. Since they optimize for logical plan length rather than continuous execution time, standard planners lack the intrinsic metric to seek concurrency, typically converging to sequential solutions. To address temporal reasoning, planners such as POPF [30] and LPG [31] introduce durative actions and heuristic search over temporal action graphs, enabling partial concurrency. However, they primarily operate in a symbolic domain and do not explicitly incorporate continuous geometric feasibility during planning. More recent work on multi-arm and makespan-aware planning considers coordination across multiple manipulators [32] and explicitly optimizes execution time under coupled task constraints [33], highlighting the importance of temporal coordination in multi-robot systems. In contrast, our work focuses on a task-specific dual-arm tabletop wiping problem with temporary object removal. We emphasize coordination between coverage wiping and object rearrangement under fixed primitive abstractions, where geometric feasibility is handled by an external motion optimization module.
I-B Contribution
The main contributions of this paper are summarized as follows: (i) We propose a hierarchical dual-arm planning framework that integrates coverage wiping with active, reversible object removal, enabling complete access to occluded regions that are unreachable by conventional collision-avoidance strategies. (ii) We introduce Geo-MILP, a task planner that explicitly optimizes the temporal coordination of dual-arm actions, and combine it with a lbbd scheme to iteratively refine the schedule with geometric feedback, ensuring that the generated concurrent plans are not only time-efficient but also physically executable. (iii) We validate the proposed framework which achieves near-complete cleaning coverage in cluttered environments through extensive simulations and physcical experiments.
I-C Overview
The remainder of this paper is organized as follows: Section II provides a high-level system overview of the proposed coordinated framework and its hierarchical modules. Section III details the formulation of Geo-MILP task planner, and the LBBD-based geometric feedback mechanism. Section IV describes the KOMO-based motion planner used for trajectory generation and feasibility verification. Section V presents the simulation and physical experimental results. Finally, Section VI concludes the paper with discussions.
II Coordinated Framework
Fig. 2 provides an overview of our coordinated framework for cluttered tabletop wiping. The key challenge is that maximizing wiping coverage on a tabletop often requires interaction with movable objects, while achieving time efficiency demands temporal coordination between wiping and object rearrangement.
II-A CPP: Tabletop Coverage Path Generation
We first discretize the tabletop region into occupancy grids and construct a graph over the resulting cells. CPP then computes a coverage-efficient visiting order of waypoints for the wiper to achieve complete surface coverage. At this stage, clutter objects are treated as blocked nodes in the graph: we only identify occluded waypoints but do not generate any interaction or detouring logic. Accordingly, the output of CPP is a coverage-oriented abstraction, including the visiting sequence, adjacency relations, and the subset of occluded waypoints that are infeasible to wipe without manipulation.
II-B MILP-based Task Planner: Temporal Scheduling and Dual-Arm Coordination
Taking the coverage path and blocked-waypoint information produced by CPP as input, we formulate dual-arm coordination as a milp problem. The MILP assigns obstacle-handling primitives to the left arm (e.g., pick, place, and reversible actions that return objects to their original locations) and jointly schedules them on a timeline alongside the right arm’s wiping sequence. Its primary goal is to produce a geometrically feasible, time-optimal action schedule that minimizes the makespan under logical precedence and synchronization constraints. To efficiently solve the spatial temporal coupling, we formulate this layer using an optimization-based architecture rooted in lbbd. Specifically, the MILP acts as the Master Problem proposing a feasible schedule, while a geometric sub-problem iteratively verifies feasibility and injects logic-based cuts to prune invalid solutions. Through this iterative constraint injection, the task planner refines the schedule until a valid, collision-free task skeleton is found. The solver outputs a time-indexed dual-arm action sequence that balances sequencing and concurrency, avoiding conservative sequential execution.
II-C KOMO-based Motion Planner: Trajectory Generation
The discrete actions scheduled by the MILP is passed to the motion planner. We employ komo to translate each scheduled primitive into continuous constraints (e.g., end-effector pose targets for wipe and remove/place conditions) and jointly optimize the resulting trajectories. KOMO handles the robot’s kinematic constraints and the scene geometry, enforcing collision avoidance between the arms, the environment, and objects. By solving a trajectory optimization problem, KOMO produces smooth, physically executable, and collision-free trajectories for the scheduled action.
III Task Planning via Logic-Based Benders Decomposition
The primary challenge in bimanual tabletop wiping is the tight spatial temporal coupling between the right arm’s continuous coverage and the left arm’s discrete rearrangement actions. Unlike search-based alternatives, our method leverages milp for global coordination, ensuring high search efficiency while maximizing bimanual concurrency.
III-A Graph Construction
As illustrated in Fig. 2, we first abstract the continuous workspace into a graph representation via cpp. To transform the surface-covering task into a discrete optimization problem, we perform workspace tessellation. Given a rectangular tabletop \mathcal{W}\subset\mathbb{R}^{2} and a wiping tool with an effective footprint \mathcal{F}, we discretize \mathcal{W} into a grid of cells. We construct a directed graph \mathcal{G}=(\mathcal{V},\mathcal{E}), where each node v\in\mathcal{V}=\{1,\dots,N\} corresponds to a cell center.
The edge set \mathcal{E} is generated based on a boustrophedon sweeping pattern to ensure full coverage while minimizing redundant traversals. We define an occupancy mapping \mathcal{O}:K\to 2^{\mathcal{V}}, where 2^{\mathcal{V}} denotes the power set of \mathcal{V}. For each obstacle k\in K=\{1,\dots,M\}, the mapping B(k)\in 2^{\mathcal{V}} identifies the subset of nodes occluded by the obstacle’s physical footprint. Consequently, the coordinated wiping task is formalized as a constrained optimization problem: finding a time-optimal path for the right arm that covers all nodes in \mathcal{G}, synchronized with the left arm’s rearrangement sequence to clear obstructed regions B(k).
III-B Master Problem: Temporal-Logic MILP Formulation
As shown in Fig. 3, the Master Problem optimizes the symbolic task sequence and the global timeline, ensuring that all logical dependencies and temporal constraints are satisfied before geometric verification. We formulate this as a MILP model to minimize the total completion time (makespan).
1) Continuous Variables (\in\mathbb{R}_{\geq 0}):
T_{r}^{\mathrm{end}},T_{l}^{\mathrm{end}}: Right and left arm completion times.
T^{\mathrm{end}}: Overall makespan of the task (\max\{T_{r}^{\mathrm{end}},T_{l}^{\mathrm{end}}\}).
A_{v}: The time step index when right arm visits node v.
S_{k}^{\alpha},E_{u}^{\alpha}: Start and end times for action primitive \alpha (\in\{\textit{wipe},\textit{pick},\textit{remove},\textit{place},\textit{release}\}) on obstacle k or waypoint u.
2) Binary Variables (\in\{0,1\}):
x_{u,v}^{t}: Indicator for traversing edge (u,v) (\in\mathcal{E}) at discrete step t.
y_{k,u}: Logical switch variable for resolving geometric collisions between left-arm action on obstacle k and right-arm action at waypoint u.
3) Objective Function:
\min\quad T^{\mathrm{end}}\;+\;\varepsilon\sum_{t=2}^{T_{max}}\sum_{i\in\mathcal{V}}x^{t}_{ii},\quad\varepsilon\in(0,1)where T_{max} is the maximum allowable time steps. We minimize the total makespan while penalizing unnecessary right-arm waiting self-loops (x_{ii}^{t}) to prioritize active movement.
4) Subject to Constraints:
\displaystyle A_{v}=\sum_{t=1}^{T_{max}}t\cdot\left(\sum_{u\in\mathcal{V}}x_{u,v}^{t}\right),\quad\forall v\in\mathcal{V} \\ \displaystyle A_{v}\geq E_{k}^{\textit{remove}}+1,\quad\forall k\in K,\forall v\in B(k) \\ \displaystyle E_{k}^{\textit{pick}}\leq S_{k}^{\textit{remove}}\leq E_{k}^{\textit{remove}} \\ \displaystyle\leq S_{k}^{\textit{place}}\leq E_{k}^{\textit{place}}\leq S_{k}^{\textit{release}},\quad\forall k\in KThe constraints above bridge high-level task logic with low-level temporal execution. Specifically, Eq. (2) retrieves the arrival time A_{v} from the time-indexed binary decision variables. Eq. (3) acts as a safety gate, ensuring that the right arm arrives at an occluded waypoint v strictly after the left arm has completed the remove action (the +1 term enforces the strict inequality t>t_{remove} implied by the discrete state update). Finally, Eq. (4) enforces a strict causal sequence for the left-arm manipulation primitives, ensuring logically sound obstacle rearrangement.
III-C Geometric Sub Problem: Benders Cut Generation
The high-level schedule \mathcal{S} produced by the MILP layer may still contain geometric infeasibilities, such as collisions between the left arm’s pick motion and the right arm’s wipe motion.
We invoke a Geometric Verifier to validate the schedule. As detailed in Algorithm 1, if a collision is detected between Left Action at obstacle k and Right Action at waypoint u, we generate a Separation Constraint (No-good Cut). By introducing a binary decision variable y_{k,u}\in\{0,1\}, we inject disjunctive Big-M constraints into the Master Problem:
\displaystyle S_{u} \\ \displaystyle\geq E_{k}-\mathcal{M}(1-y_{k,u}) \\ \displaystyle S_{k} \\ \displaystyle\geq E_{u}-\mathcal{M}y_{k,u}where \mathcal{M} is a large constant. y_{k,u} acts as a logical switch that forces the solver to choose a precedence order: either the left arm completes its action before the right arm starts (y_{k,u}=0), or vice versa (y_{k,u}=1). The MILP solver selects the precedence direction that is optimal for the current master problem under the accumulated cuts. It then shifts the action windows to obtain a conflict-free schedule after verification. For instance, if a geometric collision occurs during a pick action, the solver can seamlessly delay the left arm or command the right arm to wait at a safe node, effectively reshaping the continuous feasible region without the need to backtrack through the discrete task skeleton.
We solve the MILP with Gurobi to optimize (1), obtaining the makespan T^{\mathrm{end}} and its associated discrete action plan. For downstream path planning, we organize the solution as two time-ordered sequences: \mathcal{A}^{R}=\{(t,x_{u,v}^{t},\nu_{t})\}_{t=1}^{T^{end}} and \mathcal{A}^{L}=\{(t,\alpha_{t},k)\}_{t=1}^{T^{end}}. The overall framework does not guarantee global optimality for the planning problem, since geometric conflicts are resolved through temporal precedence constraints. We therefore describe the resulting solutions as low-makespan schedules rather than globally optimal ones.
IV Continuous Motion Generation via Path Optimization
After decomposing the overall tabletop wiping task into subtasks and determining the optimal discrete schedule \mathcal{A}^{R} and \mathcal{A}^{L}, the motion planner must generate continuous, collision-free, and dynamically smooth trajectories. In this section, we utilize the komo framework to transform high-level subtask sequences into executable joint configurations by solving a non-linear constrained optimization problem.
IV-A K-Order Markov Path Optimization
komo is an efficient framework for solving trajectory optimization problems [34]. It represents a path in the robot configuration space as a discrete sequence of waypoints \boldsymbol{q}_{0:T}=\{\boldsymbol{q}_{0},\dots,\boldsymbol{q}_{T}\}, where \boldsymbol{q}_{t}\in\mathbb{R}^{n} denotes the joint angles and n represents the manipulator’s degrees of freedom (DOF). Under the k-order Markov assumption, the cost and constraint functions at any time t are evaluated on k+1 consecutive waypoints \boldsymbol{q}_{t-k:t}. This allows the optimization problem to be formulated in a general k-order non-linear sum-of-squares constrained form:
\displaystyle\min_{\boldsymbol{q}_{0:T}}\quad \\ \displaystyle\sum_{t=0}^{T}\boldsymbol{f}_{t}\left(\boldsymbol{q}_{t-k:t}\right)^{\top}\boldsymbol{f}_{t}\left(\boldsymbol{q}_{t-k:t}\right) \\ \displaystyle\text{s.t.}\quad\forall t:\quad \\ \displaystyle\boldsymbol{g}_{t}\left(\boldsymbol{q}_{t-k:t}\right)\leq 0,\quad\boldsymbol{h}_{t}\left(\boldsymbol{q}_{t-k:t}\right)=0where \boldsymbol{f}_{t} represents the cost terms, while \boldsymbol{g}_{t} and \boldsymbol{h}_{t} denote inequality and equality constraints, respectively. Problem (7) is solved by the Augmented Lagrangian method, which reformulates the constrained problem into an unconstrained one by introducing Lagrange multipliers and penalty terms, making it suitable for handling complex non-linear geometric constraints.
IV-B Mapping Task Sequences to Optimization Constraints
The core of our motion planner is the automatic translation of the discrete arrival-action sequences \mathcal{A}^{R} and \mathcal{A}^{L} into a unified KOMO optimization problem. Each discrete time step t in the MILP schedule corresponds to a fixed time interval in KOMO. For each subtask (\alpha_{t},x_{u,v}^{t}) in the sequences, we impose task-specific constraints over its duration. For instance, during a wipe action, the end-effector is constrained to the tabletop surface with a specific orientation, while for the left arm’s pick and place actions, grasping constraints are enforced at specific time-slices.
IV-C Objective Function: Smoothness and Regularization
The cost function \boldsymbol{f} in Eq. (7) ensures the generated motion is both natural and efficient.
1) Joint Deviation (k=0): To maintain a favorable configuration and avoid singular poses, we penalize the squared deviation of a configuration \boldsymbol{q}_{t} from a reference configuration \boldsymbol{q}_{ref}:
\boldsymbol{f}_{0}(\boldsymbol{q}_{t})=\sqrt{w_{pos}}(\boldsymbol{q}_{t}-\boldsymbol{q}_{ref})where w_{pos}>0 is a scalar weighting factor that regulates the trade-off between task-specific constraints and the preference for a neutral robot posture, providing numerical stability and intuitive tuning of the regularization strength.
2) Control Effort (k=1,2): We penalize high-order derivatives of the trajectory to ensure smoothness. Specifically, we minimize joint velocities and accelerations through finite-difference operators:
\dot{\boldsymbol{q}}_{t}\approx\frac{\boldsymbol{q}_{t}-\boldsymbol{q}_{t-1}}{\Delta t},\quad\ddot{\boldsymbol{q}}_{t}\approx\frac{\boldsymbol{q}_{t+1}-2\boldsymbol{q}_{t}+\boldsymbol{q}_{t-1}}{\Delta t^{2}}The velocity penalty (first-order difference) penalizes large joint displacements, ensuring the manipulator does not move excessively fast during execution.
IV-D Geometric and Kinematic Constraints
1) Joint Limits and Collision Avoidance: We impose strict inequality constraints to respect the physical joint bounds \boldsymbol{q}_{\min}\leq\boldsymbol{q}_{t}\leq\boldsymbol{q}_{\max}. Collision-free motion is ensured by evaluating distances d_{ij}(\boldsymbol{q}_{t}) between all rigid body bounding volumes K_{i} and K_{j}. We enforce a non-penetration condition with a safety margin \delta:
\boldsymbol{g}_{coll}(\boldsymbol{q}_{t})=\delta-d_{ij}(\boldsymbol{q}_{t})\leq 0In this work, we use the Gilbert-Johnson-Keerthi (GJK) algorithm to compute Euclidean distances and enforce the accumulated collision measure to be zero.
2) Pose Alignment Constraints: For precise interaction tasks, such as wiping or grasping, we define position \boldsymbol{P}(\boldsymbol{q}_{t}) and orientation \boldsymbol{R}(\boldsymbol{q}_{t}) via forward kinematics. Alignment is enforced via equality constraints:
\displaystyle\boldsymbol{h}_{pos} \\ \displaystyle=\boldsymbol{P}(\boldsymbol{q}_{t})-\boldsymbol{p}^{\star}=0 \\ \displaystyle\boldsymbol{h}_{ori} \\ \displaystyle=\operatorname{Log}(\boldsymbol{r}^{\star}{}^{\top}\boldsymbol{R}(\boldsymbol{q}_{t}))=0where (\boldsymbol{p}^{\star},\boldsymbol{r}^{\star}) is the target pose and \operatorname{Log}(\cdot) produces a minimal 3D orientation error. Additionally, we use axial alignment to constrain specific tool axes \boldsymbol{u}_{i}(\boldsymbol{q}_{t}) relative to environmental vectors \boldsymbol{v}_{j}:
\boldsymbol{h}_{axis}=\boldsymbol{u}_{i}(\boldsymbol{q}_{t})^{\top}\boldsymbol{v}_{j}-c_{i}=0where c_{i}=1 enforces parallel alignment.
V Simulation and Experiment
We evaluate our coordinated dual-arm wiping framework in both simulation and real-robot experiments. The experiments are designed to answer three questions: (Q1) Does explicit object interaction improve achievable coverage beyond obstacle-detouring CPP? (Q2) Does MILP-based temporal coordination improve efficiency over standard TAMP baselines? (Q3) Is the proposed Geo-MILP (LBBD-style) feedback loop necessary to ensure geometric feasibility and reduce expensive geometric re-planning?
V-A Experimental Setup
The simulated environment features a 0.4\,\text{m}\times 0.75\,\text{m} tabletop workspace cluttered with |\mathcal{K}|\in\{1,2,3\} movable objects, as shown in Fig. 4(a). To perform coverage tasks, the right arm is equipped with a rectangular wiping tool of size 0.09\,\text{m}\times 0.15\,\text{m}. Each object occludes a specific subset of waypoints (blocked nodes B(k)) derived from the wiper’s footprint. The dual-arm system is configured with the right arm as the primary wiper and the left arm as the support for object rearrangement. For each difficulty level, we evaluate the performance over N_{\text{sim}}=10 randomized configurations to ensure statistical significance.
Real-world validation was conducted on two 7-DoF Franka Research arms in a bimanual configuration. To verify the framework’s versatility, we also deploy the algorithm on a Kuavo humanoid robot, as shown in Fig. 4(b) and (c). The experimental workspace consists of a 0.6\,\text{m}\times 0.8\,\text{m} tabletop, and the physical wiper measures 0.2\,\text{m}\times 0.1\,\text{m}, adapting to the real-world scale.
V-B Behavioral Analysis and Validation
We qualitatively evaluate the efficacy of the proposed strategies by analyzing the robot’s interaction behaviors in physical environments.
1) Efficacy of dual arm cooperation: As shown in the qualitative execution sequence in Fig. 5, Geo-MILP proactively identifies these occlusions and coordinates the support arm to temporarily relocate obstacles. By mathematically ensuring all unblocked and temporarily unblocked nodes in the CPP graph are visited, our framework inherently guarantees complete coverage of the reachable workspace when the geometric sub-problem yields feasible continuous trajectories, which is visibly confirmed by the qualitative results.
10 randomized initializations is shown. (b) Real-world deployment on a dual Franka Research robotic system. (c) Hardware transferability demonstration on the Kuavo humanoid robot platform.2) Physical Execution on Heterogeneous Platforms: We further validated the feasibility of the generated plans on two distinct physical platforms.
On the Franka setup, the system successfully executed coordinated sequences pick-remove-wipe-place-release for scenarios with up to three obstacles. The motion planner (KOMO) generated smooth trajectories that maintained strict safety margins, even during close-proximity bimanual operations where the wiper passed dangerously close to the support arm. Compared to sequential baselines like PDDLStream, our method exhibited visible concurrency, with the wiping arm moving to the next region immediately while the support arm was restoring the previous object, thereby minimizing idle time.
The deployment on the Kuavo humanoid demonstrates the framework’s kinematic adaptability. Although the robot’s fixed-base configuration limited the reachable workspace to a sub-region of the table, the system successfully performed the coordinated wiping and rearrangement tasks within its range. This validates that our logic-layer scheduling (Stage II) is agnostic to the underlying hardware, provided the motion planning layer (Stage III) is correctly configured for the specific robot kinematics.
V-C Efficiency Improvement over PDDLStream
Fig. 6 compares the performance against standard sequential TAMP (PDDLStream) baselines in terms of both planning and execution efficiency. Since PDDLStream does not explicitly optimize makespan in our implementation, this comparison should be interpreted as a sequential-versus-coordinated comparison rather than a full comparison against all temporal or parallel TAMP methods.
1) Planning Efficiency: As shown in Fig. 6(b), PDDLStream suffers from an exponential growth in computation time as the number of objects increases, due to the combinatorial explosion in symbolic state search. In contrast, Geo-MILP achieves a significant speedup (e.g., approximately 9\times faster in 3-object scenes), maintaining a tractable polynomial growth in planning time. The box plots further reveal that while PDDLStream exhibits a long-tailed distribution (high variance), Geo-MILP demonstrates significantly tighter interquartile ranges (IQR), indicating superior algorithmic scalability and stability.
2) Execution Efficiency: In terms of physical execution, our MILP formulation explicitly promotes concurrency between wiping and obstacle handling. As shown in Fig. 6(c), we observe a consistent reduction in the median makespan (e.g., approximately 40\% reduction) compared to the sequential baseline. This confirms that our framework not only computes solutions faster but also generates higher-quality schedules that minimize robot idle time.
V-D Ablation on Geometric Feedback with LBBD Cuts
- 1
- 2.5\pm 0.5
- 2.57\pm 0.83
- 11.30\pm 1.45
- 2
- 3.8\pm 1.0
- 6.39\pm 2.28
- 11.79\pm 0.60
- 3
- 5.3\pm 1.1
- 19.56\pm 1.87
- 15.43\pm 1.25
To validate the necessity of the LBBD feedback loop, we compare against a Decoupled MILP+KOMO baseline where geometric cuts are disabled. As illustrated in the planning time distribution (Fig. 6(b)), the decoupled baseline achieves the lowest computation time (averaging 11–17s) by bypassing the expensive geometric verification loop. However, this efficiency is deceptive: without geometric feedback, the planner generates aggressively concurrent schedules that frequently fail during downstream motion generation due to close-proximity dual-arm conflicts. Consequently, its success rate drops significantly in cluttered scenes (as shown in Fig. 6(a)).
In contrast, Geo-MILP incurs a moderate overhead (averaging 14–37 s total planning time) to rigorously enforce geometric consistency. By iteratively injecting the compact temporal cuts, our method resolves conflicts and converges within 2–6 iterations. Crucially, as detailed in Table I, Geo-MILP exhibits remarkable computational stability. Even in dense 3-object clutter, the geometric iteration count remains tightly bounded (5.3\pm 1.1), and the MILP solve time maintains low variance (19.56\pm 1.87 s). This confirms that our LBBD formulation effectively constrains the search space, avoiding erratic computational spikes and reliably transforming a theoretical schedule into a physically executable one.
Overall, the results show that (i) reversible object relocation is essential for achieving complete wiping coverage in clutter; (ii) explicit temporal coordination via MILP yields substantial efficiency gains over sequential TAMP; (iii) the Geo-MILP feedback loop is critical for producing executable concurrent schedules with high success rates under geometric constraints.
VI Conclusion and Discussion
In this paper, we proposed a hierarchical dual-arm planning framework for thorough tabletop wiping in cluttered environments. By leveraging lbbd, we successfully decoupled symbolic scheduling from geometric verification using Geo-MILP. Unlike conventional search-based TAMP solvers that prioritize logical satisfiability, our MILP-based planner explicitly optimizes the global makespan, promoting maximal concurrency between the two arms. Experimental results demonstrate that our method achieves near-total surface coverage while significantly reducing execution time compared to sequential baselines.
While our framework provides a robust solution, it resolves geometric conflicts solely through temporal precedence constraints under fixed primitive definitions. The possibility of adapting grasp poses, wiping directions, or object placements when conflicts arise is not explored. Future work will incorporate sampled grasp and placement candidates to enable joint spatial reasoning over multiple manipulation alternatives. Additionally, integrating real-time visual feedback will enable more adaptive cleaning in dynamic and unpredictable domestic environments. Also, improving computational efficiency for larger object sets, denser clutter, and finer coverage grids remains important for future research.