MEKAWIRE
ExpertarXiv

Dual-arm Cooperation for Tabletop Wiping with Temporal Object Removal

Pengqi Zhang, Longchang Yu, Daohan Li, Liang Yan, Hangxin Liu
From the abstract

We devise a dual-arm cooperative planning framework for wiping table surface in the presence of scattered objects. Unlike conventional surface-cleaning strategies that only cover free areas and detour around obstacles, our framework explicitly assigns one arm to rearrange objects while the other performs coverage wiping, thereby enabling access to previously obstructed regions.

From the abstract. Our summary is in progress.

Full paper

Dual-arm Cooperation for Tabletop Wiping with Temporal Object Removal

Pengqi Zhang, Longchang Yu, Daohan Li, Liang Yan, Hangxin Liu

Published under CC BY 4.0. Reproduced with attribution; original at arXiv:2610.19527 (PDF).

Abstract

We devise a dual-arm cooperative planning framework for wiping table surface in the presence of scattered objects. Unlike conventional surface-cleaning strategies that only cover free areas and detour around obstacles, our framework explicitly assigns one arm to rearrange objects while the other performs coverage wiping, thereby enabling access to previously obstructed regions. Specifically, we first construct a set of wiping and object-rearrangement action primitives. Based on these primitives, we introduce Geo-MILP, a geometry-aware task planner formulated as milp (milp). By integrating lbbd (lbbd), Geo-MILP iteratively optimizes action sequencing and timing to resolve geometric conflicts, promoting efficient cooperation between wiping and object rearrangement. We then employ komo (komo) to generate smooth, collision-free motions to ensure feasible execution. Simulation and physical experiments demonstrate that the proposed framework not only increases reachable coverage by enabling access to obstructed areas, but also significantly improves time efficiency compared to tamp (tamp) baselines, reducing planning time by up to 9\times and execution makespan by approximately 40\%.

I Introduction

Wiping a tabletop surface to remove dust, stains, or liquid spills is a common domestic chore, and automating this task with service robots is highly desirable [1, 2]. Effective wiping requires the robot’s end effector to thoroughly cover the entire planar surface. This could be accomplished by solving a coverage problem [3, 4, 5] in robotics, which has been extensively studied in the cpp (cpp) literature [6, 7, 8, 9]. CPP-based methods have achieved great success in applications such as robotic vacuum cleaning [10, 7, 8], surface inspection and polishing [11, 12, 13, 14], where obstacles are typically modeled as static occupancy to be avoided.

However, in real-world domestic settings, desks, kitchen counters, and workbenches are often scattered with everyday objects that partially occlude the tabletop surface. When standard CPP is directly applied in such situation, the robot’s end effector is instructed to detour around objects, leaving large portions of the surface uncleaned (see Fig. 1(a)). Moreover, such detouring motions increase the risk of collisions and lead to inefficient trajectories. As a result, achieving complete, safe, and efficient surface coverage in cluttered tabletop environments remains a challenging open problem.

To address this problem, we leverage a dual-arm robot that incorporates temporary object removal to clear obstructions. In particular, one arm performs coverage wiping while the other temporarily removes obstructing objects by picking them up and placing them back after the corresponding surface region has been wiped. This cooperated behavior enables the robot to reach regions that would otherwise be inaccessible. In principle, such behavior can be formulated within a tamp (tamp) framework [15, 16, 17], where symbolic actions such as pick, place and others are defined at the task level and instantiated into continuous motions after proper sequencing.

Fig. 1: A tpyical table wiping task. (a) Classic CPP: The robot detours around obstacles, leaving occluded regions uncleaned. (b) TAMP: The robot strictly alternates between rearrangement and wiping, leading to inefficient execution. (c) Ours (Geo-MILP based TAMP): The planner generates a synchronized schedule where wiping and rearrangement occur concurrently, achieving complete coverage with minimal makespan.

However, directly applying conventional TAMP to this problem is often suboptimal for tabletop wiping. Standard TAMP frameworks typically focus on generating feasible sequences of symbolic actions, relying heavily on the assumption of atomic actions and instantaneous state transitions. Under this discrete modeling paradigm, the system state is updated instantaneously between action steps, making it especially difficult to represent the continuous temporal overlap required for coordinated execution. Consequently, without an explicit mechanism to coordinate motion duration, the two arms are forced to operate sequentially rather than concurrently [18, 19, 17], leaving one arm idle while the other performs its task, as shown in Fig. 1(b). This not only increases the overall task completion time but also prevents the robot from fully exploiting the advantages of bimanual cooperation. Although TAMP provides a natural formalism for dual-arm tabletop wiping, an additional mechanism is required to coordinately plan bimanual actions to achieve efficient and complete surface coverage.

In this work, we propose a dual-arm cooperative planning framework that explicitly reasons about concurrent wiping and temporary object removal to achieve efficient and complete tabletop cleaning. Our approach first constructs a set of primitive actions for wiping and object handling, and formulates a milp (milp) problem to optimize their sequencing and temporal coordination, promoting concurrency between the two arms (see Fig. 1(c)). Crucially, to ensure physical feasibility in cluttered environments, we incorporate a lbbd (lbbd) strategy that iteratively refines the MILP schedule using geometric feedback from the motion planner. The resulting high-level plan is then refined using komo (komo) to generate smooth, collision-free motions that are physically feasible for execution on a real robot. The simulation and physical experiment demonstrate that our framework achieves significantly larger surface coverage while reducing task completion time compared to conventional TAMP approaches.

I-A Related Work

Fig. 2: The proposed hierarchical framework. (a) CPP generates surface coverage waypoints and identifies obstructed nodes. (b) The task planner uses lbbd to jointly schedule concurrent bimanual actions. (c) The KOMO-based motion planner translates the discrete schedule into continuous, collision-free joint trajectories.

Surface cleaning has long been studied as a coverage problem in robotics. Classical cpp has succeeded in static surface cleaning tasks like floor and window wiping [6, 7]. However, tabletop wiping introduces manipulable clutter. Existing approaches predominantly treat obstacles as immutable constraints, focusing on passive collision avoidance that inevitably leaves occluded regions uncleaned [8, 20, 21, 3, 10]. To guarantee maximal coverage, our formulation integrates CPP with active, reversible object rearrangement to explicitly recover obstructed workspace.

Bimanual Manipulation research has extensively explored safe motion synchronization [22, 1] and compliance [23, 24, 25], but it primarily focuses on collision-free execution. Relying solely on low-level coordination limits overall efficiency due to the lack of proactive action scheduling [26, 27]. To overcome the limitations of purely reactive coordination, our approach elevates dual-arm synchronization to the task planning level. By explicitly optimizing the timing of wiping and rearrangement, we maximize bimanual concurrency rather than merely avoiding collisions.

Task and Motion Planning seeks to formally integrate discrete high-level reasoning and continuous low-level control [16]. In standard TAMP implementations, the task planning layer typically relies on symbolic planners (e.g., PDDL-based [18], VKC-based [17]) to resolve causal dependencies [28, 29]. However, a fundamental limitation of these approaches is the assumption of atomic actions and instantaneous state transitions. Since they optimize for logical plan length rather than continuous execution time, standard planners lack the intrinsic metric to seek concurrency, typically converging to sequential solutions. To address temporal reasoning, planners such as POPF [30] and LPG [31] introduce durative actions and heuristic search over temporal action graphs, enabling partial concurrency. However, they primarily operate in a symbolic domain and do not explicitly incorporate continuous geometric feasibility during planning. More recent work on multi-arm and makespan-aware planning considers coordination across multiple manipulators [32] and explicitly optimizes execution time under coupled task constraints [33], highlighting the importance of temporal coordination in multi-robot systems. In contrast, our work focuses on a task-specific dual-arm tabletop wiping problem with temporary object removal. We emphasize coordination between coverage wiping and object rearrangement under fixed primitive abstractions, where geometric feasibility is handled by an external motion optimization module.

I-B Contribution

The main contributions of this paper are summarized as follows: (i) We propose a hierarchical dual-arm planning framework that integrates coverage wiping with active, reversible object removal, enabling complete access to occluded regions that are unreachable by conventional collision-avoidance strategies. (ii) We introduce Geo-MILP, a task planner that explicitly optimizes the temporal coordination of dual-arm actions, and combine it with a lbbd scheme to iteratively refine the schedule with geometric feedback, ensuring that the generated concurrent plans are not only time-efficient but also physically executable. (iii) We validate the proposed framework which achieves near-complete cleaning coverage in cluttered environments through extensive simulations and physcical experiments.

I-C Overview

The remainder of this paper is organized as follows: Section II provides a high-level system overview of the proposed coordinated framework and its hierarchical modules. Section III details the formulation of Geo-MILP task planner, and the LBBD-based geometric feedback mechanism. Section IV describes the KOMO-based motion planner used for trajectory generation and feasibility verification. Section V presents the simulation and physical experimental results. Finally, Section VI concludes the paper with discussions.

II Coordinated Framework

Fig. 2 provides an overview of our coordinated framework for cluttered tabletop wiping. The key challenge is that maximizing wiping coverage on a tabletop often requires interaction with movable objects, while achieving time efficiency demands temporal coordination between wiping and object rearrangement.

II-A CPP: Tabletop Coverage Path Generation

We first discretize the tabletop region into occupancy grids and construct a graph over the resulting cells. CPP then computes a coverage-efficient visiting order of waypoints for the wiper to achieve complete surface coverage. At this stage, clutter objects are treated as blocked nodes in the graph: we only identify occluded waypoints but do not generate any interaction or detouring logic. Accordingly, the output of CPP is a coverage-oriented abstraction, including the visiting sequence, adjacency relations, and the subset of occluded waypoints that are infeasible to wipe without manipulation.

II-B MILP-based Task Planner: Temporal Scheduling and Dual-Arm Coordination

Taking the coverage path and blocked-waypoint information produced by CPP as input, we formulate dual-arm coordination as a milp problem. The MILP assigns obstacle-handling primitives to the left arm (e.g., pick, place, and reversible actions that return objects to their original locations) and jointly schedules them on a timeline alongside the right arm’s wiping sequence. Its primary goal is to produce a geometrically feasible, time-optimal action schedule that minimizes the makespan under logical precedence and synchronization constraints. To efficiently solve the spatial temporal coupling, we formulate this layer using an optimization-based architecture rooted in lbbd. Specifically, the MILP acts as the Master Problem proposing a feasible schedule, while a geometric sub-problem iteratively verifies feasibility and injects logic-based cuts to prune invalid solutions. Through this iterative constraint injection, the task planner refines the schedule until a valid, collision-free task skeleton is found. The solver outputs a time-indexed dual-arm action sequence that balances sequencing and concurrency, avoiding conservative sequential execution.

II-C KOMO-based Motion Planner: Trajectory Generation

The discrete actions scheduled by the MILP is passed to the motion planner. We employ komo to translate each scheduled primitive into continuous constraints (e.g., end-effector pose targets for wipe and remove/place conditions) and jointly optimize the resulting trajectories. KOMO handles the robot’s kinematic constraints and the scene geometry, enforcing collision avoidance between the arms, the environment, and objects. By solving a trajectory optimization problem, KOMO produces smooth, physically executable, and collision-free trajectories for the scheduled action.

Fig. 3: the Geo-MILP Task Planning framework. The framework employs a lbbd scheme to resolve the spatial temporal coupling between the two arms. The Master Problem (MILP) optimizes the high-level task schedule based on logical dependencies, while the Geometric Sub-Problem iteratively verifies the feasibility of candidate schedules and injects logic-based cuts to resolve geometric conflicts. This closed-loop process ensures the generated plan is both time-efficient and physically executable.

III Task Planning via Logic-Based Benders Decomposition

The primary challenge in bimanual tabletop wiping is the tight spatial temporal coupling between the right arm’s continuous coverage and the left arm’s discrete rearrangement actions. Unlike search-based alternatives, our method leverages milp for global coordination, ensuring high search efficiency while maximizing bimanual concurrency.

III-A Graph Construction

As illustrated in Fig. 2, we first abstract the continuous workspace into a graph representation via cpp. To transform the surface-covering task into a discrete optimization problem, we perform workspace tessellation. Given a rectangular tabletop \mathcal{W}\subset\mathbb{R}^{2} and a wiping tool with an effective footprint \mathcal{F}, we discretize \mathcal{W} into a grid of cells. We construct a directed graph \mathcal{G}=(\mathcal{V},\mathcal{E}), where each node v\in\mathcal{V}=\{1,\dots,N\} corresponds to a cell center.

The edge set \mathcal{E} is generated based on a boustrophedon sweeping pattern to ensure full coverage while minimizing redundant traversals. We define an occupancy mapping \mathcal{O}:K\to 2^{\mathcal{V}}, where 2^{\mathcal{V}} denotes the power set of \mathcal{V}. For each obstacle k\in K=\{1,\dots,M\}, the mapping B(k)\in 2^{\mathcal{V}} identifies the subset of nodes occluded by the obstacle’s physical footprint. Consequently, the coordinated wiping task is formalized as a constrained optimization problem: finding a time-optimal path for the right arm that covers all nodes in \mathcal{G}, synchronized with the left arm’s rearrangement sequence to clear obstructed regions B(k).

III-B Master Problem: Temporal-Logic MILP Formulation

As shown in Fig. 3, the Master Problem optimizes the symbolic task sequence and the global timeline, ensuring that all logical dependencies and temporal constraints are satisfied before geometric verification. We formulate this as a MILP model to minimize the total completion time (makespan).

1) Continuous Variables (\in\mathbb{R}_{\geq 0}):

T_{r}^{\mathrm{end}},T_{l}^{\mathrm{end}}: Right and left arm completion times.

T^{\mathrm{end}}: Overall makespan of the task (\max\{T_{r}^{\mathrm{end}},T_{l}^{\mathrm{end}}\}).

A_{v}: The time step index when right arm visits node v.

S_{k}^{\alpha},E_{u}^{\alpha}: Start and end times for action primitive \alpha (\in\{\textit{wipe},\textit{pick},\textit{remove},\textit{place},\textit{release}\}) on obstacle k or waypoint u.

2) Binary Variables (\in\{0,1\}):

x_{u,v}^{t}: Indicator for traversing edge (u,v) (\in\mathcal{E}) at discrete step t.

y_{k,u}: Logical switch variable for resolving geometric collisions between left-arm action on obstacle k and right-arm action at waypoint u.

3) Objective Function:

\min\quad T^{\mathrm{end}}\;+\;\varepsilon\sum_{t=2}^{T_{max}}\sum_{i\in\mathcal{V}}x^{t}_{ii},\quad\varepsilon\in(0,1)
(1)

where T_{max} is the maximum allowable time steps. We minimize the total makespan while penalizing unnecessary right-arm waiting self-loops (x_{ii}^{t}) to prioritize active movement.

4) Subject to Constraints:

\displaystyle A_{v}=\sum_{t=1}^{T_{max}}t\cdot\left(\sum_{u\in\mathcal{V}}x_{u,v}^{t}\right),\quad\forall v\in\mathcal{V} \\ \displaystyle A_{v}\geq E_{k}^{\textit{remove}}+1,\quad\forall k\in K,\forall v\in B(k) \\ \displaystyle E_{k}^{\textit{pick}}\leq S_{k}^{\textit{remove}}\leq E_{k}^{\textit{remove}} \\ \displaystyle\leq S_{k}^{\textit{place}}\leq E_{k}^{\textit{place}}\leq S_{k}^{\textit{release}},\quad\forall k\in K
(2) (3) (4)

The constraints above bridge high-level task logic with low-level temporal execution. Specifically, Eq. (2) retrieves the arrival time A_{v} from the time-indexed binary decision variables. Eq. (3) acts as a safety gate, ensuring that the right arm arrives at an occluded waypoint v strictly after the left arm has completed the remove action (the +1 term enforces the strict inequality t>t_{remove} implied by the discrete state update). Finally, Eq. (4) enforces a strict causal sequence for the left-arm manipulation primitives, ensuring logically sound obstacle rearrangement.

III-C Geometric Sub Problem: Benders Cut Generation

The high-level schedule \mathcal{S} produced by the MILP layer may still contain geometric infeasibilities, such as collisions between the left arm’s pick motion and the right arm’s wipe motion.

We invoke a Geometric Verifier to validate the schedule. As detailed in Algorithm 1, if a collision is detected between Left Action at obstacle k and Right Action at waypoint u, we generate a Separation Constraint (No-good Cut). By introducing a binary decision variable y_{k,u}\in\{0,1\}, we inject disjunctive Big-M constraints into the Master Problem:

\displaystyle S_{u} \\ \displaystyle\geq E_{k}-\mathcal{M}(1-y_{k,u}) \\ \displaystyle S_{k} \\ \displaystyle\geq E_{u}-\mathcal{M}y_{k,u}
(5) (6)

where \mathcal{M} is a large constant. y_{k,u} acts as a logical switch that forces the solver to choose a precedence order: either the left arm completes its action before the right arm starts (y_{k,u}=0), or vice versa (y_{k,u}=1). The MILP solver selects the precedence direction that is optimal for the current master problem under the accumulated cuts. It then shifts the action windows to obtain a conflict-free schedule after verification. For instance, if a geometric collision occurs during a pick action, the solver can seamlessly delay the left arm or command the right arm to wait at a safe node, effectively reshaping the continuous feasible region without the need to backtrack through the discrete task skeleton.

We solve the MILP with Gurobi to optimize (1), obtaining the makespan T^{\mathrm{end}} and its associated discrete action plan. For downstream path planning, we organize the solution as two time-ordered sequences: \mathcal{A}^{R}=\{(t,x_{u,v}^{t},\nu_{t})\}_{t=1}^{T^{end}} and \mathcal{A}^{L}=\{(t,\alpha_{t},k)\}_{t=1}^{T^{end}}. The overall framework does not guarantee global optimality for the planning problem, since geometric conflicts are resolved through temporal precedence constraints. We therefore describe the resulting solutions as low-makespan schedules rather than globally optimal ones.

Algorithm 1 Geo-MILP Solver

IV Continuous Motion Generation via Path Optimization

After decomposing the overall tabletop wiping task into subtasks and determining the optimal discrete schedule \mathcal{A}^{R} and \mathcal{A}^{L}, the motion planner must generate continuous, collision-free, and dynamically smooth trajectories. In this section, we utilize the komo framework to transform high-level subtask sequences into executable joint configurations by solving a non-linear constrained optimization problem.

IV-A K-Order Markov Path Optimization

komo is an efficient framework for solving trajectory optimization problems [34]. It represents a path in the robot configuration space as a discrete sequence of waypoints \boldsymbol{q}_{0:T}=\{\boldsymbol{q}_{0},\dots,\boldsymbol{q}_{T}\}, where \boldsymbol{q}_{t}\in\mathbb{R}^{n} denotes the joint angles and n represents the manipulator’s degrees of freedom (DOF). Under the k-order Markov assumption, the cost and constraint functions at any time t are evaluated on k+1 consecutive waypoints \boldsymbol{q}_{t-k:t}. This allows the optimization problem to be formulated in a general k-order non-linear sum-of-squares constrained form:

\displaystyle\min_{\boldsymbol{q}_{0:T}}\quad \\ \displaystyle\sum_{t=0}^{T}\boldsymbol{f}_{t}\left(\boldsymbol{q}_{t-k:t}\right)^{\top}\boldsymbol{f}_{t}\left(\boldsymbol{q}_{t-k:t}\right) \\ \displaystyle\text{s.t.}\quad\forall t:\quad \\ \displaystyle\boldsymbol{g}_{t}\left(\boldsymbol{q}_{t-k:t}\right)\leq 0,\quad\boldsymbol{h}_{t}\left(\boldsymbol{q}_{t-k:t}\right)=0
(7)

where \boldsymbol{f}_{t} represents the cost terms, while \boldsymbol{g}_{t} and \boldsymbol{h}_{t} denote inequality and equality constraints, respectively. Problem (7) is solved by the Augmented Lagrangian method, which reformulates the constrained problem into an unconstrained one by introducing Lagrange multipliers and penalty terms, making it suitable for handling complex non-linear geometric constraints.

IV-B Mapping Task Sequences to Optimization Constraints

The core of our motion planner is the automatic translation of the discrete arrival-action sequences \mathcal{A}^{R} and \mathcal{A}^{L} into a unified KOMO optimization problem. Each discrete time step t in the MILP schedule corresponds to a fixed time interval in KOMO. For each subtask (\alpha_{t},x_{u,v}^{t}) in the sequences, we impose task-specific constraints over its duration. For instance, during a wipe action, the end-effector is constrained to the tabletop surface with a specific orientation, while for the left arm’s pick and place actions, grasping constraints are enforced at specific time-slices.

IV-C Objective Function: Smoothness and Regularization

The cost function \boldsymbol{f} in Eq. (7) ensures the generated motion is both natural and efficient.

1) Joint Deviation (k=0): To maintain a favorable configuration and avoid singular poses, we penalize the squared deviation of a configuration \boldsymbol{q}_{t} from a reference configuration \boldsymbol{q}_{ref}:

\boldsymbol{f}_{0}(\boldsymbol{q}_{t})=\sqrt{w_{pos}}(\boldsymbol{q}_{t}-\boldsymbol{q}_{ref})
(8)

where w_{pos}>0 is a scalar weighting factor that regulates the trade-off between task-specific constraints and the preference for a neutral robot posture, providing numerical stability and intuitive tuning of the regularization strength.

2) Control Effort (k=1,2): We penalize high-order derivatives of the trajectory to ensure smoothness. Specifically, we minimize joint velocities and accelerations through finite-difference operators:

\dot{\boldsymbol{q}}_{t}\approx\frac{\boldsymbol{q}_{t}-\boldsymbol{q}_{t-1}}{\Delta t},\quad\ddot{\boldsymbol{q}}_{t}\approx\frac{\boldsymbol{q}_{t+1}-2\boldsymbol{q}_{t}+\boldsymbol{q}_{t-1}}{\Delta t^{2}}
(9)

The velocity penalty (first-order difference) penalizes large joint displacements, ensuring the manipulator does not move excessively fast during execution.

IV-D Geometric and Kinematic Constraints

1) Joint Limits and Collision Avoidance: We impose strict inequality constraints to respect the physical joint bounds \boldsymbol{q}_{\min}\leq\boldsymbol{q}_{t}\leq\boldsymbol{q}_{\max}. Collision-free motion is ensured by evaluating distances d_{ij}(\boldsymbol{q}_{t}) between all rigid body bounding volumes K_{i} and K_{j}. We enforce a non-penetration condition with a safety margin \delta:

\boldsymbol{g}_{coll}(\boldsymbol{q}_{t})=\delta-d_{ij}(\boldsymbol{q}_{t})\leq 0
(10)

In this work, we use the Gilbert-Johnson-Keerthi (GJK) algorithm to compute Euclidean distances and enforce the accumulated collision measure to be zero.

2) Pose Alignment Constraints: For precise interaction tasks, such as wiping or grasping, we define position \boldsymbol{P}(\boldsymbol{q}_{t}) and orientation \boldsymbol{R}(\boldsymbol{q}_{t}) via forward kinematics. Alignment is enforced via equality constraints:

\displaystyle\boldsymbol{h}_{pos} \\ \displaystyle=\boldsymbol{P}(\boldsymbol{q}_{t})-\boldsymbol{p}^{\star}=0 \\ \displaystyle\boldsymbol{h}_{ori} \\ \displaystyle=\operatorname{Log}(\boldsymbol{r}^{\star}{}^{\top}\boldsymbol{R}(\boldsymbol{q}_{t}))=0
(11) (12)

where (\boldsymbol{p}^{\star},\boldsymbol{r}^{\star}) is the target pose and \operatorname{Log}(\cdot) produces a minimal 3D orientation error. Additionally, we use axial alignment to constrain specific tool axes \boldsymbol{u}_{i}(\boldsymbol{q}_{t}) relative to environmental vectors \boldsymbol{v}_{j}:

\boldsymbol{h}_{axis}=\boldsymbol{u}_{i}(\boldsymbol{q}_{t})^{\top}\boldsymbol{v}_{j}-c_{i}=0
(13)

where c_{i}=1 enforces parallel alignment.

V Simulation and Experiment

We evaluate our coordinated dual-arm wiping framework in both simulation and real-robot experiments. The experiments are designed to answer three questions: (Q1) Does explicit object interaction improve achievable coverage beyond obstacle-detouring CPP? (Q2) Does MILP-based temporal coordination improve efficiency over standard TAMP baselines? (Q3) Is the proposed Geo-MILP (LBBD-style) feedback loop necessary to ensure geometric feasibility and reduce expensive geometric re-planning?

V-A Experimental Setup

The simulated environment features a 0.4\,\text{m}\times 0.75\,\text{m} tabletop workspace cluttered with |\mathcal{K}|\in\{1,2,3\} movable objects, as shown in Fig. 4(a). To perform coverage tasks, the right arm is equipped with a rectangular wiping tool of size 0.09\,\text{m}\times 0.15\,\text{m}. Each object occludes a specific subset of waypoints (blocked nodes B(k)) derived from the wiper’s footprint. The dual-arm system is configured with the right arm as the primary wiper and the left arm as the support for object rearrangement. For each difficulty level, we evaluate the performance over N_{\text{sim}}=10 randomized configurations to ensure statistical significance.

Real-world validation was conducted on two 7-DoF Franka Research arms in a bimanual configuration. To verify the framework’s versatility, we also deploy the algorithm on a Kuavo humanoid robot, as shown in Fig. 4(b) and (c). The experimental workspace consists of a 0.6\,\text{m}\times 0.8\,\text{m} tabletop, and the physical wiper measures 0.2\,\text{m}\times 0.1\,\text{m}, adapting to the real-world scale.

V-B Behavioral Analysis and Validation

We qualitatively evaluate the efficacy of the proposed strategies by analyzing the robot’s interaction behaviors in physical environments.

1) Efficacy of dual arm cooperation: As shown in the qualitative execution sequence in Fig. 5, Geo-MILP proactively identifies these occlusions and coordinates the support arm to temporarily relocate obstacles. By mathematically ensuring all unblocked and temporarily unblocked nodes in the CPP graph are visited, our framework inherently guarantees complete coverage of the reachable workspace when the geometric sub-problem yields feasible continuous trajectories, which is visibly confirmed by the qualitative results.

Fig. 4: Experimental setups for the dual-arm tabletop wiping task. (a) The simulation environment used for evaluation. The semi-transparent overlays conceptualize the random spatial variance of the objects. For visual clarity, only a representative subset of the 10 randomized initializations is shown. (b) Real-world deployment on a dual Franka Research robotic system. (c) Hardware transferability demonstration on the Kuavo humanoid robot platform.

2) Physical Execution on Heterogeneous Platforms: We further validated the feasibility of the generated plans on two distinct physical platforms.

On the Franka setup, the system successfully executed coordinated sequences pick-remove-wipe-place-release for scenarios with up to three obstacles. The motion planner (KOMO) generated smooth trajectories that maintained strict safety margins, even during close-proximity bimanual operations where the wiper passed dangerously close to the support arm. Compared to sequential baselines like PDDLStream, our method exhibited visible concurrency, with the wiping arm moving to the next region immediately while the support arm was restoring the previous object, thereby minimizing idle time.

The deployment on the Kuavo humanoid demonstrates the framework’s kinematic adaptability. Although the robot’s fixed-base configuration limited the reachable workspace to a sub-region of the table, the system successfully performed the coordinated wiping and rearrangement tasks within its range. This validates that our logic-layer scheduling (Stage II) is agnostic to the underlying hardware, provided the motion planning layer (Stage III) is correctly configured for the specific robot kinematics.

Fig. 5: Qualitative execution sequence. (1) & (4): Our framework enables true bimanual concurrency: the left arm picks and removes the obstacle, allowing the right arm to wipe the previously occluded surface, followed by placing the object back. (2) & (3): Comparison of before and after states across different objects. Unlike static single-arm CPP detouring, our reversible relocation strategy achieves complete workspace coverage without leaving uncleaned patches.
Fig. 6: Quantitative performance comparison. (a) Success Rate: Task success rates across varying clutter complexities. The shared legend applies to all subfigures. (b) Planning Time: Distributions highlighting the tight variance of Geo-MILP compared to search-based baselines. (c) Execution Makespan: Total execution time, showing significant bimanual efficiency gains.

V-C Efficiency Improvement over PDDLStream

Fig. 6 compares the performance against standard sequential TAMP (PDDLStream) baselines in terms of both planning and execution efficiency. Since PDDLStream does not explicitly optimize makespan in our implementation, this comparison should be interpreted as a sequential-versus-coordinated comparison rather than a full comparison against all temporal or parallel TAMP methods.

1) Planning Efficiency: As shown in Fig. 6(b), PDDLStream suffers from an exponential growth in computation time as the number of objects increases, due to the combinatorial explosion in symbolic state search. In contrast, Geo-MILP achieves a significant speedup (e.g., approximately 9\times faster in 3-object scenes), maintaining a tractable polynomial growth in planning time. The box plots further reveal that while PDDLStream exhibits a long-tailed distribution (high variance), Geo-MILP demonstrates significantly tighter interquartile ranges (IQR), indicating superior algorithmic scalability and stability.

2) Execution Efficiency: In terms of physical execution, our MILP formulation explicitly promotes concurrency between wiping and obstacle handling. As shown in Fig. 6(c), we observe a consistent reduction in the median makespan (e.g., approximately 40\% reduction) compared to the sequential baseline. This confirms that our framework not only computes solutions faster but also generates higher-quality schedules that minimize robot idle time.

V-D Ablation on Geometric Feedback with LBBD Cuts

TABLE I: Geo-MILP statistics and planning-time breakdown. The results are reported as mean \pm standard deviation over 10 randomized trials per complexity level.
  • 1
    Geo iters
    2.5\pm 0.5
    MILP time (s)
    2.57\pm 0.83
    KOMO time (s)
    11.30\pm 1.45
  • 2
    Geo iters
    3.8\pm 1.0
    MILP time (s)
    6.39\pm 2.28
    KOMO time (s)
    11.79\pm 0.60
  • 3
    Geo iters
    5.3\pm 1.1
    MILP time (s)
    19.56\pm 1.87
    KOMO time (s)
    15.43\pm 1.25

To validate the necessity of the LBBD feedback loop, we compare against a Decoupled MILP+KOMO baseline where geometric cuts are disabled. As illustrated in the planning time distribution (Fig. 6(b)), the decoupled baseline achieves the lowest computation time (averaging 11–17s) by bypassing the expensive geometric verification loop. However, this efficiency is deceptive: without geometric feedback, the planner generates aggressively concurrent schedules that frequently fail during downstream motion generation due to close-proximity dual-arm conflicts. Consequently, its success rate drops significantly in cluttered scenes (as shown in Fig. 6(a)).

In contrast, Geo-MILP incurs a moderate overhead (averaging 14–37 s total planning time) to rigorously enforce geometric consistency. By iteratively injecting the compact temporal cuts, our method resolves conflicts and converges within 2–6 iterations. Crucially, as detailed in Table I, Geo-MILP exhibits remarkable computational stability. Even in dense 3-object clutter, the geometric iteration count remains tightly bounded (5.3\pm 1.1), and the MILP solve time maintains low variance (19.56\pm 1.87 s). This confirms that our LBBD formulation effectively constrains the search space, avoiding erratic computational spikes and reliably transforming a theoretical schedule into a physically executable one.

Overall, the results show that (i) reversible object relocation is essential for achieving complete wiping coverage in clutter; (ii) explicit temporal coordination via MILP yields substantial efficiency gains over sequential TAMP; (iii) the Geo-MILP feedback loop is critical for producing executable concurrent schedules with high success rates under geometric constraints.

VI Conclusion and Discussion

In this paper, we proposed a hierarchical dual-arm planning framework for thorough tabletop wiping in cluttered environments. By leveraging lbbd, we successfully decoupled symbolic scheduling from geometric verification using Geo-MILP. Unlike conventional search-based TAMP solvers that prioritize logical satisfiability, our MILP-based planner explicitly optimizes the global makespan, promoting maximal concurrency between the two arms. Experimental results demonstrate that our method achieves near-total surface coverage while significantly reducing execution time compared to sequential baselines.

While our framework provides a robust solution, it resolves geometric conflicts solely through temporal precedence constraints under fixed primitive definitions. The possibility of adapting grasp poses, wiping directions, or object placements when conflicts arise is not explored. Future work will incorporate sampled grasp and placement candidates to enable joint spatial reasoning over multiple manipulation alternatives. Additionally, integrating real-time visual feedback will enable more adaptive cleaning in dynamic and unpredictable domestic environments. Also, improving computational efficiency for larger object sets, denser clutter, and finer coverage grids remains important for future research.

References

  1. [1] J. Kim, A. K. Mishra, R. Limosani, M. Scafuro, N. Cauli, J. Santos-Victor, B. Mazzolai, and F. Cavallo (2019) Control strategies for cleaning robots in domestic applications: a comprehensive review. International Journal of Advanced Robotic Systems 16 (4), pp. 1729881419857432.
  2. [2] R. K. Megalingam, S. R. R. Vadivel, S. S. Kotaprolu, B. Nithul, D. V. Kumar, and G. Rudravaram (2025) Cleaning robots: a review of sensor technologies and intelligent control strategies for cleaning. Journal of Field Robotics.
  3. [3] M. Mayr, F. Ahmad, A. Duerr, and V. Krueger (2023) Using knowledge representation and task planning for robot-agnostic skills on the example of contact-rich wiping tasks. In IEEE 19th international Conference on automation Science and engineering (CASE),
  4. [4] P. Veerajagadheswar, S. Yuyao, P. Kandasamy, M. R. Elara, and A. A. Hayat (2022) S-sacrr: a staircase and slope accessing reconfigurable cleaning robot and its validation. IEEE Robotics and Automation Letters 7 (2), pp. 4558–4565.
  5. [5] A. M. Kabir, K. N. Kaipa, J. Marvel, and S. K. Gupta (2017) Automated planning for robotic cleaning using multiple setups and oscillatory tool motions. IEEE Transactions on Automation Science and Engineering 14 (3), pp. 1364–1377.
  6. [6] E. Galceran and M. Carreras (2013) A survey on coverage path planning for robotics. Robotics and Autonomous systems 61 (12), pp. 1258–1276.
  7. [7] C. S. Tan, R. Mohd-Mokhtar, and M. R. Arshad (2021) A comprehensive review of coverage path planning in robotics using classical and heuristic algorithms. IEEE Access 9, pp. 119310–119342.
  8. [8] R. Bormann, F. Jordan, J. Hampp, and M. Hägele (2018) Indoor coverage path planning: survey, implementation, analysis. In IEEE International Conference on Robotics and Automation (ICRA),
  9. [9] Y. Wang and M. Gleicher (2025) Hierarchically accelerated coverage path planning for redundant manipulators. arXiv preprint arXiv:2502.19591.
  10. [10] W. Zhang, Z. Li, L. M. Tam, and Q. Xu (2024) Novel complete coverage path planning of a biped wall-climbing robot for window cleaning. In 2024 IEEE International Conference on Robotics and Biomimetics (ROBIO),
  11. [11] Y. Wen, D. J. Jaeger, and P. R. Pagilla (2022) Uniform coverage tool path generation for robotic surface finishing of curved surfaces. IEEE Robotics and Automation Letters 7 (2), pp. 4931–4938.
  12. [12] S. McGovern and J. Xiao (2023) A general approach for constrained robotic coverage path planning on 3d freeform surfaces. IEEE Transactions on Automation Science and Engineering 21 (4), pp. 5546–5557.
  13. [13] S. Schneyer, A. Sachtler, T. Eiband, and K. Nottensteiner (2023) Segmentation and coverage planning of freeform geometries for robotic surface finishing. IEEE Robotics and Automation Letters 8 (8), pp. 5267–5274.
  14. [14] F. Tsai and K. Song (2024) Path planning and control of a 6-dof manipulator for freeform surface polishing based-on a point cloud model. In 2024 International Conference on Advanced Robotics and Intelligent Systems (ARIS),
  15. [15] C. R. Garrett, R. Chitnis, R. Holladay, B. Kim, T. Silver, L. P. Kaelbling, and T. Lozano-Pérez (2021) Integrated task and motion planning. Annual review of control, robotics, and autonomous systems 4 (1), pp. 265–293.
  16. [16] L. P. Kaelbling and T. Lozano-Pérez (2011) Hierarchical task and motion planning in the now. In IEEE International Conference on Robotics and Automation (ICRA),
  17. [17] Z. Jiao, Z. Zhang, W. Wang, D. Han, S. Zhu, Y. Zhu, and H. Liu (2021) Efficient task planning for mobile manipulation: a virtual kinematic chain perspective. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS),
  18. [18] D. McDermott, M. Ghallab, A. Howe, C. Knoblock, A. Ram, M. Veloso, D. Weld, and D. Wilkins (1998) PDDL-the planning domain definition language. Technical Report.
  19. [19] S. Edelkamp and J. Hoffmann (2004) PDDL2.2: the language for the classical part of the 4th international planning competition. Technical Report 195, University of Freiburg.
  20. [20] J. Martínez-de-Dios, L. Merino, A. Ollero, L. M. Ribeiro, and X. Viegas (2007) Multi-uav experiments: application to forest fires. In Multiple heterogeneous unmanned aerial vehicles, pp. 207–228.
  21. [21] L. Collins, P. Ghassemi, E. T. Esfahani, D. Doermann, K. Dantu, and S. Chowdhury (2021) Scalable coverage path planning of multi-robot teams for monitoring non-convex areas. In IEEE International Conference on Robotics and Automation (ICRA),
  22. [22] C. Smith, Y. Karayiannidis, L. Nalpantidis, X. Gratal, P. Qi, D. V. Dimarogonas, and D. Kragic (2012) Dual arm manipulation—a survey. Robotics and Autonomous systems 60 (10), pp. 1340–1353.
  23. [23] S. S. Mirrazavi Salehian, N. Figueroa, and A. Billard (2018) A unified framework for coordinated multi-arm motion planning. The International Journal of Robotics Research 37 (10), pp. 1205–1232.
  24. [24] K. Shi, J. Chang, S. Feng, Y. Fan, Z. Wei, and G. Hu (2024) Safe human dual-robot interaction based on control barrier functions and cooperation functions. IEEE Robotics and Automation Letters 9 (11), pp. 9581–9588.
  25. [25] C. Jiao, L. Zhang, X. Su, J. Huang, Z. Bing, and A. Knoll (2023) Task-based compliance control for bottle screw manipulation with a dual-arm robot. IEEE Transactions on Industrial Electronics 71 (2), pp. 1823–1831.
  26. [26] T. Pan, A. M. Wells, R. Shome, and L. E. Kavraki (2021) A general task and motion planning framework for multiple manipulators. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS),
  27. [27] W. Li, S. Zhang, S. Dai, H. Huang, R. Hu, X. Chen, and K. Xu (2024) Synchronized dual-arm rearrangement via cooperative mtsp. In IEEE International Conference on Robotics and Automation (ICRA),
  28. [28] C. R. Garrett, T. Lozano-Pérez, and L. P. Kaelbling (2020) PDDLStream: integrating symbolic planners and blackbox samplers via optimistic adaptive planning. In Proceedings of International Conference on Automated Planning and Scheduling (ICAPS),
  29. [29] Z. Jiao, Y. Niu, Z. Zhang, Y. Wu, Y. Su, Y. Zhu, H. Liu, and S. Zhu (2025) Integration of robot and scene kinematics for sequential mobile manipulation planning. IEEE Transactions on Robotics (T-RO).
  30. [30] A. Coles, A. Coles, M. Fox, and D. Long (2010) Forward-chaining partial-order planning. In Proceedings of the International Conference on Automated Planning and Scheduling, Vol. 20, pp. 42–49.
  31. [31] A. Gerevini, A. Saetti, and I. Serina (2003) Planning through stochastic local search and temporal action graphs in lpg. Journal of Artificial Intelligence Research 20, pp. 239–290.
  32. [32] J. Chen, J. Li, Y. Huang, C. Garrett, D. Sun, C. Fan, A. Hofmann, C. Mueller, S. Koenig, and B. C. Williams (2022) Cooperative task and motion planning for multi-arm assembly systems. arXiv preprint arXiv:2203.02475.
  33. [33] V. N. Hartmann and M. Toussaint (2023) Towards computing low-makespan solutions for multi-arm multi-task planning problems. arXiv preprint arXiv:2305.17527.
  34. [34] M. Toussaint (2014) Newton methods for k-order markov constrained motion problems. arXiv preprint arXiv:1407.0414.