Collaborative Planning for UAV-UGV Teams under Operational Constraints via Masked Error-bounded Neuro-Symbolic Diffusion
Collaborative planning under operational constraints is essential for heterogeneous robot teams in large-scale missions. Unmanned Aerial Vehicles (UAVs) provide rapid area coverage but are limited by onboard energy, while Unmanned Ground Vehicles (UGVs) can serve as mobile recharging stations yet are constrained by road-network traversability.
Aus dem Abstract. Unsere Zusammenfassung folgt.
Vollständige Studie
Collaborative Planning for UAV-UGV Teams under Operational Constraints via Masked Error-bounded Neuro-Symbolic Diffusion
Veröffentlicht unter CC BY 4.0. Wiedergabe mit Namensnennung, Original unter arXiv:2610.18850 (PDF).
Abstract
Collaborative planning under operational constraints is essential for heterogeneous robot teams in large-scale missions. Unmanned Aerial Vehicles (UAVs) provide rapid area coverage but are limited by onboard energy, while Unmanned Ground Vehicles (UGVs) can serve as mobile recharging stations yet are constrained by road-network traversability. Effective collaboration must enforce operational constraints during execution while enabling parallel, coordinated actions. Masked Diffusion Models (MDMs) have shown promise through token unmasking but have two key limitations: entropy-guided scheduling assumes distributional alignment and reliance on differentiable constraints for diffusion-time optimization. We propose Masked Error-bounded Neuro-Symbolic Diffusion (MEND), which formulates collaborative planning as a conditional masked generative process to generate context-aware action sequences for UAV-UGV teams. MEND introduces a neuro-symbolic diffusion paradigm that constrains conditional masked diffusion policies at execution by reweighting the learned action distribution with a logic-induced admissibility indicator, thereby enforcing compliance with operational constraints. MEND introduces an error-bounded inference scheduling at execution that constructs the unmasking schedule by selecting positions with minimal predictive entropy over the constraint-aware action distribution, enhancing collaborative planning optimality under operational constraints. Extensive experimental results in simulation, on real-world maps, and with physical robot teams demonstrate that MEND advances UAV-UGV collaborative planning under operational constraints. More details are available on the website: https://hcrlab.gitlab.io/project/mend.
Keywords: Heterogeneous Multi-Robot Planning, Neuro-Symbolic Diffusion.
1 Introduction
Collaborative planning enables multi-robot systems to coordinate actions and share resources for interdependent tasks, supporting parallel operation [1], scalability [2], and robustness [3]. In applications such as search and rescue [4, 5, 6, 7] and environmental monitoring [8, 9, 10, 11], robot teams are often heterogeneous, comprising platforms with complementary capabilities and constraints. For example, Unmanned Aerial Vehicles (UAVs) provide rapid area coverage but are limited by onboard energy, whereas Unmanned Ground Vehicles (UGVs) offer substantial power reserves and enable in-mission UAV recharging, yet are constrained by road-network traversability. Consequently, collaborative planning must explicitly enforce operational constraints at execution time. To ensure efficiency, multi-robot systems must execute plans in parallel with synchronized actions (Figure 1).
Optimization-based methods, e.g., mixed-integer programming [12, 13, 14], and symbolic planners, e.g., based on First-Order Logic (FOL) [15, 16, 17], provide optimal solutions and constraint satisfaction but scale poorly due to combinatorial search. Reinforcement learning methods [18] often assume greedy recharging, simplify robot motion, or encode constraints only during training. Diffusion models excel in trajectory planning [19, 20, 21, 22], while Masked Diffusion Models (MDMs) achieve stronger results via token unmasking [23, 24]. MDMs typically employ entropy-guided inference scheduling [25, 26] to improve sampling quality. However, they assume alignment between the learned and true distributions; when generated actions violate constraints, entropy estimates are distorted, leading to suboptimal solutions that breach operational constraints in collaborative planning. Recent work extends MDMs to constrained generation via classifier-guidance [27] and neuro-symbolic constraint enforcement during sampling [28, 29]. However, a theoretical limitation is that they rely on gradient-based optimization over differentiable constraints in sampling, whereas operational constraints are often discrete, non-differentiable, and not preserved by standard diffusion dynamics.
We propose Masked Error-bounded Neuro-Symbolic Diffusion (MEND), a theoretical approach for collaborative planning in heterogeneous teams under operational constraints. MEND represents interdependent operational contexts as a graph, and formulates collaborative planning as a conditional masked generative process to generate context-aware action sequences for UAVs and UGVs. MEND introduces a neuro-symbolic diffusion paradigm that constrains conditional masked diffusion policies at execution time by reweighting the learned action distribution with a FOL-induced admissibility indicator, thereby enforcing compliance with operational constraints at execution. MEND also introduces an error-bounded inference scheduling strategy at execution that constructs the unmasking schedule by selecting positions with minimal predictive entropy over the constraint-aware action distribution, enhancing collaborative planning optimality under operational constraints. The joint action sequences generated by MEND are executed by UAVs and UGVs simultaneously, which enables parallel operation of heterogeneous robots while satisfying operational constraints.
Our contribution is MEND, a novel and principled learning approach for masked error-bounded neuro-symbolic diffusion, to enable collaborative planning for UAV-UGV teams under operational constraints. MEND introduces two key novelties: MEND introduces two key novelties:
- Execution-time masked neuro-symbolic diffusion that constrains conditional masked diffusion policies via neuro-symbolic reasoning, reshaping the learned action distribution into a constraint-aware distribution using a logic-induced admissibility indicator. This enables the satisfaction of non-differentiable constraints that cannot be optimized by gradient-based diffusion updates, thereby enforcing operational constraints for UAV-UGV teams.
- Execution-time error-bounded inference scheduling, which guarantees that predictive entropy computed under the constraint-aware action distribution incurs a provably smaller sampling error relative to the true distribution. This reduces misalignment between the learned and true action distributions, thereby improving collaborative planning optimality under operational constraints.
2 Related Work
Collaborative Planning for Multi-Robot Systems
Optimization-based methods formulate UAV-UGV planning as NP-hard routing problems. Mixed Integer Programming (MIP) [30, 12, 13, 14], dynamic programming [31, 32, 33], and heuristic search methods [34, 35, 36, 37, 38, 39] can compute optimal or near-optimal solutions, but their computational cost limits scalability and real-time deployment.
Symbolic planning employs predicate-based representations for constraint-guaranteed reasoning. Prior work uses action language BC [40, 41], Planning Domain Definition Language (PDDL) [42, 43], Temporal Logic (TL) [44, 45], and Backus-Naur Form (BNF) [46] to model mission structures and operational constraints in multi-robot systems. These formalisms are largely grounded in First-Order Logic (FOL) [15, 16, 17], enabling quantified reasoning for constraint-aware multi-robot planning.
Reinforcement Learning has been applied to routing tasks [47, 48, 49] with energy-constraints [50, 51, 52], combined with Graph Learning to encode context [53, 54, 55]. Neuro-symbolic approaches have emerged for both single-robot [56] and multi-robot systems [57, 58, 59, 60] for constraint satisfaction. Energy-constrained UAVs with UGV support have been explored [18]. However, these methods are often limited by greedy recharging strategies, simplify UGV traversal as straight-line trajectories, and enforce constraints during training rather than providing execution-time guarantees.
Masked Diffusion Models.
Diffusion models have shown promise in trajectory planning [19, 20, 21, 22]. In discrete domains, masked diffusion models (MDMs) achieve competitive results in task and maze planning [61, 62, 23, 63, 24]. Recent work extends MDMs to constrained generation via classifier-guidance and neuro-symbolic reasoning [27, 28, 29]. However, these approaches rely on differentiable constraints optimized during diffusion via gradient-based updates, whereas operational constraints are often discrete, non-differentiable, and not preserved by standard diffusion dynamics.
MDMs support flexible inference schedules, whose choice strongly affects sampling quality, as random unmasking can lead to error propagation [64]. Prior work improves sampling via variable-length generation [24], caching [65], and entropy-guided scheduling [66, 25], with recent theory relating optimal scheduling to predictive entropy [26]. However, existing entropy-guided scheduling assumes alignment between the learned and true data distributions; when constraints are violated, entropy estimates become distorted, resulting in biased unmasking schedules in practice.
3 Preliminaries
Masked Diffusion Models (MDMs) [67] define a discrete-time Markov chain a_{0}\rightarrow a_{1}\rightarrow\cdots\rightarrow a_{T}, where a_{0}=(a_{0}^{1},\dots,a_{0}^{L})\in\mathcal{A}^{L} is the ground-truth sequence of length L and a_{t}\in(\mathcal{A}\cup\{m\})^{L} for t\in\{0,\dots,T\}, with vocabulary \mathcal{A} and mask token m. The forward process progressively corrupts a_{0} by replacing tokens with m. At diffusion step t, a_{t} is sampled from the distribution q(a_{t}|a_{0})=\prod_{i=1}^{L}q(a_{t}^{i}|a_{0}^{i}) and q(a_{t}^{i}|a_{0}^{i})=\mathrm{Cat}\!\left(\alpha_{t}\,\mathbf{e}_{a_{0}^{i}}+(1-\alpha_{t})\,\mathbf{e}_{m}\right), where \alpha_{t}\in[0,1] denotes a predefined noise schedule, and \mathbf{e}_{a_{0}^{i}} and \mathbf{e}_{m} denote the one‑hot vector of a_{0}^{i} and m, respectively. The reverse process iteratively reconstructs a_{0} from a masked sequence a_{T}=(m,\dots,m). For any intermediate step s<t, we sample a_{s}\sim q(a_{s}\mid a_{t},a_{0})=\prod_{i=1}^{L}q(a_{s}^{i}\mid a_{t},a_{0}), where q(a_{s}^{i}\mid a_{t},a_{0})=\mathrm{Cat}(\mathbf{e}_{a_{t}^{i}}) if a_{t}^{i}\neq m, and otherwise \mathrm{Cat}\!\big(\frac{1-\alpha_{s}}{1-\alpha_{t}}\mathbf{e}_{m}+\frac{\alpha_{s}-\alpha_{t}}{1-\alpha_{t}}\mathbf{e}_{a_{0}^{i}}\big). Thus, if a_{t}^{i}\neq m, the token remains unchanged, i.e., a_{s}^{i}=a_{t}^{i}; otherwise, a_{s}^{i}\in\{m,a_{0}^{i}\} according to \alpha_{s} and \alpha_{t}.
MDM Inference Scheduling
At diffusion step t, given a set of masked positions, an inference schedule is a mapping \mathcal{S}:\{T,\dots,1\}\rightarrow 2^{\{1,\dots,L\}}, where \mathcal{S}(t)\subseteq\{i\in\{1,\dots,L\}\,|\,a_{t}^{i}=m\} specifies the subset of masked positions to be revealed. The reveal set is updated as S_{t+1}=S_{t}\cup\mathcal{S}(t), resulting \{S_{t}\}_{t=0}^{T} with S_{t}\subseteq\{1,\dots,L\}. Uniform scheduling [68] uniformly reveals positions i_{t} from the remaining masked set, defined as i_{t}\sim\mathcal{U}(\{1,\dots,L\}\setminus S_{t}) and S_{t+1}=S_{t}\cup\{i_{t}\}. As the prediction a_{0}^{i} depends on a_{0}^{S_{t}} in the learned distribution p(a_{0}^{i}|a_{0}^{S_{t}},t), entropy-guided scheduling [25] improves sampling quality by selecting the minimum-entropy position, which is defined as S_{t+1}=S_{t}\cup\{i_{t}\} with i_{t}\in\arg\min_{i\in\{1,\dots,L\}\setminus S_{t}}H\!\big(p(a_{0}^{i}|a_{0}^{S_{t}},t)\big).
Symbolic Logic in Robotic Planning can be formalized by a tuple (\mathcal{O},\mathcal{A},\Phi,\mathcal{R}) [69], where \mathcal{O} is a finite set of symbols representing entities, \mathcal{A} denotes a set of grounded actions with a\in\mathcal{A} corresponding to an instantiated operator that induces a discrete decision, and \Phi denotes a set of grounded predicates \phi:\mathcal{O}\rightarrow\{0,1\} encoding entity properties or relations. The logic rule set \mathcal{R} consists of symbolic action constraints, where each rule r\in\mathcal{R} is a formal formula defined over \Phi to specify preconditions on \mathcal{A}. In this work, \mathcal{R} is instantiated using First-Order Logic (FOL) [70, 15], such that each rule takes the form r:\phi(o)\Rightarrow a(o), where \phi(o) is a predicate formula constructed from \Phi using logical connectives (\wedge,\vee,\neg,\Rightarrow) and quantifiers (\forall,\exists) over o\in\mathcal{O}, thereby defining the admissible set of a via constraint satisfaction conditions.
4 Approach
Problem Definition
Let \mathcal{U}^{a}=\{u^{a}_{i}\} denote a team of energy-constrained UAVs tasked with visiting a set of task location points \mathcal{C}=\{c_{j}\}. Let \mathcal{U}^{g}={u^{g}_{i}} denote a team of traversability-constrained UGVs that plan trajectories over traversable terrain to rendezvous points \mathcal{P}={p_{k}} for UAV recharging. Then, the symbol set \mathcal{O}=\mathcal{U}^{a}\cup\mathcal{C}\cup\mathcal{U}^{g}\cup\mathcal{P} captures all robotic and task-relevant entities.
We represent the operational context as a heterogeneous graph \mathcal{G}=\{\mathcal{T},\mathcal{E}^{\mathrm{intra}},\mathcal{E}^{\mathrm{uav}},\mathcal{E}^{\mathrm{ugv}}\}, where the node set is defined as \mathcal{T}=\mathcal{T}^{c}\cup\mathcal{T}^{p}\cup\mathcal{T}^{a}\cup\mathcal{T}^{g}. Task nodes \mathcal{T}^{c}=\{\mathbf{t}_{i}^{c}\} encode tasks c_{i}\in\mathcal{C} with \mathbf{t}_{i}^{c}=[\mathbf{d}_{i}^{c},\delta_{i}], where \mathbf{d}_{i}^{c}\in\mathbb{R}^{d} denotes task coordinates and \delta_{i}\in\{0,1\} indicates visitation status. Path nodes \mathcal{T}^{p}=\{\mathbf{t}_{i}^{p}\} encode paths p_{i}\in\mathcal{P} with \mathbf{t}_{i}^{p} denotes the centroid of p_{i}. UAV nodes \mathcal{T}^{a}=\{\mathbf{t}_{i}^{a}\} encode UAVs u_{i}^{a}\in\mathcal{U}^{a} with \mathbf{t}_{i}^{a}=[\mathbf{d}_{i}^{a},f_{i}], where \mathbf{d}_{i}^{a} and f_{i} denote UAV coordinates and remaining energy, respectively. UGV nodes \mathcal{T}^{g}=\{\mathbf{t}_{i}^{g}\} encode UGVs u_{i}^{g}\in\mathcal{U}^{g} with \mathbf{t}_{i}^{g}=[\mathbf{d}_{i}^{g},\mathbf{d}^{a}], where \mathbf{d}_{i}^{g} denotes UGV coordinates and \mathbf{d}^{a} represents the coordinates of all UAVs. The edge sets model heterogeneity and spatial proximity. \mathcal{E}^{\mathrm{intra}}=\{e^{\mathrm{intra}}_{i,j}\} connects \mathbf{t}_{i}\in\mathcal{T}^{k} and \mathbf{t}_{j}\in\mathcal{T}^{k} with k\in\{c,p,a,g\}. \mathcal{E}^{\mathrm{uav}}=\{e^{\mathrm{uav}}_{i,j}\} connects \mathbf{t}_{i}\in\mathcal{T}^{a} to \mathbf{t}_{j}\in\mathcal{T}^{c}\cup\mathcal{T}^{g}. \mathcal{E}^{\mathrm{ugv}}=\{e^{\mathrm{ugv}}_{i,j}\} connects \mathbf{t}_{i}\in\mathcal{T}^{g} to \mathbf{t}_{j}\in\mathcal{T}^{a}\cup\mathcal{T}^{p}. For all edges, e_{i,j}=1 if \|\mathbf{d}_{i}-\mathbf{d}_{j}\|_{2}<\rho, where \rho is a predefined radius.
We define the grounded action set \mathcal{A} for the UAV-UGV team with three action types. The UAV action \texttt{Visit}(u^{a}_{i},c_{j}) denotes u^{a}_{i} visiting c_{j}, yielding |\mathcal{U}^{a}|\times|\mathcal{C}| actions. The UGV action \texttt{Traverse}(u^{g}_{i},p_{j}) denotes u^{g}_{i} traversing to p_{j}, yielding |\mathcal{U}^{g}|\times|\mathcal{P}| actions. The recharge action \texttt{Recharge}(u^{a}_{i},u^{g}_{j}) denotes u^{a}_{i} recharging on u^{g}_{j}, yielding |\mathcal{U}^{a}|\times|\mathcal{U}^{g}| actions.
We define the grounded predicate set \Phi as a relational abstraction for describing domain-specific properties for the entire team. Each predicate is evaluated to a Boolean value based on the current state of the corresponding UAVs, UGVS, tasks, or paths. For example, the predicate \texttt{UAV}(u^{a}_{i}) indicates whether u^{a}_{i} exists, and \texttt{UnderCost}(u^{a}_{i},c_{j}) indicates whether c_{j} is energy-affordable for u^{a}_{i}.
We define the logic rules set \mathcal{R} to formalize operational constraints using FOL, which defines a sufficient condition for the admissibility of an action. For example, the recharging rule, “For the i-th UAV, if no task is under cost, and there exists a j-th UGV that is under cost, then a recharge action with the j-th UGV exists”, can be expressed as \bigl[\texttt{UAV}(u_{i}^{a})\wedge\neg\exists c_{k}(\texttt{Task}(c_{k})\wedge\texttt{UnderCost}(u_{i}^{a},c_{k}))\wedge\exists u_{j}^{g}(\texttt{UGV}(u_{j}^{g})\wedge\texttt{UnderCost}(u_{i}^{a},u_{j}^{g}))\bigr]\Rightarrow\exists u_{j}^{g}\,\texttt{Recharge}(u_{i}^{a},u_{j}^{g}).
We introduce MEND (Masked Error-bounded Neuro-Symbolic Diffusion), a novel learning approach as shown in Figure 2. Our goal is to address the collaborative planning for UAV-UGV teams under operational constraints, enabling the following two key multi-robot capabilities:
- Heterogeneous Coordination with Simultaneous Execution: The joint planning of
\mathcal{U}^{a}and\mathcal{U}^{g}to execute an interdependent mission while minimizing the total makespan. Plans are executed in parallel, where\mathcal{U}^{a}determine task visitation sequences over\mathcal{C}and\mathcal{U}^{g}compute routes over\mathcal{P}, enabling continuous task execution and timely in-mission recharging. - Execution-Time Constraint Satisfaction: At execution time, the generated joint plans must satisfy all operational constraints symbolically specified by
\mathcal{R}, including: (1) UAV energy constraints (e.g.,\texttt{UnderCost}(u^{a}_{i},c_{j})) for\texttt{Visit}(u^{a}_{i},c_{k}), (2) UGV traversability constraints (e.g.,\texttt{ClosestUGV}(u^{g}_{i},u^{a}_{j})) for\texttt{Traverse}(u^{g}_{i},p_{k}), and (3) UAV-UGV recharging constraints (e.g.,\texttt{UnderCost}(u^{a}_{i},u^{g}_{j})) for\texttt{Recharge}(u^{a}_{i},u^{g}_{j}).
MDM for Collaborative Planning of Heterogeneous Robots
We formulate collaborative UAV-UGV planning as learning the conditional distribution p(a|\mathcal{H}) over joint action sequences a=(a^{1},\dots,a^{L}), where a^{l}\in\mathcal{A}. Due to the combinatorial action space, we approximate p(a|\mathcal{H}) using a conditional masked diffusion model (MDM) for context-aware joint action generation.
Given the operational context graph \mathcal{G}, we use a heterogeneous graph network \omega [71] to compute node embeddings \mathcal{H}=\{\mathbf{h}_{i}\}=\omega(\mathcal{G}) for context-aware planning. Each node attribute \mathbf{t}_{i} is projected as \mathbf{z}_{i}=\mathbf{W}^{z}\mathbf{t}_{i}, where \mathbf{W}^{z} is a learnable matrix. Then \mathbf{z}_{i} is transformed into query, key, and value embeddings as \mathbf{q}_{i}=\mathbf{W}_{q}\mathbf{z}_{i}, \mathbf{k}_{i}=\mathbf{W}_{k}\mathbf{z}_{i}, and \mathbf{v}_{i}=\mathbf{W}_{v}\mathbf{z}_{i}, respectively, where \mathbf{W}_{q}, \mathbf{W}_{k}, and \mathbf{W}_{v} are learnable matrices. To encode homogeneous and heterogeneous relationships, attention is applied over edges (i,o)\in\mathcal{E}^{\mathrm{intra}}, (i,k)\in\mathcal{E}^{\mathrm{uav}}, and (i,n)\in\mathcal{E}^{\mathrm{ugv}}, with attention weights \alpha_{i,o}=\mathrm{SoftMax}_{o}(\mathbf{q}_{i}^{\top}\mathbf{k}_{o}/\sqrt{d}), \beta_{i,k}^{a}=\mathrm{SoftMax}_{k}(\mathbf{q}_{i}^{\top}\mathbf{k}_{k}/\sqrt{d}), and \beta_{i,n}^{g}=\mathrm{SoftMax}_{n}(\mathbf{q}_{i}^{\top}\mathbf{k}_{n}/\sqrt{d}), respectively, where d denotes the embedding dimension. Then, \mathbf{h}_{i} is obtained by attention aggregation with layer normalization \text{LN}(\cdot) as \mathbf{h}_{i}=\mathrm{LN}\!\left(\sum_{e_{i,o}^{\mathrm{intra}}=1}\alpha_{i,o}\mathbf{v}_{o}+\sum_{e_{i,k}^{\mathrm{uav}}=1}\beta_{i,k}^{a}\mathbf{v}_{k}+\sum_{e_{i,n}^{\mathrm{ugv}}=1}\beta_{i,n}^{g}\mathbf{v}_{n}\right).
We apply the forward process q(a_{t}^{i}|a_{0}^{i}) to the ground-truth action sequence a_{0} and consider the reverse process q(a_{s}^{i}|{a}_{t},{a}_{0}), which defines the posterior for recovering a_{0}. However, a_{0} is unknown during sampling, and q(a_{s}^{i}|{a}_{t},{a}_{0}) does not explicitly incorporate operational context. To address this, we use a denoising network to approximate the reverse process that predicts the distribution p_{\theta}(a_{0}^{i}|a_{t},t,\mathcal{H}) over a^{i}_{0}\in\mathcal{A}, which is learned by minimizing the negative log-likelihood over masked positions: \mathbb{E}_{{a}_{0},\,t,\sim\mathrm{Unif}(\{1,\dots,T\}),\,a_{t}\sim q(a_{t}|a_{0})}[\sum_{i:a_{t}^{i}=m}-\log p_{\theta}(a_{0}^{i}|{a}_{t},t,\mathcal{H}), where \mathrm{Unif}(\cdot) denotes the uniform distribution. The learned distribution p_{\theta}(a_{0}^{i}|{a}_{t},t,\mathcal{H}) enables collaborative planning for the UAV-UGV team by generating a context-aware joint sequence a through conditioning on \mathcal{H}.
Execution-Time Masked Neuro-Symbolic Diffusion
As a theoretical limitation, MDMs cannot guarantee a^{i}\models\mathcal{R} for samples a^{i}\sim p_{\theta}, since likelihood maximization does not enforce constraints. Moreover, each FOL rule in \mathcal{R} induces a discrete admissibility indicator, which is non-differentiable and thus cannot be imposed by gradient-based training or standard diffusion sampling.
We propose a neuro-symbolic approach that constrains conditional masked diffusion policies to enforce execution-time constraints for UAV-UGV teams. MEND reshapes the learned distribution p_{\theta} into a constraint-aware distribution \tilde{p} by reweighting actions probabilities with an admissibility indicator induced by \mathcal{R}. By removing inadmissible mass while preserving relative likelihoods over admissible actions, MEND satisfies non-differentiable constraints, i.e., \forall a^{i}\sim\tilde{p},\;a^{i}\models\mathcal{R}.
Let a_{t} denote a partially masked sequence at step t, and \mathcal{M}(a_{t})=\{i|a_{t}^{i}=m\} the masked indices. For each i\in\mathcal{M}(a_{t}), the MDM defines a distribution over \mathcal{A} as p_{\theta}(a_{0}^{i}=a^{i,j}|a_{t},t,\mathcal{H}),\ \forall a^{i,j}\in\mathcal{A}. This distribution satisfies p_{\theta}(\cdot)\geq 0 and \sum_{a^{i,j}\in\mathcal{A}}p_{\theta}(a_{0}^{i}=a^{i,j}|\cdot)=1. For each position i, define an admissibility indicator \mathbf{b}_{i}\in\{0,1\}^{|\mathcal{A}|}, where b_{i}^{j}=1 iff a^{i,j}\models\mathcal{R}. We construct a constraint-aware distribution by masking and renormalizing as \tilde{p}_{i}=\frac{p_{\theta}(\cdot|a_{t},t,\mathcal{H})\odot\mathbf{b}_{i}}{\mathbf{1}^{\top}(p_{\theta}(\cdot|a_{t},t,\mathcal{H})\odot\mathbf{b}_{i})}. By construction, \tilde{p}_{i}(a^{i,j})=0 for a^{i,j}\not\models\mathcal{R}, and for any admissible actions a^{i,j},a^{i,k}\models\mathcal{R}, \frac{\tilde{p}_{i}(a^{i,j})}{\tilde{p}_{i}(a^{i,k})}=\frac{p_{\theta}(a^{i,j}|a_{t},t,\mathcal{H})}{p_{\theta}(a^{i,k}|a_{t},t,\mathcal{H})}.
Under the recharging rule, if UAV u_{i}^{a} cannot afford any Visit action but an affordable UGV u_{j}^{g} exists, then Recharge(u_{i}^{a},u_{j}^{g}) is the only admissible action at position i, with b_{i}^{\texttt{Recharge}}=1 and b_{i}^{j}=0 otherwise. Thus, \tilde{p} assigns zero probability to a^{i,j}\not\models\mathcal{R}, MEND explicitly ensures the satisfaction of execution-time operational constraints under the neuro-symbolic diffusion paradigm.
Execution-Time Error-Bounded Inference Scheduling
The quality of MDM sampling depends on the schedule \mathcal{S} and revealed sets \{S_{t}\}_{t=0}^{T} because p_{\theta}(a_{0}^{i}|a_{0}^{S_{t}},t,\mathcal{H}) changes with a_{0}^{S_{t}}. Entropy-guided scheduling [25] selects the minimum-entropy position and assumes the sampled distribution \nu from p_{\theta} aligns with the ground-truth distribution \mu, where a\sim\mu with a^{i}\models\mathcal{R}. If p_{\theta} assigns mass to a^{i}\not\models\mathcal{R}, this entropy deviates from \mu(a_{0}^{i}|a_{0}^{S_{t}}), causing suboptimal, constraint-violating samples.
To address this theoretical limitation, we introduce a novel error-bounded inference scheduling strategy at execution time that guarantees predictive entropy computed under the constraint-aware distribution \tilde{p} yields a provably smaller mismatch with \mu(a_{0}^{i}|a_{0}^{S_{t}}) than entropy computed under p_{\theta}.
We characterize the effect of \{S_{t}\}_{t=0}^{T} on sampling quality by the information curve \mathbf{r}=(r_{1},\dots,r_{L}), where r_{j}=\mathbb{E}_{|S|=j-1,\;i\notin S}[I(a_{0}^{i};a_{0}^{S})] for j\in\{1,\dots,L\}, with S\subseteq\{1,\dots,L\} and i\in\{1,\dots,L\}\setminus S sampled uniformly. Given S_{0}=\emptyset, S_{t-1}\subseteq S_{t}, and N_{t}=|S_{t}|, the schedule-induced approximation \mathbf{r}^{T}=(r_{1}^{T},\dots,r_{L}^{T}) is defined as r_{j}^{T}=r_{N_{t-1}+1} for N_{t-1}<j\leq N_{t}. We then quantify the sampling error between the true action distribution \mu and the schedule-induced distribution \nu_{\{S_{t}\}_{t=0}^{T}}:
Lemma 1 (Schedule-Induced Sampling Error).
Let \mu be the true distribution over a_{0} with \mu(a_{0}^{i}\not\models\mathcal{R})=0, and let \{S_{t}\}_{t=0}^{T} be an inference schedule. Let \nu_{\{S_{t}\}_{t=0}^{T}} denote the distribution induced by sampling from p(\cdot|a_{0}^{S_{t}},t,\mathcal{H}). The schedule-induced sampling error is bounded as [26]:
\mathrm{KL}\!\left(\mu\,\|\,\nu_{\{S_{t}\}_{t=0}^{T}}\right)\leq\left\|\mathbf{r}-\mathbf{r}^{T}\right\|_{1}.We show that sampling from the constraint-aware distribution \tilde{p} reduces this error through \tilde{\nu}_{\{S_{t}\}_{t=0}^{T}}:
Theorem 1 (Error Reduction via Constraint-Aware Scheduling).
Let \nu_{\{S_{t}\}_{t=0}^{T}}\!(a^{i}\models\mathcal{R})\in(0,1] denote the admissible mass under \nu_{\{S_{t}\}_{t=0}^{T}}; hence \log\nu_{\{S_{t}\}_{t=0}^{T}}\!(a^{i}\models\mathcal{R})\leq 0. Let \nu_{\{S_{t}\}_{t=0}^{T}} and \tilde{\nu}_{\{S_{t}\}_{t=0}^{T}} be induced by sampling from p(\cdot|a_{0}^{S_{t}},t,\mathcal{H}) and \tilde{p}(\cdot|a_{0}^{S_{t}},t,\mathcal{H}), respectively. Then:
\mathrm{KL}\big(\mu\;\|\;\tilde{\nu}_{\{S_{t}\}_{t=0}^{T}}\big)=\mathrm{KL}\big(\mu\;\|\;\nu_{\{S_{t}\}_{t=0}^{T}}\big)+\log\nu_{\{S_{t}\}_{t=0}^{T}}\!\big(a^{i}\models\mathcal{R}\big),It follows that constraint-aware scheduling reduces the sampling error:
\mathrm{KL}\big(\mu\;\|\;\tilde{\nu}_{\{S_{t}\}_{t=0}^{T}}\big)\leq\mathrm{KL}\big(\mu\;\|\;\nu_{\{S_{t}\}_{t=0}^{T}}\big).Proof. See Appendix B for the proofs of Lemma 1 and Theorem 1.
Lemma 1 shows that the sampling error is governed by the information-curve mismatch \|\mathbf{r}-\mathbf{r}^{T}\|_{1}. Thus, an effective schedule \{S_{t}\}_{t=0}^{T} reveals positions with larger mutual information I(a_{0}^{i};a_{0}^{S}) earlier to minimize \|\mathbf{r}-\mathbf{r}^{T}\|_{1}. Since I(a_{0}^{i};a_{0}^{S})=H(a_{0}^{i})-H(a_{0}^{i}|a_{0}^{S}) and H(a_{0}^{i}) is fixed, maximizing I(a_{0}^{i};a_{0}^{S_{t}}) is equivalent to minimizing H(a_{0}^{i}|a_{0}^{S_{t}}). However, if p_{\theta}(a_{0}^{i}|a_{0}^{S_{t}},t,\mathcal{H}) assigns nonzero mass to inadmissible actions (a^{i}\not\models\mathcal{R}), then \nu_{\{S_{t}\}_{t=0}^{T}} may deviate from \mu.
Theorem 1 addresses this limitation by constructing \{S_{t}\}_{t=0}^{T} under the constraint-aware distribution \tilde{p}, which is provably closer to \mu and satisfies \tilde{p}(a^{i})=0 for a^{i}\not\models\mathcal{R} while preserving the relative likelihoods among admissible actions. Since \mu(a_{0}^{i}|a_{0}^{S_{t}}) is unknown at inference time, H(a_{0}^{i}|a_{0}^{S_{t}})=-\sum_{a_{0}^{i}}\mu(a_{0}^{i}|a_{0}^{S_{t}})\log\mu(a_{0}^{i}|a_{0}^{S_{t}}) is intractable. MEND approximates it using H(\tilde{p}(a_{0}^{i}|a_{0}^{S_{t}},t,\mathcal{H})) and constructs \{S_{t}\}_{t=0}^{T} via S_{t+1}=S_{t}\cup\{i_{t}\}, where i_{t}\in\argmin_{i\in\{1,\dots,L\}\setminus S_{t}}H(\tilde{p}(a_{0}^{i}|a_{0}^{S_{t}},t,\mathcal{H})).
As a result, this error-bounded schedule constructed under \tilde{p} reduces the misalignment between p_{\theta} and the true conditional distribution \mu(a_{0}^{i}|a_{0}^{S_{t}}). Then, the joint action sequence a is generated by sampling a^{i}\sim\tilde{p}(a_{0}^{i}|a_{0}^{S_{t}},t,\mathcal{H}), which is executed by UAVs and UGVs simultaneously, enabling parallel operation of heterogeneous robots while satisfying operational constraints.
5 Experiments
Experimental Setups
We evaluate MEND in a high-fidelity Unity-based 3D multi-robot simulator in ROS, using real-world maps reconstructed from 3D LiDAR scans, and on physical robot teams. Mission complexity ranges from 15 tasks with 5 paths to 45 tasks with 10 paths, and team size from 1 UAV-1 UGV to 4 UAV-2 UGV. Experiments are conducted in a 10,\mathrm{km}\times 10,\mathrm{km} region, where UAVs and UGVs operate at fixed speeds of q_{a}=10 m/s and q_{g}=4.5 m/s, with energy capacities of 287.7 kJ and 36{,}810 kJ, respectively. UAV and UGV energy consumption are modeled as 0.0461(q_{a})^{3}-0.5834(q_{a})^{2}-1.8761q_{a}+229.6 and 464.8q_{g}+356.3, respectively [72]. In all scenarios, UAVs visit tasks while UGVs provide recharging support along road networks under operational constraints. To obtain expert data, we adopt MIP for constrained UAV task assignment and UGV path planning. While effective offline, MIP is unsuitable for real-time execution. See Appendices D and E for implementation and training details.
We compare MEND against three metaheuristics planners and two baselines: (1) Guided Local Search (GLS) [34], which augments the routing with penalties to bias the search away from repeatedly selected task assignments; (2) Tabu Search (TS) [35], which performs an iterative neighborhood search with a tabu list; (3) Simulated Annealing (SA) [36], which allows early exploration via probabilistic acceptance of worse routes and tightens acceptance over iterations; (4) Vanilla MDM (VMDM): a baseline method performs diffusion sampling from the learned distribution using a uniform scheduling; and (5) Entropy-guided MDM (EMDM), a baseline method (presented in the preliminary based on [25]), which replaces uniform scheduling with entropy-guided scheduling while sampling from the unconstrained learned distribution.
We quantitatively evaluate and compare MEND with other methods using three metrics: (1) Task Completion Rate (TCR) [73] is defined as the ratio of completed tasks to all required tasks, measured as a percentage; (2) Makespan [74] is defined as the total time required to complete all task visits, and is reported only for scenarios in which all methods achieve full task completion, measured in seconds; (3) Energy [75] is defined as the cumulative energy consumption of all UAVs and UGVs over the mission horizon, measured in kilojoules.
We present three example First-Order Logic (FOL) rules used in MEND to encode operational constraints, as summarized in Table 1: (1) UAV task visitation, which restricts UAVs to energy-affordable tasks; (2) UGV path traversal, which allows UGV movement only when a UAV requires recharging support; and (3) Recharge collaboration, which enforces that a recharging event occurs when a UAV is about to deplete its energy.
Results under Various Task and Team Configurations
We evaluate MEND in ROS-integrated Unity 3D simulations with energy-constrained Starling-2 UAVs and terrain-constrained Warthog UGVs across varying missions and team sizes. Figure 3 demonstrates scalable collaborative planning under operational constraints, Figure 4 presents a time-stamped scenario illustrating timely in-mission recharging, and Table 2 reports quantitative results. In the 15-task mission, metaheuristic methods achieve perfect TCR but incur the highest makespan and energy due to suboptimal coordination and routing. Diffusion baselines improve efficiency, with EMDM outperforming VMDM, but still suffer TCR degradation from constraint violations. MEND achieves 100\% TCR with the lowest makespan and energy across all settings. In the 45-task mission, MEND further widens the performance gap, demonstrating its effectiveness under operational constraints.
Results on Unseen Simulation and Real-World Environments
We evaluate the generalizability of MEND in unseen environments with different depots and road networks. Trained on the rural map in Figure 3, MEND is evaluated on two additional maps in Figure 5, featuring novel road layouts (e.g., a city map with two distinct paths) and depots (e.g., a suburban map with a central team start). We further evaluate MEND on an unseen 3D-scanned LiDAR campus map, as shown in Figure 6. The 3D-scanned environment enables evaluation under real-world deployment conditions using physical robot models, where the Starling UAV has a 106.6\,\mathrm{kJ} capacity with 198.6\,\mathrm{kJ/h} consumption at 10\,\mathrm{m/s}, and the Warthog UGV has a 36{,}810,\mathrm{kJ} capacity with 2{,}680.3,\mathrm{kJ/h} consumption at 5\,\mathrm{m/s} (See Appendix F for additional experimental results). These results demonstrate that MEND generalizes effectively to unseen simulations and real-world environments.
Case Studies on Physical UAV-UGV Teams
We validate MEND through real-world case studies using a team of two Crazyflie UAVs and two Limo UGVs controlled through ROS2. As shown in Figure 7, experiments are conducted in a mixed-reality setup, where projected outdoor environments are overlaid onto the physical workspace and robot poses are tracked via a motion capture system. Tasks are distributed across the map, including regions that are non-traversable for the Limo UGVs. The team successfully and efficiently visits all 15 tasks under operational constraints, with the fourth subfigure illustrating a recharging event and demonstrating MEND’s capability for collaborative planning and applicability to real-world deployment.
Scalability
We evaluate MEND’s scalability across team configurations and mission complexities in Figure 8, which reports execution frequency (Hz) for four team configurations under two mission complexities (see Appendix C for time complexity analysis). MEND maintains a planning frequency of 7.8 Hz for A1-G1 with T15-P5 and 2.8 Hz for A4-G2 with T45-P10. Compared with ground-truth MIP on A4-G2 with T45-P10, MEND achieves near-optimal makespan and energy, with 4.28% and 5.95% gaps, respectively, while running 472\times faster. On T15-P5 with 2 UAVs and 1 UGV, MEND achieves 1.9% makespan and 3.9% energy gaps while planning 14.5\times faster. These results demonstrate MEND’s scalability to larger UAV-UGV teams.
Ablation Study
We conduct an ablation study to evaluate the contributions of the neuro-symbolic (NS) module and entropy-guided scheduling (EGS) in MEND, as shown in Figure 9. Dashed lines indicate model-predicted plans that violate operational constraints. Figure 9(a) illustrates the variant without NS or EGS, which results in imbalanced UAV workloads and energy violations. Figure 9(b) shows the variant with EGS but without NS, which improves plan quality yet still fails to satisfy operational constraints. In contrast, Figure 9(c) shows that the full MEND policy achieves effective collaborative planning while satisfying operational constraints, highlighting the necessity of both NS and EGS.
6 Limitation
MEND has two main limitations. First, MEND plans over a fixed-length masked sequence with a static task set within each planning episode; although replanning can accommodate new tasks, dynamic task arrivals are not explicitly modeled. Second, while MEND supports decentralized execution via local graph communication, planning relies on joint inference, which potentially limits robustness under communication constraints. Future work will investigate online task insertion with variable-length masked diffusion models for horizon-agnostic planning and graph-factorized masked diffusion for fully decentralized planning under limited communication.
7 Conclusion
We propose MEND, a theoretical approach for collaborative planning in heterogeneous robot teams under operational constraints. MEND formulates collaborative planning as a conditional masked generative process for context-aware planning of both UAVs and UGVs. It introduces a neuro-symbolic diffusion paradigm that constrains masked diffusion policies to enforce compliance with operational constraints during execution, together with an error-bounded inference scheduling strategy to improve collaborative planning optimality under these constraints. Extensive experiments in simulation, on real-world maps, and with physical robots demonstrate that MEND advances UAV-UGV collaborative planning under operational constraints.
Acknowledgments
This work was partially supported by NSF CAREER Award IIS-2308492, DEVCOM ARL TBAM CRA Award W911NF-25-2-0024, DARPA Award N65236-26-9-0001, and NSF Award IIS-2404386.