달 표면 Forensic Trajectory Analysis: Byzantine 로버를 식별하는 attribution-aware 궤적 추정
이 논문은 달 표면에서 여러 운영 주체의 로버가 공존할 때 일부 로버가 의도적으로 잘못된 측정값을 제공하는 Byzantine 상황에서 사후적으로 궤적을 재구성하는 문제를 다룬다. 저자들은 로버 개별 측정의 이상치 여부가 아니라 로버 집단의 신뢰성을 평가하는 attribution-aware 방법을 제안했고, 합성 및 행성 유사 환경 데이터에서 GNC나 PCM 같은 기존 강건 PGO 방식이 오히려 Byzantine 로버의 거짓 궤적에 속는 반면 제안 방법은 Byzantine 로버를 식별하고 궤적 오차를 크게 줄였다고 보고했다. arXiv 프리프린트다.
자율 로버 여러 대가 같은 지역에서 활동할 때, 일부 로버가 보정 오류나 의도적 조작으로 잘못된 궤적 정보를 제공하는 상황에서 사후 데이터를 바탕으로 신뢰할 수 있는 로버를 식별하고 모든 로버의 실제 궤적을 재구성할 수 있는가?
화성이나 달 탐사에서 여러 회사와 국가의 로버가 인접해 임무를 수행하는 경우 Lunar Safety Zone 같은 운영 제약 준수 여부를 검증해야 한다. 그러나 상시 현장 관측이 어려워 사후에 다운링크된 오도메트리, 위치 사전 정보, 로버 간 상대 탐지 데이터만으로 궤적을 복원해야 한다. 기존 이상치 강건 PGO는 측정값이 내적으로 일관되고 수가 많은 Byzantine 공격에 취약해 진실을 말하는 소수의 유죄 측정값을 이상치로 오인할 수 있다.
기존 다중 로봇 위치 추정과 강건 PGO는 협력적 로봇을 가정하거나 거짓 루프 클로저와 같은 측정 단위 이상치를 제거하는 데 초점을 맞췄다. 대표적으로 Pairwise Consistency Maximisation(PCM)과 Graduated Non-Convexity(GNC)가 쓰이지만, 이들은 참 측정값이 다수이고 내적으로 일관되며 이상치는 소수라는 가정에 의존한다. Byzantine 로버가 여러 대가 공모해 일관된 거짓 궤적을 대량 생성하면 이 가정이 깨져, PCM은 사전 정보와 충돌하는 상대 측정만 이상치로 판단하고 GNC도 거짓 측정을 참으로 선택할 수 있다.
저자들은 문제를 사후 상태 추정으로 정식화하고, 로버 집합 중 절반 미만이 비신뢰적이라는 가정 아래 로버 단위 신뢰성을 평가한다. 먼저 위치 사전 정보만으로 잠정 궤적과 불확실성을 추정한 뒤, 가능한 모든 로버 부분집합에 대해 집단 내부 상대 탐지의 통계적 일관성과 집단 경계(내부 로버와 외부 로버 사이) 탐지의 불일치 정도를 카이제곱 분포 기반 p값으로 점수화한다. log p_internal - log p_boundary를 최대화하는 부분집합을 신뢰 로버로 선택하고, 이후 선택된 로버가 제공한 측정값과 비신뢰 로버에 대한 약한 평활 제약만 사용해 PGO로 최종 궤적을 추정한다.
합성 시뮬레이션에서 로버 5대 중 1대 또는 2대가 Byzantine인 조건을 평가했다. 제안 방법은 비신뢰 측정값 재현율이 단일 Byzantine에서 range-bearing 기준 90.8%, bearing-only 83.3%였고, 2대 Byzantine에서는 각각 89.2%, 64.6%였다. 반면 GNC는 7.1% 이하, PCM은 6.4% 이하였다. 정밀도에서도 제안 방법은 80% 안팎 이상을 보였고 GNC와 PCM은 20~45% 수준이었다. 측정 누락 실험에서는 제안 방법이 최대 80% 누락까지 재현율 81.2%(range-bearing)를 유지했고, 행성 유사 환경 C-SLAM 데이터셋에서는 Safety Zone을 우회하는 거짓 궤적을 만든 로버 B를 정확히 식별했으며 제안 방법만이 로버 B가 Safety Zone에 침입한 사실을 궤적으로 드러냈다.
저자들은 이번 연구가 이상화된 가우시안 섭동으로 생성된 사전 정보와 상대 탐지를 사용했으며 실제 오도메트리, 위치 인식, 상대 탐지 프론트엔드 성능을 검증하지 않았다고 밝혔다. 또 Byzantine 행동을 단일 또는 공모한 두 로버에 국한했고, 행성 유사 데이터에서도 Byzantine 거동은 시뮬레이션으로 주입했다. 방법은 평면 SE(2) 가정을 사용하며 신뢰 로버가 과반이라는 조건이 필요하고, 로버 수가 늘어나면 모든 부분집합을 평가하는 계산 비용이 증가한다. 코드 공개 여부는 논문에 보고되지 않았다.
이 방법은 Artemis Accords의 Lunar Safety Zone 준수 감시나 여러 기업 로버가 협업하는 IM-2 같은 임무의 사후 검증에 활용될 수 있다. 규제 기관이나 임무 운영자가 다운링크된 오도메트리와 상대 탐지 데이터를 바탕으로 특정 로버의 침입 여부를 판단하는 데 쓸 수 있다. 다만 실제 적용은 1~3년 내 지상 로봇이나 유사 환경에서 실측 센서 프론트엔드와 연동한 검증이 선행되어야 하며, 실제 달 임무 데이터를 확보하기 전까지는 감시 도구보다 연구용 분석 프레임워크에 가깝다.
논문 전문
Who Went Where When on the Lunar Surface: Forensic Trajectory Analysis to Identify Byzantine Rovers
CC BY-SA 4.0 라이선스로 공개된 논문입니다. 출처를 밝혀 전재하며, 원문은 arXiv:2610.02694(PDF)에서 볼 수 있습니다.
Abstract
Future planetary surface missions are likely to involve multiple independently operated rovers sharing the same deployment region, raising the need to verify compliance with operational constraints such as Lunar Safety Zones. Because continuous in-situ observability is rarely available, such verification requires post-hoc reconstruction of rover trajectories from sparse telemetry, including odometry, pose priors, and relative inter-rover detections. We introduce the problem of forensic trajectory analysis for non-cooperative planetary rovers in the presence of Byzantine agents: rovers that provide miscalibrated or deliberately falsified measurements to support an incorrect trajectory. We show that standard outlier-robust pose graph optimisation methods are vulnerable in this setting, because Byzantine rovers can generate measurements that are internally consistent and numerous enough to make truthful incriminating measurements appear as outliers. To address this, we propose an attribution-aware trajectory estimation method that reasons over rover credibility rather than individual measurement validity. The method evaluates candidate credible rover subsets by comparing the statistical consistency of their internal and boundary relative detections against provided priors, and then estimates trajectories using only measurements attributed to credible agents. Across synthetic simulations and real planetary-analogue trajectory data, the proposed method identifies Byzantine rovers and produces significantly more accurate trajectory estimates than existing robust pose graph optimisation baselines.
†
I Introduction
One of the key characteristics of the New Space era of the 21st century is the rise of space missions driven by private companies [1]. With lunar landings no longer solely the domain of individual nation-states, current and future missions involve the rovers and landers of multiple companies and countries working together in close proximity. This is exemplified by missions like IM-2, which involved multiple US and Japan-based companies [12]. For successful co-located operation of this kind, efforts like the Artemis Accords [21] and the Chinese-led International Lunar Research Station [23] are attempting to establish norms. One relevant provision of the Artemis Accords is that of Lunar Safety Zones, where stakeholders can establish areas where only certain parties may enter.
To be able to determine the compliance of different rovers with protocols like Lunar Safety Zones under the situational awareness constraints typical of planetary missions, a method for post-hoc determining the trajectories that rovers have taken based on relatively low-fidelity downlinked data is essential. This data includes metrics like odometry, map localisation estimates, and relative detections from infrequent images. For the real-world application of these trajectories, it is crucial to design a method that is Byzantine-resilient, which is to say capable of handling agents that are providing poorly calibrated or deliberately misleading data. This work introduces this problem of “forensic trajectory analysis”: post-hoc determination of multi-rover trajectories in the presence of adversarial measurements.
This paper makes three contributions:
- We formulate forensic trajectory analysis for non-cooperative planetary rovers as a post-hoc state-estimation problem with Byzantine measurement sources;
- We propose an attribution-aware credibility inference method that scores candidate rover subsets using internal consistency and boundary inconsistency of relative detections; and
- We demonstrate, using synthetic and planetary-analogue trajectories, that conventional robust pose graph optimisation (PGO) methods can be systematically misled by Byzantine agents, while the proposed method identifies non-credible rovers and improves trajectory reconstruction.
II Related work
This work sits at the intersection of multi-robot localisation, robust PGO, and Byzantine-resilient robotics. Multi-robot localisation provides the estimation framework for fusing odometry, pose priors, and inter-robot observations. Robust PGO addresses false loop closures and other measurement outliers. Byzantine robotics studies unreliable or adversarial agents in distributed systems. Crucially, forensic trajectory analysis builds on and differs from each of these settings: our task is post-hoc reconstruction from attributed measurements, where entire rovers may act as a coherent but unreliable source of evidence.
II-A Multi-Robot Localisation
One of the key problems in multi-agent robotic systems is that of localisation. While methods for accurate localisation of individual rovers over time exist [verma.etal.2024_enabling, 13], there has also been considerable investigation into how the relative detections between multiple rovers can be leveraged for even better estimation [4].
These kinds of approaches are used as the basis for multi-rover collaborative localisation and mapping (C-SLAM), with key implementations DOOR-SLAM [15], Kimera-Multi [3], and Swarm-SLAM [14]. Approaches for especially challenging environments like caves, mines, and planetary surfaces have been developed [8, 2, 16].
These systems generally assume that robots are cooperative participants in a shared estimation problem, whereas forensic trajectory analysis treats rovers as independently operated sources of evidence whose measurements may not be credible.
II-B Robust Pose Graph Optimisation
Pose graph optimisation is a form of Bayesian state estimation that is commonly used for SLAM back-ends, especially for state-of-the-art multi-agent SLAM [15, 3, 8, 14], with well-known forms for factors representing pose priors, odometry, relative measurements, and loop closures [7].
Perceptual aliasing causing loop closure outliers is a key challenge of SLAM. Two primary underlying approaches for outlier-robust PGO are Pairwise Consistency Maximisation (PCM) [19], which underpins [15, 8], and Graduated Non-Convexity (GNC) [24], which underpins [3, 14, 2]. These are the two methods that we compare against in this paper.
PCM [19] and variations [22, 9] robustly merge two maps with loop closures between them by leveraging graph theory to efficiently find the maximum clique of pairwise-consistent measurements. GNC [24] is a more general method for robust optimisation of any kind of factor graph, which uses robust cost functions with an iterative solver.
These robust PGO methods are very effective at handling perceptual aliasing and allowing successful SLAM back-end optimisation, but as we discuss further in Sec. III-C, they are insufficient for identifying and rejecting actively misleading information from Byzantine agents.
II-C Byzantine Robotics
While much of the literature focuses on the cases of cooperative agents working together to solve problems, there is also investigation into resilience against Byzantine agents – those who are adversarial or misleading when participating in multi-agent systems. While Byzantine resilience is relevant to all manner of distributed and networked systems, within robotics it is frequently considered in the context of multi-agent consensus [18, 25] or distributed learning [5, 17].
At the specific intersection of Byzantine resilience for robotic localisation, problems like Byzantine detection by comparing against GNSS signals in UAV swarms [11], and target and formation tracking [6, 10] have been investigated. These works address challenges in an online filtering context and with local, constrained communication and connectivity. This contrasts against our post-hoc, forensic trajectory analysis focus in this paper, which motivates using PGO as our underlying method and hence the comparisons to PCM and GNC.
The closest work we are aware of is by [20], which also explicitly considers the problem of Byzantine agents in a SLAM or PGO-based setting. Our work contrasts against theirs in a few key ways: we consider more advanced Byzantine behaviour including groups of consistent, collaborative agents; we use a statistically-motivated criteria for identifying Byzantine agents; we explain and demonstrate the vulnerability of robust PGO to Byzantine attacks; and we include the attribution of measurements and the identification of Byzantine agents as a first-class output of our system.
Taken together, there is a clear gap in the literature: existing multi-robot localisation methods provide the estimation machinery, and robust PGO methods provide measurement-level outlier rejection, but neither addresses adversarial measurement sources that can generate coherent false trajectories. In contrast, Byzantine robotics studies unreliable agents, but rarely in a post-hoc pose-graph reconstruction setting with attributed odometry, pose priors, and relative detections. Our work addresses this gap by treating credibility as a property of rovers rather than individual measurements.
III Method
In this section, we outline the problem formulation, our method for identifying non-credible rovers, and how we then calculate final trajectories. The process consists of first estimating putative trajectories from pose priors only; second scoring candidate credible rover subsets using internal and boundary consistency of relative detections; third selecting the credible set; and finally running PGO using only measurements attributed to credible rovers and weak smoothness constraints. This is illustrated further in Fig. 1. We then have a brief discussion of the fundamental limitations of robust PGO methods and how attribution of data is the key element that allows our method to work successfully in the Byzantine case.
III-A Problem Definition
Each rover provides trajectory priors and relative detections, but some rovers may be non-credible sources. Our goal is to identify the credible sources and reconstruct all rover trajectories. We assume that at least one and no more than half of the rovers are non-credible.
Consider a collection of |R| rovers
R=\{R_{1},R_{2},R_{3},\ldots,R_{|R|}\}\text{.}If the state of a rover R_{r} at time t is denoted by
x^{(r)}_{t}\in\text{SE}(2)and the overall state of all rovers over all times t=0,\ldots,T is denoted by
X=\{x^{(r)}_{t}\mid r\in\{1,\ldots,|R|\},t\in\{0,\ldots,T\}\}\text{,}we are interested in finding the optimal state estimate X^{\star} that approximates the real, ground-truth states of the rovers \tilde{X}. In this work, we use x^{(r)}_{t}\in\text{SE}(2) as we assume pose priors and detections are reported relative to an overhead two-dimensional map, like those commonly used for on-board navigation.
We consider two kinds of measurements z, required to be provided by rover operators to achieve this goal – pose priors, and relative detections of other rovers. It is reasonable to assume these measurements are available from rover operators, as they are readily derived from crucial localisation, navigation, and situational awareness systems. The pose priors have uncertainty at each timestep, and can take either an absolute form (like those from map-based localisation), or a relative form (like those from odometry.) Hence we have
z_{P}\in Z_{P}\text{ where }Z_{P}=\{z^{(r)}_{t}\text{ or }z^{(r)}_{t-1,t},\ldots\}\text{,}where the measurement takes the form of an absolute or relative pose z_{P}\in\text{SE}(2). For the relative detections of one rover by another at a particular timestep, we have
z_{D}\in Z_{D}\text{ where }Z_{D}=\{z^{(r_{1},r_{2})}_{t},\ldots\}\text{.}In this work, we consider three kinds of relative detections – bearing only, where z_{D}\in[,), range and bearing, where z_{D}\in\mathbb{R}\times[,), and full degree-of-freedom range, bearing, and orientation, where z_{D}\in\text{SE}(2).
For some subset of rovers
C\in\mathcal{P}(R)where \mathcal{P}(S) denotes the power set of S, we can consider the relevant subset of measurements originating from rovers in C,
Z^{C}=Z^{C}_{P}\cup Z^{C}_{D}=\{z^{(r)}_{t}\mid R_{r}\in C\}\cup\{z^{(r_{1},r_{2})}_{t}\mid R_{r_{1}}\in C\}\text{.}If we say that a rover R_{r} is credible, we take that to mean that each measurement it provides accurately represents the world state up to well-characterised noise, i.e.
z^{(r)}\sim\mathcal{N}\left(h(\tilde{X}),\Sigma^{(r)}\right)for the relevant measurement function h(X). If a certain subset of rovers \tilde{C} are credible, and all other rovers R\setminus\tilde{C} are non-credible, then our ultimate goal is to find the optimal state estimate X^{\star} which based on only measurements from credible rovers Z^{\tilde{C}}. As the true set of credible rovers \tilde{C} is impossible to know, the problem is realised in two steps where first an estimate of the credible rovers C^{\star} is found, and then a state estimate X^{\star} is made by considering Z^{C^{\star}}. This two step structure was found to perform more reliably than a joint optimisation in preliminary experiments.
III-B Identifying Byzantine Rovers
We first consider putative trajectories \hat{X} with uncertainties \hat{\Sigma} for each rover based on the pose priors data only. These are found either taking \hat{X}, \hat{\Sigma} from absolute priors directly, or by solving the following in the case where relative priors Z_{P} are provided:
\hat{X},\hat{\Sigma}\leftarrow\argmax_{X}p(X\mid Z_{P})\text{.}Then, for a candidate set of credible rovers C\in\mathcal{P}(R), we consider the set of internal relative detections
Z^{C}_{I}=\{z^{(r_{1},r_{2})}_{t}\mid z\in Z_{D},R_{r_{1}}\in C,R_{r_{2}}\in C\}i.e. the measurements between two rovers in C, as well as the set of boundary relative detections
Z^{C}_{B}=\{z^{(r_{1},r_{2})}_{t}\mid z\in Z_{D},R_{r_{1}}\in C\veebar R_{r_{2}}\in C\}where \veebar represents exclusive OR. This is illustrated graphically in Fig. 1(c), with C=\{R_{A},R_{B}\}. We are interested in determining the degree to which these measurements align with the provided priors – more specifically, we want to determine how well the internal set of measurements are consistent with the priors and how poorly the boundary set of measurements are consistent with the priors. As such, we can then calculate the internal and boundary sets of residual errors for some error function e(\cdot) as
\displaystyle E^{C}_{I} \\ \displaystyle=\{e(z,\hat{X},\hat{\Sigma})\mid z\in Z^{C}_{I}\}\text{ and} \\ \displaystyle E^{C}_{B} \\ \displaystyle=\{e(z,\hat{X},\hat{\Sigma})\mid z\in Z^{C}_{B}\}\text{.}If |Z^{C}_{I}|=0, the internal boundary set is degenerate and the candidate set C is skipped.
To determine the form of e(z,X,\Sigma) for the relative detection z^{(r_{1},r_{2})}_{t}, we first consider the raw measurement residual
e_{0}=z^{(r_{1},r_{2})}_{t}\ominus h(\hat{x}^{(r_{1})}_{t},\hat{x}^{(r_{2})}_{t})for measurement function h(\cdot). The effective information matrix, taking into account the uncertainty of the relative detection itself \Sigma_{D}\triangleq\hat{\Sigma}^{(r_{1},r_{2})}_{t} and the uncertainties of the two relevant poses \Sigma_{1}\triangleq\hat{\Sigma}^{(r_{1})}_{t} and \Sigma_{2}\triangleq\hat{\Sigma}^{(r_{2})}_{t}, is
\Lambda_{\text{eff}}=\Sigma_{\text{eff}}^{-1}=\left(\Sigma_{D}+H_{1}\Sigma_{1}H_{1}^{\top}+H_{2}\Sigma_{2}H_{2}^{\top}\right)^{-1}for Jacobians
H_{1}=\frac{\partial h}{\partial x_{1}}\text{ and }H_{2}=\frac{\partial h}{\partial x_{2}}evaluated at
x_{1}=\hat{x}^{(r_{1})}_{t}\text{ and }x_{2}=\hat{x}^{(r_{2})}_{t}\text{.}Interpreting the raw residual under these uncertainties therefore leads to the overall error function
e(z,X,\Sigma)=\lVert z^{(r_{1},r_{2})}_{t}\ominus h(\hat{X})\rVert^{2}_{\Sigma_{\text{eff}}}=e_{0}^{\top}\Lambda_{\text{eff}}\,e_{0}\text{.}This function has the nice property that as the pose prior uncertainties increase, a measurement that aligns less accurately with \hat{X} will be punished less and receive a lower residual.
If the noise is properly characterised, it is determined that we would expect the residual to follow the distribution
\lVert z-h(x)\rVert^{2}_{\Sigma}\sim\chi^{2}_{\nu}for \nu degrees of freedom in the measurement (i.e. \nu=1 for bearing, \nu=2 for range-bearing, \nu=3 for full state). As such, we can determine the p-values indicating the probability with which, all rovers being credible, we would expect to see these internal and boundary residuals. Due to the additivity of the \chi^{2} distribution, these can be calculated as
\displaystyle p^{C}_{I} \\ \displaystyle=P\left(\chi^{2}_{\nu\,\lvert r^{C}_{I}\rvert}\geq\textstyle\sum_{e\in E^{C}_{I}}e\right)\text{ and } \\ \displaystyle p^{C}_{B} \\ \displaystyle=P\left(\chi^{2}_{\nu\,\lvert r^{C}_{B}\rvert}\geq\textstyle\sum_{e\in E^{C}_{B}}e\right)\text{.}Finally, we can find a quality metric q^{C} for a particular subset C as the difference of log probabilities
q^{C}=\log p^{C}_{I}-\log p^{C}_{B}\text{.}Hence, our estimated set of credible rovers C^{\star} can be found as
C^{\star}=\argmax_{C\in\mathcal{P}(R)}q^{C}\text{.}Intuitively, we are interested in finding the group of rovers that simultaneously has the least surprising relative measurements between each other and has the most surprising relative measurements between themselves and out-group rovers.
Once we have our estimated set of credible rovers C^{\star}, we choose to trust the measurements attributed to these rovers, Z^{C^{\star}}. This set does not include any of the priors or relative detections that come from the deemed non-credible rovers R\setminus C^{\star}. Discounting the priors completely in this way causes the pose graph to become under constrained, so different constraints need to be added. The laws of physics dictate that even for a non-credible rover, the state x^{(r)}_{t+1} is going to be within some neighbourhood of x^{(r)}_{t}, represented by an expected relative pose offset
\breve{z}\in\text{SE}(2)=[\delta_{\text{forwards}},0,0]which indicates expected forwards motion and a corresponding, considerably large uncertainty in all three components. As such, we supplement our observations with “smoothness constraints”
\breve{Z}=\{\breve{z}_{t,t+1}^{(r)}\mid r\in R\setminus C^{\star},t\in\{0,\ldots,T-1\}\}We can then finally use typical pose-graph optimisation via the Levenberg-Marquardt method to estimate the trajectories of all rovers X^{\star}, which optimises:
X^{\star}=\argmax_{X}p\left(X\mid Z^{C^{\star}},\breve{Z}\right)\text{.}An overview of this method is shown in Alg. 1.
III-C Contrasting Against Robust Methods
The fundamental difference between our method and robust PGO methods like GNC and PCM is that we consider the attribution of measurements. Robust PGO methods are designed to mitigate false positive loop closures in SLAM, and as such have an underlying assumption that the true set of inlier measurements will be internally consistent and any consistent set of outliers will be smaller than the true set. This is encapsulated in their overall optimisation formulation
X^{\star}=\argmax_{X}p\left(X\middle|Z\right)which includes all measurements Z.
In the Byzantine case, this assumption no longer holds – Byzantine agents can produce essentially arbitrary volumes of data that is internally consistent and consistent with the true world state of credible agents, while being misleading about their own state. As an illustrative example, consider Fig. 1(a), where believing rover C’s false detections and consistent priors (four measurements in total) only requires disbelieving two true, incriminating edges. Maximising the likelihood over all measurements is going to prefer the solution which disbelieves fewer measurements. Thus, treating the Byzantine identification problem as a problem of rejecting outlier measurements fails systematically under coherent Byzantine attacks, and this is supported experimentally in the following section.
Furthermore, while GNC implicitly allows for outliers in odometry or pose prior measurements, PCM explicitly only identifies relative detections as outliers when they disagree with priors and so will always side with misleading measurements over incriminating ones. Considering the attribution of measurements, as our method does, is crucial in the Byzantine case.
IV Experiments
In this section, we evaluate the performance of our method against both simulated and real planetary-analogue trajectory data. We compare against GNC and PCM as representatives of a robust PGO approach, to demonstrate that this class of method – designed for robustness to false positive loop closures – is fundamentally untenable in the Byzantine case.
IV-A Simulation Definition
We begin by demonstrating our method in a 2D simulation environment. We consider groups of |R|=5 rovers, and evaluate across five different initial positions.
IV-A1 Motion Model
Each rover is modelled as a white noise on acceleration model, and hence is parameterised as
R_{r}=(x_{0},v_{0},\omega_{0},\sigma_{v},\sigma_{\omega})^{(r)}\text{,}with update equations
\displaystyle v_{t} \\ \displaystyle\sim\mathcal{N}(v_{t-1},\sigma_{v}^{2}) \\ \displaystyle\omega_{t} \\ \displaystyle\sim\mathcal{N}(\omega_{t-1},\sigma_{\omega}^{2}) \\ \displaystyle x_{t} \\ \displaystyle=x_{t-1}+\begin{bmatrix}v_{t}\cos(\theta_{t-1}+\omega_{t})\\
v_{t}\sin(\theta_{t-1}+\omega_{t})\\
\omega_{t}\end{bmatrix}\text{.}We use parameters v_{0}=1 m s⁻¹, \sigma_{v}=0.02 m s⁻¹, \omega_{0}=0 s⁻¹ and \sigma_{\omega}=0.2 s⁻¹, which produce relatively smooth trajectories representative of rover traverses.
IV-A2 Trajectory Priors
We consider two modes of supplied trajectory priors – relative and absolute – both created by perturbing the true trajectory with Gaussian noise. This is somewhat idealised, but serves to demonstrate the capability of our method independent of front-end performance.
For the former, relative case, we use a noise model of \sigma_{\text{forward}}=0.3 m, \sigma_{\text{left}}=0.2 m, \sigma_{\theta}=$$ to perturb the true relative pose between subsequent timesteps. A single pose prior at t=0 is also used to ground the odometry in the world frame, with noise model \sigma_{x}=\sigma_{y}=2 m, \sigma_{\theta}=$$.
For the latter, absolute, case, we use a noise model of \sigma_{x}=\sigma_{y}=1 m, \sigma_{\theta}=$$ to independently perturb the true absolute pose at each timestep.
For the smoothness constraints \breve{z} we use \delta_{\text{forward}}=1 m, \sigma_{\text{forward}}=0.5 m, \sigma_{\text{left}}=0.25 m, and \sigma_{\text{turn}}=$$.
IV-A3 Relative Detections
For the relative detections between rovers, we use a noise model of \sigma_{\text{range}}=3 m, \sigma_{\text{bearing}}=$$, and \sigma_{\text{orientation}}=$$. Each rover only produces a relative observation of other rovers every t=5 timesteps, and only observes rovers within a certain field-of-view of its forwards and backwards directions. We evaluate the effect of differing fields of view in the following section.
IV-A4 Byzantine Behaviour
We consider the effects of both one and two Byzantine agents on our group of five rovers. We leverage the concept of a “purported trajectory” to define the Byzantine behaviour, where this is the path that they intend for us to believe was taken. All measurements sourced from a Byzantine agent are based on perturbed (as above) measurements from this purported trajectory. Credible rovers still provide relative measurements to the Byzantine rover’s true state, as expected. Additionally, in the case of two Byzantine agents, we assume they are collaborating; i.e. the relative detections they provide between one another correspond to the differences between their respective purported trajectories and hence are internally consistent.
We consider a range of classes of purported trajectories. All are based on transformations of the rover’s initial trajectory, with different combinations of distance scaling, and offsets in translation and rotation applied. We additionally consider a “late turn”, where the rover’s purported trajectory aligns with its true trajectory for the first half of the experiment, and then diverges for the second half.
IV-B Simulation Experiments
The simulation environment is used for a series of comparisons against GNC and PCM. The most reasonable relative measurements to expect in a non-cooperative planetary context are either bearing (B) or range-bearing (RB), so we use these degrees of freedom to evaluate our method and GNC. The full three degree-of-freedom range-bearing-orientation (RBO) measurements are required for PCM, so we evaluate that method using these. We use N=5 runs with varied trajectories for each individual configuration of parameters.
IV-B1 One Byzantine Rover
First, we consider the cases of a single Byzantine rover, relative and absolute trajectory priors, and front and rear fields of view of 180°, 120°, and 90°. As demonstrated in Fig. 2, while all methods provide relatively accurate localisation results for the credible rovers, only our method provides at all comparable localisation results for the Byzantine rovers across all of the cases under consideration. This improved performance is seen across all measurement kinds, fields of view, and types of Byzantine behaviour, as shown in Fig. 3.
This can be explained by considering the recall metric in Tab. I, where we evaluate the proportion of non-credible measurements successfully rejected as outliers by each method. Our method of identifying non-credible rovers and rejecting all of their measurements performs very well, as indicated by the 83.3% and 90.8% recalls, while the robust PGO methods are misled by the internally consistent Byzantine measurements, as indicated by recalls of less than 10%. These methods’ lower precision in Tab. I further indicate that outlier rejection does not accurately detect Byzantine measurements.
- Ours
- RB
- 90.8
- 89.2
- 90.0
- 86.7
- 94.2
- 90.4
- —
- B
- 83.3
- 64.6
- 74.0
- 80.8
- 71.7
- 76.2
- GNC
- RB
- 7.1
- 4.4
- 5.7
- 20.1
- 13.5
- 16.8
- —
- B
- 4.2
- 5.0
- 4.6
- 19.8
- 18.3
- 19.0
- PCM
- RBO
- 6.4
- 5.4
- 5.9
- 31.1
- 45.2
- 38.1
This is further illustrated by the qualitative trajectories compared in Fig. 4, where the results from GNC largely follow the Byzantine rover’s purported trajectory and PCM fails to produce to a meaningful estimate, while ours successfully leverages the data from the credible rovers to track its true trajectory instead.
IV-B2 Two Byzantine Rovers
Largely the same trend is demonstrated for the case of two collaborative Byzantine rovers, as indicated in Tab. I and Fig. 5. This again is consistent across experimental conditions as demonstrated in Fig. 3. The recall performance in the case of bearing-only measurements under the case of two Byzantine rovers is markedly poorer than other circumstances, but still outperforms robust PGO by achieving 64.6% compared to their approximately 5% each.
IV-B3 Simulated Occlusions
To investigate the cases where rovers may not have clear views of one another, we run another suite of experiments where relative measurements have a probability of not being captured (“dropout”) at each potential timestep, rather than being constrained by rover field-of-view. As shown in Figs. 6 and II, our method maintains relatively consistent recall and precision performance up to even 80% dropout. The same trend as above, where bearing-only measurements perform worse than range-bearing measurements, is seen.
- Ours
- RB
- 83.8
- 81.2
- 81.2
- 66.7
- 85.0
- 81.2
- 85.0
- 58.8
- —
- B
- 77.5
- 68.8
- 67.9
- 50.0
- 85.0
- 73.8
- 71.8
- 50.0
- GNC
- RB
- 8.5
- 4.3
- 2.1
- 0.2
- 27.5
- 18.6
- 18.5
- 2.5
- —
- B
- 5.7
- 7.6
- 1.5
- 0.0
- 33.0
- 32.4
- 14.5
- 0.0
- PCM
- RBO
- 7.6
- 4.6
- 6.3
- 16.7
- 30.3
- 26.4
- 20.6
- 20.0
IV-C Planetary Analogue Experiments
To further validate the concept, the C-SLAM dataset collected by [16] is used, which has RTK GPS data serving as ground truth trajectories for three rovers exploring a planetary analogue environment. We consider the scenario where there is a Safety Zone that rover B is prohibited from entering, and so rover B purports a “shortcut” trajectory that bypasses the time it spent within the zone, as indicated in Fig. 7 (top).
For this experiment, we take the absolute poses at 0.3\text{\,}\mathrm{Hz} and perturb them with noise model \sigma_{x}=\sigma_{y}=2 m, \sigma_{\theta}=$$, which is more than generous based on the results in [verma.etal.2024_enabling]. We use a relative detection model with \sigma_{\text{range}}=1 m, \sigma_{\text{bearing}}=$$ (plus \sigma_{\text{orientation}}=$$ for PCM), with detections captured every t=8 timesteps, corresponding to almost 30\text{\,}\mathrm{s} of real time.
Our method successfully identifies rover B as Byzantine. Furthermore, consider the plotted final trajectory estimates in Fig. 7 (bottom). Although considerably smoothed due to the relative infrequency of relative measurements from credible rovers to guide rover B’s trajectory, our method is the only one that clearly and unambiguously shows that rover B intrudes into the Safety Zone for a considerable amount of time, which is one of the most important outcomes for this problem of forensic trajectory analysis.
V Conclusions
In this paper, we have introduced the problem of forensic trajectory analysis grounded in the needs of co-located operation of rovers by multiple stakeholders simultaneously. We demonstrate that traditional robust PGO is unable to provide suitable trajectory estimates in the case of Byzantine agents, and have introduced a statistically-motivated novel method based on the consistency of relative measurements observation and between groups of rovers. Experimental analysis has validated the accuracy of this method across a range of synthetic and real planetary analogue trajectories.
Future work should include investigating performance when using data from real odometry, localisation, and relative detection front-ends. It could also include a greater variety of Byzantine behaviours, including multiple disjoint groups of collaborative rovers, as well as further validation on real space or planetary analogue robotic platforms.
\AtNextBibliography