MEKAWIRE
上級arXiv

磁気とIMUを融合したモジュール式連続体ロボットの自己姿勢推定、外部カメラ不要で16.7Hz更新

Zheng Cao, Guo Ning Sue, Xiangyun Bu, David Quinn, Junzhe Hu, Carmel Majidi
30秒で読む

本論文は、分散配置したIMUと基板コイルによる磁気計測を組み合わせ、外部カメラに依存せず連続体ロボットの三次元形状を推定するモジュール式センシング方式を開発した。4シナリオ20試行でバックボーンRMSE 10.0±3.2 mm、先端RMSE 14.9±6.5 mm、更新レート16.7 Hzを達成し、先端高さの閉ループ制御も実証した。これはプレプリントであり、査読済みとは報告されていない。

研究課題

外部カメラやアクチュエータモデルを使わずに、分散磁気および慣性計測で軟体連続体ロボットの三次元形状を実時間推定し、閉ループ制御に利用できるかを明らかにする。

問題

連続体ロボットは連続変形するため、アクチュエータ入力からの推定は材料非線形性や摩擦、外力の影響を受け、外部カメラは視界確保が必要である。既存の磁気と慣性センシングは更新レートが約1.2Hzと低く、動的追従やフィードバック制御に不向きだった。

従来の手法

従来は、アクチュエータ入力と運動学モデル、外部ビジョン、ひずみセンサ、分散IMU、磁気計測などが用いられた。特に近い研究では磁気と慣性を統合したが、更新レートが約1.2Hzでモジュール長尺化への拡張性も限られていた。IMUのみでは重力方向しか得られず、加速度積分で誤差が蓄積する問題があった。

新しい手法

各モジュールにBNO086 IMU、ATtiny3226マイコン、平面コイル、MOSFETを搭載した基板を組み込み、ESP32-S3がI2Cで連続姿勢をポーリングし、300msごとにコイルを40ms励磁して隣接モジュールの磁気計測を実施する。磁気補正は各関節で約3秒ごとに行われ、姿勢は16.7Hzで更新される。関節を固定半径の球面ピボットと仮定し、コイル磁場差を正規化してMLPで親軸方向を推定する。学習には2台のウェブカメラとAprilTagで誘導した約15,000姿勢を10時間かけて収集した。各セグメントのクォータニオン方位と磁気推定をカルマン型の回転状態で融合し、加速度積分なしにバックボーンを再構成する。

結果

OptiTrack Motiveを地面真理とし、9セグメント全長261mmで4シナリオ各5試合計20試行を評価した。融合手法のバックボーンRMSEは2Dカール7.6±1.1mm、障害物接触11.3±1.1mm、3Dカール13.3±0.9mm、手動操作7.8±4.0mm、平均10.0±3.2mm、先端RMSE平均14.9±6.5mmだった。比較として磁気のみはバックボーン24.6±9.5mm、先端42.3±13.8mm、拘束加速度とクォータニオンはバックボーン114.8±36.8mm、先端176.2±51.1mm、加速度のみはバックボーン175.3±20.7mm、先端274.7±37.4mmだった。閉ループ先端高さ制御では8モジュール構成で目標40mmに対し、到達3.4秒、最大46mm、5.5秒後に±2mm以内へ整定し、500g負荷後も最小点から5.1秒で2mm以内に回復した。

限界

著者らは、接触による圧縮が固定長近似を破ること、3Dカールが学習範囲(25度から30度)を超える関節角を含むこと、手動操作ではねじれや圧縮で無ねじれおよび固定長の仮定が破れる可能性を指摘した。長期記録ではクリープと推定ドリフトを分離できず、高さ制御の精度も独立した地面真理で未検証である。受信機アライメントは同シナリオの他試行の姿勢を利用しており、センサ経路は完全に独立ではない。また、更新レート16.7Hzは従来より高いが高速運動への適用は示されていない。

産業への影響

この自己位置推定は、外部カメラを設置できない低侵襲手術ロボット、柔軟グリッパを備えた食品収穫および物流ロボット、狭隘空間の検査ロボットに応用できる。現在は研究プロトタイプ段階で、産業展開にはモジュールごとの校正、磁場外乱への耐性、長期信頼性、安全性の検証が必要であり、実用化には1年から3年以上かかると考えられる。

論文全文

Magnetic based In-situ Self 3D Pose Estimation for a Modular Soft Tendon-Driven Continuum Robot via IMU-Fusion

Zheng Cao, Guo Ning Sue, Xiangyun Bu, David Quinn, Junzhe Hu, Carmel Majidi

CC BY-NC-SA 4.0 のもとで公開された論文です。出典を明記して転載しています。原文は arXiv:2609.39950(PDF)。

Abstract

Continuum robots are well suited for gentle manipulation because of their inherent compliance and ability to adapt to complex environments. However, their continuously deformable structure makes accurate configuration estimation challenging, particularly when external vision systems are unavailable or obstructed. In this work, we present an embedded pose sensing framework that combines inertial measurement units (IMUs) and active magnetic fields to estimate the robot configuration without relying on external cameras. The angular measurements from the IMU and magnetic-field references are fused to improve local orientation estimation and reduce accumulated orientation error during operation. This pose sensing scheme achieves an update rate of 16.7 Hz, allowing real-time feedback. The proposed system is experimentally validated through closed-loop control, where the estimated robot configuration is used to maintain the end-effector at a desired position while interacting with an object. These results demonstrate the potential of distributed magnetic–inertial sensing for real-time pose estimation and closed-loop control of continuum robots.

I INTRODUCTION

Soft continuum robots deform continuously to conform to complex environments and handle delicate objects, enabling gentle manipulation [1], food harvesting [2], and minimally invasive procedures [3, 4, 5]. However, their distributed deformation makes configuration estimation more challenging than for rigid-link robots.

Reliable configuration feedback is essential for closed-loop control. Estimates derived from actuation inputs through kinematic or mechanical models [6, 7] are sensitive to material nonlinearities, hysteresis, friction, and external loading [8, 9]. External vision provides accurate measurements but requires clear visibility [10], motivating embedded proprioception. Strain sensors measure local deformation but may require complex models for global shape reconstruction [11]. Accelerometers provide inclination relative to gravity but cannot resolve full orientation and are affected by dynamic acceleration [12]. Magnetic measurements provide complementary directional information for distributed shape estimation [13].

Fig. 1: Modular tendon-driven continuum robot and sensing principle. a) Pose estimation during 3D curling. Frontal images show the physical robot, while isometric views highlight the reconstructed three-dimensional backbone. Orange denotes our estimate and black denotes motion-capture ground truth. b) Modular platform design and sensing principle. Relative motion between identical segments is modeled using virtual pivots, with relative positions inferred from magnetic fields generated by embedded PCB coils. c) Grasping demonstration with a soft, deformable object (T-shirt).

Distributing magnetic–inertial sensing across modular robots requires efficient acquisition and communication. The approximately 1.2 Hz estimation rate of [13] limits dynamic tracking and feedback control. We address this limitation with embedded sensing modules that combine onboard attitude estimates and magnetic measurements to reconstruct the three-dimensional backbone. Continuous attitude polling and intermittent magnetic corrections enable configuration updates at 16.7 Hz. The architecture supports distributed sensing and closed-loop control under external loading without external visual tracking during deployment.

The main contributions are:

  1. A modular magnetic–inertial sensing architecture for embedded three-dimensional shape reconstruction.
  2. A sensing and communication scheme providing configuration updates at 16.7 Hz.
  3. Experimental validation of shape estimation under varied deformation and contact conditions, and closed-loop tip-height control under an external disturbance.

II RELATED WORKS

II-A Pose and Configuration Estimation

Accurate configuration estimation is essential for continuum robots because their compliant, continuously deformable structures make the relationship between actuation and robot shape difficult to predict. Model-based approaches estimate robot configuration from actuation inputs using kinematic or mechanical models [6, 7], but their accuracy can degrade in the presence of material nonlinearities, hysteresis, friction, and external loading.

External sensing has therefore been widely used to directly observe the robot configuration. Vision-based methods have employed stereo cameras and learning-based approaches for continuum-robot pose estimation [14], while other systems combine visual tracking with additional displacement measurements for real-time configuration estimation [15]. Although these approaches can provide accurate measurements, they depend on external sensing infrastructure and an unobstructed line of sight.

Embedded deformation sensing provides an alternative for self-contained proprioception. Strain and fiber-optic sensing methods measure local deformation along the robot body and reconstruct the global configuration from distributed measurements [16, 17]. However, these approaches often require calibration or a model relating local sensor measurements to the global robot shape.

II-B Embedded Inertial and Magnetic Proprioception

Inertial sensing has been explored as a compact approach for embedded configuration estimation. [18] combined inertial sensing with actuator measurements to estimate continuum-robot pose, while [12] used distributed inertial measurement units (IMUs) to reconstruct robot shape and estimate the end-effector position. These studies demonstrate that distributed orientation measurements can provide proprioceptive information without external tracking.

Magnetic sensing has similarly been used for embedded shape estimation. [19] used magnetic measurements to infer local bending and reconstruct continuum-robot shape, while [20] and [21] demonstrated learning-based reconstruction from embedded magnetic-field measurements. Magnetic sensing provides an additional directional reference but can require dedicated magnetic sources, robot-specific calibration, or learned mappings.

More closely related to this work, magnetic and inertial measurements have been combined for embedded orientation estimation [13]. However, existing implementations remain limited in update rate and scalability when distributed across long, modular continuum robots. In this work, we develop a modular magnetic–inertial proprioceptive sensing architecture that combines local orientation estimates from multiple robot segments to reconstruct the three-dimensional configuration at a rate suitable for real-time feedback control.

III METHODOLOGY

III-A Design

Fig. 2: Overview of the mechanical and electronic components of one proprioceptive module of the continuum robot. a) Exploded view of a single module. Numbered parts include (1) PCB (2) coil (3) module (4) support standoff (5) M2-20mm screw (6) M2 nut. b) Customized sensing boards in each module and customized coil.

The robot comprises nine serial TPU 90A modules, each 20 mm high, with two disks (50 mm in diameter, 2 mm thick) connected by an hourglass joint (16 mm high, 5 mm minimum diameter). Compared to existing designs [13] [22], our architecture features a soft mechanical module with integrated joints that simplifies the mechanical structure and reduces the number of separate components (Fig. 2 (a)). This approach facilitates assembly and disassembly while preserving modularity, allowing individual modules to be replaced and the robot length to be adjusted. In addition, each mechanical module has one magnetic coil instead of a single magnetic placed on the base, allowing infinite number of modules to be stacked. Each module carries a PCB integrating a BNO086 IMU, ATtiny3226 microcontroller, planar coil, and switching MOSFET (Fig. 2 (b)). Following [13], each microcontroller reads its IMU over SPI and exposes registers on a shared I2C bus. An ESP32-S3 polls the boards at 400 kHz and streams measurements over USB to a Raspberry Pi 5 running ROS 2. Separate logic and coil rails isolate the 3.3 V electronics from coil switching.

The BNO086 Game Rotation Vector fuses accelerometer and gyroscope measurements without magnetic input, allowing attitude tracking during coil activation. Magnetic measurements correct its arbitrary initial heading and subsequent drift. Raw magnetometer readings arrive at approximately 90 Hz.

The wound coil in [13] is replaced by additively wound traces on both sides of a 0.8 mm FR4 PCB with 2 oz copper. The coil trace is defined by the following equation:

r(\phi)=R_{0}\!\left[1+\sum_{k=1}^{3}\alpha_{k}\cos(k\phi+\beta_{k})\right],
(1)

where \boldsymbol{\alpha}=(0.085,0.100,0.050) and \boldsymbol{\beta}=(0.5,0.2,-0.4) rad; successive turns use constant pitch. Its asymmetric outline breaks axial field symmetry (Fig. 2 (b)) and thus provide more features in the magnetic field to be captured and process down stream in the sensing pipelin. Approximately 19 turns per layer of 10 mil traces give a resistance near 1\,\Omega. A 40 ms pulse at 3.3 V produces approximately 100\,\muT at the neighboring segment, compared with 0.6\,\muT noise per axis.

III-B Sensing

Fig. 3: Sensing principle, data collection setup, and sampled pose distribution. a) Joint bending and magnetic sensing under the fixed pivot assumption of [13]. The IMU and magnetometer on the upper segment are assumed to move along a hemispherical surface at a fixed radius from a virtual pivot at the center of the compliant joint. b) Data collection setup using two cameras to track a world reference tag and a joint tag attached to the upper segment. The world tag provides a common reference frame, allowing the joint position to be measured when its tag is visible to either camera. Random target orientations guide sampling across the reachable workspace to learn the mapping from magnetic measurements to joint position. c) Sampled pose distribution showing (i) positions across the hemispherical workspace, (ii) a fitted spherical surface with an RMSE of 0.19 mm, supporting the fixed pivot assumption, and (iii, iv) histograms of colatitude and azimuth, respectively. Sampling covers the workspace, although hardware biases and differences between camera measurements may contribute to uneven coverage.
III-B1 Joint Model and Training

Following [13], each joint is modeled as a fixed-radius spherical pivot without axial twist (Fig. 3 (a)). Its relative pose is therefore represented by a unit direction \mathbf{u}\in S^{2}. Unlike piecewise constant curvature [23], these local assumptions do not prescribe bending along the full backbone. The pivot radius is 10 mm; a 9 mm platform offset (height of sensing electronics), and a 10 mm before the pivot of the next module, giving a total pivot spacing of L=29 mm.

Training used a fixed proximal coil and a distal sensor actuated by four antagonistic tendons. Camera feedback from two webcams and AprilTags guided the joint toward targets sampled uniformly over a spherical cap (Fig. 3 (b) (c)): \cos\lambda\sim\mathcal{U}[\cos\lambda_{\max},1] and \theta\sim\mathcal{U}[-\pi,\pi), with \lambda_{\max} slightly below the 30^{\circ} mechanical limit. \lambda and \theta are colatitude and azimuth respectively. Equal-solid-angle Fibonacci cells and sampling quotas improved coverage.

At each stationary target, two to three pulses, each at most 40 ms, provided six coil-on samples. The coil field was \Delta\mathbf{B}=\mathbf{m}_{\mathrm{on}}-\mathbf{b}(t), where \mathbf{b}(t) was fitted linearly to surrounding coil-off measurements (ambient). \mathbf{m}_{\mathrm{on}} denotes the measured magnetic reading when the coil was on. Approximately 15,000 unique poses were collected over 10 h.

With the base leveled, normalized stationary acceleration \hat{\mathbf{a}}=\mathbf{a}/\|\mathbf{a}\| provides the parent axis in the child sensor frame. These training labels avoid camera and pivot-fitting errors; cameras guide coverage and check consistency. An MLP maps normalized \Delta\mathbf{B} to a unit vector, using cosine loss \ell=1-f(\Delta\mathbf{B})^{\top}\hat{\mathbf{a}}. Hereafter, f the function approximated by the MLP, includes input normalization, which removes multiplicative field-amplitude variation.

III-B2 Acquisition

Continuous attitude polling is interleaved with magnetic bursts. Reading each 96-byte sensor block takes about 3.4 ms; a ten-segment (1 base module and 9 sensing module on TPU) sweep takes approximately 52 ms, with an achieved attitude update rate of 16.7 Hz. Every T_{\mathrm{pair}}=300 ms, one coil fires for 40 ms while the master polls only the other segments’ 12-byte magnetometer blocks, taking approximately 3 ms per round.

For each receiver, the coil field is the mean of fresh coil-on samples minus its latest confirmed coil-off baseline. Samples are accepted only after settling and a bitwise change indicating a new conversion. Each segment receives a parent-coil correction every NT_{\mathrm{pair}}\approx 3 s, while attitude tracking continues between bursts.

III-B3 Calibration and Reconstruction

Let R_{i}=R(\mathbf{q}_{i})R(\mathbf{q}_{i}^{0})^{\top}, where \mathbf{q}_{i}^{0} is recorded with the robot hanging straight, and let \mathbf{e}=-\hat{\mathbf{z}}. Quaternion and magnetic directions are

\displaystyle\mathbf{u}_{i}^{q} \\ \displaystyle=R_{i}\mathbf{e}, \\ \displaystyle\mathbf{u}_{i}^{m} \\ \displaystyle=R_{i-1}M_{\mathbf{e}}\,f(A_{i}W_{i}\Delta\mathbf{B}_{i}), \\ \displaystyle M_{\mathbf{e}} \\ \displaystyle=2\mathbf{e}\mathbf{e}^{\top}-I.

Under the no-twist assumption, M_{\mathbf{e}} converts the predicted parent axis in the child frame into the child direction in the parent frame. The parent’s rotation is evaluated at coil activation.

Ambient subtraction removes constant offsets. An ellipsoid fit to ambient-field measurements during sensor rotation determines the gain and soft-iron correction W_{i}. The remaining alignment A_{i} is fitted over a 45 s initialization window by minimizing the angle between M_{\mathbf{e}}f(A_{i}W_{i}\Delta\mathbf{B}_{i}) and R_{i-1}^{\top}\mathbf{u}_{i}^{q}. Stationary data identify tilt alignment; bending motion additionally identifies axial alignment.

III-B4 Fusion

Quaternion heading drift measured approximately 0.65% of angular travel. We estimate its slowly varying directional error using a per-segment rotation state \mathbf{b}_{i}:

\hat{\mathbf{u}}_{i}=\exp([\mathbf{b}_{i}]_{\times})\mathbf{u}_{i}^{q},\qquad P_{i}\leftarrow P_{i}+\sigma_{b}^{2}\Delta t\,I.
(3)

At each magnetic update,

\displaystyle\mathbf{y}_{i} \\ \displaystyle=\operatorname{Log}(\mathbf{u}_{i}^{q}\!\to\!\mathbf{u}_{i}^{m})-\mathbf{b}_{i}, \\ \displaystyle K_{i} \\ \displaystyle=P_{i}(P_{i}+\sigma_{m}^{2}I)^{-1}, \\ \displaystyle\mathbf{b}_{i} \\ \displaystyle\leftarrow\mathbf{b}_{i}+K_{i}\mathbf{y}_{i},\qquad P_{i}\leftarrow(I-K_{i})P_{i}.

Here \operatorname{Log} denotes the minimum rotation between directions. The unobservable component about \mathbf{u}_{i}^{q} is damped toward zero. The backbone is reconstructed at the attitude update rate without integrating acceleration:

\mathbf{p}_{0}=\mathbf{0},\qquad\mathbf{p}_{i}=\mathbf{p}_{i-1}+L\hat{\mathbf{u}}_{i},\quad i=1,\ldots,N.
(5)

III-C Closed-Loop Tip Height Control

The estimated tip height above the straight hanging configuration is

h=L\sum_{i=1}^{N}(1+\hat{u}_{i,z}).
(6)

Height is independent of heading, so this task evaluates height feedback rather than heading-drift correction. A tendon is selected before each trial because bending in either direction raises the tip. The spool velocity is

v=k_{p}e+k_{i}I_{h}-k_{d}\dot{h},\qquad\dot{I}_{h}=e\,\mathbf{1}_{\{|e|<10\,\mathrm{mm}\}},\quad e=h^{*}-h.
(7)

The measured height derivative is low-pass filtered. Conditional integration limits windup during slack take-up; velocity magnitude and its rate of increase are limited. Unwinding past neutral is prohibited because it reverses the height response.

After alignment, the robot settles for 2 s at zero command; median height and spool position establish trial references. Trials are rejected if initial height exceeds the straight configuration by 5 mm.

IV EXPERIMENTAL SETUP

IV-A Platform and Ground Truth

The robot comprised nine 29 mm segments (261 mm total), suspended from a rigid base and actuated by four antagonistic tendons using velocity-controlled servomotors (Dynamixel XM540-W270-R) in the 4 cardinal directions. Unless stated otherwise, one tendon produced unidirectional curling. The fused, quaternion, magnetic, and inertial estimators processed identical recordings at 16.7 Hz (Section III). The ground truth from the Optitrack Motive system recorded at 100 Hz was used. We report position RMSE across all segments and frames, and tip RMSE.

IV-B Pose Estimation Scenarios

We evaluated four conditions:

  1. Planar curl (2D curl): Slow, unobstructed single-tendon bending constrained to a plane on a flat surface.
  2. Planar curl with obstacle (2D obst.): The same motion against a box of rocks, whose location was unknown to the estimator, testing contact-induced deformation.
  3. Free curl in 3D (3D curl): Single-tendon actuation while freely suspended, testing spatial reconstruction and magnetic correction of quaternion heading error.
  4. Manual manipulation in 3D (3D hand): Arbitrary bending with slack tendons, including shapes beyond the actuated workspace, testing externally imposed deformation without actuator or tendon-length inputs.

IV-C Demonstrations

IV-C1 Cloth Grasping

Mounted on a UFactory Xarm7, the robot curled around and lifted a shirt without feedback control. We present the estimated backbone during the task, demonstrating onboard sensing during occlusion by the cloth and arm.

IV-C2 Closed-Loop Height Hold

The controller in Section III-C used fused feedback to maintain the tip 40 mm above its relaxed vertical position. Height, h=L\sum_{i}(1+u_{i,z}), is independent of heading error. We compare target, estimated, and independently measured heights, and assess disturbance recovery after attaching a 500 g tip load. Furthermore, to demonstrate the modular aspect of our paradigm, we used only 8 modules (9 including the base) for this experiment where as every other experiments we used 9 modules (10 , including the base)

IV-D Drift and Hysteresis

IV-D1 Cyclic Actuation

One tendon underwent 50 pull–release cycles of half a spool turn, each lasting 10 s (5 s per direction; 500 s total). Encoder feedback at 50 Hz tracked p^{*}(t)=p_{0}+\tfrac{A}{2}[1-\cos(2\pi t/T)], ensuring identical commanded strokes and return positions. Pulling and releasing estimates were compared at matched spool positions to assess hysteresis, repeatability and drift.

IV-D2 Static Hold

The robot remained in a fixed curled configuration for 30 min. Joint-angle and tip-position changes quantified estimator drift, particularly for the quaternion chain and fused estimate.

V RESULTS

Fig. 4: Pose estimation during a) planar curling, b) obstacle contact, c) free 3D curling, and d) manual manipulation. Panels (i) to (iv) show selected robot configurations and the corresponding estimated backbones. Panel (v) shows instantaneous backbone RMSE against motion capture, with errors at the final frame annotated. The fused estimate (our estimation) is shown in orange, the magnetic estimate as a dashed line, constrained acceleration with quaternions as a dash dotted line, and acceleration alone as a dotted line. Motion capture is shown in solid black.
TABLE I: Position estimation accuracy and reported drift. Scenario RMSEs are mean \pm standard deviation against motion capture over five trials; Avg. reports the mean \pm standard deviation across all 20 trials pooled across the four scenarios, computed from the rounded scenario statistics. Drift values are changes per 50 s averaged across x, y, and z during recordings without ground truth and may include physical motion.
  • Fusion (this work)
    Backbone RMSE (mm) 2D curl
    7.6\pm 1.1
    Backbone RMSE (mm) 2D obst.
    11.3\pm 1.1
    Backbone RMSE (mm) 3D curl
    13.3\pm 0.9
    Backbone RMSE (mm) 3D hand
    7.8\pm 4.0
    Backbone RMSE (mm) Avg.
    10.0\pm 3.2
    Drift (mm/50 s) Cyclic
    4.1
    Drift (mm/50 s) Hold
    1.2
  • Magnetics only
    Backbone RMSE (mm) 2D curl
    36.9\pm 2.2
    Backbone RMSE (mm) 2D obst.
    18.0\pm 1.5
    Backbone RMSE (mm) 3D curl
    29.4\pm 0.9
    Backbone RMSE (mm) 3D hand
    14.1\pm 2.7
    Backbone RMSE (mm) Avg.
    24.6\pm 9.5
    Drift (mm/50 s) Cyclic
    51.1
    Drift (mm/50 s) Hold
    3.3
  • Constrained acceleration + quaternions
    Backbone RMSE (mm) 2D curl
    133.8\pm 3.4
    Backbone RMSE (mm) 2D obst.
    163.0\pm 3.4
    Backbone RMSE (mm) 3D curl
    71.9\pm 2.1
    Backbone RMSE (mm) 3D hand
    90.5\pm 4.3
    Backbone RMSE (mm) Avg.
    114.8\pm 36.8
    Drift (mm/50 s) Cyclic
    54.6
    Drift (mm/50 s) Hold
    17.1
  • Acceleration only
    Backbone RMSE (mm) 2D curl
    189.0\pm 20.4
    Backbone RMSE (mm) 2D obst.
    153.8\pm 15.3
    Backbone RMSE (mm) 3D curl
    177.7\pm 9.1
    Backbone RMSE (mm) 3D hand
    180.8\pm 21.1
    Backbone RMSE (mm) Avg.
    175.3\pm 20.7
    Drift (mm/50 s) Cyclic
    24.5
    Drift (mm/50 s) Hold
    0.3
  • —
    Backbone RMSE (mm) 2D curl
    Tip RMSE (mm)
    Backbone RMSE (mm) 2D obst.
    Tip RMSE (mm)
    Backbone RMSE (mm) 3D curl
    Tip RMSE (mm)
    Backbone RMSE (mm) 3D hand
    Tip RMSE (mm)
    Backbone RMSE (mm) Avg.
    Tip RMSE (mm)
    Drift (mm/50 s) Cyclic
    データなし
    Drift (mm/50 s) Hold
    データなし
  • Method
    Backbone RMSE (mm) 2D curl
    2D curl
    Backbone RMSE (mm) 2D obst.
    2D obst.
    Backbone RMSE (mm) 3D curl
    3D curl
    Backbone RMSE (mm) 3D hand
    3D hand
    Backbone RMSE (mm) Avg.
    Avg.
    Drift (mm/50 s) Cyclic
    データなし
    Drift (mm/50 s) Hold
    データなし
  • Fusion (this work)
    Backbone RMSE (mm) 2D curl
    8.8\pm 1.1
    Backbone RMSE (mm) 2D obst.
    16.5\pm 1.9
    Backbone RMSE (mm) 3D curl
    21.1\pm 1.8
    Backbone RMSE (mm) 3D hand
    13.0\pm 9.5
    Backbone RMSE (mm) Avg.
    14.9\pm 6.5
    Drift (mm/50 s) Cyclic
    データなし
    Drift (mm/50 s) Hold
    データなし
  • Magnetics only
    Backbone RMSE (mm) 2D curl
    59.9\pm 2.6
    Backbone RMSE (mm) 2D obst.
    36.2\pm 3.0
    Backbone RMSE (mm) 3D curl
    48.0\pm 1.4
    Backbone RMSE (mm) 3D hand
    24.9\pm 5.9
    Backbone RMSE (mm) Avg.
    42.3\pm 13.8
    Drift (mm/50 s) Cyclic
    データなし
    Drift (mm/50 s) Hold
    データなし
  • Constrained acceleration + quaternions
    Backbone RMSE (mm) 2D curl
    193.7\pm 9.2
    Backbone RMSE (mm) 2D obst.
    246.0\pm 5.4
    Backbone RMSE (mm) 3D curl
    113.1\pm 6.8
    Backbone RMSE (mm) 3D hand
    151.8\pm 7.8
    Backbone RMSE (mm) Avg.
    176.2\pm 51.1
    Drift (mm/50 s) Cyclic
    データなし
    Drift (mm/50 s) Hold
    データなし
  • Acceleration only
    Backbone RMSE (mm) 2D curl
    297.5\pm 35.1
    Backbone RMSE (mm) 2D obst.
    232.6\pm 32.1
    Backbone RMSE (mm) 3D curl
    279.4\pm 12.9
    Backbone RMSE (mm) 3D hand
    289.1\pm 32.8
    Backbone RMSE (mm) Avg.
    274.7\pm 37.4
    Drift (mm/50 s) Cyclic
    データなし
    Drift (mm/50 s) Hold
    データなし

V-A Pose Estimation Against Motion Capture

Across four scenarios and 20 trials, fusion achieved scenario-averaged backbone and tip RMSEs of 10.0 and 14.9 mm, respectively, with tip error equal to 5.5% of the 270 mm robot length. Link angular RMSE was 9.3^{\circ} (Table I, Fig. 4).

Magnetic-only backbone and tip RMSEs averaged 24.6 and 42.3 mm, partly reflecting sparse updates during motion. At coil activation, magnetic angular errors were 5.4^{\circ} median, 9.7^{\circ} RMS, and 17.8^{\circ} at the 95th percentile. The constrained and unconstrained inertial variants saturated in every trial, with backbone RMSEs of 114.8 and 175.3 mm, consistent with joint accelerations below residual accelerometer bias. Position errors generally accumulated toward the tip.

V-A1 Scenario Comparison

Planar curling produced fused backbone and tip RMSEs of 7.6 and 8.8 mm, with 6.3^{\circ} angular RMSE. Obstacle contact increased these to 11.3 and 16.5 mm and 9.7^{\circ}. Compression violated the fixed-length approximation, while marker reconstruction in 10–14% of frames contributed to an 8.8 mm metric floor, compared with 2.0 mm without contact.

Free 3D curling produced the largest errors: 13.3 mm backbone and 21.1 mm tip RMSE. Joint bends reached 20^{\circ}–40^{\circ}, exceeding the 25^{\circ}–30^{\circ} training cap. Magnetic angular errors reached a 7.4^{\circ} median and 31.7^{\circ} 95th percentile; errors decreased as the robot straightened.

Manual manipulation achieved 7.8 mm backbone and 13.0 mm tip RMSE despite occlusion, twisting, and compression, without actuator inputs. The best trial achieved 3.5 mm backbone RMSE against a 1.4 mm metric floor.

V-A2 Model Variants and Alignment

Five training and architecture variants differed by less than 0.4 mm in fused backbone RMSE and 0.2^{\circ} in magnetic angular error. Receiver alignment had a larger effect, with its omission increasing error for both fused and magnetic-only estimation.

V-B Demonstrations

V-B1 Cloth Grasping

Estimation continued during occlusion by the cloth and arm (Fig. 5(a)). Across stationary intervals lasting 7, 20, and 14 s, tip estimates varied by at most 6 mm for fusion, 40 mm for magnetic-only estimation, and 50–280 mm for the inertial variants. These measurements characterize stability rather than absolute accuracy.

V-B2 Closed-Loop Height Hold

Fused feedback at 18.6 Hz, using 8 modules, regulated tip height to 40 mm (Fig. 5(b)). The reconstructed response reached the target in 3.4 s, peaked at 46 mm (15% overshoot), and settled within \pm 2 mm after 5.5 s, subsequently holding 40.6\pm 0.04 mm for 10 s.

A 500 g load applied at 24 s lowered the tip and redistributed bending from distal to proximal joints. Height recovered to within 2 mm of the target 5.1 s after its minimum and subsequently held 39.0\pm 0.3 mm. Furthermore, in this scenario we showed that our paradigm work just as well with one less module that the other scenarios, demonstrating our modular ability.

V-C Long-Term Estimation

V-C1 Cyclic Actuation

Across 49 analyzed cycles over 500 s, the final phase-matched tip difference reached 29.1 mm for fusion; magnetic-only differences ranged from 29 to 44 mm without a clear trend (Fig. 5(c)(ii)). Baseline change and cycle-to-cycle variation were 16.1 and 2.3 mm for fusion, versus 4.4 and 7.9 mm for magnetic-only estimation. Magnetic measurements thus showed less baseline change but greater variability. Without ground truth, these changes cannot separate sensor drift from creep or imperfect motion repetition.

V-C2 Static Hold

During a 31.9 min interval with all gyroscopes below 0.02 rad/s, 5258 magnetic fixes were recorded. Fused and magnetic-only tip displacements reached 11.1 and 12.7 mm, respectively, with linear-trend displacements of 8.7 and 8.4 mm and RMS scatter of 0.6 and 1.3 mm (Fig. 5(c)(i)). The shared downward trend was consistent with curl relaxation, but does not establish an absolute drift bound without independent ground truth.

VI DISCUSSION

Fig. 5: Task demonstrations and long-term estimation. a) Open-loop shirt grasping with grip attachments: (i) initial and (ii) final configurations. b) Height regulation at 40 mm under a 500 g tip load: (i–ii) configurations before and after loading; (iii) height response. Blue and orange dots mark the illustrated frames; the red dashed line marks load application. For this demonstration, we removed the end module to demonstrate that the shape estimation ability is independent of the number of modules. c) Estimated displacement during (i) a stationary hold and (ii) cyclic actuation. The cyclic plot shows z displacement relative to the first cycle.
TABLE II: Reported proprioceptive sensing accuracy. L: robot or sensed length; —: unreported. Metrics and experimental conditions differ across studies. For our work, the row averages scenario means; this work’s shape error is backbone RMSE across nine tracked segments.
  • Baaij et al. [20]
    L [mm]
    110
    Sensing / method
    3 magnetometers + magnet, NN
    Tip error
    —
    Shape error
    4.5% (config.)
  • Adamu et al. [21]
    L [mm]
    240
    Sensing / method
    Hall + magnet/segment, MLP
    Tip error
    <5%L
    Shape error
    max 11 mm per marker
  • Guo et al. [19]
    L [mm]
    —
    Sensing / method
    embedded magnets + sensors
    Tip error
    0.23–9.34 mm
    Shape error
    —
  • Li et al. [24]
    L [mm]
    —
    Sensing / method
    Hall + base magnet + IMUs
    Tip error
    —
    Shape error
    <1 mm
  • Pittiglio et al. [25]
    L [mm]
    64
    Sensing / method
    ball chain + Hall array
    Tip error
    2.9%L (max 7.1%)
    Shape error
    —
  • Thuruthel et al. [26]
    L [mm]
    120
    Sensing / method
    cPDMS strain, LSTM
    Tip error
    2.4\pm 2.2 mm
    Shape error
    —
  • Vicari et al. [27]
    L [mm]
    220
    Sensing / method
    base pressure, BiLSTM
    Tip error
    6.0\pm 4.7 mm (2.7%L)
    Shape error
    —
  • Martin et al. [12]
    L [mm]
    660
    Sensing / method
    8 IMUs, PCC
    Tip error
    median <10%L
    Shape error
    —
  • Stella et al. [28]
    L [mm]
    750
    Sensing / method
    2 IMUs, PCC filter
    Tip error
    \approx7%L
    Shape error
    —
  • Han et al. [29]
    L [mm]
    583
    Sensing / method
    bend + IMUs, Kalman
    Tip error
    RMSE 17.0 mm (2.9%L)
    Shape error
    —
  • Sue et al. [13]
    L [mm]
    650
    Sensing / method
    coils + magnetometers, NN
    Tip error
    47.4 mm (7.3%L)
    Shape error
    RMSE 44.2 mm
  • This work
    L [mm]
    \approx270
    Sensing / method
    PCB coils + IMUs, NN + ESKF
    Tip error
    14.9 mm (5.5%L)
    Shape error
    RMSE 10.0 mm

VI-A Effect of Magnetic Fusion

Magnetic corrections offered little benefit during 13–30 s trials. Magnetic estimates had 5.4^{\circ} median angular error and updated every 3 s per joint, whereas attitudes updated at 16.7 Hz with heading drift of approximately 0.65% of angular travel. Greater magnetic weighting may therefore degrade short-term accuracy while potentially helping after larger accumulated motion.

Across 49 cycles, fused and magnetic-only baseline changes were approximately 16 and 4 mm, with cycle-to-cycle variations of 2.3 and 7.9 mm. Filter parameters came from holdout residuals and measured heading drift without further tuning. Retuning or joint-specific bias modeling may improve correction at the cost of greater variability. Both estimators showed similar 8–9 mm trends during the 32 min static hold, consistent with creep but not excluding shared estimation error.

Fusion reconstructed the backbone without acceleration integration, avoiding the 100–300 mm errors developed by inertial variants within 1 s. Fused feedback also supported height regulation and disturbance recovery, with a reconstructed settling time of 5.5 s to \pm 2 mm. However, height is heading-insensitive, and the response was reconstructed from logged attitudes because the controller’s estimate was not recorded.

Overall tip RMSE was 14.5 mm (5.4% of length), with 3.3% during planar curling and 5–8% in 3D. These values are comparable to reported small magnetic systems and below the approximately 7–10% reported for longer IMU-only arms, but exceed the 2.9% reported for bend-sensor–IMU fusion (Table II). Our system uses no strain or bend sensors and shares one trained joint model, although differing platforms and metrics limit direct comparison.

VI-B Measurement and Evaluation Limitations

RMSE includes reference, reconstruction, and alignment uncertainty. Planar references used single markers with possible center offsets; 3D references used three markers, inferring missing rotation from chain pitch when only two were visible.

Obstacle contact compressed joints and required reconstruction of interior segments in 10–14% of frames. Restricting evaluation to measured positions reduced fused RMSE from 11.3 to 10.5 mm, indicating that reference limitations contributed to contact error. Friction, actuation speed, marker occlusion, and manual placement introduced further variation. Tight curls exceeded the training range, while manual forces could violate the no-twist and fixed-length assumptions. Hardware and calibration also varied between sessions.

A shared time offset and world heading were fitted from segment attitudes. Independent magnetic alignment reduced magnetic RMSE from 25.2 to 15.1 mm, while fused RMSE changed by only 0.1 mm, demonstrating sensitivity to the comparison frame. Receiver alignment also used attitudes from other trials in the same scenario, excluding the scored trial and motion capture. The sensing channels are therefore not fully independent, and a single world heading cannot correct relative segment drift.

Without independent ground truth, long recordings cannot separate creep from estimator drift, and height-control accuracy remains unverified. These limitations are insufficient to explain the much larger inertial errors but constrain conclusions about differences of a few millimetres between methods.

VII CONCLUSIONS

We presented a modular continuum robot combining PCB coils, magnetometers, and onboard attitude sensing for shape estimation without actuator models, strain sensors, or external cameras during deployment. A shared learned joint model, per-segment calibration, and quaternion–magnetic fusion achieved pooled backbone and tip RMSEs of 10.0\pm 3.2 and 14.9\pm 6.5 mm, respectively, across 20 trials in four scenarios. Mean tip RMSE corresponded to 5.5% of robot length, with estimation demonstrated under both tendon actuation and manual manipulation. The estimate also supported tip-height control and disturbance recovery, although control accuracy requires independent ground-truth validation. Future work will improve drift correction, expand the training workspace, extend feedback control from tip height to backbone shape, and incorporate force sensing for more comprehensive proprioception.

ACKNOWLEDGMENT

This work used large language models (LLMs) such as ChatGPT and Claude to assist in proofreading and revising the manuscript text. In addition, LLMs were also used to assist in the creation of code segments/scripts used for experimental data analysis, figure generation and implementation.

References

  1. [1] Z. Tang, J. Shao, Y. Yang, L. Zhou, and J. Zheng (2026) An origami-inspired cable-driven continuum robot. Advanced Intelligent Systems 8 (1), pp. 2500520. External Links: Document
  2. [2] L. Li, S. Li, M. Wang, Y. Chen, X. Kuang, J. Li, Y. Yue, and H. Chen (2026) A continuum robot based on a conical helical configuration for adaptive grasping of irregular objects. IEEE Robotics and Automation Letters 11 (5), pp. 5946–5953. External Links: Document
  3. [3] J. Lai, Y. Liu, T. Ren, Y. Ma, T. Zhang, J. Y. Teoh, M. R. Cutkosky, and H. Ren (2026) Single twistable tendon-driven continuum robots. Nature Communications 17 (1), pp. 8322. External Links: Document, ISSN 2041-1723
  4. [4] P. Yang, L. Mao, C. Tian, X. Meng, and H. Xie (2025) A cooperative and multifunctional magnetic continuum robot for noninteractive access, dexterous navigation, and versatile manipulation. Advanced Functional Materials 35 (2), pp. 2412543. External Links: Document
  5. [5] P. E. Dupont, N. Simaan, H. Choset, and C. Rucker (2022) Continuum robots for medical interventions. Proceedings of the IEEE 110 (7), pp. 847–870. External Links: Document
  6. [6] D. B. Camarillo, C. R. Carlson, and J. K. Salisbury (2009) Configuration tracking for continuum manipulators with coupled tendon drive. IEEE Transactions on Robotics 25 (4), pp. 798–808. External Links: Document
  7. [7] P. Rao, Q. Peyron, S. Lilge, and J. Burgner-Kahrs (2021) How to model tendon-driven continuum robots and benchmark modelling performance. Frontiers in Robotics and AI Volume 7 - 2020. External Links: Document, ISSN 2296-9144
  8. [8] J. Shen, B. Browne, J. Ha, and Y. Chen (2026) Friction modeling of tendon-driven continuum robots through linear complementarity problem. IEEE Robotics and Automation Letters 11 (6), pp. 7468–7475. External Links: Document
  9. [9] M. K. Mishra, A. K. Samantaray, and G. Chakraborty (2022) Fractional-order bouc-wen hysteresis model for pneumatically actuated continuum manipulator. Mechanism and Machine Theory 173, pp. 104841. External Links: Document, ISSN 0094-114X
  10. [10] M. Russo, S. M. H. Sadati, X. Dong, A. Mohammad, I. D. Walker, C. Bergeles, K. Xu, and D. A. Axinte (2023) Continuum robots: an overview. Advanced Intelligent Systems 5 (5), pp. 2200367. External Links: Document
  11. [11] L. Liu, X. Huang, X. Zhang, B. Zhang, H. Xu, V. M. Trivedi, K. Liu, Z. Shaikh, and H. Zhao (2025) Model-based 3d shape reconstruction of soft robots via distributed strain sensing. Soft Robotics 12 (6), pp. 721–731.
  12. [12] Y. J. Martin, D. Bruder, and R. J. Wood (2022) A proprioceptive method for soft robots using inertial measurement units. In 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vol. , pp. 9379–9384. External Links: Document
  13. [13] G. N. Sue, Z. Cao, J. Hu, X. Bu, D. Quinn, T. Wu, Z. Erickson, and C. Majidi (2026) Tendon-driven continuum robot with modular stiffness and in-situ self pose estimation. External Links: 2609.16256, Link
  14. [14] A. Reiter, R. E. Goldman, A. Bajo, K. Iliopoulos, N. Simaan, and P. K. Allen (2011) A learning algorithm for visual pose estimation of continuum robots. In 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vol. , pp. 2390–2396. External Links: Document
  15. [15] Y. Fang, X. Dong, A. Mohammad, and D. Axinte (2023) Design and Control of a Multiple-Section Continuum Robot With a Hybrid Sensing System. IEEE/ASME Transactions on Mechatronics 28 (3), pp. 1522–1533. External Links: ISSN 1941-014X, Document
  16. [16] S. Lilge, T. D. Barfoot, and J. Burgner-Kahrs (2022) Continuum robot state estimation using Gaussian process regression on SE(3). The International Journal of Robotics Research 41 (13-14), pp. 1099–1120 (en). External Links: ISSN 0278-3649, 1741-3176, Document
  17. [17] S. Teetaert, S. Lilge, J. Burgner-Kahrs, and T. D. Barfoot (2025) A Stochastic Framework for Continuous-Time State Estimation of Continuum Robots. arXiv. Note: arXiv:2510.01381 [cs] External Links: Link, Document
  18. [18] J. Hughes, F. Stella, C. D. Santina, and D. Rus (2021) Sensing soft robot shape using imus: an experimental investigation. pp. 543–552. External Links: ISBN 978-3-030-71151-1
  19. [19] H. Guo, F. Ju, Y. Cao, F. Qi, D. Bai, Y. Wang, and B. Chen (2019) Continuum robot shape estimation using permanent magnets and magnetic sensors. Sensors and Actuators A: Physical 285, pp. 519–530.
  20. [20] T. Baaij, M. K. Holkenborg, M. Stölzle, D. Van Der Tuin, J. Naaktgeboren, R. Babuška, and C. Della Santina (2023) Learning 3D shape proprioception for continuum soft robots with multiple magnetic sensors. Soft Matter 19 (1), pp. 44–56 (en). External Links: ISSN 1744-683X, 1744-6848, Document
  21. [21] Y. A. Adamu, D. Feliu-Talegon, A. T. Mathew, and F. Renda (2025) 3-axis angular strain estimation with hall effect sensors for proprioception of soft robotic manipulators. IEEE Robotics and Automation Letters 10 (9), pp. 8666–8673. External Links: Document
  22. [22] Y. Li, Y. Kuang, M. Cui, and W. Li (2026) A novel shape estimation strategy for continuum robots using multiple Hall-Effect sensors and IMUs. In Advanced Computational Intelligence and Intelligent Informatics, Communications in Computer and Information Science, Vol. 2782, pp. 546–560. External Links: Document
  23. [23] R. J. Webster and B. A. Jones (2010) Design and kinematic modeling of constant curvature continuum robots: a review. The International Journal of Robotics Research 29 (13), pp. 1661–1683. External Links: Document
  24. [24] Y. Li, Y. Kuang, M. Cui, and W. Li (2026) A novel shape estimation strategy for continuum robots using multiple hall-effect sensors and IMUs. In Advanced Computational Intelligence and Intelligent Informatics (IWACIII 2025), Communications in Computer and Information Science, Vol. 2782, pp. 546–560. External Links: Document
  25. [25] G. Pittiglio, A. Donder, and P. E. Dupont (2024) Continuum robot shape estimation using magnetic ball chains. Note: arXiv preprint External Links: 2410.16025, Document
  26. [26] T. G. Thuruthel, B. Shih, C. Laschi, and M. T. Tolley (2019) Soft robot perception using embedded soft sensors and recurrent neural networks. Science Robotics 4 (26), pp. eaav1488. External Links: Document
  27. [27] A. Vicari, N. Obayashi, F. Stella, G. Raynaud, K. Mulleners, C. D. Santina, and J. Hughes (2023) Proprioceptive sensing of soft tentacles with model based reconstruction for controller optimization. In 2023 IEEE International Conference on Soft Robotics (RoboSoft), Vol. , pp. 1–6. External Links: Document
  28. [28] F. Stella, C. Della Santina, and J. Hughes (2024) Soft robot shape estimation with IMUs leveraging PCC kinematics for drift filtering. IEEE Robotics and Automation Letters 9 (2), pp. 1945–1952. External Links: Document
  29. [29] D. H. Han, M. Mehta, R. Zuo, Z. Wanger, and D. Bruder (2025) An enhanced proprioceptive method for soft robots integrating bend sensors and IMUs. Note: arXiv preprint External Links: 2511.01165, Document