ChunkVLA-AM, 적층 제조 로봇 제어를 위한 병렬 액션 청킹 VLA 배포 파이프라인
이 논문은 오픈소스 VLA 모델 OpenVLA-OFT를 FAIRINO FR3 로봇에 적응시키고 8단계 액션 청크를 예측해 실행하는 ChunkVLA-AM 배포 파이프라인을 제안했다. 실물 A-to-B 이송 시험 42회 중 39회(92.9%) 성공했고, 궤적 예측 오차는 평균 1.74 mm로 단일 단계 적응 모델의 9.50 mm보다 낮았다. 다만 이 연구는 동료 심사를 거치지 않은 프리프린트이며, 실패 3건은 모두 최종 배치 높이 제어 부족으로 물체가 쓰러진 경우였다.
사전 훈련된 VLA 모델을 FR3 로봇의 적층 제조 작업장에 적용할 때, 로봇 실시예 적응과 조명 변화에 강건한 배포 파이프라인을 만들 수 있는가?
VLA 모델을 적층 제조에 쓰려면 로봇마다 다른 좌표계, 행동 표현, 그리퍼 규약 때문에 적응 비용이 크다. 또 고정 카메라와 조명으로 수집한 데모로 학습한 정책은 조명, 배경, 물체 자세가 바뀌면 시각 특징에 과적합해 동작이 흔들린다. 제로샷 OpenVLA와 OpenVLA-OFT는 FR3 작업공간에서 179.60~650.12 mm의 궤적 오차를 보여 바로 쓸 수 없었다.
기존에는 제로샷 VLA 모델을 그대로 쓰거나 단일 단계 자동회귀 방식으로 미세조정했다. 제로샷 모델은 FR3의 운동학과 작업공간에 맞지 않아 큰 오차가 났고, 단일 단계 적응 모델은 평균 9.50 mm, X축 16.90 mm의 드리프트가 누적됐다. 액션 청킹만으로는 공간 의미가 부족해 제로샷 성능을 보완하지 못했다.
ChunkVLA-AM은 모노큘러 RGB 데모를 OpenVLA 호환 TFDS/RLDS 데이터로 변환하고, 7차원 Cartesian 델타 행동을 ±5 mm, ±0.05 rad로 정규화한 뒤 LoRA rank 32로 OpenVLA-OFT를 적응시켰다. 실행 시에는 한 번의 요청으로 8단계 액션 청크를 예측하고 FR3가 청크를 개방 루프로 실행한 뒤 새 관찰을 받아 폐쇄 루프를 형성한다. 클라우드 서버와 CPU 전용 로봇 클라이언트를 FastAPI로 연결하고, 작업공간 이탈, 최소 높이, 최대 스텝, NaN, 지연 응답을 거부하는 안전 필터를 적용했다.
로깅 궤적 분석에서 ChunkVLA-AM은 X 0.37 mm, Y 0.97 mm, Z 3.87 mm, 전체 평균 1.74 mm의 MAE를 기록했다. 제로샷 OpenVLA와 OpenVLA-OFT는 179.60~650.12 mm, 단일 단계 적응 모델은 평균 9.50 mm( X 16.90 mm)였다. 실물 FR3에서 8단계 청크를 순차 실행한 A-to-B 이송 시험 42회 중 39회(92.9%) 성공했고, 빨강 21회, 파랑 21회로 나뉘었다. 실패 3회는 모두 최종 배치에서 물체가 쓰러진 경우였다. 조명 휘도 스윕은 10개 로깅 궤적을 181개 목표 휘도에서 평가했고, 85~125 구간이 저오차였다. 평균 공간 오차 최저치는 휘도 95에서 5.459 mm였다. 휘도 30에서는 7.165 mm, 210에서는 6.598 mm로 증가했고, Z축이 주 오차였다.
저자들은 실패 원인이 배치 높이 제어 부족이라고 밝혔고, 향후 작업으로 더 넓은 물체와 작업 일반화, 청크 길이 단독 절제, 접촉력 모니터링, 뒤틀린 부품 검사와 실패 출력 제거 같은 실제 AM 작업을 꼽았다. 현재 평가는 고정 카메라와 단일 FR3 작업장에서 두 가지 색 블록 이송에 한정됐고, 적응 방식과 예측 지평이 함께 바뀌어 액션 청킹만의 효과를 분리하지 못했다. 코드 공개 여부는 논문에 보고되지 않았다.
적층 제조 작업장의 인쇄물 회수, 빌드 플레이트 이송, 사후 처리 같은 단순 반복 작업에 클라우드 추론 로봇을 도입하려는 통합업체가 참고할 수 있다. 지금은 고정 조명(휘도 85~125)과 단순 블록 이송에서는 동작하지만, 실제 부품 검사나 실패 출력 제거에 쓰려면 더 다양한 데모, 접촉 감지, 조명 증강, 안전 인증이 먼저 필요하다. 1~3년 내 실제 AM 보조 작업으로 확장하려면 청크 길이 절제와 실제 프린터 부품 대상 평가가 뒷받침돼야 한다.
논문 전문
ChunkVLA-AM: Parallel Action Chunking for Vision-Language-Action Robot Control in Additive Manufacturing
CC BY 4.0 라이선스로 공개된 논문입니다. 출처를 밝혀 전재하며, 원문은 arXiv:2610.01856(PDF)에서 볼 수 있습니다.
Abstract
Vision–language–action (VLA) models unify visual perception, language understanding, and action generation, offering new opportunities for automation in additive manufacturing (AM). However, deployment in AM remains challenging because adapting these models to unseen robot embodiments is costly, and performance can degrade under environment changes. In this work, we present a framework for deploying OpenVLA-OFT on a FAIRINO FR3 robot in a fixed AM workcell. A data pipeline converts monocular real-world demonstrations into OpenVLA-compatible TFDS/RLDS datasets to support adaptation to the FR3 embodiment. At runtime, each inference request predicts an eight-step chunk of 7-D actions. The FR3 executes each chunk open loop before capturing a new observation, providing closed-loop feedback between chunks. The system uses a cloud–edge architecture in which the FR3 client streams observations to a remote inference server through a FastAPI interface. In 42 physical A-to-B object-transfer trials, evenly split between red and blue targets, the system succeeded in 39 (92.9%). All three failures occurred during final placement, when insufficient release-height control caused the object to topple. An illumination sweep identified a low-error luminance range of 85–125 on a 0–255 scale, with the lowest mean spatial error at 95.
Index Terms:
vision-language-action model, additive manufacturing, robot manipulation, action chunking, OpenVLA
.
I Introduction
Additive manufacturing (AM) has become an important production paradigm for rapid prototyping, customized medical devices, aerospace components, and high-value industrial parts [1, 2, 3]. Beyond deposition itself, practical AM workflows require inspection, part retrieval, build-plate handling, post-processing, and occasional intervention after process failures. These operations can expose human operators to process-specific risks: fused deposition modeling (FDM) may emit ultrafine particles and volatile organic compounds during heated thermoplastic extrusion [4, 5], while selective laser melting (SLM) involves fine metallic powders and particulate-matter hazards [6]. Robotic automation is therefore attractive for AM workcells because it can improve repeatability and reduce human exposure during inspection, transfer, and failure response. However, conventional rule-based robot programs are difficult to reuse across different printers, robot platforms, camera configurations, lighting conditions, object poses, and defect types such as FDM warping, inter-layer delamination, SLM porosity, lack-of-fusion holes, and cracks [7, 8, 9].
Vision-language-action (VLA) models provide a possible route toward more flexible AM robotic systems. By mapping visual observations and natural-language task descriptions directly to robot actions, VLA policies can represent tasks such as “retrieve the printed part,” “inspect the warped edge,” or “move the build-plate sample to the cooling area” without requiring a separate perception pipeline and a handcrafted state machine. Recent systems including RT-1, RT-2, Open X-Embodiment, and OpenVLA have shown that large-scale robot datasets, vision-language backbones, and action-token prediction can support general manipulation and transfer across tasks and embodiments [10, 11, 12, 13]. This capability is relevant to AM because the robot must interpret both the visual manufacturing context and the language instruction while generating manipulation commands within a constrained workspace.
Despite this potential, transferring a VLA model to an AM workcell is not a straightforward model-deployment problem. The first difficulty is migrating demonstrations and action interfaces across robot platforms. Robot datasets often differ in image resolution, observation structure, sampling rate, episode organization, coordinate frames, state definitions, and gripper conventions. Their action spaces may also represent joint positions, joint velocities, absolute Cartesian poses, or relative end-effector motion. Even when two platforms expose action vectors of the same dimension, the individual elements may have different physical meanings, units, ranges, or normalization rules. RLDS and TFDS provide a common structure for organizing episodic robot data, but they do not by themselves resolve these embodiment-specific differences [14, 15]. As a result, transferring an existing VLA pipeline to a platform such as the FAIRINO FR3 requires more than renaming dataset fields. Coordinate transformations, action semantics, gripper commands, and normalization statistics must all be defined consistently before the model can be trained and safely deployed.
The second difficulty is robustness to changes between the demonstration environment and the deployed AM workcell. Lighting intensity, illumination direction, camera exposure, background clutter, camera viewpoint, and object pose may vary between data collection and execution. Reflective build plates, dark polymer parts, shadows cast by the robot, and changes in printer illumination can further alter the visual appearance of the part and the gripper. These variations are especially relevant when the model is adapted using demonstrations collected under a fixed camera and lighting configuration. Because a VLA policy predicts actions directly from image observations, it may associate the required motion with incidental visual features of the training environment instead of the task geometry. A policy that succeeds under the original lighting condition may therefore become less reliable when the workcell appearance changes, even though the physical task remains the same.
In this work, we present ChunkVLA-AM, a reproducible OpenVLA-OFT-based deployment pipeline for FR3-based AM post-print retrieval. To make embodiment adaptation explicit, we construct a conversion pipeline that transforms monocular FR3 demonstrations, Cartesian end-effector states, binary gripper commands, language instructions, and episode metadata into OpenVLA-compatible TFDS/RLDS episodes. The pipeline defines the coordinate frames, action semantics, and normalization procedure required by the target FR3 system, while LoRA is used to avoid full-parameter fine-tuning. For robot control, we adopt a horizon-H action-chunk interface and use H=8 in the reported physical tests, allowing the model to predict short-horizon motion sequences in a single request. The FR3 client then applies action denormalization, workspace clipping, unsafe-action rejection, and chunk-wise replanning after execution of the returned actions. This implementation focuses on the system-level adaptation and deployment required to use an action-chunked VLA policy in a fixed AM workcell and to evaluate its behavior under changes in lighting and object pose.
II Related Work
II-A Vision-Language-Action Models for Robot Control
Vision-language-action (VLA) models have emerged from the broader trend of connecting language, perception, and embodied decision making. Early generalist and language-conditioned robot systems, including Gato, SayCan, PaLM-E, and VIMA, showed that multimodal representations can support instruction following, planning, and interactive manipulation across diverse tasks [16, 17, 18, 19]. More recent VLA policies such as RT-1, RT-2, Open X-Embodiment, and OpenVLA further demonstrate that large-scale robot datasets and vision-language backbones can be used to predict robot actions directly from images and natural-language instructions [10, 11, 12, 13]. These studies provide the main methodological foundation for applying VLA models beyond household or tabletop manipulation. However, their evaluation settings are still largely centered on general manipulation benchmarks, leaving manufacturing-oriented scenarios comparatively underexplored.
II-B Robotic Automation in Additive Manufacturing
Additive manufacturing (AM) has been widely studied as a flexible production technology for customized, lightweight, and high-value components [1, 2, 3]. Robotic systems have also been introduced into AM workflows for material handling, inspection, deposition assistance, post-processing, and large-scale or wire-arc manufacturing [20]. Compared with conventional automation, AM workcells pose distinctive perception and decision-making challenges because part geometry, surface appearance, thermal history, defect morphology, and process state can vary significantly across builds. Defects such as warping, delamination, porosity, lack of fusion, and cracking further require robots to reason over visual manufacturing evidence instead of simply replaying fixed trajectories [7, 8, 9]. These characteristics make AM a natural application domain for VLA models: language can specify task intent, visual input can capture part and process context, and action prediction can support flexible intervention.
II-C Challenges of Applying VLA Models to AM
Although VLA models are promising for AM, existing literature suggests two major barriers to practical use. The first is data and adaptation cost. AM tasks are weakly represented in large robot-learning datasets, while effective VLA adaptation requires demonstrations that align visual observations, language instructions, action labels, and episode structure in reusable formats such as TFDS/RLDS [14, 15]. Full fine-tuning of large VLA models can be expensive and data-hungry, motivating parameter-efficient adaptation methods such as LoRA [21]. The second challenge is achieving temporally coherent motion. Single-step autoregressive prediction can accumulate covariate shift and produce open-loop drift during precise manipulation. Prior work on action chunking and horizon-based visuomotor policies shows that predicting multiple future actions as a structured sequence improves motion consistency [22, 23]. In AM settings, such temporal coherence must be balanced against responsiveness and safety, because robot motions often occur near printed parts, build plates, tools, or process-sensitive regions. Therefore, the VLA–AM research gap is not only whether VLA models can represent AM tasks, but also how they can be adapted and executed with sufficient temporal stability for precise manufacturing intervention.
III Preliminaries
III-A VLA Policy for AM Robot Intervention
We formulate AM robot intervention as language-conditioned action prediction. At time t, the robot observes a RGB image I_{t}\in\mathbb{R}^{h\times w\times 3} and receives a natural-language instruction l. A VLA policy parameterized by \theta predicts a robot action from the image–language pair,
a_{t}=f_{\theta}(I_{t},l),where a_{t}\in\mathbb{R}^{d_{a}} denotes the continuous control command after token decoding and denormalization. For an AM demonstration dataset
\mathcal{D}_{\mathrm{AM}}=\{(I_{t}^{(i)},l^{(i)},a_{t}^{(i)},e_{t}^{(i)})\}_{i,t},where e_{t}^{(i)} stores episode metadata, the adaptation objective can be written as empirical risk minimization, following standard supervised imitation-style VLA adaptation [10, 13],
\theta^{\star}=\arg\min_{\theta}\frac{1}{|\mathcal{D}_{\mathrm{AM}}|}\sum_{(I,l,a)\in\mathcal{D}_{\mathrm{AM}}}\mathcal{L}\big(f_{\theta}(I,l),a\big).III-B Costly Adaptation and Fine-Tuning
Let \theta_{0} denote a pretrained VLA model and let N_{\theta} be the number of trainable parameters under full fine-tuning. Direct adaptation updates all model weights,
\theta=\theta_{0}+\Delta\theta,\qquad\Delta\theta\in\mathbb{R}^{N_{\theta}},which creates a high optimization and storage cost when N_{\theta} is large. The adaptation cost can be abstracted as
C_{\mathrm{adapt}}\propto N_{\mathrm{train}}\,|\mathcal{D}_{\mathrm{AM}}|\,E,where N_{\mathrm{train}} is the number of trainable parameters and E is the number of training epochs. In AM, this cost is amplified by the limited availability of task-specific demonstrations and by embodiment-dependent action conventions. Parameter-efficient adaptation reduces the trainable parameter count by freezing \theta_{0} and learning a low-dimensional update \Delta\theta_{\phi} [21],
\theta=\theta_{0}+\Delta\theta_{\phi},\qquad|\phi|\ll N_{\theta}.Thus, the goal is to minimize task loss on \mathcal{D}_{\mathrm{AM}} while keeping N_{\mathrm{train}}=|\phi| small. This motivates a data interface that preserves AM observations, instructions, actions, and episode boundaries, together with parameter-efficient fine-tuning while avoiding full-model adaptation.
III-C Visual Input Conditions: Illumination and Camera Viewpoint
The observed image I_{t} depends not only on the scene content but also on physical imaging conditions. Let \mathcal{S}_{t} denote the geometric and material state of the AM workspace at time t, let \lambda_{t}\in\Lambda be the ambient illumination—characterized by mean luminance \mu(\lambda_{t})\in[0,255] and color temperature T(\lambda_{t}) in Kelvin—and let \mathbf{c}=(K,[R\mid\mathbf{t}]) denote the camera intrinsic matrix K and fixed extrinsic pose [R\mid\mathbf{t}]. The image formation can then be written as
I_{t}=\mathcal{G}(\mathcal{S}_{t},\,\lambda_{t};\,\mathbf{c}),where \mathcal{G} is the image formation function. In our deployment \mathbf{c} is held constant across all episodes (fixed monocular camera), so cross-episode variation in I_{t} arises primarily from changes in \mathcal{S}_{t} (part pose, build-plate state) and \lambda_{t} (workcell lighting).
For the VLA policy to generalize across AM workcell conditions, it must satisfy approximate illumination invariance,
\bigl\|f_{\theta}\!\bigl(\mathcal{G}(\mathcal{S}_{t},\lambda;\mathbf{c}),l\bigr)-f_{\theta}\!\bigl(\mathcal{G}(\mathcal{S}_{t},\lambda_{0};\mathbf{c}),l\bigr)\bigr\|_{2}\leq\epsilon_{\lambda},\quad\forall\,\lambda\in\Lambda,where \lambda_{0} is a reference (baseline) illumination and \epsilon_{\lambda} is a tolerable action deviation. A small \epsilon_{\lambda} across a wide range of \Lambda indicates that the visual backbone has learned illumination-robust features.
Under a fixed camera pose \mathbf{c}, the appearance of the same workspace also varies with object placement and orientation on the build plate. The perspective projection of the scene can be written as
I_{t}=\Pi(\mathcal{S}_{t};\,K,R,\mathbf{t}),where \Pi denotes the perspective projection operator. Because the camera pose is fixed, residual viewpoint variation arises from differences in printed-part pose. The policy must therefore handle object-level pose variation without explicit 3D estimation. This motivates the use of square-padded, fixed-resolution image inputs and the robustness study in Section V, where we evaluate the adapted policy across seven distinct illumination conditions spanning luminance.
III-D Action Representation
Each action is represented as a Cartesian end-effector delta and gripper command,
a_{t}=[\Delta x,\Delta y,\Delta z,\Delta\phi,\Delta\theta,\Delta\psi,g].The first six terms describe translational and rotational increments, and g is a binary gripper state.
IV ChunkVLA-AM
ChunkVLA-AM is a reproducible OpenVLA-OFT-based deployment pipeline. It uses monocular RGB input, synchronized robot poses, parallel action-chunk prediction, Cartesian end-effector control, and robot-side safety filters. The pipeline defines five interfaces:
- TFDS/RLDS conversion,
- Action Normalization and Token Targets,
- LoRA Adaptation,
- Action Chunk Construction
- Cloud-Edge Execution and Safety Filtering
Figure 1 summarizes the pipeline. The remote server performs large language model inference, while the CPU-only robot workstation handles capture, requests, parsing, denormalization, smoothing, clipping, validation, execution, and logging. This split supports hardware where the robot controller and VLA model cannot run on the same machine.
IV-A TFDS/RLDS Data Conversion
Each demonstration becomes an RLDS-style episode with synchronized observations, actions, language, and metadata [14, 15]. The raw log contains time-stamped end-effector poses, gripper states, controller commands, and camera frames. We use the robot base frame for Cartesian translations. At step t, the translational action is
\Delta p_{t}=p_{t+1}-p_{t},where p_{t}=[x_{t},y_{t},z_{t}] is the end-effector position. Rotation uses a roll-pitch-yaw Euler increment,
\Delta r_{t}=[\Delta\phi_{t},\Delta\theta_{t},\Delta\psi_{t}],computed from consecutive orientations after conversion to the same Euler convention. The gripper command g_{t} is binary, with g_{t}=1 for closing or holding and g_{t}=0 for opening or release. The final 7-D action is
a_{t}=[\Delta x_{t},\Delta y_{t},\Delta z_{t},\Delta\phi_{t},\Delta\theta_{t},\Delta\psi_{t},g_{t}].Images are converted to RGB, square-padded, and resized to 224\times 224 pixels. Images and robot states are synchronized by nearest time stamp; frames outside one control period are dropped. The demonstrations and corresponding action labels are sampled at approximately 25 Hz. Episode boundaries come from the start/stop signal, timeout, or task-completion marker. The schema stores image observations, Cartesian state and gripper metadata, normalized 7-D delta actions, repeated language instructions, and trial metadata including episode id, step index, timestamps, and terminal flag.
IV-B Action Normalization and Token Targets
Before tokenization, each continuous action dimension is clipped to a symmetric range and normalized to [-1,1]:
\bar{a}_{t,j}=\mathrm{clip}(a_{t,j},-c_{j},c_{j})/c_{j}.For the post-print retrieval configuration, the default clipping values are c_{x}=c_{y}=c_{z}=5 mm per action and c_{\phi}=c_{\theta}=c_{\psi}=0.05 rad per action. The gripper channel is not normalized as a continuous value; it is binarized by the open/close state and serialized as a discrete command token. These thresholds are deployment parameters and should not be interpreted as safety guarantees: they limit the largest command passed to the controller, but physical safety still depends on validation, contact monitoring, and emergency stop handling.
IV-C LoRA Adaptation
The adaptation uses only monocular RGB images and language instructions, avoiding multi-view cameras, depth sensing, tactile sensing, or other additional modalities. We adapt the OpenVLA-OFT model with LoRA, which trains low-rank updates while freezing the pretrained backbone [21]. For FR3 adaptation, we use a LoRA rank of 32 with zero dropout, a learning rate of 5\times 10^{-4}, a batch size of 8, and gradient accumulation over 4 steps, giving an effective batch size of 32. The model is trained for approximately 30 epochs.
For single-step imitation, the supervised objective is
\mathcal{L}_{\text{step}}=-\sum_{t}\log p_{\theta}(a_{t}\mid I_{t},l).For chunked imitation, adjacent expert actions form a short-horizon target,
\mathcal{L}_{\text{chunk}}=-\sum_{t}\sum_{h=0}^{H-1}\log p_{\theta}(a_{t+h}\mid I_{t},l).Terminal chunks are truncated to the remaining valid actions and padded positions are masked from the loss.
IV-D Action Chunk Construction
For a horizon H, the training target concatenates H future normalized 7-D actions into one longer target sequence,
C_{t}=[\bar{a}_{t},\bar{a}_{t+1},\ldots,\bar{a}_{t+H-1}].At each physical inference cycle, the RGB image is synchronized with the current robot pose, the remote server predicts an eight-step action chunk, and the robot executes the returned actions before the next image is acquired. The next inference request is therefore issued after completion of the current chunk in the physical experiments reported here. Parallel host-side inference was tested separately on the computer but was not used for the reported physical robot trials.
IV-E Cloud-Edge Execution and Safety Filtering
The 7B OpenVLA-OFT model runs on a remote inference server [13], while the robotic client remains CPU-only. On the RTX 6000 Ada server used in our experiments, the logged model-side inference time was approximately 0.06–0.08 s per request. This measurement excludes image capture, network transmission, and physical robot execution time. At each replan step, the client sends (I_{t},l,H) through FastAPI, receives C_{t}, and decodes it into candidate actions. A candidate action is rejected if any of the following checks fail:
\displaystyle p_{t}+\Delta p_{t}\in\mathcal{B},\quad z_{t}+\Delta z_{t}\geq z_{\min}, \\ \displaystyle\|\Delta p_{t}\|_{\infty}\leq d_{\max},\quad\|\Delta r_{t}\|_{\infty}\leq r_{\max}.Here \mathcal{B} is the allowed workspace, z_{\min} is the minimum build-plate clearance, d_{\max}=5 mm, and r_{\max}=0.05 rad for the current post-print retrieval configuration. The gripper command must be a valid binary state. The client also rejects NaN actions, network-timeout responses, stale chunks, and commands arriving after an emergency-stop flag. If a command is rejected, the remaining chunk is discarded and the client either requests a new chunk or halts the episode, depending on the experiment mode.
V Experiments
V-A Experimental Scope and Connection to the Method
The experiments evaluate both trajectory-level prediction and physical closed-loop execution of the proposed ChunkVLA-AM pipeline. Following the formulation in Section III, the policy receives a monocular image I_{t} and a language instruction l, then predicts a short-horizon action chunk A_{t}=[a_{t},\ldots,a_{t+H-1}]. The logged-trajectory analysis evaluates whether these chunks preserve the structure of expert AM handling trajectories after data conversion, action normalization, LoRA adaptation, and chunk construction, while a separate 42-trial physical evaluation measures end-to-end A-to-B transfer success. The trajectory plots therefore describe open-loop prediction consistency, whereas the robot trials provide a direct closed-loop deployment check under the same FR3 workcell configuration.
V-B Post-Print Retrieval Task
The evaluation includes two color-conditioned manipulation tasks: “catch the blue block” and “catch the red block.” In each task, the FR3 approaches the specified block at point A, closes the gripper, transfers the target to point B, and releases it. The two tasks use the same manipulation sequence but require the policy to associate the instruction with the corresponding visual target. These controlled A-to-B block-transfer tasks serve as reproducible proxies for post-print part retrieval and transfer while evaluating language-conditioned Cartesian trajectory prediction and physical execution.
V-C Evaluation Metrics
For each logged frame, the policy receives the monocular observation and instruction and predicts an H-step action chunk. The predicted future positions are compared with the expert end-effector trajectory along the x, y, and z axes. Because these plots are generated from logged states and not from closed-loop rollouts, the metrics describe open-loop trajectory consistency, not final task success.
The primary trajectory metric is axis-wise mean absolute error (MAE),
\mathrm{MAE}_{k}=\frac{1}{N}\sum_{t=1}^{N}|p^{\mathrm{pred}}_{t,k}-p^{\mathrm{expert}}_{t,k}|.V-D Comparison of Adaptation Methods and Prediction Horizons
To evaluate embodiment-specific adaptation and compare the evaluated policy configurations, we tested four models on the same FAIRINO FR3, camera setup, workspace, and test data. The standard single-step OpenVLA (Zero-Shot) and the 8-step action-chunked OpenVLA-OFT (Zero-Shot) received no FR3-specific training. The single-step adapted model, referred to as Bridging the Pretrain-to-Real Gap [24], and ChunkVLA-AM (Ours) were both adapted using the same FR3 demonstration dataset. ChunkVLA-AM uses 8-step action chunks. Because adaptation and prediction horizon differ across configurations, this comparison evaluates the complete configurations without isolating chunk length as a single controlled variable.
We use Mean Absolute Error (MAE) across the X, Y, and Z axes as the primary evaluation metric to assess spatial tracking accuracy against the ground-truth Cartesian trajectory. The performance comparison is illustrated in Figure 2, where a logarithmic scale is applied to the y-axis to accommodate the multi-order magnitude disparities.
The empirical data show that both zero-shot models are unsuitable for the FR3 additive manufacturing environment. OpenVLA (Zero-Shot) and OpenVLA-OFT (Zero-Shot) produce extreme spatial deviations, with MAE values ranging from 179.60 mm to 650.12 mm. This magnitude of error indicates that pre-trained visual backbones cannot directly transfer to the constrained workspace and specific kinematics of the FR3 robot without targeted training. The failure of the OpenVLA-OFT (Zero-Shot) model confirms that temporal action chunking alone cannot compensate for the lack of spatial semantics.
The single-step adaptation model [24] significantly reduces the tracking error. However, it still yields an average spatial error of 9.50 mm across the three axes, with a pronounced deviation of 16.90 mm on the X-axis. In physical AM workcells, a 16.90 mm lateral offset easily causes collisions with the build plate or printed parts. This localized drift exposes the limitation of single-step autoregressive decoding, where slight execution deviations accumulate over time and lead to terminal open-loop drift.
In contrast, ChunkVLA-AM achieves an overall average MAE of 1.74 mm, with lateral errors of 0.37 mm on the X-axis and 0.97 mm on the Y-axis and a Z-axis error of 3.87 mm. The adapted chunked configuration therefore exhibits substantially lower trajectory error than the evaluated single-step adapted baseline. Because the compared configurations differ in both adaptation and prediction horizon, these results support the combined FR3-adaptation and chunked-deployment configuration but do not by themselves attribute the improvement solely to action chunking.
V-E Physical Closed-Loop Robot Validation
We additionally evaluated the complete camera–server–robot loop in 42 physical A-to-B transfer trials using eight-step action chunks. The trials were evenly divided between the red and blue targets, with 21 trials per color. Across all 42 trials, 39 transfers were completed successfully, corresponding to an overall success rate of 92.9%. The three failures occurred during terminal placement at point B: the placement height was not sufficiently controlled, causing the released object to fall and topple. These failures were retained in the reported success rate. The physical trials use the same FR3 workcell and sequential observation–inference–execution loop described in Section IV.
V-F Influence of Physical Illumination and Color Temperature
\pm 1 standard deviation, respectively. The remaining curves show the axis-wise MAEs. The highlighted range from 85 to 125 indicates a low-error region centered around the minimum error observed at luminance 95.We also evaluated ten separately recorded but task-matched logged test trajectories at 181 target luminance levels from 30 to 210; the ten trials are similar A-to-B sequences collected independently, not repeated copies of a single trajectory. As shown in Fig. 3, the mean spatial error reached its minimum of 5.459 mm at luminance 95 and remained low within the highlighted 85–125 range. The error increased to 7.165 mm and 6.598 mm at luminance 30 and 210, respectively. The axis-wise curves further show that the z-axis was the dominant source of error, whereas the x- and y-axis errors remained smaller.
The experimental setup used the same FR3 workspace under controlled physical lighting changes. Illumination was varied by adjusting the room light intensity and swapping between neutral white, warm (3000 K), and cold (6500 K) light sources. All captures were taken with a fixed monocular RGB camera at the same pose; no digital post-processing or gamma correction was applied. Figure 4 shows six representative captures from the seven tested illumination conditions, spanning variations in luminance and color temperature.
The policy was evaluated directly on environmental captures under Low Light, Baseline, and Over-Exposed conditions without mathematically simulating brightness. As shown in Table I, the system maintains similar spatial tracking error across mild lighting shifts (luminance spanning 65.2 to 165.1), with the z-axis MAE remaining approximately 3.8–4.0 mm.
However, extreme over-exposure (luminance 189.1) degrades lateral tracking, with the y-axis MAE increasing to 2.30 mm. The warm and cold color-temperature conditions remain close to the baseline, while extreme glare produces the largest degradation. This result motivates additional lighting augmentation for highly reflective AM workspaces.
- —
- (0–255)
- x
- y
- z
- 3D L_{2}
- Baseline (Neutral)
- 109
- 0.37
- 0.97
- 3.87
- 4.01
- LowLight Extreme
- 30
- 0.45
- 1.28
- 4.04
- 4.26
- LowLight Mild
- 65
- 0.26
- 1.03
- 4.03
- 4.17
- OverLight Mild
- 165
- 0.37
- 1.00
- 3.86
- 4.00
- OverLight Extreme
- 190
- 0.59
- 2.30
- 4.65
- 5.22
- ColorTemp Warm
- 116
- 0.41
- 0.99
- 3.93
- 4.07
- ColorTemp Cold
- 108
- 0.50
- 0.97
- 3.76
- 3.92
We further analyzed a dense luminance sweep comprising 10 trials, each evaluated at 181 target luminance levels from 30 to 210. The realized image luminance closely followed the requested value: the mean actual-minus-target difference was 0.0037 and the maximum absolute difference was 0.0742 on the 0–255 scale. Because the sweep outputs contain neither a color-temperature field nor a task-success label, this analysis is used specifically to quantify trajectory-error sensitivity to luminance and does not replace the warm/cold comparison in Table I.
Figure 3 visualizes the low-error region around the aggregate minimum and the error increases near the darkest and brightest ends of the sweep.
- 30–84
- 5.872
- 0.834
- 1.209
- 4.985
- 85–125
- 5.499
- 0.676
- 1.198
- 4.639
- 126–210
- 5.644
- 0.720
- 1.331
- 4.688
The dense sweep supports the 85–125 interval as a narrower low-error band without implying a single optimal illumination. Its trial-level mean spatial error was 5.499 mm, whereas the 30–84 and 126–210 regions increased the error by 0.373 mm (6.8%) and 0.146 mm (2.6%), respectively; descriptive bootstrap 95% confidence intervals for these paired regional differences were [0.225, 0.529] mm and [0.064, 0.233] mm. Within 85–125, the aggregate mean curve varied by only 1.2% of the global minimum. Although the across-trial curve reached its lowest value of 5.459 mm at luminance 95 and remained within 5% of this minimum from 58 to 200, the error-minimizing luminance of individual trials ranged from 36 to 198 (median 95). Thus, luminance 95 should not be interpreted as a universal optimum.
Degradation became clearer at the sweep endpoints: the aggregate mean error was 7.165 mm at luminance 30 and 6.598 mm at luminance 210, corresponding to increases of 31.2% and 20.9% over the aggregate minimum. The axis-wise results in Table II show that the z-axis remained the dominant error component throughout the sweep. Relative to the 85–125 band, low-light degradation was primarily associated with larger z- and x-axis errors, whereas the largest high-luminance increase occurred on the y-axis. This continuous-sweep evidence is consistent with the discrete-condition results: intermediate illumination produces lower error, while the darkest and brightest regimes are more likely to disturb visual grounding.
Overall, illumination changes affect height and lateral localization differently in the fixed AM workcell, highlighting the importance of lighting robustness during deployment.
VI Conclusion and Discussion
This paper presented ChunkVLA-AM as a reproducible OpenVLA-OFT-based system pipeline for FR3-based post-print retrieval in additive manufacturing. The paper specifies the data conversion interface, 7-D Cartesian action representation, horizon-based chunk construction, LoRA adaptation setup, cloud-edge request loop, and robot-side action filtering needed to reproduce the system. The logged-trajectory analyses show low Cartesian prediction error for the FR3-adapted eight-step configuration, while the physical evaluation completed 39 of 42 A-to-B transfer trials successfully (92.9%). The three failures occurred during terminal placement when the released object toppled because of insufficient placement-height control. The lighting experiments further show that prediction error remains lowest over an intermediate luminance range and increases toward the darkest and brightest conditions. These results support the feasibility of the proposed deployment pipeline in the evaluated fixed FR3 workcell. Future work will add broader object and task generalization, controlled chunk-length ablations, contact-force monitoring, and richer AM-specific tasks such as warped-part inspection and failed-print removal.
Acknowledgment
The authors gratefully acknowledge funding from the National Science Foundation (NSF) CREST Center for Multidisciplinary Research Excellence in Cyber-Physical Infrastructure Systems (MECIS) under Award No. 2112650. Additional support was provided by the NSF Expand AI PARTNER: ARISE: AI Research and Innovation for Smart Environments under NSF Award No. 2434916, as well as NSF ACCESS: AI-Enhanced Cross-Scale Sensing and Intelligent Quality Assessment for Scalable Additive Manufacturing (NSF Award No. ELE250047). The authors also acknowledge the University Transportation Center for Railway Safety (UTCRS) for providing the datasets used in this work and funding support under the USDOT UTC Program Grant No. 69A3552348340.