Pedestrian trackingIntermediate
Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environments
This preprint presents a deployment-focused evaluation protocol for 3D pedestrian multi-object tracking that holds detections fixed and reports trajectory-level success rates for initialization, detector-gap continuation, identity recovery, close-neighbor association, and load-dependent runtime on a Jetson Orin. On JRDB, non-GT-assisted trackers score only 24.26–29.67% HOTA; after a 1.0 s detection gap, no non-GT tracker maintains correct same-ID spatial output in more than 45.4% of cases, and most fall below 1%. The protocol shows aggregate leaderboard scores hide large behavioral differences that matter for real-time robots among pedestrians.