High Performance Space Debris Tracking in Complex Skylight Backgrounds with a Large-Scale Dataset
Guohang Zhuang, Weixi Song, Jinyang Huang, Chenwei Yang, Wanli OuYang, Yan Lu

TL;DR
This paper introduces SDT-Net, a deep learning model for space debris tracking, supported by a large-scale synthetic dataset, achieving high accuracy and transferability to real-world data.
Contribution
The paper presents a novel deep learning-based debris tracking network and a large-scale synthetic dataset for training and evaluation.
Findings
SDT-Net achieves high accuracy in debris tracking.
The dataset covers extensive synthetic debris scenarios.
Model demonstrates strong transferability to real-world data.
Abstract
With the rapid development of space exploration, space debris has attracted more attention due to its potential extreme threat, leading to the need for real-time and accurate debris tracking. However, existing methods are mainly based on traditional signal processing, which cannot effectively process the complex background and dense space debris. In this paper, we propose a deep learning-based Space Debris Tracking Network~(SDT-Net) to achieve highly accurate debris tracking. SDT-Net effectively represents the feature of debris, enhancing the efficiency and stability of end-to-end model learning. To train and evaluate this model effectively, we also produce a large-scale dataset Space Debris Tracking Dataset (SDTD) by a novel observation-based data simulation scheme. SDTD contains 18,040 video sequences with a total of 62,562 frames and covers 250,000 synthetic space debris. Extensive…
Peer Reviews
Decision·Submitted to ICLR 2026
The paper proposes a deep-learning approach for space debris tracking in complex skylight backgrounds. The main contributions are: 1.The authors introduce a novel dataset, the Space Debris Tracking Dataset (SDTD), created by an observation-based simulation scheme, drawing on astronomy images (from e.g. the Zwicky Transient Facility, ZTF) and synthetically imposing debris trajectories and backgrounds. The dataset reportedly includes 18,040 video sequences (≈ 62,562 frames) and ~250,000 synthetic
While the paper makes interesting advances, there are several concerns and weaknesses that the authors should address: 1. Synthetic-to-real transfer gap / dataset realism 1) Although the dataset is large and simulation-based, synthetic data may not fully replicate the statistical characteristics of real debris tracks, noise sources, background clutter, telescope artefacts, or imaging conditions (e.g., atmospheric scintillation, streak brightness variation, non-uniform PSF, variations in exposu
1. Large, reproducible benchmark built from real survey backgrounds (ZTF) with PSF and truncation adds realism; the dataset scale and explicit dense-scene split are valuable to the community. 2. On SDTD, SDT-Net improves over CenterTrack/OCSORT/ByteTrack; on real Antarctic data it leads across MOTA/HOTA/DetA. Ablations isolate the gains from line-segment detection, RoI-FE, and the offset head. 3. Clear task formulation with architecture tweaks that match physics. Modeling debris as paired endp
1. Although the SDTD dataset is large and covers complex backgrounds, its generation process is mainly based on superimposing line sources from the background of ZTF astronomical images. The paper uses simple long-exposure line drawing with Gaussian blurring, without introducing high-fidelity physical constraints such as realistic trajectory dynamics modeling, PSF spatial variation, photosensitivity saturation, or noise field modeling. Therefore, from a technical perspective, the dataset's contr
Motivation and Meaning: motivation is feasible This manuscript focuses on detecting and predicting the motion trajectories of space debris to mitigate collision risks and advance the development of the aerospace industry. Dataset: This manuscript constructs a relatively large-scale dataset for space debris tracking, addressing a critical gap in existing research resources. Writing Quality: The manuscript is clearly articulated and highly readable. The methodological approach, experimental vali
Innovation: the contribution not enough for a ICLR paper The design of RoI-FE demonstrates the distinction between SDT tasks and classical detection and tracking methods, suggesting that solutions tailored to the unique challenges of SDT may be necessary. Methodology Section: The explanation of the final loss function is insufficient, and there is a lack of corresponding ablative experimental analysis. Experimental Evaluation: The comparative experiments and ablative studies are inadequate.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSpace Satellite Systems and Control · Spacecraft Dynamics and Control · Anomaly Detection Techniques and Applications
MethodsSoftmax · Attention Is All You Need
