NBFTP: A Dedicated Data Transfer System for Remote Astronomical Observation at Dome A

TL;DR

This paper introduces NBFTP, a specialized data transfer system optimized for low-bandwidth, unstable satellite links at Dome A, Antarctica, significantly reducing network traffic compared to standard tools like rsync.

Contribution

The paper presents NBFTP, a novel data transfer protocol tailored for remote astronomical sites with limited bandwidth, featuring a unified interface, data-specific transmission schemes, and resuming capabilities.

Findings

NBFTP reduces network traffic by 60% compared to rsync.

For small files (1KB), NBFTP uses 40% less network bandwidth.

As file size increases, NBFTP remains more efficient than rsync.

Abstract

Dome A, Antarctica has been thought to be one of the best astronomical sites on the earth since decades ago. From it was first visited by astronomers in 2008, dozens of facilities for astronomical observation and site testing were deployed. Due to its special geographical location, the data and message exchange between Dome A and the domestic control center could only depend on Iridium. Because the link bandwidth of Iridium is extremely limited, meanwhile the network traffic cost is quite expensive and the network is rather unstable, the commonly used data transfer tools, such as rsync and scp, are not suitable in this case. In this paper, we design and implement a data transfer tool called NBFTP (narrow bandwidth file transfer protocol) for the astronomical observation of Dome A. NBFTP uses a uniform interface to arrange all types of data and matches specific transmission schemes for different data types according to rules. Break-point resuming and extensibility functions are also implemented. Our experimental results show that NBFTP consumes 60% less network traffic than rsync when detecting the data pending to be transferred. And when transferring small files of 1KB, the network traffic consumption of NBFTP is 40% less than rsync. However, as the file size increases, the network traffic consumption of NBFTP tends to approach rsync, but it is still smaller than rsync.