DTN-COMET: A Comprehensive Operational Metrics Evaluation Toolkit for DTN

TL;DR

This paper introduces a new framework for reproducible and scalable performance evaluation of Delay- and Disruption-tolerant Networks (DTN), validated through physical testbeds and comparison of two DTN implementations.

Contribution

The paper presents a novel generic framework for evaluating DTN implementations, addressing reproducibility and scalability issues in existing testing methods.

Findings

uD3TN has higher goodput and shorter bundle retention times

ION exhibits better memory management and fault tolerance

Framework is validated with physical testbed comparisons

Abstract

Delay- and Disruption-tolerant Networking (DTN) is essential for communication in challenging environments with intermittent connectivity, long delays, and disruptions. Ensuring high performance in these types of networks is crucial because windows for data transmission are sparse and often short. However, research on evaluating DTN implementations is limited. Moreover, existing research relies on manual testing methods that lack reproducibility and scalability. We propose a novel generic framework for reproducible performance evaluation of DTN implementations to address this issue. We validate the framework's accuracy using a physical testbed and compare the uD3TN and ION DTN implementations. This comparison reveals that uD3TN exhibits higher goodput and shorter bundle retention times. On the other hand, ION exhibited superior memory management and fault tolerance, albeit at the cost of sending and receiving performance. Through this comparison, our framework demonstrates the feasibility of developing a generic toolkit for evaluating DTN.