HashFlow For Better Flow Record Collection
Zongyi Zhao, Xingang Shi, Xia Yin, Zhiliang Wang

TL;DR
HashFlow is a novel flow record collection tool that improves accuracy and space utilization for network traffic analysis by employing a unique collision resolution and record promotion strategy, outperforming existing methods.
Contribution
The paper introduces HashFlow, a new approach for flow record collection that enhances accuracy and efficiency without added complexity, validated through implementation and extensive network trace evaluations.
Findings
HashFlow records 12.5% more flows with 1MB memory than competitors.
Achieves 11.6% relative error in flow size estimation, outperforming others.
Detects 96.1% of heavy hitters with 5.6% error, better than state-of-the-art.
Abstract
Collecting flow records is a common practice of network operators and researchers for monitoring, diagnosing and understanding a network. Traditional tools like NetFlow face great challenges when both the speed and the complexity of the network traffic increase. To keep pace up, we propose HashFlow, a tool for more efficient and accurate collection and analysis of flow records. The central idea of HashFlow is to maintain accurate records for elephant flows, but summarized records for mice flows, by applying a novel collision resolution and record promotion strategy to hash tables. The performance bound can be analyzed with a probabilistic model, and with this strategy, HashFlow achieves a better utilization of space, and also more accurate flow records, without bringing extra complexity. We have implemented HashFlow, as well as several latest flow measurement algorithms such as…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsInternet Traffic Analysis and Secure E-voting · Network Security and Intrusion Detection · Software-Defined Networks and 5G
