HGFF: A Deep Reinforcement Learning Framework for Lifetime Maximization in Wireless Sensor Networks

TL;DR

This paper introduces HGFF, a deep reinforcement learning framework utilizing heterogeneous graph neural networks to optimize sink movement in wireless sensor networks, significantly extending network lifetime with efficient, learned policies.

Contribution

The paper presents a novel framework combining heterogeneous graph neural networks with deep reinforcement learning for sink movement planning in wireless sensor networks, improving performance and inference efficiency.

Findings

Outperforms existing methods on all tested map types.

Effectively models wireless sensor networks as heterogeneous graphs.

Achieves higher network lifetime through learned sink movement policies.

Abstract

Planning the movement of the sink to maximize the lifetime in wireless sensor networks is an essential problem of great research challenge and practical value. Many existing mobile sink techniques based on mathematical programming or heuristics have demonstrated the feasibility of the task. Nevertheless, the huge computation consumption or the over-reliance on human knowledge can result in relatively low performance. In order to balance the need for high-quality solutions with the goal of minimizing inference time, we propose a new framework combining heterogeneous graph neural network with deep reinforcement learning to automatically construct the movement path of the sink. Modeling the wireless sensor networks as heterogeneous graphs, we utilize the graph neural network to learn representations of sites and sensors by aggregating features of neighbor nodes and extracting hierarchical graph features. Meanwhile, the multi-head attention mechanism is leveraged to allow the sites to attend to information from sensor nodes, which highly improves the expressive capacity of the learning model. Based on the node representations, a greedy policy is learned to append the next best site in the solution incrementally. We design ten types of static and dynamic maps to simulate different wireless sensor networks in the real world, and extensive experiments are conducted to evaluate and analyze our approach. The empirical results show that our approach consistently outperforms the existing methods on all types of maps.