Energy Management in a Cooperative Energy Harvesting Wireless Sensor Network
Arghyadeep Barat, Prabuchandran.K.J, Shalabh Bhatnagar

TL;DR
This paper develops an optimal energy management policy for a distributed sensor network with energy harvesting and sharing capabilities, using deep reinforcement learning to outperform existing methods.
Contribution
It introduces a novel distributed energy sharing policy framework using DDPG, improving upon prior single-node or centralized models.
Findings
DDPG-based policies outperform non-sharing algorithms.
Distributed energy sharing enhances network efficiency.
Policies adapt well to dynamic energy harvesting conditions.
Abstract
In this paper, we consider the problem of finding an optimal energy management policy for a network of sensor nodes capable of harvesting their own energy and sharing it with other nodes in the network. We formulate this problem in the discounted cost Markov decision process framework and obtain good energy-sharing policies using the Deep Deterministic Policy Gradient (DDPG) algorithm. Earlier works have attempted to obtain the optimal energy allocation policy for a single sensor and for multiple sensors arranged on a mote with a single centralized energy buffer. Our algorithms, on the other hand, provide optimal policies for a distributed network of sensors individually harvesting energy and capable of sharing energy amongst themselves. Through simulations, we illustrate that the policies obtained by our DDPG algorithm using this enhanced network model outperform algorithms that do not…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsEnergy Harvesting in Wireless Networks · Age of Information Optimization · Energy Efficient Wireless Sensor Networks
Methods*Communicated@Fast*How Do I Communicate to Expedia? · Adam · Convolution · Dense Connections · Weight Decay · Batch Normalization · Experience Replay · Deep Deterministic Policy Gradient
