# Channel Sensing and Communication over a Time-Correlated Channel with an Energy Harvesting Transmitter

## TL;DR

This paper investigates an energy harvesting transmitter over a time-correlated channel, optimizing its actions through a partially observable Markov decision process to improve long-term throughput by intelligently sensing the channel.

## Contribution

It introduces a threshold-based optimal policy for channel sensing and transmission decisions, with numerical characterization of its performance and structure.

## Key findings

- Sensing improves long-term throughput significantly.
- Optimal policy exhibits threshold behavior on belief state.
- Numerical algorithms effectively characterize the policy and performance.

## Abstract

An energy harvesting (EH) transmitter communicating over a time-correlated wireless channel is considered. The transmitter is capable of sensing the current channel state, albeit at the cost of both energy and transmission time. The EH transmitter aims to maximize its long-term throughput by choosing one of the following actions: $i)$ defer its transmission to save energy for future use, $ii)$ transmit reliably at a low rate, $iii)$ transmit at a high rate, and $iv)$ sense the channel to reveal the channel state at a cost of energy and transmission time, and then decide to defer or to transmit. The problem is formulated as a partially observable Markov decision process with a belief on the channel state. The optimal policy is shown to exhibit a threshold behavior on the belief state, with battery-dependent threshold values. The optimal threshold values and performance are characterized numerically via the value iteration algorithm as well as a policy search algorithm that exploits the threshold structure of the optimal policy. Our results demonstrate that, despite the associated time and energy cost, sensing the channel intelligently to track the channel state improves the achievable long-term throughput significantly as compared to the performance of those protocols lacking this ability as well as the one that always senses the channel.