First- and Second-Order Coding Theorems for Mixed Memoryless Channels with General Mixture

TL;DR

This paper derives first- and second-order coding theorems for a broad class of mixed memoryless channels with general mixtures, extending existing results and including special cases with ordered component channels.

Contribution

It establishes new first- and second-order coding theorems for mixed memoryless channels with general mixtures, including cases with ordered component channels.

Findings

Formulas for ε-capacity of mixed memoryless channels.

Second-order coding theorem for channels with general mixture.

Reduction to known formulas in special cases.

Abstract

This paper investigates the first- and second-order maximum achievable rates of codes with/without cost constraints for mixed {channels} whose channel law is characterized by a general mixture of (at most) uncountably many stationary and memoryless discrete channels. These channels are referred to as {mixed memoryless channels with general mixture} and include the class of mixed memoryless channels of finitely or countably memoryless channels as a special case. For mixed memoryless channels with general mixture, the first-order coding theorem which gives a formula for the $\varepsilon$-capacity is established, and then a direct part of the second-order coding theorem is provided. A subclass of mixed memoryless channels whose component channels can be ordered according to their capacity is introduced, and the first- and second-order coding theorems are established. It is shown that the established formulas reduce to several known formulas for restricted scenarios.