Statistical Physics of Irregular Low-Density Parity-Check Codes

TL;DR

This paper applies statistical physics methods to analyze irregular low-density parity-check codes, revealing phase transitions aligned with Shannon's bound and demonstrating improved decoding performance over regular codes.

Contribution

It introduces a statistical physics framework to study irregular LDPC codes, identifying phase transitions and validating belief propagation decoding through theoretical and simulation results.

Findings

Phase transition coincides with Shannon's bound.

Belief propagation decoding matches theoretical predictions.

Irregular codes outperform regular codes in error correction.

Abstract

Low-density parity-check codes with irregular constructions have been recently shown to outperform the most advanced error-correcting codes to date. In this paper we apply methods of statistical physics to study the typical properties of simple irregular codes. We use the replica method to find a phase transition which coincides with Shannon's coding bound when appropriate parameters are chosen. The decoding by belief propagation is also studied using statistical physics arguments; the theoretical solutions obtained are in good agreement with simulations. We compare the performance of irregular with that of regular codes and discuss the factors that contribute to the improvement in performance.