Shannon's entropy and its Generalizations towards Statistics, Reliability and Information Science during 1948-2018

TL;DR

This paper reviews the development and applications of Shannon's entropy and its generalizations across statistics, reliability, and information science from 1948 to 2018, providing a comprehensive overview for researchers.

Contribution

It compiles and analyzes all significant works on entropy in statistics, reliability, and information science over 70 years, filling a gap in existing review literature.

Findings

Extensive collection of entropy-related research from 1948-2018

Identification of key developments and trends in entropy applications

Highlighting gaps and future directions in entropy research

Abstract

Starting from the pioneering works of Shannon and Weiner in 1948, a plethora of works have been reported on entropy in different directions. Entropy-related review work in the direction of statistics, reliability and information science, to the best of our knowledge, has not been reported so far. Here we have tried to collect all possible works in this direction during the period 1948-2018 so that people interested in entropy, specially the new researchers, get benefited.