Empirical Bayes to assess ecological diversity and similarity with overdispersion in multivariate counts

TL;DR

This paper introduces an empirical Bayes method for estimating ecological diversity and similarity from multivariate count data affected by overdispersion, outperforming traditional maximum likelihood approaches in simulations and real aquatic biomonitoring data.

Contribution

The novel empirical Bayes approach jointly estimates taxonomic proportions and overdispersion from a single sample, improving accuracy over classical methods.

Findings

Empirical Bayes method outperforms maximum likelihood in simulations.

Method effectively handles overdispersion in ecological count data.

Application demonstrates improved diversity and similarity assessments.

Abstract

The assessment of diversity and similarity is relevant in monitoring the status of ecosystems. The respective indicators are based on the taxonomic composition of biological communities of interest, currently estimated through the proportions computed from sampling multivariate counts. In this work we present a novel method able to work with only one sample to estimate the taxonomic composition when the data are affected by overdispersion. The presence of overdispersion in taxonomic counts may be the result of significant environmental factors which are often unobservable but influence communities. Following the empirical Bayes approach, we combine a Bayesian model with the marginal likelihood method to jointly estimate the taxonomic proportions and the level of overdispersion from one sample of multivariate counts. Our proposal is compared to the classical maximum likelihood method in an extensive simulation study with different realistic scenarios. An application to real data from aquatic biomonitoring is also presented. In both the simulation study and the real data application, we consider communities characterized by a large number of taxonomic categories, such as aquatic macroinvertebrates or bacteria which are often overdispersed. The applicative results demonstrate an overall superiority of the empirical Bayes method in almost all examined cases, for both assessments of diversity and similarity. We would recommend practitioners in biomonitoring to use the proposed approach in addition to the traditional procedures. The empirical Bayes estimation allows to better control the error propagation due to the presence of overdispersion in biological data, with a more efficient managerial decision making.