Sustainability Evaluation Metrics for Recommender Systems

TL;DR

This paper discusses sustainability evaluation metrics for recommender systems, emphasizing their role in assessing environmental, social, and economic impacts aligned with UN SDGs beyond traditional accuracy metrics.

Contribution

It introduces and analyzes various basic sustainability metrics for recommender systems, highlighting their importance in holistic impact assessment.

Findings

Sustainability metrics complement traditional evaluation methods.

Metrics can analyze environmental, social, and economic impacts.

Application of metrics varies across different recommender system contexts.

Abstract

Sustainability-oriented evaluation metrics can help to assess the quality of recommender systems beyond wide-spread metrics such as accuracy, precision, recall, and satisfaction. Following the United Nations`s sustainable development goals (SDGs), such metrics can help to analyse the impact of recommender systems on environmental, social, and economic aspects. We discuss different basic sustainability evaluation metrics for recommender systems and analyze their applications.