Stakeholder-in-the-Loop Fair Decisions: A Framework to Design Decision Support Systems in Public and Private Organizations

TL;DR

This paper introduces a framework for designing decision support systems that incorporate stakeholder values to ensure fairness and accountability in organizational decisions.

Contribution

It proposes a discussion framework considering stakeholder-specific requirements for explanations and fairness in decision support systems.

Findings

Identified four key stakeholders for accountable decision-making.

Clarified stakeholder characteristics across application domains.

Integrated stakeholder values into decision outputs.

Abstract

Due to the opacity of machine learning technology, there is a need for explainability and fairness in the decision support systems used in public or private organizations. Although the criteria for appropriate explanations and fair decisions change depending on the values of those who are affected by the decisions, there is a lack of discussion framework to consider the appropriate outputs for each stakeholder. In this paper, we propose a discussion framework that we call "stakeholder-in-the-loop fair decisions." This is proposed to consider the requirements for appropriate explanations and fair decisions. We identified four stakeholders that need to be considered to design accountable decision support systems and discussed how to consider the appropriate outputs for each stakeholder by referring to our works. By clarifying the characteristics of specific stakeholders in each application domain and integrating the stakeholders' values into outputs that all stakeholders agree upon, decision support systems can be designed as systems that ensure accountable decision makings.