Fair and Unbiased Algorithmic Decision Making: Current State and Future Challenges

TL;DR

This paper reviews the current state of fairness in algorithmic decision making, highlighting challenges in formalizing fairness, the influence of biases, and emphasizing transparency and domain-specific approaches for future research.

Contribution

It provides a comprehensive overview of fairness concepts, discusses limitations of current formalizations, and advocates for transparency and bias awareness in future algorithmic systems.

Findings

Biases in data and developers affect algorithm fairness

Formal fairness criteria have inherent tradeoffs and limitations

Transparency is crucial for fairness audits

Abstract

Machine learning algorithms are now frequently used in sensitive contexts that substantially affect the course of human lives, such as credit lending or criminal justice. This is driven by the idea that `objective' machines base their decisions solely on facts and remain unaffected by human cognitive biases, discriminatory tendencies or emotions. Yet, there is overwhelming evidence showing that algorithms can inherit or even perpetuate human biases in their decision making when they are based on data that contains biased human decisions. This has led to a call for fairness-aware machine learning. However, fairness is a complex concept which is also reflected in the attempts to formalize fairness for algorithmic decision making. Statistical formalizations of fairness lead to a long list of criteria that are each flawed (or harmful even) in different contexts. Moreover, inherent tradeoffs in these criteria make it impossible to unify them in one general framework. Thus, fairness constraints in algorithms have to be specific to the domains to which the algorithms are applied. In the future, research in algorithmic decision making systems should be aware of data and developer biases and add a focus on transparency to facilitate regular fairness audits.