A mathematical certification for positivity conditions in Neural Networks with applications to partial monotonicity and Trustworthy AI

TL;DR

This paper introduces LipVor, a novel algorithm that certifies positivity and partial monotonicity in neural networks using finite evaluations, enabling trustworthy AI applications without constraining network architecture.

Contribution

The paper presents LipVor, a new method for certifying positivity and partial monotonicity in neural networks without architectural constraints, broadening their trustworthy application scope.

Findings

LipVor effectively certifies partial monotonicity in ANNs.

The method does not require constrained architectures or specific activation functions.

LipVor can also be applied to verify other properties like convexity.

Abstract

Artificial Neural Networks (ANNs) have become a powerful tool for modeling complex relationships in large-scale datasets. However, their black-box nature poses trustworthiness challenges. In certain situations, ensuring trust in predictions might require following specific partial monotonicity constraints. However, certifying if an already-trained ANN is partially monotonic is challenging. Therefore, ANNs are often disregarded in some critical applications, such as credit scoring, where partial monotonicity is required. To address this challenge, this paper presents a novel algorithm (LipVor) that certifies if a black-box model, such as an ANN, is positive based on a finite number of evaluations. Consequently, since partial monotonicity can be expressed as a positivity condition on partial derivatives, LipVor can certify whether an ANN is partially monotonic. To do so, for every positively evaluated point, the Lipschitzianity of the black-box model is used to construct a specific neighborhood where the function remains positive. Next, based on the Voronoi diagram of the evaluated points, a sufficient condition is stated to certify if the function is positive in the domain. Unlike prior methods, our approach certifies partial monotonicity without constrained architectures or piece-wise linear activations. Therefore, LipVor could open up the possibility of using unconstrained ANN in some critical fields. Moreover, some other properties of an ANN, such as convexity, can be posed as positivity conditions, and therefore, LipVor could also be applied.