# MQLV: Optimal Policy of Money Management in Retail Banking with Q-Learning

## TL;DR

This paper introduces MQLV, a reinforcement learning method using Q-learning tailored for the Vasicek model, to optimize money management policies in retail banking, enabling personalized credit and loan decisions.

## Contribution

MQLV extends Q-learning to mean reverting processes like Vasicek, enabling transparent, personalized financial decision-making in retail banking.

## Key findings

- MQLV effectively models financial transactions with Vasicek simulations.
- It demonstrates potential in optimizing credit limits and loan decisions.
- First Q-learning approach based on Vasicek for retail banking applications.

## Abstract

Reinforcement learning has become one of the best approach to train a computer game emulator capable of human level performance. In a reinforcement learning approach, an optimal value function is learned across a set of actions, or decisions, that leads to a set of states giving different rewards, with the objective to maximize the overall reward. A policy assigns to each state-action pairs an expected return. We call an optimal policy a policy for which the value function is optimal. QLBS, Q-Learner in the Black-Scholes(-Merton) Worlds, applies the reinforcement learning concepts, and noticeably, the popular Q-learning algorithm, to the financial stochastic model of Black, Scholes and Merton. It is, however, specifically optimized for the geometric Brownian motion and the vanilla options. Its range of application is, therefore, limited to vanilla option pricing within financial markets. We propose MQLV, Modified Q-Learner for the Vasicek model, a new reinforcement learning approach that determines the optimal policy of money management based on the aggregated financial transactions of the clients. It unlocks new frontiers to establish personalized credit card limits or to fulfill bank loan applications, targeting the retail banking industry. MQLV extends the simulation to mean reverting stochastic diffusion processes and it uses a digital function, a Heaviside step function expressed in its discrete form, to estimate the probability of a future event such as a payment default. In our experiments, we first show the similarities between a set of historical financial transactions and Vasicek generated transactions and, then, we underline the potential of MQLV on generated Monte Carlo simulations. Finally, MQLV is the first Q-learning Vasicek-based methodology addressing transparent decision making processes in retail banking.