# A Bayesian Stochastic Approximation Method

## TL;DR

This paper introduces a Bayesian stochastic approximation method that enhances small sample estimation of regression roots through adaptive modeling, demonstrating superior finite-sample performance over traditional procedures.

## Contribution

It presents a novel Bayesian approach with adaptive local modeling and nonrecursive iteration, improving efficiency and consistency in root estimation tasks.

## Key findings

- Superior finite-sample performance compared to Robbins--Monro procedures
- Strong consistency of the Bayesian estimator established
- Extensions to extremum searching and multivariate quantiles included

## Abstract

Motivated by the goal of improving the efficiency of small sample design, we propose a novel Bayesian stochastic approximation method to estimate the root of a regression function. The method features adaptive local modelling and nonrecursive iteration. Strong consistency of the Bayes estimator is obtained. Simulation studies show that our method is superior in finite-sample performance to Robbins--Monro type procedures. Extensions to searching for extrema and a version of generalized multivariate quantile are presented.