# Data Driven Coded Aperture Design for Depth Recovery

## TL;DR

This paper introduces a data-driven method to learn optimal aperture patterns for depth recovery from single images, outperforming traditional design approaches by leveraging deep neural networks and real image data.

## Contribution

The paper presents a novel two-stage deep learning architecture that optimizes aperture codes based on actual image data, improving depth recovery accuracy.

## Key findings

- Learned aperture code outperforms previous codes in depth recovery tasks.
- The data-driven approach adapts better to real image distributions.
- Deep neural network effectively reconstructs depth from coded images.

## Abstract

Inserting a patterned occluder at the aperture of a camera lens has been shown to improve the recovery of depth map and all-focus image compared to a fully open aperture. However, design of the aperture pattern plays a very critical role. Previous approaches for designing aperture codes make simple assumptions on image distributions to obtain metrics for evaluating aperture codes. However, real images may not follow those assumptions and hence the designed code may not be optimal for them. To address this drawback we propose a data driven approach for learning the optimal aperture pattern to recover depth map from a single coded image. We propose a two stage architecture where, in the first stage we simulate coded aperture images from a training dataset of all-focus images and depth maps and in the second stage we recover the depth map using a deep neural network. We demonstrate that our learned aperture code performs better than previously designed codes even on code design metrics proposed by previous approaches.