Multispectral Focal Stack Acquisition Using A Chromatic Aberration Enlarged Camera

TL;DR

This paper introduces a novel camera design that captures multispectral and light field information simultaneously, enabling the reconstruction of multispectral focal stacks for enhanced scene understanding.

Contribution

It presents a new chromatic aberration enlarged camera and a LLT-based algorithm for capturing and recovering multispectral focal stacks, advancing optical imaging capabilities.

Findings

Effective multispectral slice capture demonstrated

Successful reconstruction of multispectral focal stacks

Enhanced scene perception potential

Abstract

Capturing more information, e.g. geometry and material, using optical cameras can greatly help the perception and understanding of complex scenes. This paper proposes a novel method to capture the spectral and light field information simultaneously. By using a delicately designed chromatic aberration enlarged camera, the spectral-varying slices at different depths of the scene can be easily captured. Afterwards, the multispectral focal stack, which is composed of a stack of multispectral slice images focusing on different depths, can be recovered from the spectral-varying slices by using a Local Linear Transformation (LLT) based algorithm. The experiments verify the effectiveness of the proposed method.