MetaTele: Compact Refractive Metasurface Computational Telephoto Camera

TL;DR

MetaTele introduces a novel compact optical and computational approach to achieve DSLR-level telephoto capabilities in smartphones by decoupling structure and color capture and fusing them with a diffusion model.

Contribution

It presents a new optics-algorithm co-design that significantly reduces the telephoto ratio in smartphone cameras using metasurface optics and deep learning fusion.

Findings

Achieved a telephoto ratio of 0.44 with a TTL of 13 mm.

Demonstrated high-quality RGB imaging with aberration correction.

Enabled DSLR-level telephoto capabilities in a smartphone form factor.

Abstract

Smartphone cameras face fundamental form-factor constraints that limit their optical magnification, primarily due to the difficulty of reducing a lens assembly's telephoto ratio, the ratio between total track length (TTL) and effective focal length (EFL). Currently, conventional refractive optics struggle to achieve a telephoto ratio below 0.5 without requiring multiple bulky elements to correct optical aberrations. In this paper, we introduce MetaTele, a novel optics-algorithm co-design that breaks this bottleneck. MetaTele explicitly decouples the acquisition of scene structure and color information. First, it utilizes a compact refractive-metasurface optical assembly to capture a fine-detail structure image under a narrow wavelength band, inherently avoiding severe chromatic aberrations. Second, it captures a broadband color cue using the same optics; although this cue is heavily corrupted by chromatic aberrations, it retains sufficient spectral information to guide post-processing. We then employ a custom one-step diffusion model to computationally fuse these two raw measurements, successfully colorizing the structure image while correcting for system aberrations. We demonstrate a MetaTele prototype, achieving an unprecedented telephoto ratio of 0.44 with a TTL of just 13 mm for RGB imaging, paving the way for DSLR-level telephoto capabilities within smartphone form factors.