Learning to See Through Flare
Xiaopeng Peng, Heath Gemar, Erin Fleet, Kyle Novak, Abbie Watnik, Grover Swartzlander

TL;DR
NeuSee is a novel computational imaging framework that protects sensors from laser flare by jointly learning a diffractive optical element and a neural network for high-fidelity image restoration, outperforming previous methods.
Contribution
It introduces the first full-spectrum sensor protection system combining a learned DOE and neural networks, capable of suppressing intense laser flare in diverse real-world conditions.
Findings
Suppresses laser irradiance up to 10^6 times I_sat
Achieves 10.1% improvement in image quality over prior methods
Enables full-spectrum imaging and flare suppression in complex scenes
Abstract
Machine vision systems are susceptible to laser flare, where unwanted intense laser illumination blinds and distorts its perception of the environment through oversaturation or permanent damage to sensor pixels. We introduce NeuSee, the first computational imaging framework for high-fidelity sensor protection across the full visible spectrum. It jointly learns a neural representation of a diffractive optical element (DOE) and a frequency-space Mamba-GAN network for image restoration. NeuSee system is adversarially trained end-to-end on 100K unique images to suppress the peak laser irradiance as high as times the sensor saturation threshold , the point at which camera sensors may experience damage without the DOE. Our system leverages heterogeneous data and model parallelism for distributed computing, integrating hyperspectral information and multiple neural…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
