Event Enhanced High-Quality Image Recovery
Bishan Wang, Jingwei He, Lei Yu, Gui-Song Xia, Wen Yang

TL;DR
This paper introduces eSL-Net, an explainable neural network that leverages sparse learning to denoise and super-resolve images from event cameras, significantly improving image quality and enabling high frame-rate video reconstruction.
Contribution
The paper presents a novel event-enhanced sparse learning network (eSL-Net) that effectively recovers high-quality images from noisy, low-resolution event camera data, outperforming existing methods.
Findings
eSL-Net improves image quality by 7-12 dB over state-of-the-art.
The network can generate high frame-rate videos without additional training.
The method effectively addresses denoising and super-resolution for event camera data.
Abstract
With extremely high temporal resolution, event cameras have a large potential for robotics and computer vision. However, their asynchronous imaging mechanism often aggravates the measurement sensitivity to noises and brings a physical burden to increase the image spatial resolution. To recover high-quality intensity images, one should address both denoising and super-resolution problems for event cameras. Since events depict brightness changes, with the enhanced degeneration model by the events, the clear and sharp high-resolution latent images can be recovered from the noisy, blurry and low-resolution intensity observations. Exploiting the framework of sparse learning, the events and the low-resolution intensity observations can be jointly considered. Based on this, we propose an explainable network, an event-enhanced sparse learning network (eSL-Net), to recover the high-quality…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Memory and Neural Computing · CCD and CMOS Imaging Sensors · Sparse and Compressive Sensing Techniques
