PatchEX: High-Quality Real-Time Temporal Supersampling through Patch-based Parallel Extrapolation
Akanksha Dixit, Smruti R. Sarangi

TL;DR
PatchEX is a novel real-time frame extrapolation technique that partitions tasks for parallel execution, achieving high-quality supersampling with significantly reduced latency for high-refresh-rate displays.
Contribution
It introduces a patch-based extrapolation method with parallel sub-task execution and inpainting, improving both quality and speed over existing methods.
Findings
65.29% PSNR improvement over ExtraNet
48.46% PSNR improvement over ExtraSS
6x faster than ExtraNet
Abstract
High-refresh rate displays have become very popular in recent years due to the need for superior visual quality in gaming, professional displays and specialized applications like medical imaging. However, high-refresh rate displays alone do not guarantee a superior visual experience; the GPU needs to render frames at a matching rate. Otherwise, we observe disconcerting visual artifacts such as screen tearing and stuttering. Temporal supersampling is an effective technique to increase frame rates by predicting new frames from other rendered frames. There are two methods in this space: interpolation and extrapolation. Interpolation-based methods provide good image quality at the cost of a higher latency because they also require the next rendered frame. On the other hand, extrapolation methods are much faster at the cost of quality. This paper introduces PatchEX, a novel frame…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Data Compression Techniques · Speech and Audio Processing
MethodsInpainting · SPEED: Separable Pyramidal Pooling EncodEr-Decoder for Real-Time Monocular Depth Estimation on Low-Resource Settings
