Overview of Screen Content Coding in Recently Developed Video Coding Standards

TL;DR

This paper reviews recent developments in screen content coding within modern video standards, highlighting new tools, their efficiency, and complexity considerations for computer-generated text, graphics, and animations.

Contribution

It provides a comprehensive overview and comparative analysis of screen content coding technologies across multiple recent video standards.

Findings

Screen content coding tools improve coding efficiency.

Recent standards incorporate specialized SCC features.

Trade-offs exist between performance gains and complexity.

Abstract

In recent years, screen content (SC) video including computer generated text, graphics and animations, have drawn more attention than ever, as many related applications become very popular. To address the need for efficient coding of such contents, a number of coding tools have been specifically developed and achieved great advances in terms of coding efficiency. The inclusion of screen content coding (SCC) features in all the recently developed video coding standards (namely, HEVC SCC, VVC, AVS3, AV1 and EVC) demonstrated the importance of supporting such features. This paper provides an overview and comparative study of screen content coding technologies, with discussions on the performance and complexity aspects for the tools developed in these standards.