Video Tester -- A multiple-metric framework for video quality assessment over IP networks

TL;DR

Video Tester is a flexible, open framework for comprehensive video quality assessment over IP networks, supporting multiple transmission methods, metrics, and detailed analysis capabilities.

Contribution

It introduces an extensible, Python-based framework that integrates various video quality metrics and transmission methods for improved assessment over IP networks.

Findings

Supports multiple transmission protocols including RTP over UDP and TCP

Includes diverse quality metrics like PSNR, SSIM, and G.1070

Provides detailed QoS and bitstream analysis

Abstract

This paper presents an extensible and reusable framework which addresses the problem of video quality assessment over IP networks. The proposed tool (referred to as Video-Tester) supports raw uncompressed video encoding and decoding. It also includes different video over IP transmission methods (i.e.: RTP over UDP unicast and multicast, as well as RTP over TCP). In addition, it is furnished with a rich set of offline analysis capabilities. Video-Tester analysis includes QoS and bitstream parameters estimation (i.e.: bandwidth, packet inter-arrival time, jitter and loss rate, as well as GOP size and I-frame loss rate). Our design facilitates the integration of virtually any existing video quality metric thanks to the adopted Python-based modular approach. Video-Tester currently provides PSNR, SSIM, ITU-T G.1070 video quality metric, DIV and PSNR-based MOS estimations. In order to promote its use and extension, Video-Tester is open and publicly available.