Integrating IP Broadcasting with Audio Tags: Workflow and Challenges

TL;DR

This paper explores integrating IP broadcasting with live audio tagging by containerising an audio tagging model into a microservice, enhancing workflow flexibility and addressing latency challenges.

Contribution

It introduces a modular microservice for audio tagging in IP broadcasting workflows, emphasizing containerisation for flexible deployment across various production scales.

Findings

Containerised audio tagging model enables flexible integration.

Latency impacts the real-time usefulness of audio tagging.

Workflow improvements for diverse broadcasting environments.

Abstract

The broadcasting industry has adopted IP technologies, revolutionising both live and pre-recorded content production, from news gathering to live music events. IP broadcasting allows for the transport of audio and video signals in an easily configurable way, aligning with modern networking techniques. This shift towards an IP workflow allows for much greater flexibility, not only in routing signals but with the integration of tools using standard web development techniques. One possible tool could include the use of live audio tagging, which has a number of uses in the production of content. These could include adding sound effects to automated closed captioning or identifying unwanted sound events within a scene. In this paper, we describe the process of containerising an audio tagging model into a microservice, a small segregated code module that can be integrated into a multitude of different network setups. The goal is to develop a modular, accessible, and flexible tool capable of seamless deployment into broadcasting workflows of all sizes, from small productions to large corporations. Challenges surrounding latency of the selected audio tagging model and its effect on the usefulness of the end product are discussed.