An Advert Creation System for 3D Product Placements

TL;DR

This paper introduces a framework for integrating 3D virtual advertisements into videos by understanding scene geometry and camera motion, enhancing realism in contextual advertising through mixed reality techniques.

Contribution

The paper presents a novel framework capable of perceiving 3D scene geometry and camera motion to seamlessly blend 3D ads into videos, addressing technical challenges in ad integration.

Findings

Effective 3D ad placement demonstrated in experiments

Framework enhances realism of virtual advertisements

Potential to revolutionize contextual advertising industry

Abstract

Over the past decade, the evolution of video-sharing platforms has attracted a significant amount of investments on contextual advertising. The common contextual advertising platforms utilize the information provided by users to integrate 2D visual ads into videos. The existing platforms face many technical challenges such as ad integration with respect to occluding objects and 3D ad placement. This paper presents a Video Advertisement Placement & Integration (Adverts) framework, which is capable of perceiving the 3D geometry of the scene and camera motion to blend 3D virtual objects in videos and create the illusion of reality. The proposed framework contains several modules such as monocular depth estimation, object segmentation, background-foreground separation, alpha matting and camera tracking. Our experiments conducted using Adverts framework indicates the significant potential of this system in contextual ad integration, and pushing the limits of advertising industry using mixed reality technologies.