Cloud based Scalable Object Recognition from Video Streams using Orientation Fusion and Convolutional Neural Networks

TL;DR

This paper introduces a cloud-based CNN approach using orientation fusion and empirical mode decomposition to enhance object recognition accuracy in video streams, addressing illumination and pose variations effectively.

Contribution

It proposes a novel CNN training method leveraging bi-dimensional empirical mode decomposition and Reisz transform for improved accuracy and scalability in video object recognition.

Findings

Achieved 97% recognition accuracy with orientation fusion.

Demonstrated scalability with multiple video streams.

Outperformed AlexNet, LeNet, and SE-ResNeXt in experiments.

Abstract

Object recognition from live video streams comes with numerous challenges such as the variation in illumination conditions and poses. Convolutional neural networks (CNNs) have been widely used to perform intelligent visual object recognition. Yet, CNNs still suffer from severe accuracy degradation, particularly on illumination-variant datasets. To address this problem, we propose a new CNN method based on orientation fusion for visual object recognition. The proposed cloud-based video analytics system pioneers the use of bi-dimensional empirical mode decomposition to split a video frame into intrinsic mode functions (IMFs). We further propose these IMFs to endure Reisz transform to produce monogenic object components, which are in turn used for the training of CNNs. Past works have demonstrated how the object orientation component may be used to pursue accuracy levels as high as 93\%. Herein we demonstrate how a feature-fusion strategy of the orientation components leads to further improving visual recognition accuracy to 97\%. We also assess the scalability of our method, looking at both the number and the size of the video streams under scrutiny. We carry out extensive experimentation on the publicly available Yale dataset, including also a self generated video datasets, finding significant improvements (both in accuracy and scale), in comparison to AlexNet, LeNet and SE-ResNeXt, which are the three most commonly used deep learning models for visual object recognition and classification.