# Anomaly Detection in Traffic Surveillance Videos Using Deep Learning

**Authors:** Sardar Waqar Khan, Qasim Hafeez, Muhammad Irfan Khalid, Roobaea Alroobaea, Saddam Hussain, Jawaid Iqbal, Jasem Almotiri, Syed Sajid Ullah

PMC · DOI: 10.3390/s22176563 · Sensors (Basel, Switzerland) · 2022-08-31

## TL;DR

This paper presents a deep learning method using CNNs to automatically detect traffic accidents in surveillance videos with 82% accuracy.

## Contribution

A novel CNN-based approach with a custom vehicle accident image dataset and rolling prediction algorithm for traffic accident detection.

## Key findings

- The proposed CNN model achieved 82% accuracy in detecting traffic accidents from surveillance videos.
- A custom vehicle accident image dataset (VAID) was successfully used for training the model.
- The rolling prediction algorithm improved the accuracy of anomaly detection in traffic surveillance.

## Abstract

In the recent past, a huge number of cameras have been placed in a variety of public and private areas for the purposes of surveillance, the monitoring of abnormal human actions, and traffic surveillance. The detection and recognition of abnormal activity in a real-world environment is a big challenge, as there can be many types of alarming and abnormal activities, such as theft, violence, and accidents. This research deals with accidents in traffic videos. In the modern world, video traffic surveillance cameras (VTSS) are used for traffic surveillance and monitoring. As the population is increasing drastically, the likelihood of accidents is also increasing. The VTSS is used to detect abnormal events or incidents regarding traffic on different roads and highways, such as traffic jams, traffic congestion, and vehicle accidents. Mostly in accidents, people are helpless and some die due to the unavailability of emergency treatment on long highways and those places that are far from cities. This research proposes a methodology for detecting accidents automatically through surveillance videos. A review of the literature suggests that convolutional neural networks (CNNs), which are a specialized deep learning approach pioneered to work with grid-like data, are effective in image and video analysis. This research uses CNNs to find anomalies (accidents) from videos captured by the VTSS and implement a rolling prediction algorithm to achieve high accuracy. In the training of the CNN model, a vehicle accident image dataset (VAID), composed of images with anomalies, was constructed and used. For testing the proposed methodology, the trained CNN model was checked on multiple videos, and the results were collected and analyzed. The results of this research show the successful detection of traffic accident events with an accuracy of 82% in the traffic surveillance system videos.

## Full-text entities

- **Genes:** DCD (dermcidin) [NCBI Gene 117159] {aka AIDD, DCD-1, DSEP, HCAP, PIF}
- **Diseases:** VAID (MESH:C564543), Car accident (MESH:C566176), coronavirus disease (MESH:D018352), arson (MESH:D005391), abuse (MESH:D019966), breast cancer (MESH:D001943), explosion (MESH:D007174), Confusion (MESH:D003221), DL (MESH:D007859), brain tumor (MESH:D001932), WD (MESH:D013009), Accident (MESH:D000081084), car crash (MESH:C536029), Panic (MESH:D016584)
- **Chemicals:** DA (-), alcohol (MESH:D000438)
- **Species:** Homo sapiens (human, species) [taxon 9606]

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/PMC9460365/full.md

## Figures

21 figures with captions in the complete paper: https://tomesphere.com/paper/PMC9460365/full.md

## References

59 references — full list in the complete paper: https://tomesphere.com/paper/PMC9460365/full.md

---
Source: https://tomesphere.com/paper/PMC9460365