A Geometric Model with Stochastic Error for Abnormal Motion Detection of Portal Crane Bucket Grab

TL;DR

This paper presents a real-time, camera-based method for detecting abnormal swing angles of crane bucket grabs using a geometric model and YOLOv5, validated through simulations and real-world seaport videos.

Contribution

It introduces a novel geometric model combined with an improved YOLOv5 detection algorithm for fast, accurate swing angle estimation without sophisticated sensors.

Findings

Fast processing time of 0.01 seconds per image

Effective swing angle detection in various weather conditions

Validated accuracy through simulations and real seaport videos

Abstract

Abnormal swing angle detection of bucket grabs is crucial for efficient harbor operations. In this study, we develop a practically convenient swing angle detection method for crane operation, requiring only a single standard surveillance camera at the fly-jib head, without the need for sophisticated sensors or markers on the payload. Specifically, our algorithm takes the video images from the camera as input. Next, a fine-tuned 'the fifth version of the You Only Look Once algorithm' (YOLOv5) model is used to automatically detect the position of the bucket grab on the image plane. Subsequently, a novel geometric model is constructed, which takes the pixel position of the bucket grab, the steel rope length provided by the Programmable Logic Controller system, and the optical lens information of the camera into consideration. The key parameters of this geometric model are statistically estimated by a novel iterative algorithm. Once the key parameters are estimated, the algorithm can automatically detect swing angles from video streams. Being analytically simple, the computation of our algorithm is fast, as it takes about 0.01 seconds to process one single image generated by the surveillance camera. Therefore, we are able to obtain an accurate and fast estimation of the swing angle of an operating crane in real-time applications. Simulation studies are conducted to validate the model and algorithm. Real video examples from Qingdao Seaport under various weather conditions are analyzed to demonstrate its practical performance.