Advancing from Automated to Autonomous Beamline by Leveraging Computer Vision

TL;DR

This paper presents a computer vision system that leverages deep learning and multiview cameras to enable real-time collision detection, advancing synchrotron beamlines towards autonomous operation with high accuracy and safety.

Contribution

The paper introduces a novel computer vision-based system integrating equipment segmentation, tracking, and geometric analysis for autonomous beamline operation, including an interactive annotation module for adaptability.

Findings

High accuracy in collision detection on real beamline data

Real-time performance demonstrated in experiments

Strong potential for fully autonomous beamline operations

Abstract

The synchrotron light source, a cutting-edge large-scale user facility, requires autonomous synchrotron beamline operations, a crucial technique that should enable experiments to be conducted automatically, reliably, and safely with minimum human intervention. However, current state-of-the-art synchrotron beamlines still heavily rely on human safety oversight. To bridge the gap between automated and autonomous operation, a computer vision-based system is proposed, integrating deep learning and multiview cameras for real-time collision detection. The system utilizes equipment segmentation, tracking, and geometric analysis to assess potential collisions with transfer learning that enhances robustness. In addition, an interactive annotation module has been developed to improve the adaptability to new object classes. Experiments on a real beamline dataset demonstrate high accuracy, real-time performance, and strong potential for autonomous synchrotron beamline operations.