B-jet Tagging Using a Hybrid Edge Convolution and Transformer Architecture

TL;DR

This paper introduces the Edge Convolution Transformer (ECT), a hybrid deep learning model combining edge convolutions and transformers, achieving state-of-the-art b-jet tagging performance with real-time inference capabilities.

Contribution

The paper presents a novel hybrid architecture that integrates edge convolutions with transformers for improved jet flavor tagging in high-energy physics.

Findings

ECT achieves 0.9333 AUC for b-jet vs charm and light jets

Outperforms ParticleNet and pure transformer models in accuracy

Maintains inference latency below 0.060 ms per jet

Abstract

Jet flavor tagging plays an important role in precise Standard Model measurement enabling the extraction of mass dependence in jet-quark interaction and quark-gluon plasma (QGP) interactions. They also enable inferring the nature of particles produced in high-energy particle collisions that contain heavy quarks. The classification of bottom jets is vital for exploring new Physics scenarios in proton-proton collisions. In this research, we present a hybrid deep learning architecture that integrates edge convolutions with transformer self-attention mechanisms, into one single architecture called the Edge Convolution Transformer (ECT) model for bottom-quark jet tagging. ECT processes track-level features (impact parameters, momentum, and their significances) alongside jet-level observables (vertex information and kinematics) to achieve state-of-the-art performance. The study utilizes the ATLAS simulation dataset. We demonstrate that ECT achieves 0.9333 AUC for b-jet versus combined charm and light jet discrimination, surpassing ParticleNet (0.8904 AUC) and the pure transformer baseline (0.9216 AUC). The model maintains inference latency below 0.060 ms per jet on modern GPUs, meeting the stringent requirements for real-time event selection at the LHC. Our results demonstrate that hybrid architectures combining local and global features offer superior performance for challenging jet classification tasks. The proposed architecture achieves good results in b-jet tagging, particularly excelling in charm jet rejection (the most challenging task), while maintaining competitive light-jet discrimination comparable to pure transformer models.