Teaching a Transformer to Think Like a Chemist: Predicting Nanocluster Stability

TL;DR

This paper integrates density functional theory and AI to predict the stability of bimetallic nanoclusters, enabling rapid and interpretable screening of new chemistries for catalysis.

Contribution

It introduces a transformer-based model trained on DFT data to accurately predict nanocluster stability and preferences, with effective transfer learning to new host metals.

Findings

Transformer achieves ~0.6-0.7 eV MAE in formation energy predictions.

Model adapts quickly to unseen Fe-host nanoclusters with minimal data.

Attention and Shapley analyses identify key stability descriptors.

Abstract

Atomically precise metal nanoclusters bridge the molecular and bulk regimes, but designing bimetallic motifs with targeted stability and reactivity remains challenging. Here we combine density functional theory (DFT) and physics-grounded predictive artificial intelligence to map the configurational landscape of 13-atom icosahedral nanoclusters X$_{12}$TM, with hosts X = (Ti, Zr, Hf), and Fe and a single transition--metal dopant spanning the 3$d$-5$d$ series. Spin-polarized DFT calculations on 240 bimetallic clusters reveal systematic trends in binding and formation energies, distortion penalties, effective coordination number, d-band centre, and HOMO-LUMO gap that govern the competition between core-shell (in) and surface-segregated (out) arrangements. We then pretrain a transformer architecture on a curated set of 2968 unary clusters from the Quantum Cluster Database and fine-tune it on bimetallic data to predict formation energies and in/out preference, achieving mean absolute errors of about $0.6-0.7$eV and calibrated uncertainty intervals. The resulting model rapidly adapts to an unseen Fe-host domain with only a handful of labelled examples. At the same time, attention patterns and Shapley attributions highlight size mismatch, $d$-electron count, and coordination environment as key descriptors. All data, code, and workflows follow FAIR/TRUE principles, enabling reproducible, interpretable screening of unexplored nanocluster chemistries for catalysis and energy conversion.