Deep Reinforcement Learning for Modelling Protein Complexes

TL;DR

This paper introduces GAPN, a novel deep reinforcement learning approach that models multi-chain protein complexes efficiently, addressing combinatorial challenges and scale variance, resulting in improved accuracy and computational performance.

Contribution

The work presents a new reinforcement learning framework, GAPN, for protein complex modeling that effectively handles large search spaces and scale variability.

Findings

Achieved significant accuracy improvements in RMSD and TM-Score.

Demonstrated enhanced computational efficiency over existing PCM methods.

Successfully modeled diverse protein complexes with varying chain numbers.

Abstract

AlphaFold can be used for both single-chain and multi-chain protein structure prediction, while the latter becomes extremely challenging as the number of chains increases. In this work, by taking each chain as a node and assembly actions as edges, we show that an acyclic undirected connected graph can be used to predict the structure of multi-chain protein complexes (a.k.a., protein complex modelling, PCM). However, there are still two challenges: 1) The huge combinatorial optimization space of $N^{N-2}$ ($N$ is the number of chains) for the PCM problem can easily lead to high computational cost. 2) The scales of protein complexes exhibit distribution shift due to variance in chain numbers, which calls for the generalization in modelling complexes of various scales. To address these challenges, we propose GAPN, a Generative Adversarial Policy Network powered by domain-specific rewards and adversarial loss through policy gradient for automatic PCM prediction. Specifically, GAPN learns to efficiently search through the immense assembly space and optimize the direct docking reward through policy gradient. Importantly, we design an adversarial reward function to enhance the receptive field of our model. In this way, GAPN will simultaneously focus on a specific batch of complexes and the global assembly rules learned from complexes with varied chain numbers. Empirically, we have achieved both significant accuracy (measured by RMSD and TM-Score) and efficiency improvements compared to leading PCM softwares.