MeToken: Uniform Micro-environment Token Boosts Post-Translational Modification Prediction

TL;DR

MeToken introduces a novel approach that combines sequence and structural information through micro-environment tokens to improve the prediction of post-translational modification sites and types in proteins.

Contribution

This work presents the MeToken model, which uniquely integrates protein structural context with sequence data using uniform sub-codebooks for enhanced PTM prediction.

Findings

MeToken outperforms existing methods in PTM site prediction accuracy.

Incorporating structural data significantly improves PTM type classification.

The model effectively handles rare PTM types through uniform sub-codebooks.

Abstract

Post-translational modifications (PTMs) profoundly expand the complexity and functionality of the proteome, regulating protein attributes and interactions that are crucial for biological processes. Accurately predicting PTM sites and their specific types is therefore essential for elucidating protein function and understanding disease mechanisms. Existing computational approaches predominantly focus on protein sequences to predict PTM sites, driven by the recognition of sequence-dependent motifs. However, these approaches often overlook protein structural contexts. In this work, we first compile a large-scale sequence-structure PTM dataset, which serves as the foundation for fair comparison. We introduce the MeToken model, which tokenizes the micro-environment of each amino acid, integrating both sequence and structural information into unified discrete tokens. This model not only captures the typical sequence motifs associated with PTMs but also leverages the spatial arrangements dictated by protein tertiary structures, thus providing a holistic view of the factors influencing PTM sites. Designed to address the long-tail distribution of PTM types, MeToken employs uniform sub-codebooks that ensure even the rarest PTMs are adequately represented and distinguished. We validate the effectiveness and generalizability of MeToken across multiple datasets, demonstrating its superior performance in accurately identifying PTM types. The results underscore the importance of incorporating structural data and highlight MeToken's potential in facilitating accurate and comprehensive PTM predictions, which could significantly impact proteomics research. The code and datasets are available at https://github.com/A4Bio/MeToken.