# Attention-based Multi-Input Deep Learning Architecture for Biological Activity Prediction: An Application in EGFR Inhibitors

## TL;DR

This paper introduces an attention-based deep learning model that simultaneously uses structural and chemical data to predict biological activity of EGFR inhibitors, improving accuracy and interpretability.

## Contribution

The study presents a novel multi-input architecture with attention mechanism that enhances prediction performance and interpretability in drug activity modeling.

## Key findings

- Achieved MCC of 0.58 and AUC of 90% on EGFR dataset.
- Outperformed existing models in bioactivity prediction.
- Enabled interpretation of chemical structure contributions.

## Abstract

Machine learning and deep learning have gained popularity and achieved immense success in Drug discovery in recent decades. Historically, machine learning and deep learning models were trained on either structural data or chemical properties by separated model. In this study, we proposed an architecture training simultaneously both type of data in order to improve the overall performance. Given the molecular structure in the form of SMILES notation and their label, we generated the SMILES-based feature matrix and molecular descriptors. These data were trained on a deep learning model which was also integrated with the Attention mechanism to facilitate training and interpreting. Experiments showed that our model could raise the performance of prediction comparing to the reference. With the maximum MCC 0.58 and AUC 90% by cross-validation on EGFR inhibitors dataset, our architecture was outperforming the referring model. We also successfully integrated Attention mechanism into our model, which helped to interpret the contribution of chemical structures on bioactivity.