A Sentiment Analysis of Medical Text Based on Deep Learning

TL;DR

This paper explores deep learning models for sentiment analysis of medical texts, demonstrating that CNN combined with BERT performs best on small datasets, aiding clinical applications.

Contribution

It introduces a novel combination of BERT with CNN, FCN, and GCN for medical sentiment analysis and evaluates their performance on the METS-CoV dataset.

Findings

CNN outperforms other models on small medical datasets

BERT combined with CNN yields the best training performance

Model selection is crucial for effective medical sentiment analysis

Abstract

The field of natural language processing (NLP) has made significant progress with the rapid development of deep learning technologies. One of the research directions in text sentiment analysis is sentiment analysis of medical texts, which holds great potential for application in clinical diagnosis. However, the medical field currently lacks sufficient text datasets, and the effectiveness of sentiment analysis is greatly impacted by different model design approaches, which presents challenges. Therefore, this paper focuses on the medical domain, using bidirectional encoder representations from transformers (BERT) as the basic pre-trained model and experimenting with modules such as convolutional neural network (CNN), fully connected network (FCN), and graph convolutional networks (GCN) at the output layer. Experiments and analyses were conducted on the METS-CoV dataset to explore the training performance after integrating different deep learning networks. The results indicate that CNN models outperform other networks when trained on smaller medical text datasets in combination with pre-trained models like BERT. This study highlights the significance of model selection in achieving effective sentiment analysis in the medical domain and provides a reference for future research to develop more efficient model architectures.