Sentiment analysis of texts from social networks based on machine learning methods for monitoring public sentiment

TL;DR

This study develops a machine learning-based sentiment analysis system using transformer models like DistilBERT and RoBERTa to monitor public opinion on social networks, achieving high accuracy and better nuance recognition.

Contribution

The paper introduces a hybrid sentiment analysis approach combining transformer architectures with traditional machine learning models, demonstrating improved accuracy over existing methods.

Findings

Transformer models achieved 80-85% accuracy in real-world social media data.

Deep learning models outperform lexicon-based classifiers in nuance detection.

Context tokens and sentiment keywords are key features for accurate classification.

Abstract

A sentiment analysis system powered by machine learning was created in this study to improve real-time social network public opinion monitoring. For sophisticated sentiment identification, the suggested approach combines cutting-edge transformer-based architectures (DistilBERT, RoBERTa) with traditional machine learning models (Logistic Regression, SVM, Naive Bayes). The system achieved an accuracy of up to 80-85% using transformer models in real-world scenarios after being tested using both deep learning techniques and standard machine learning processes on annotated social media datasets. According to experimental results, deep learning models perform noticeably better than lexicon-based and conventional rule-based classifiers, lowering misclassification rates and enhancing the ability to recognize nuances like sarcasm. According to feature importance analysis, context tokens, sentiment-bearing keywords, and part-of-speech structure are essential for precise categorization. The findings confirm that AI-driven sentiment frameworks can provide a more adaptive and efficient approach to modern sentiment challenges. Despite the system's impressive performance, issues with computing overhead, data quality, and domain-specific terminology still exist. In order to monitor opinions on a broad scale, future research will investigate improving computing performance, extending coverage to various languages, and integrating real-time streaming APIs. The results demonstrate that governments, corporations, and social researchers looking for more in-depth understanding of public mood on digital platforms can find a reliable and adaptable answer in AI-powered sentiment analysis.