On Quantifying Sentiments of Financial News -- Are We Doing the Right Things?

TL;DR

This paper critically evaluates existing financial news sentiment analysis methods, demonstrating their limitations, and introduces SENTInews, a novel sentiment analyzer tailored for the Indian financial news context.

Contribution

It highlights the inadequacy of popular sentiment libraries for financial news and proposes SENTInews, a new approach optimized for Indian market news sentiment analysis.

Findings

Popular sentiment libraries often fail to accurately capture financial news sentiment.

SENTInews provides more reliable sentiment measurements for Indian financial news.

The study questions the effectiveness of existing sentiment analysis tools in finance.

Abstract

Typical investors start off the day by going through the daily news to get an intuition about the performance of the market. The speculations based on the tone of the news ultimately shape their responses towards the market. Today, computers are being trained to compute the news sentiment so that it can be used as a variable to predict stock market movements and returns. Some researchers have even developed news-based market indices to forecast stock market returns. Majority of the research in the field of news sentiment analysis has focussed on using libraries like Vader, Loughran-McDonald (LM), Harvard IV and Pattern. However, are the popular approaches for measuring financial news sentiment really approaching the problem of sentiment analysis correctly? Our experiments suggest that measuring sentiments using these libraries, especially for financial news, fails to depict the true picture and hence may not be very reliable. Therefore, the question remains: What is the most effective and accurate approach to measure financial news sentiment? Our paper explores these questions and attempts to answer them through SENTInews: a one-of-its-kind financial news sentiment analyzer customized to the Indian context