ConTrip: Consensus Sentiment review Analysis and Platform ratings in a single score

TL;DR

ConTrip is a novel method that combines review consensus and platform ratings into a single, interpretable score to better reflect agreement among reviews and differentiate items with similar ratings.

Contribution

It introduces ConTrip, a new consensus score that merges review agreement with overall ratings, improving interpretability and differentiation.

Findings

ConTrip effectively captures review consensus and rating agreement.

The score is interpretable within the rating range.

Available as open-source implementation.

Abstract

People unequivocally employ reviews to decide on purchasing an item or an experience on the internet. In that regard, the growing significance and number of opinions have led to the development of methods to assess their sentiment content automatically. However, it is not straightforward for the models to create a consensus value that embodies the agreement of the different reviews and differentiates across equal ratings for an item. Based on the approach proposed by Nguyen et al. in 2020, we derive a novel consensus value named ConTrip that merges their consensus score and the overall rating of a platform for an item. ConTrip lies in the rating range values, which makes it more interpretable while maintaining the ability to differentiate across equally rated experiences. ConTrip is implemented and freely available under MIT license at https://github.com/pepebonet/contripscore