# Corpus Statistics in Text Classification of Online Data

**Authors:** Marina Sokolova, Victoria Bobicev

arXiv: 1803.06390 · 2018-03-20

## TL;DR

This paper investigates how corpus characteristics influence text classification results, using empirical analysis on health forum data for sentiment analysis to enhance understanding of data impact on ML performance.

## Contribution

It provides an empirical analysis of corpus characteristics' effects on text classification accuracy in online health forum data.

## Key findings

- Corpus features correlate with classification performance
- Insights into data-driven improvements for sentiment analysis
- Empirical evidence on corpus influence in real-world datasets

## Abstract

Transformation of Machine Learning (ML) from a boutique science to a generally accepted technology has increased importance of reproduction and transportability of ML studies. In the current work, we investigate how corpus characteristics of textual data sets correspond to text classification results. We work with two data sets gathered from sub-forums of an online health-related forum. Our empirical results are obtained for a multi-class sentiment analysis application.

---
Source: https://tomesphere.com/paper/1803.06390