# Towards Integration of Statistical Hypothesis Tests into Deep Neural   Networks

**Authors:** Ahmad Aghaebrahimian, Mark Cieliebak

arXiv: 1906.06550 · 2019-06-18

## TL;DR

This paper introduces a deep learning architecture that integrates statistical hypothesis testing to identify informative words for label descriptions, improving multi-label and multi-class text classification performance.

## Contribution

It presents a novel data-driven method combining hypothesis testing with deep learning to enhance label-aware text classification without external information.

## Key findings

- Achieved state-of-the-art results on one dataset with significant margin
- Obtained competitive results on multiple datasets
- Method is adaptable and requires minimal hyper-parameter tuning

## Abstract

We report our ongoing work about a new deep architecture working in tandem with a statistical test procedure for jointly training texts and their label descriptions for multi-label and multi-class classification tasks. A statistical hypothesis testing method is used to extract the most informative words for each given class. These words are used as a class description for more label-aware text classification. Intuition is to help the model to concentrate on more informative words rather than more frequent ones. The model leverages the use of label descriptions in addition to the input text to enhance text classification performance. Our method is entirely data-driven, has no dependency on other sources of information than the training data, and is adaptable to different classification problems by providing appropriate training data without major hyper-parameter tuning. We trained and tested our system on several publicly available datasets, where we managed to improve the state-of-the-art on one set with a high margin, and to obtain competitive results on all other ones.

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/1906.06550/full.md

## Figures

1 figure with captions in the complete paper: https://tomesphere.com/paper/1906.06550/full.md

## References

34 references — full list in the complete paper: https://tomesphere.com/paper/1906.06550/full.md

---
Source: https://tomesphere.com/paper/1906.06550