Effects of Soft-Domain Transfer and Named Entity Information on Deception Detection

TL;DR

This paper investigates how soft-domain transfer and named entity information influence deception detection accuracy across various online text datasets, demonstrating notable improvements with these methods.

Contribution

It introduces a transfer learning approach using BERT with intermediate layer concatenation and evaluates the impact of named entity features on deception detection.

Findings

Transfer learning improves accuracy over baseline.

Jensen-Shannon distance correlates with transfer performance.

Named entity features enhance accuracy up to 11.2%.

Abstract

In the modern age an enormous amount of communication occurs online, and it is difficult to know when something written is genuine or deceitful. There are many reasons for someone to deceive online (e.g., monetary gain, political gain) and detecting this behavior without any physical interaction is a difficult task. Additionally, deception occurs in several text-only domains and it is unclear if these various sources can be leveraged to improve detection. To address this, eight datasets were utilized from various domains to evaluate their effect on classifier performance when combined with transfer learning via intermediate layer concatenation of fine-tuned BERT models. We find improvements in accuracy over the baseline. Furthermore, we evaluate multiple distance measurements between datasets and find that Jensen-Shannon distance correlates moderately with transfer learning performance. Finally, the impact was evaluated of multiple methods, which produce additional information in a dataset's text via named entities, on BERT performance and we find notable improvement in accuracy of up to 11.2%.