MultiVerS: Improving scientific claim verification with weak supervision and full-document context

TL;DR

MultiVerS is a multitask model that improves scientific claim verification by incorporating full-document context and leveraging weak supervision for domain adaptation, achieving superior performance especially in low-resource settings.

Contribution

It introduces a multitask approach that combines claim verification and rationale identification using shared encoding, enabling weak supervision and better domain adaptation.

Findings

Outperforms baseline models on three scientific claim verification datasets.

Excels in zero-shot and few-shot domain adaptation scenarios.

Effectively utilizes weak supervision from heuristic-labeled data.

Abstract

The scientific claim verification task requires an NLP system to label scientific documents which Support or Refute an input claim, and to select evidentiary sentences (or rationales) justifying each predicted label. In this work, we present MultiVerS, which predicts a fact-checking label and identifies rationales in a multitask fashion based on a shared encoding of the claim and full document context. This approach accomplishes two key modeling goals. First, it ensures that all relevant contextual information is incorporated into each labeling decision. Second, it enables the model to learn from instances annotated with a document-level fact-checking label, but lacking sentence-level rationales. This allows MultiVerS to perform weakly-supervised domain adaptation by training on scientific documents labeled using high-precision heuristics. Our approach outperforms two competitive baselines on three scientific claim verification datasets, with particularly strong performance in zero / few-shot domain adaptation experiments. Our code and data are available at https://github.com/dwadden/multivers.