TL;DR
This paper presents TOKOFOU, an ensemble of six transformer models fine-tuned for COVID-19 misinformation detection, achieving top performance with an F1 score of 89.7% in the shared task.
Contribution
It introduces a novel ensemble approach combining multiple transformer encoders for misinformation detection in the COVID-19 context.
Findings
Achieved an F1 score of 89.7%
Ranked first in the shared task
Effective ensemble method for misinformation detection
Abstract
This paper describes the TOKOFOU system, an ensemble model for misinformation detection tasks based on six different transformer-based pre-trained encoders, implemented in the context of the COVID-19 Infodemic Shared Task for English. We fine tune each model on each of the task's questions and aggregate their prediction scores using a majority voting approach. TOKOFOU obtains an overall F1 score of 89.7%, ranking first.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
MethodsLinear Layer · Residual Connection · Weight Decay · Attention Dropout · Linear Warmup With Linear Decay · WordPiece · Adam · Dropout · Softmax · Dense Connections
