TL;DR
MelBERT is a novel metaphor detection model that combines contextualized language models with linguistic theories, outperforming existing methods on multiple benchmark datasets.
Contribution
Introduces MelBERT, a metaphor detection approach that integrates BERT-based models with metaphor identification theories for improved accuracy.
Findings
MelBERT outperforms strong baselines on four benchmark datasets.
The model effectively distinguishes between literal and metaphorical meanings.
Empirical results validate the effectiveness of combining linguistic theories with contextual models.
Abstract
Automated metaphor detection is a challenging task to identify metaphorical expressions of words in a sentence. To tackle this problem, we adopt pre-trained contextualized models, e.g., BERT and RoBERTa. To this end, we propose a novel metaphor detection model, namely metaphor-aware late interaction over BERT (MelBERT). Our model not only leverages contextualized word representation but also benefits from linguistic metaphor identification theories to distinguish between the contextual and literal meaning of words. Our empirical results demonstrate that MelBERT outperforms several strong baselines on four benchmark datasets, i.e., VUA-18, VUA-20, MOH-X, and TroFi.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
MethodsMulti-Head Attention · Attention Is All You Need · Linear Layer · Refunds@Expedia|||How do I get a full refund from Expedia? · Dense Connections · Linear Warmup With Linear Decay · WordPiece · Residual Connection · Softmax · Attention Dropout
