Distributional Part-of-Speech Tagging
Hinrich Schuetze (CSLI, Stanford University)
TL;DR
This paper introduces a context-based algorithm for part-of-speech tagging that classifies word tokens in context rather than word types, evaluated on the Brown Corpus.
Contribution
It presents a novel context-aware tagging algorithm that improves upon previous type-based methods.
Findings
Effective on Brown Corpus data
Outperforms previous type-based approaches
Demonstrates the importance of context in POS tagging
Abstract
This paper presents an algorithm for tagging words whose part-of-speech properties are unknown. Unlike previous work, the algorithm categorizes word tokens in context instead of word types. The algorithm is evaluated on the Brown Corpus.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNatural Language Processing Techniques · Topic Modeling · Algorithms and Data Compression