Word Segmentation on Micro-blog Texts with External Lexicon and Heterogeneous Data
Qingrong Xia, Zhenghua Li, Jiayuan Chao, Min Zhang
TL;DR
This paper presents a system for word segmentation of micro-blog texts, leveraging external lexicons and heterogeneous data sources to improve segmentation accuracy in social media language.
Contribution
The paper introduces a novel approach combining external lexicons and heterogeneous data for improved micro-blog word segmentation.
Findings
Enhanced segmentation accuracy on micro-blog texts
Effective use of external lexicons and diverse data sources
Improved performance over baseline methods
Abstract
This paper describes our system designed for the NLPCC 2016 shared task on word segmentation on micro-blog texts.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNatural Language Processing Techniques · Topic Modeling · Translation Studies and Practices