Zooming Network
Yukun Yan, Daqi Zheng, Zhengdong Lu, Sen Song

TL;DR
The paper introduces the Zooming Network, a neural model that captures hierarchical document structures and analyzes long texts effectively, improving sequence labeling performance over existing models.
Contribution
It presents a novel neural network architecture combining hierarchical encoding and multi-level interpretation, trained with hybrid learning methods for better long document understanding.
Findings
Achieved over 10 F1 improvement on long text sequence labeling tasks.
Effectively models hierarchical document structures.
Outperforms baseline biLSTM-CRF models.
Abstract
Structural information is important in natural language understanding. Although some current neural net-based models have a limited ability to take local syntactic information, they fail to use high-level and large-scale structures of documents. This information is valuable for text understanding since it contains the author's strategy to express information, in building an effective representation and forming appropriate output modes. We propose a neural net-based model, Zooming Network, capable of representing and leveraging text structure of long document and developing its own analyzing rhythm to extract critical information. Generally, ZN consists of an encoding neural net that can build a hierarchical representation of a document, and an interpreting neural model that can read the information at multi-levels and issuing labeling actions through a policy-net. Our model is trained…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Natural Language Processing Techniques · Advanced Text Analysis Techniques
