RexUniNLU: Recursive Method with Explicit Schema Instructor for Universal NLU
Chengyuan Liu, Shihang Wang, Fubang Zhao, Kun Kuang, Yangyang Kang,, Weiming Lu, Changlong Sun, Fei Wu

TL;DR
RexUniNLU is a universal NLU framework that unifies information extraction and text classification tasks using explicit schema constraints, covering a wide range of schemas and modalities with improved accuracy.
Contribution
The paper introduces a formal universal information extraction formulation and a recursive method with explicit schema constraints for unified NLU tasks, including IE and CLS across multiple schemas and modalities.
Findings
Effective across IE and CLS tasks in English and Chinese
Outperforms existing models in accuracy and versatility
Successfully handles complex schemas like quadruples and quintuples
Abstract
Information Extraction (IE) and Text Classification (CLS) serve as the fundamental pillars of NLU, with both disciplines relying on analyzing input sequences to categorize outputs into pre-established schemas. However, there is no existing encoder-based model that can unify IE and CLS tasks from this perspective. To fully explore the foundation shared within NLU tasks, we have proposed a Recursive Method with Explicit Schema Instructor for Universal NLU. Specifically, we firstly redefine the true universal information extraction (UIE) with a formal formulation that covers almost all extraction schemas, including quadruples and quintuples which remain unsolved for previous UIE models. Then, we expands the formulation to all CLS and multi-modal NLU tasks. Based on that, we introduce RexUniNLU, an universal NLU solution that employs explicit schema constraints for IE and CLS, which…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsIntelligent Tutoring Systems and Adaptive Learning
MethodsSoftmax · Attention Is All You Need
