# ChunkUIE: Chunked instruction-based unified information extraction

## TL;DR

ChunkUIE is a new model for information extraction that improves performance in both Chinese and English by using a chunked instruction strategy.

## Contribution

ChunkUIE introduces a novel chunked instruction construction strategy to address schema inconsistencies in information extraction.

## Key findings

- ChunkUIE improves zero-shot performance in information extraction for both Chinese and English.
- The chunked strategy reduces performance degradation caused by schema count inconsistencies.
- Negative schemas from a hard schema dictionary help reduce semantic confusion in the model.

## Abstract

Large language models (LLMs) have demonstrated remarkable performance across various linguistic tasks. However, existing LLMs perform inadequately in information extraction tasks for both Chinese and English. Numerous studies attempt to enhance model performance by increasing the scale of training data. However, discrepancies in the number and type of schemas used during training and evaluation can harm model effectiveness. To tackle this challenge, we propose ChunkUIE, a unified information extraction model that supports Chinese and English. We design a chunked instruction construction strategy that randomly and reproducibly divides all schemas into chunks containing an identical number of schemas. This approach ensures that the union of schemas across all chunks encompasses all schemas. By limiting the number of schemas in each instruction, this strategy effectively addresses the performance degradation caused by inconsistencies in schema counts between training and evaluation. Additionally, we construct some challenging negative schemas using a predefined hard schema dictionary, which mitigates the model’s semantic confusion regarding similar schemas. Experimental results demonstrate that ChunkUIE enhances zero-shot performance in information extraction.