A Reasoning Paradigm for Named Entity Recognition

TL;DR

This paper introduces a reasoning framework for Named Entity Recognition that shifts from pattern matching to explicit reasoning, significantly improving zero-shot performance and interpretability.

Contribution

It proposes a three-stage reasoning paradigm for NER, including CoT generation, tuning, and enhancement, to improve reasoning and extraction accuracy.

Findings

Achieves state-of-the-art zero-shot NER performance

Outperforms GPT-4 by 12.3 F1 points in zero-shot settings

Demonstrates strong reasoning capabilities in NER tasks

Abstract

Generative LLMs typically improve Named Entity Recognition (NER) performance through instruction tuning. They excel at generating entities by semantic pattern matching but lack an explicit, verifiable reasoning mechanism. This "cognitive shortcutting" leads to suboptimal performance and brittle generalization, especially in zero-shot and lowresource scenarios where reasoning from limited contextual cues is crucial. To address this issue, a reasoning framework is proposed for NER, which shifts the extraction paradigm from implicit pattern matching to explicit reasoning. This framework consists of three stages: Chain of Thought (CoT) generation, CoT tuning, and reasoning enhancement. First, a dataset annotated with NER-oriented CoTs is generated, which contain task-relevant reasoning chains. Then, they are used to tune the NER model to generate coherent rationales before deriving the final answer. Finally, a reasoning enhancement stage is implemented to optimize the reasoning process using a comprehensive reward signal. This stage ensures explicit and verifiable extractions. Experiments show that ReasoningNER demonstrates impressive cognitive ability in the NER task, achieving competitive performance. In zero-shot settings, it achieves state-of-the-art (SOTA) performance, outperforming GPT-4 by 12.3 percentage points on the F1 score. Analytical results also demonstrate its great potential to advance research in reasoningoriented information extraction. Our codes are available at https://github.com/HuiResearch/ReasoningIE.