Large Language Model for Extracting Complex Contract Information in Industrial Scenes

TL;DR

This paper introduces a novel method for extracting complex contract information in industrial settings by constructing a high-quality dataset and fine-tuning a large language model, achieving high accuracy and efficiency.

Contribution

It presents a new dataset construction approach and fine-tuning process for large language models tailored to industrial contract information extraction.

Findings

High model accuracy and robustness achieved

Effective data augmentation improves performance

Model maintains high recall and precision in industrial scenarios

Abstract

This paper proposes a high-quality dataset construction method for complex contract information extraction tasks in industrial scenarios and fine-tunes a large language model based on this dataset. Firstly, cluster analysis is performed on industrial contract texts, and GPT-4 and GPT-3.5 are used to extract key information from the original contract data, obtaining high-quality data annotations. Secondly, data augmentation is achieved by constructing new texts, and GPT-3.5 generates unstructured contract texts from randomly combined keywords, improving model robustness. Finally, the large language model is fine-tuned based on the high-quality dataset. Experimental results show that the model achieves excellent overall performance while ensuring high field recall and precision and considering parsing efficiency. LoRA, data balancing, and data augmentation effectively enhance model accuracy and robustness. The proposed method provides a novel and efficient solution for industrial contract information extraction tasks.