# Coreference Resolution Based on High-Dimensional Multi-Scale Information

## TL;DR

This paper introduces a new method for coreference resolution using multi-scale information to improve BERT's performance on text encoding.

## Contribution

A novel multi-scale context module is proposed to enhance BERT's encoding for varying text spans.

## Key findings

- The multi-scale module improves BERT's global information collection ability.
- Adding the module increased F1 scores by 0.5% with BERT and 0.2% with span BERT.

## Abstract

Coreference resolution is a key task in Natural Language Processing. It is difficult to evaluate the similarity of long-span texts, which makes text-level encoding somewhat challenging. This paper first compares the impact of commonly used methods to improve the global information collection ability of the model on the BERT encoding performance. Based on this, a multi-scale context information module is designed to improve the applicability of the BERT encoding model under different text spans. In addition, improving linear separability through dimension expansion. Finally, cross-entropy loss is used as the loss function. After adding BERT and span BERT to the module designed in this article, F1 increased by 0.5% and 0.2%, respectively.