A Novel Dependency Framework for Enhancing Discourse Data Analysis

TL;DR

This paper introduces a dependency framework that converts various discourse annotations into dependency structures, enabling unified analysis across multiple languages and discourse theories, validated through BERT-based parsers and correlation metrics.

Contribution

It presents a novel method for converting PDTB and RST discourse annotations into dependency structures, enhancing cross-theoretical and cross-linguistic discourse data analysis.

Findings

PDTB dependency data is valid.

Strong correlation between RST and PDTB dependency distances.

Framework is applicable across multiple languages.

Abstract

The development of different theories of discourse structure has led to the establishment of discourse corpora based on these theories. However, the existence of discourse corpora established on different theoretical bases creates challenges when it comes to exploring them in a consistent and cohesive way. This study has as its primary focus the conversion of PDTB annotations into dependency structures. It employs refined BERT-based discourse parsers to test the validity of the dependency data derived from the PDTB-style corpora in English, Chinese, and several other languages. By converting both PDTB and RST annotations for the same texts into dependencies, this study also applies ``dependency distance'' metrics to examine the correlation between RST dependencies and PDTB dependencies in English. The results show that the PDTB dependency data is valid and that there is a strong correlation between the two types of dependency distance. This study presents a comprehensive approach for analyzing and evaluating discourse corpora by employing discourse dependencies to achieve unified analysis. By applying dependency representations, we can extract data from PDTB, RST, and SDRT corpora in a coherent and unified manner. Moreover, the cross-linguistic validation establishes the framework's generalizability beyond English. The establishment of this comprehensive dependency framework overcomes limitations of existing discourse corpora, supporting a diverse range of algorithms and facilitating further studies in computational discourse analysis and language sciences.