Challenges in Expanding Portuguese Resources: A View from Open Information Extraction

TL;DR

This paper introduces a high-quality Portuguese Open IE corpus, addressing the scarcity of resources for non-English languages and facilitating the development of Open IE systems in Portuguese.

Contribution

It presents a rigorously annotated Portuguese Open IE corpus, including annotation rules and validation, filling a critical resource gap for non-English Open IE research.

Findings

Validated the corpus with state-of-the-art Open IE systems

Identified challenges in Portuguese annotation process

Provided structural and contextual annotation guidelines

Abstract

Open Information Extraction (Open IE) is the task of extracting structured information from textual documents, independent of domain. While traditional Open IE methods were based on unsupervised approaches, recently, with the emergence of robust annotated datasets, new data-based approaches have been developed to achieve better results. These innovations, however, have focused mainly on the English language due to a lack of datasets and the difficulty of constructing such resources for other languages. In this work, we present a high-quality manually annotated corpus for Open Information Extraction in the Portuguese language, based on a rigorous methodology grounded in established semantic theories. We discuss the challenges encountered in the annotation process, propose a set of structural and contextual annotation rules, and validate our corpus by evaluating the performance of state-of-the-art Open IE systems. Our resource addresses the lack of datasets for Open IE in Portuguese and can support the development and evaluation of new methods and systems in this area.