Mapping Process for the Task: Wikidata Statements to Text as Wikipedia Sentences

TL;DR

This paper presents a mapping process to convert Wikidata statements into natural language sentences for Wikipedia, aiming to automate content generation and reduce human effort in multilingual projects.

Contribution

It introduces a novel sentence-level mapping process from Wikidata statements to English Wikipedia sentences, enhancing data-to-text generation methods.

Findings

Effective organization of statements as quadruples and triples

Improved sentence structure analysis and noise filtering

Insights into relationships between sentence components

Abstract

Acknowledged as one of the most successful online cooperative projects in human society, Wikipedia has obtained rapid growth in recent years and desires continuously to expand content and disseminate knowledge values for everyone globally. The shortage of volunteers brings to Wikipedia many issues, including developing content for over 300 languages at the present. Therefore, the benefit that machines can automatically generate content to reduce human efforts on Wikipedia language projects could be considerable. In this paper, we propose our mapping process for the task of converting Wikidata statements to natural language text (WS2T) for Wikipedia projects at the sentence level. The main step is to organize statements, represented as a group of quadruples and triples, and then to map them to corresponding sentences in English Wikipedia. We evaluate the output corpus in various aspects: sentence structure analysis, noise filtering, and relationships between sentence components based on word embedding models. The results are helpful not only for the data-to-text generation task but also for other relevant works in the field.