MGSA: Multi-Granularity Graph Structure Attention for Knowledge Graph-to-Text Generation

TL;DR

This paper introduces MGSA, a multi-granularity graph structure attention model that enhances knowledge graph-to-text generation by capturing both entity-level and word-level structural information, leading to improved text quality.

Contribution

The paper proposes a novel multi-granularity structure encoding approach that combines entity-level and word-level information within pre-trained language models for better KG-to-text generation.

Findings

MGSA outperforms single-granularity models on WebNLG and EventNarrative datasets.

Multi-granularity encoding improves the semantic richness of generated texts.

Extensive evaluations confirm the effectiveness of the proposed approach.

Abstract

The Knowledge Graph-to-Text Generation task aims to convert structured knowledge graphs into coherent and human-readable natural language text. Recent efforts in this field have focused on enhancing pre-trained language models (PLMs) by incorporating graph structure information to capture the intricate structure details of knowledge graphs. However, most of these approaches tend to capture only single-granularity structure information, concentrating either on the relationships between entities within the original graph or on the relationships between words within the same entity or across different entities. This narrow focus results in a significant limitation: models that concentrate solely on entity-level structure fail to capture the nuanced semantic relationships between words, while those that focus only on word-level structure overlook the broader relationships between original entire entities. To overcome these limitations, this paper introduces the Multi-granularity Graph Structure Attention (MGSA), which is based on PLMs. The encoder of the model architecture features an entity-level structure encoding module, a word-level structure encoding module, and an aggregation module that synthesizes information from both structure. This multi-granularity structure encoding approach allows the model to simultaneously capture both entity-level and word-level structure information, providing a more comprehensive understanding of the knowledge graph's structure information, thereby significantly improving the quality of the generated text. We conducted extensive evaluations of the MGSA model using two widely recognized KG-to-Text Generation benchmark datasets, WebNLG and EventNarrative, where it consistently outperformed models that rely solely on single-granularity structure information, demonstrating the effectiveness of our approach.