Online Back-Parsing for AMR-to-Text Generation
Xuefeng Bai, Linfeng Song, Yue Zhang

TL;DR
This paper introduces an online back-parsing decoder for AMR-to-text generation that improves meaning preservation by jointly predicting AMR graphs during text generation, outperforming previous models.
Contribution
It presents a novel decoder that back predicts AMR graphs during generation, enhancing semantic fidelity over standard language modeling decoders.
Findings
Outperforms previous state-of-the-art on two AMR benchmarks
Better preservation of input meaning in generated text
Demonstrates effectiveness of back-parsing approach
Abstract
AMR-to-text generation aims to recover a text containing the same meaning as an input AMR graph. Current research develops increasingly powerful graph encoders to better represent AMR graphs, with decoders based on standard language modeling being used to generate outputs. We propose a decoder that back predicts projected AMR graphs on the target sentence during text generation. As the result, our outputs can better preserve the input meaning than standard decoders. Experiments on two AMR benchmarks show the superiority of our model over the previous state-of-the-art system based on graph Transformer.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Natural Language Processing Techniques · Cancer-related gene regulation
MethodsLinear Layer · Absolute Position Encodings · Position-Wise Feed-Forward Layer · Adam · Softmax · Dense Connections · Byte Pair Encoding · Multi-Head Attention · Layer Normalization · Label Smoothing
