Layout-Aware Text Editing for Efficient Transformation of Academic PDFs to Markdown

TL;DR

This paper introduces EditTrans, a hybrid model that efficiently transforms academic PDFs into markup language by leveraging layout-aware editing, significantly reducing inference time while maintaining quality.

Contribution

The paper presents EditTrans, a novel layout-aware editing-generation model that improves PDF to markup transformation efficiency through a lightweight classification approach.

Findings

Reduced transformation latency by up to 44.5%

Maintained high transformation quality

Leveraged a fine-tuned Document Layout Analysis model

Abstract

Academic documents stored in PDF format can be transformed into plain text structured markup languages to enhance accessibility and enable scalable digital library workflows. Markup languages allow for easier updates and customization, making academic content more adaptable and accessible to diverse usage, such as linguistic corpus compilation. Such documents, typically delivered in PDF format, contain complex elements including mathematical formulas, figures, headers, and tables, as well as densely layouted text. Existing end-to-end decoder transformer models can transform screenshots of documents into markup language. However, these models exhibit significant inefficiencies; their token-by-token decoding from scratch wastes a lot of inference steps in regenerating dense text that could be directly copied from PDF files. To solve this problem, we introduce EditTrans, a hybrid editing-generation model whose features allow identifying a queue of to-be-edited text from a PDF before starting to generate markup language. EditTrans contains a lightweight classifier fine-tuned from a Document Layout Analysis model on 162,127 pages of documents from arXiv. In our evaluations, EditTrans reduced the transformation latency up to 44.5% compared to end-to-end decoder transformer models, while maintaining transformation quality. Our code and reproducible dataset production scripts are open-sourced.