The Pitfalls of Publishing in the Age of LLMs: Strange and Surprising Adventures with a High-Impact NLP Journal

TL;DR

This paper explores the challenges and unexpected issues in academic publishing related to large language models, using a recent NLP journal case study to highlight potential pitfalls.

Contribution

It provides a detailed analysis of the difficulties faced in publishing NLP research in the era of LLMs, revealing new challenges and considerations.

Findings

Identifies specific pitfalls in NLP publishing with LLMs

Highlights surprising issues encountered in a high-impact journal

Offers insights into the academic publishing landscape amidst LLM advancements

Abstract

We show the fraught side of the academic publishing realm and illustrate it through a recent case study with an NLP journal.