NLLG Quarterly arXiv Report 09/24: What are the most influential current AI Papers?

TL;DR

This report analyzes the most influential AI papers from early 2023 to late 2024, highlighting emerging trends like multimodal architectures, shifts in research focus, and the integration of generative AI in academic writing.

Contribution

It provides a comprehensive overview of recent top-cited papers, revealing new developments, declining trends, and patterns in AI research and language use.

Findings

45% of top papers are new since last report

Emergence of multimodal architectures like diffusion models

Decline in AI-generated content markers in top-cited papers

Abstract

The NLLG (Natural Language Learning & Generation) arXiv reports assist in navigating the rapidly evolving landscape of NLP and AI research across cs.CL, cs.CV, cs.AI, and cs.LG categories. This fourth installment captures a transformative period in AI history - from January 1, 2023, following ChatGPT's debut, through September 30, 2024. Our analysis reveals substantial new developments in the field - with 45% of the top 40 most-cited papers being new entries since our last report eight months ago and offers insights into emerging trends and major breakthroughs, such as novel multimodal architectures, including diffusion and state space models. Natural Language Processing (NLP; cs.CL) remains the dominant main category in the list of our top-40 papers but its dominance is on the decline in favor of Computer vision (cs.CV) and general machine learning (cs.LG). This report also presents novel findings on the integration of generative AI in academic writing, documenting its increasing adoption since 2022 while revealing an intriguing pattern: top-cited papers show notably fewer markers of AI-generated content compared to random samples. Furthermore, we track the evolution of AI-associated language, identifying declining trends in previously common indicators such as "delve".