Large language model use in oral and maxillofacial surgery training: a national resident survey

TL;DR

This study explores how oral and maxillofacial surgery residents in the U.S. use large language models, finding frequent use despite limited formal training.

Contribution

The study is the first to investigate LLM usage trends and educational integration among OMFS residents in the U.S.

Findings

79% of OMFS residents reported using large language models, primarily ChatGPT.

Most residents use LLMs for clinical decision support, board preparation, and research.

Only 3% of residents received formal LLM education during residency.

Abstract

Large language models (LLMs) are advanced artificial intelligence (AI) tools capable of generating human-like text and are increasingly used in education, clinical care, and research. Little is known about their use within oral and maxillofacial surgery (OMFS) training. This study investigates LLM usage trends, perceived value, and educational integration among OMFS residents in the United States.

A national, anonymous cross-sectional survey was distributed to OMFS residents via program directors. It gathered demographic data, LLM usage patterns, applications, perceived limitations, and attitudes toward incorporating LLMs into formal education.

Eighty-one residents responded, 79.0% (64/81) reported having used an LLM, and of that group, 96.9% (62/64) use ChatGPT. 51.9% (42/81) of respondents used LLMs at least monthly in residency; however, 97.5% (79/81) reported having received no formal LLM education during residency. Residents used LLMs for clinical decision support, board preparation, research, and career planning. Free-text responses revealed a wide spectrum of views. Some advocated for curricular integration and patient education applications, while others questioned the need for formal instruction. Some respondents supported integrating LLMs into curriculums and patient education while others questioned the need for formal instruction.

LLMs are used frequently by OMFS residents for a variety of purposes. As AI and LLMs become embedded in healthcare, understanding how OMFS residents interact with LLMs is vital. These findings may guide curriculum development, fostering responsible and effective use of LLMs in surgical training and practice.

The online version contains supplementary material available at 10.1007/s10006-026-01514-y.