# Identifying Early Signals From Emerging Public Health Events Using Natural Language Processing

## TL;DR

This paper explores using natural language processing to detect early signs of public health threats by analyzing clinical documents for specific signals.

## Contribution

The study introduces a method to identify early signals like public health communication and pathogen exposure mentions using NLP in clinical data.

## Key findings

- Positive predictive values for early signals ranged from 0.615 to 1.0, showing acceptable accuracy.
- Over 33 million emergency department visits were analyzed, with extracted exposures matching expected pathogen patterns.
- Automated NLP methods proved feasible for scaling biosurveillance efforts.

## Abstract

Timely detection of emerging public health threats is challenging because the surveillance infrastructure is not yet tuned to the emerging threat. We attempt to identify three nonspecific early signals that might be common across emerging events: public health authority communication, zoonotic exposure mentions, and other pathogen exposure mentions.

Data from U.S. Department of Veterans Affairs emergency department visits between 2004 and 2024 were used to construct training and validation sets from reportable or emerging infectious diseases identified by historical diagnoses and laboratories. Not all early signal types were extracted using the same method. Rule‐based and transformer models were used in a way to minimize developer and chart reviewer time. We then extracted cases from historic documents among selected diseases.

Positive predictive values for public health authority communication, zoonotic exposure, and other pathogen exposure ranged from 0.615 to 1.0. Target concepts were extracted from over 33 million emergency department visits. Distributions of extracted exposures generally matched expectations for the identified pathogen.

Automated natural language processing methods allow surveillance scaling to large amounts of clinical documents to identify relevant cases. Initial validation compared to manual text review shows that accuracy is acceptable for initial feasibility exploration in biosurveillance efforts.