Open-sourced modeling and simulating tools for decision-makers during an emerging pandemic or epidemic – Systematic evaluation of utility and usability: A scoping review update

TL;DR

This scoping review evaluates open-source epidemiological modeling tools for decision-makers during pandemics, highlighting their usability and areas needing improvement.

Contribution

The study updates and expands the evaluation of open-source tools for pandemic decision-making, focusing on usability and utility.

Findings

29 open-source tools were identified and assessed for user-friendliness and utility.

Tools varied in their ability to incorporate external data and provide geographic resolution.

Improvements are needed in communication of uncertainties and expert review processes.

Abstract

The COVID-19 pandemic had devastating effects on health systems globally. Emerging infectious diseases and pandemics will persist as a global health threat and preparedness for an evidence based response becomes challenging for decision makers. Epidemiological modeling can and has supported decision-making throughout pandemics. This study provides an update of the review “Publicly available software tools for decision-makers during an emergent epidemic—Systematic evaluation of utility and usability”1.

What epidemiological modeling tools for decision-makers are open-sourced available for the usage in emerging epidemics or pandemics and how useful and user-friendly are these tools?

A scoping review was conducted. We identified relevant studies through a search of peer-reviewed (Medline Ovid, Embase Ovid, PubMed, Cochrane) and gray literature databases, search engines such as Google, searches through stakeholder websites as well as expert consultations.

Of the 66 identified epidemiological modeling tools, 29 were included and qualitatively assessed using five-point-rating scales. The tools showed a good baseline of user-friendliness with variations in assessed components, features and utility. Room for improvement was found, specifically the capability to incorporate external data sources, detailed population descriptions, and geographic resolution.

Development efforts should prioritize clear communication of uncertainties and expert review processes. Trainings for specific tools should be considered.

Tool usage can enhance decision-making when adapted to the user's needs and purpose. They should be consulted critically rather than followed blindly.

Figures