Operationalizing community engagement evaluation: A structured and scalable approach using the RE-AIM framework and net effects diagrams

TL;DR

This paper introduces a structured and scalable method for evaluating community engagement in health programs using the RE-AIM framework and Net Effects Diagrams.

Contribution

The novel contribution is a seven-step operational approach to standardize and visualize community engagement evaluation using RE-AIM and Net Effects Diagrams.

Findings

Spanish-language workshops outperformed English-language workshops in attendance, satisfaction, and short-term effectiveness.

Net Effects Diagrams facilitated stakeholder collaboration and interpretation of program outcomes.

The framework supports scalable and transparent evaluation of community-based programs.

Abstract

Community engagement (CE) is essential in Clinical and Translational Science (CTS), yet its evaluation remains inconsistent and often lacks standardization. The RE-AIM framework (Reach, Effectiveness, Adoption, Implementation, Maintenance) offers a promising structure for evaluating CE efforts, but its application in dynamic, community-based contexts is often limited by data variability and implementation complexity.

We developed and applied a seven-step, structured, and replicable approach to operationalizing RE-AIM for program evaluation. This method includes the use of tailored RE-AIM subdomains, standardized scoring systems, and visual analytics through Net Effects Diagrams.

We applied this framework to our community-based health education workshops delivered in English and Spanish across Los Angeles, using participant surveys and facilitator feedback data. The operationalized framework enabled consistent assessment and comparison between language groups. Spanish-language workshops outperformed English-language workshops (ELWs) in measures of attendance, participant satisfaction, and short-term effectiveness. Visualizations using Net Effects Diagrams facilitated collaboration among stakeholders to interpret program outputs and outcomes, supporting actionable insights for program adaptation. Differences between workshop groups will inform changes to recruitment and content delivery strategies in ELWs.

This approach offers a transparent, scalable, and context-sensitive method for assessing CE programs. It supports data-driven decision-making, continuous program improvement, and stakeholder engagement. While developed for CE initiatives, the method is broadly adaptable to other community and public health programs. Future efforts will include expanded outcome tracking, integration into dashboards, and dissemination as a toolkit for broader adoption within and beyond the CTS Award network.

Figures