Inequities in food access during the COVID19 pandemic: a multilevel, mixed methods pilot study
Megha R. Aepala, Alice Guan, Tessa Cruz, Jamaica Sowell, Brenda Mattias, Katherine Lin, Analena Hope Hassberg, Salma Shariff-Marco, Mindy C. DeRouen, Antwi Akom

TL;DR
This study explores how food access and insecurity changed during the pandemic in low-income and minority communities in the San Francisco Bay Area.
Contribution
The study introduces a data integration model combining qualitative, survey, and geospatial data to rapidly assess community needs during crises.
Findings
70% of participants reported food insecurity before and after the pandemic began.
Food-related reports were most common in lower socioeconomic census tracts with higher food insecurity.
Food-insecure individuals emphasized needs related to security, resources, and equity more than others.
Abstract
Innovative data integration may serve to inform rapid, local responses to community needs. We conducted a mixed methods pilot study among communities of color or low-income in the San Francisco Bay Area amid the COVID-19 pandemic to assess a hypothesized data model to inform rapid response efforts. Between 2020–2021, we collected (1) qualitative data through neighborhood reports submitted via Streetwyze, a mobile neighborhood mapping platform; (2) survey data on social and economic circumstances; and (3) geospatial data among residents of three counties. Qualitative data were coded and then integrated with survey and geospatial data. We used descriptive analyses to examine participants’ experiences with food in their neighborhoods. Seventy percent of participants reported food insecurity before and after the pandemic began in March 2020. Within neighborhood reports, food was the most…
Genes, proteins, chemicals, diseases, species, mutations and cell lines named across the full text — each resolved to its canonical identifier and authoritative record.
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 4- —California Breast Cancer Foundation, University of California Office of the President
- —National Cancer Institute
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFood Security and Health in Diverse Populations · Urban Agriculture and Sustainability · Homelessness and Social Issues
INTRODUCTION
We recently described design aspects of a mixed methods, community-based participatory research (MMCBPR) pilot study within the California counties of Alameda, Contra Costa, and San Francisco during the COVID-19 pandemic that offered a unique approach to assessing community need.^1^ It incorporated continued feedback on participants’ experiences within their neighborhoods through Streetwyze, a mobile mapping platform designed with and for communities of color or low-income.^1^ During our study, we used emerging themes from these neighborhood reports to inform the development of repeated epidemiological surveys that assessed several domains of structural and social determinants of health (employment, healthcare access, housing, child/eldercare, transportation, food, finances, everyday discrimination) and well-being (COVID-19 stressors and physical/mental health). Recently, we also published an inductive analysis of neighborhood reports that describes three themes participants found particularly salient during the pandemic; innovation to foster community cohesion and establish informal networks; the value and importance of racial, ethnic, and culturally tailored services; and dignity in service.^2^ In addition to neighborhood reports (qualitative data) and surveys (quantitative data), we collected multiple forms of geospatial data including participants’ residence, locations associated with neighborhood reports, locations of resources listed in public resource directories and secondary neighborhood data. To further leverage the three data types collected, we now describe a data model that integrates them and illustrates the potential utility of doing so in the context of food access among study participants. The purpose of illustrating this data model is to present a real-world application of how sustained community engagement via a mobile platform and data integration can be used to identify localized, targeted, and specific areas of intervention to address salient community needs and expand community-identified solutions to unmet needs.
METHODS
Participant recruitment
We recruited a convenience sample of individuals residing in San Francisco, Alameda, or Contra Costa counties. Community-based recruitment strategies developed and implemented by Streetwyze and Roots Community Health Center included social media (e.g., Instagram, Twitter), printed advertisement (e.g., fliers distributed in community groups, posters in community clinics), and outreach presentations during existing virtual support group meetings run by Roots. We also outreached to existing Streetwyze users. A total of 75 participants were consented into the study. Of these participants, 51 completed a baseline survey, and 19 provided neighborhood reports (18 of whom also completed the baseline survey). All data were collected between September 1, 2020 and December 31, 2021.
Data Collection
Qualitative data were collected as participant-submitted neighborhood reports in Streetwyze, a mobile mapping and SMS platform that allows for real-time mobile data collection via neighborhood reports, ratings, and reviews reflecting participants’ lived experiences.^1,2^ Within the Streetwyze platform, participants were directed to describe their experiences with resources and services during the pandemic through tailored focus questions (e.g., “Where is the safest and most affordable place for you to go to get the things you need?”, “Are there community-based organizations or neighbors who are making a difference in your life that you’d like to highlight?”). While participants were provided multiple format options to share their experiences (i.e., video, audio, or text), all reports we received in this study were text-based. A total of 236 neighborhood reports from 19 participants (range: 10 to 27 reports per participant) were received. Codebook development as well as formal inductive analysis of these reports have been published elsewhere.^1,2^ Briefly, the codebook was developed by a team of academic and community researchers to capture themes across neighborhood reports through preliminary assessment and discussion. A hierarchy of themes was developed to summarize six topical categories, which included: goods, resources, access, infrastructure, well-being, and infection control. Each of these “parent themes” included several sub-codes to reflect specific topics that were mentioned in the reports. For example, the ‘Access’ parent theme was subdivided into availability, convenience, price, orderliness, quality, security, and service (Supplemental Fig. 1). Each neighborhood report was independently coded by one community and one academic researcher; code conflicts were resolved by consensus among the full coding team.
Quantitative data were collected through an epidemiological survey (N = 51) via REDCap^3,4^ between January 1, 2021-October 31, 2021 and assessed participants’ circumstances prior to, and following, the COVID-19 pandemic shelter-in-place orders in the San Francisco Bay Area (March 2020). Survey domains included demographic characteristics (age, gender, race/ethnicity) along with social and structural determinants of health (employment, healthcare, housing, childcare, transportation, food, well-being, and financial circumstance). Surveys were drafted with questions and instruments sourced from the PhenX Toolkit and other published sources;^5–22^ the full baseline and follow-up surveys are available as Supplemental Methods and include source references relevant to specific survey items. In some cases, instruments were added (e.g., COVID-related safety, coping) or adapted (e.g., pandemic-related concerns) to our study based on integration of results of qualitative data analysis according to a convergent mixed methods approach.^1^ Food insecurity was assessed by adapting the six-item standard measure from the U.S. Department of Agriculture Economic Research Service (Supplemental Methods).^20^
Geospatial data. All (100%) participants who completed the baseline survey provided a full residential address (n = 50) or cross-streets of residence (n = 1). Addresses and cross-streets were geocoded to latitude/longitude coordinates using ArcGIS; census tract identifiers for 2010 census geographies were then appended. Measures of census tract-level neighborhood SES (nSES) and percent food insecure were obtained from UCSF Health Atlas.^23^ Neighborhood SES was previously created with principal components analysis of measures related to census tract-level income, occupation, education, and housing with data from the American Community Survey (2013–2017); quintiles are based on the distribution of index scores among all census tracts in the state of California.^24^ The proportion of individuals within a census tract experiencing food insecurity was from Feeding America’s Map the Meal Gap study (2016 and 2017).^25^
Neighborhood reports provided via the Streetwyze mapping platform are geocoded to latitude/longitude coordinates within the Streetwyze application and were then assigned to 2010 census tracts.Public resources described via Alameda, Contra Costa, and San Franciscocounty directories were obtained from in March 2021; the address of each resource was geocoded using Google API; census tract identifiers were then appended. The frequency of resources per capita was calculated for each census tract using population estimates from Census 2010.^26^
Data Analysis and Integration
Frequency of code applications across each parent theme were used to summarize qualitative data using descriptive statistics across all domains of structural and social determinants of health for the total sample, as well as by self-reported food insecurity.
We explored several data integration approaches illustrated by the data model in Fig. 1. First, we transformed qualitative reports into quantitative data at the participant level by creating an indicator for whether each code was mentioned more than average. Frequencies of these transformed qualitative data were then summarized by food insecurity status as self-reported by participants via survey. We found that the compound effects of experiencing multiple forms of stressors can influence an individual’s wellbeing. Therefore, we additionally evaluated the distribution of frequently mentioned codes within parent themes which appeared to differ substantially between those who were never and ever food insecure (i.e., resources, wellbeing, and infrastructure). Finally, we integrated geospatial measures by (1) overlaying the locations where participants reported receiving food resources via survey atop a base map illustrating the proportion of food resources for each census tract and (2) illustrating locations where participants mentioned food resources in neighborhood reports atop census tract-level base maps illustrating nSES and proportion of residents who experienced food insecurity. All maps were created with ArcGIS using shapefiles for Census 2010 tract boundaries available from the National Historical Geographic Information System.^27,28^
RESULTS
Data types and our data integration approach are illustrated in Fig. 1 (Subsections below correspond to number boxes in Fig. 1).
Food experiences in neighborhoods: Summary of transformed qualitative data
Of the 236 qualitative reports collected from 19 participants, the most frequently mentioned parent themes were access (61%) and infection control (59%) while the least common were infrastructure (11%) and well-being (5%). Frequencies of sub-themes within each of the parent themes is presented in Supplemental Fig. 2. Food was the most frequently mentioned sub-theme within the parent themes of resources (49%) and goods (68%).
Participants circumstances around food access: Summary of survey data
A total of 51 participants completed the baseline survey (Table 1). Most participants lived in Alameda County (85.7%), were between 18–45 years of age (77.6%), were women (74.0%), and had less than 6 months of household savings (68.6%). Most participants reported changes in employment (68.6%) and transportation (60.8%) from before to after the pandemic began in March 2020. On average participants reported 7.7 stressors related to the COVID-19 pandemic, and 202.5 experiences of discrimination in the past year. Over 70% of participants reported food insecurity in both pre-and post-pandemic time periods.
In the period after the pandemic began, 65% of participants reported receiving reduced price or free food resources. The most common resources used were from non-profit organizations (43%, including Meals on Wheels and food banks), government food assistance programs (22%, including CalFresh, the Special Supplemental Nutrition Program for Women, Infants, and Children, or the pandemic Electronic Benefit Transfer (P-EBT) program), and free meals through schools (31%).
Intersections of individual experiences and neighborhood food experiences: Integrating neighborhood reports and survey responses
An illustrative integration of qualitative and quantitative data is displayed in Fig. 2. For each of the parent themes, the distributions of frequently mentioned codes in qualitative reports are presented according to self-reported food insecurity (ever vs. never food insecure). Most mentions of social and resource programs (87.5%) and informal networks (83.3%) were among participants who were food insecure (12.5% of mentions of resource programs and 16.6% of mentions of informal networks were among those who were not food insecure). Mentions of programs and networks were not specific to food; they include mentions of healthcare, childcare, and community-based organizations (e.g., organizations providing legal assistance). Within the Access parent category, mentions of sub-themes among those who were food insecure ranged from 87.5% of the total mentions of quality of goods to less than 45% of the total mentions of security or safety (compared to 12.5% of the total mentions of quality of goods and 55% of the total mentions of security among those who were not food insecure). These differences may indicate the priority of concerns among participants who are food insecure.
Figure 3 presents the frequency of themes mentioned among participants who were ever food insecure according to the number of pandemic-related stressors reported, categorized as below (< 8) and above (>/=8) the average number of stressors among the total participant population. Those who reported food insecurity and >/= 8 pandemic-related stressors had a higher proportion of reports mentioning outdoor space (83.3%), food (66.7%), and health (60.0%) resources; programs and solutions (57.1%); and experiences related to equity (60.0%) and coping (60.0%) compared to those who reported fewer than 8 stressors (Fig. 4). Participants who were food insecure and had >/= 8 pandemic-related stressors, on the other hand, were less likely to mention child or transport resources.
Locating food experiences: Integrating neighborhood reports, survey responses, and geospatial measures
Figure 4 presents strategies for integrating geospatial data with other data types within the domain of food security and food access. In Fig. 4a, neighborhood food resources reported by participants via survey are located over the density of food resources as reported by public resource directories. The food resources that participants reported utilizing appeared to be located within census tracts with a higher density of food resources. In Fig. 4b and 4c the location of qualitative reports mentioning food resources are overlayed on tract-level neighborhood socioeconomic status (4b) and the proportion reporting food insecurity (4c). In general, it appears that neighborhood reports mentioning food resources occurred in census tracts with lower nSES and higher proportions of food insecurity.
DISCUSSION
We used data collected through this MMCBPR pilot study to illustrate how several data elements can be integrated to describe participants’ experiences around social determinants of health using the domain of food insecurity as an example. By integrating qualitative data from written neighborhood reports, surveys, and geospatial data, we present a data model with the potential to identify specific, targeted needs and resources that emerge from participants’ experiences. In our example, data integration indicates how participants who have ever experienced food insecurity (before or after the beginning of the pandemic) were more likely to also report employment, housing, and healthcare changes during the pandemic and more likely to report everyday discrimination. Similarly, those reporting food insecurity were much more likely to mention resources and programs of any kind and to report experiences related to equity in their neighborhoods.
While this report is focused on food insecurity, it is intended to serve as an illustrative example of how this data model can inform tangible solutions across domains of structural and social determinants of health. For example, we found that those reporting both food insecurity and a higher number of other pandemic-related stressors had higher mentions of resources, programs, potential solutions, and issues related to equity and coping. This suggests that more comprehensive wrap-around services are needed for individuals who already experience stressors related to food insecurity. In addition, participants who mentioned food in neighborhood reports and who had many COVID-related stressors suggested areas for resource development related to outdoor space and health. Thus, a multilevel response to this need might include 1-community food service organizations serving as a point of contact for individuals who may benefit from other resources (healthcare and public health information) and 2-investment in outdoor spaces as sites to promote physical and mental health as well as deliver tangible health resources. Similarly, this observation stresses the importance of cross-institutional communication and connectivity to alleviate the administrative burden experienced by those who access multiple social services.
In our study, results from maps largely serve to validate the congruence of information across our data sources (e.g., mentions of food occurring most frequently in neighborhoods with higher area-level food insecurity). While we are reassured in the capacity for transformation of neighborhood reports to align with other measures of food access or experience, integration of reports or survey data with geospatial data would be most powerful when it contributes to new or emerging understanding of communities’ needs. Doing so may require smaller geographic units of analysis with larger numbers of community residents contributing reports and survey responses. For example, emergence of themes related to (non-COVID) safety in the vicinity of an existing food resource may be an early signal of an emerging access barrier or relatively frequent positive mentions of racial equity may identify exemplary aspects of existing programs. And of course, new mentions of needed resources may indicate specific areas with emerging need. We will continue to develop the relevancy of our data model to hyper-local assessment of barriers and solutions in ongoing and future studies.
A limitation inherent to our data model is that integration across data sources inevitably reduces cell sizes. Specifically, because participants were provided with multiple options to share their experiences and perspectives, there was limited overlap between data sources. This could lead to an overreliance on making inferences based on single data sources rather than on integration. Despite that, using a data integration model can help overcome the limitations of small sample sizes by leveraging information across sources of data to reinforce the validity of each. For instance, the fact that there were more mentions of food resources in qualitative neighborhood reports among those reporting food insecurity in the epidemiologic survey bolsters the validity of both data sources. Due to the small size of the participant population in this pilot study, we were unable to examine results according to individual-level factors such as race, ethnicity, immigration status, LGBTQA + status, and other individual social factors that impact individuals’ vulnerability to structural oppression. Targeted data collection to specific populations where appropriate or increasing participation would allow us to better represent those with intersecting identities.
Despite these limitations, there are several key benefits of this approach to data collection compared with other approaches that have been employed. First, collecting qualitative data using a mobile platform combined with brief, focused survey questions simultaneously with geographic information allows for continued participation compared with longer forms of data collection (e.g., in-depth interviews). Additionally, because the Streetwyze platform allows participants to share their feedback and experiences in real-time and within the context of their own neighborhood experiences, the barrier to participation is lower. This allows for sustained and low-effort participation and can make research more accessible for more diverse people and experiences.
Overall, we have demonstrated the feasibility of simultaneous, multi-modal data collection, which can be scaled to allow for a wider scope of inquiry, along with a tangible model for data integration with the potential to identify salient needs emerging from communities. The combined analysis of quantitative, qualitative, and geospatial data can be adapted by community organizations, policy makers, and researchers to improve the implementation of policies and services over time by periodically tracking and analyzing residential reports and sustaining community participation. This effort is in line with our broader intent to facilitate community-led research and community ownership of data that generates local knowledge, investment, and progress (Akom, Hope Hassberg, and Cruz; pending book chapter).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Guan A, Cruz T, Sowell J Combining mixed methods and community-based participatory research approaches to identify neighborhood-level needs during the COVID-19 pandemic. Journal of Mixed Methods Research. [Manuscript in publication];Department of Epidemiology and Biostatistics, University of California, San Francisco.
- 2Guan A, Cruz T, Sowell J, Dignified Resources and Coping Strategies During the COVID-19 Pandemic: a Qualitative Study of Racially and Economically Marginalized Communities. J Racial Ethn Health Disparities. Published online Oct. 2023;16. 10.1007/s 40615-023-01824-x.PMC 1156437637843779 · doi ↗ · pubmed ↗
- 3Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (RED Cap)—A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81. 10.1016/j.jbi.2008.08.010.18929686 PMC 2700030 · doi ↗ · pubmed ↗
- 4Harris PA, Taylor R, Minor BL, The RED Cap consortium: Building an international community of software platform partners. J Biomed Inform. 2019;95:103208. 10.1016/j.jbi.2019.103208.31078660 PMC 7254481 · doi ↗ · pubmed ↗
- 52010–2016 PROMIS Health Organization and PROMIS Cooperative Group. https://www.healthmeasures.net/index.php. PROMIS Scale v 1.2 - Global Physical 2a 07September 2016.
- 62010–2016 PROMIS Health Organization and PROMIS Cooperative Group. https://www.healthmeasures.net/index.php. PROMIS Scale v 1.2 - Global Mental 2a 07September 2016.
- 7Grasso DJ, Briggs-Gowan MJ, Ford JD, Carter AS. The Epidemic - Pandemic Impacts Inventory (EPII). University of Conneticut School of Medicine; 2020.
- 8Williams DR, Yu Y, Jacksonnull, Anderson JS. Racial Differences in Physical and Mental Health: Socio-economic Status, Stress and Discrimination. J Health Psychol. 1997;2(3):335–51. 10.1177/135910539700200305.22013026 · doi ↗ · pubmed ↗
