Does timing matter? The role of health information shocks in measuring willingness to pay
Carolin Brinkmann, Sebastian Neumann-Böhme, Werner B. F. Brouwer, Tom Stargardt

TL;DR
This study explores how recent news about SARS-CoV-2 infections affects people's willingness to pay for booster vaccinations.
Contribution
The study introduces the concept of health information shocks and their timing in influencing willingness to pay for health interventions.
Findings
A recent health information shock increases willingness to pay for booster vaccinations by €14.54.
The effect of health information shocks on willingness to pay is strongest within four weeks of the event.
Controlling for socio-demographic factors reduces the significance of health information shocks on willingness to pay.
Abstract
The optimal point in time to measure willingness-to-pay (WTP) remains unclear. We investigated the role of health information shocks (HIS) in individuals’ WTP, analyzing the extent to which news of SARS-CoV-2 infections among people they know/themselves altered WTP for booster vaccinations. We elicited WTP in eight European countries using the European Covid Survey. First, we presented participants with a hypothetical setting recommending a booster vaccination that had to be paid out-of-pocket. To measure WTP, we elicited a lower and upper WTP limit, and a WTP value contingent on both of these. To measure HIS, we asked about the duration since participants received news of COVID-19 cases among people they know (including themselves), as well as the degree of personal connection to these cases and their severity. We used a two-part model to estimate the association between HIS and…
Genes, proteins, chemicals, diseases, species, mutations and cell lines named across the full text — each resolved to its canonical identifier and authoritative record.
Click any figure to enlarge with its caption.
Figure 1- —Universität Hamburg (1037)
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHealth Systems, Economic Evaluations, Quality of Life · Economic and Environmental Valuation · Healthcare cost, quality, practices
Introduction
To quantify the value of non-marketed goods and services such as health care interventions, health economic evaluations often seek to elicit the maximum amount that individuals are willing to pay for them. This amount can then be used to estimate the value of the interventions in monetary terms, facilitating comparisons between them. In this way, willingness-to-pay (WTP) can help policymakers assess value for money and prioritize different interventions based on individual preferences as part of their allocative decisions [1–5].
In healthcare, this approach is especially important because the absence of market prices and the desire of policymakers to align their decisions with the preferences of citizens mean that value is usually not observable. WTP therefore has become an established measure in preventive and curative health interventions [6, 7]. Yet despite their broad use and theoretical underpinnings, the validity of WTP estimates has been criticised, for example due to their insensitivity to scale [8] and hypothetical bias [9]. Additionally, WTP values are known to be associated with the elicitation procedure, framing, and study design [10–18].
Another issue to consider when designing WTP exercises in the context of health interventions is when to ask participants for a valuation. Just as the phenomenon that adaptation may affect subjective health-related quality of life [19–22], the timing of a WTP exercise in relation to the occurrence of some relevant ‘shock’ may be associated with its results. This may especially be the case if participants have experienced a health event or health information shock. The concept of information shocks has been the subject of recent health research [23–27]. In the present study, we aimed to contribute to this literature by exploring the role of health information shocks (HIS) in relation to WTP. To do so, we focused on the example of SARS-CoV-2 booster vaccinations, eliciting the hypothetical WTP for these in eight European countries and investigating the extent to which WTP was associated with the timing of a HIS. We defined a HIS either as having experienced a COVID-19 infection oneself or having heard of infections among people one knows. At the time of data collection in December 2021 and January 2022, total cumulative COVID-19 cases were between 8,180.7 (Germany) and 22,777.1 per 100,000 persons (United Kingdom) in Europe [28], i.e., a majority of the population had not experienced a COVID-19 infection (yet). While the Delta variant was predominant in incident cases in late December 2021, the more contagious omicron variant only started to spread in Europe in early 2022 [29].
Our results suggest that the occurrence of a HIS is associated with WTP estimates, especially in the short run. A HIS might prompt individuals to be willing to pay for the offered good. The observed association suggests that the timing of WTP surveys might influence their results and ultimately affect allocation decisions.
Methods
The European Covid Survey
The European Covid Survey (ECOS) was an online survey that elicited information on the attitudes, behavior, worries, and health characteristics of European residents aged 18 years or older approximately every two months between April 2020 and December 2022. The samples consisted of approximately 1000 participants per country and wave and were representative of the general population in each country in terms of gender and age. The participating countries were Denmark, France, Germany, Italy, Portugal, the Netherlands, the United Kingdom (UK), and, after July 2021, Spain. Participants were recruited by the market research company Dynata. Participation was anonymous and required written informed consent. The questionnaires were developed in English, translated into the various national languages, and piloted in 10% of each sample. Further information can be found elsewhere [30–33]. The present analysis is based on the 9th wave of ECOS data, collected between 23 December 2021 and 11 January 2022.
Measuring health information shocks (HIS)
We defined health information shocks (HIS) as important new information received by participants about their own health or the health of someone in their social environment. Based on this definition, we measured HIS by asking participants about (a) the duration since they heard news of COVID-19 cases among people they know (including themselves), (b) their degree of personal connection to these cases, and (c) the severity of these cases.
To do so, we used a matrix in which participants could tick boxes for each combination of temporal (when? ) and relational (who?) information (see Online Resource). The duration since receiving news about a case of COVID-19 was shown using two-week intervals ranging from “0 to 2 weeks” to “7 to 8 weeks”, and complemented by an open interval of “more than 8 weeks”. The degree of personal connection to these cases was shown as “household”, “family”, “friends”, “colleagues”, and “no” or “don’t know”. Self-shocks (infections among participants themselves) were implicitly included in the category “household”. Lastly, participants were asked to indicate the overall severity of the majority of the COVID-19 cases, with the options ranging from “more severe than expected” to “milder than expected”, and including a mixed category (“mixed, i.e., half of the cases more severe than expected, and half of the cases milder than expected”).
When analyzing the data, we treated the category “Don’t know” the same as the category “No” based on the assumption that a case of COVID-19 that the participant did not remember or did not consciously perceive would be the same as that of the absence of a case of COVID-19.
WTP measurement
To measure WTP, we presented participants with a hypothetical scenario in which (a) a booster vaccination was recommended, (b) it had to be paid out of pocket and the costs would not be reimbursed by health insurance or the government, (c) participants’ health and vaccination status permitted a booster vaccination, (d) participants could choose their preferred COVID-19 vaccine brand, and (e) the vaccination would be administered in a convenient location.
Similar to Himmler et al. [34], we opted for a guided measurement procedure to help participants form their WTP for a non-marketed good. An initial filter question identified whether individuals were willing to pay a positive amount for a booster vaccination. For those with a positive amount, we followed a three-step approach to elicit the WTP for a booster shot. First, we asked for the amount participants would certainly pay, using a scale ranging from €0 to €150 with visual anchoring points every €30. Alternatively, an open-ended question allowed participants to indicate a WTP greater than €150. Second, we asked for the amount participants would be unwilling to go beyond, using the same instruments as in the first step. Lastly, participants were asked to state their WTP using an open-ended question phrased in such a way that it reminded them of, and was conditional on, the previously set interval (see Online Resource).
For participants who stated in the initial filter question that they had no WTP or a WTP of €0 in the third step, we asked for their motivation in order to differentiate between true zeros and protest answers that would indicate a violation of the hypothetical setting. Motivation options included (1) not needing the booster shot because the participant believed he or she would not become ill with COVID-19, (2) not being able to afford the booster shot, (3) the booster shot being of no value to the participant because of worries about potential side effects, (4) vaccines generally having no value to the participant, (5) not wanting to pay because of the belief that vaccines should be paid by the government, and (6) other reasons. Options 1 to 4 were considered to be reflective of a true WTP of €0. Options 5 and 6 were regarded as protest answers and thus excluded from the analysis. We excluded extreme values, defined as WTP values above the adjusted gross disposable income of households per capita for the year 2020 for each country [35].
We asked for valuations in participants’ local currency. For our analyses, we converted pound sterling and Danish krone to euros using the exchange rate of the European Central Bank from 23 December 2021. We adjusted WTP values for purchasing power parity based on the 2020 Eurostat purchasing power adjusted gross domestic product per capita [36]. We used conditional pathways, dynamic validation, and piped text to ensure the quality and consistency of answers. Lastly, we identified careless responders– e.g., those who completed the questionnaire in less than a third of the median survey duration per country (so-called speeders)– and dropped these observations [37].
Statistical analysis
We calculated descriptive statistics for the sample, as well as WTP and HIS values. All analyses were based on the WTP response to the last elicitation step. We estimated the difference in WTP depending on the occurrence of HIS using a two-part model because of the continuous, non-negative nature of the dependent variable WTP [38] and a large number of zeros. In the first part, we modeled the probability of the WTP being positive with logistic regression (WTP > 0; WTP = 0). In the second part, we estimated the WTP, conditional on it being positive, using a gamma distribution and log-link function.
We considered four different model specifications for HIS: Model 1 included a binary variable indicating whether a participant had been subject to a HIS. Model 2 included a cardinal measurement of HIS intensity (i.e., the number of HIS experienced and its quadratic term). Model 3 referred to the most recent HIS experienced by a participant; it included the duration since the most recent HIS and the severity of the majority of COVID-19 cases. Lastly, Model 4 combined the specifications of Models 2 and 3 by adding the total number of HIS experienced in order to control for experience with COVID-19. We chose a linear rather than a squared specification for the number of HIS experienced by a participant because the results of Model 2 indicated that the tipping point was approximately six times the maximum reported number of HIS.
Additionally, Model 4 controlled for the following predictors of WTP reported in the literature: socio-demographic characteristics, perceived threat from the disease, perceived benefits, and prior knowledge of the health intervention [39]. We operationalized socio-economic status using a binary variable for gender, six categories for age, and a three-level education variable based on each country’s educational qualifications (see Online Resource), as well as a four-category variable as a proxy for income indicating the extent to which participants were “able to make ends meet”, ranging from “easily” to “with great difficulty”. We operationalized the perceived threat from the disease as quality of life measured using EQ-5D-5 L and as subjective risk to own health from COVID-19 ranging from “no risk at all” to “very high risk”. In turn, we operationalized the perceived benefit of the health intervention by including (a) the vaccination status of the participant, measured using five levels ranging from not being vaccinated/not yet being vaccinated to having received up to three vaccination shots, and (b) the vaccination status of peers in four levels (“none”, “just a few”, “about half”, “most”). In addition, we included country fixed-effects and a risk-aversion measure based on Barsky et al. [40] with four levels ranging from “very low” to “high”. We chose this measure based on the assumption that it was independent of the COVID-19 pandemic and would be unaffected by the HIS examined in our study.
We calculated average marginal effects (AME) to facilitate interpretation of the results of the two-part model in one estimate. We conducted the analysis using the “twopm” command [41] in Stata 17.
Results
Descriptive results
After we excluded careless responders, extreme values, protesters, and missing information, the final sample comprised 5809 observations (Fig. 1). Detailed sample characteristics can be found in Table 1.
Fig. 1. Flowchart of the sample. HIS– Health information shock, WTP– Willingness to pay
Table 1. Sample characteristicsSample characteristics per HIS status (N = 5809)Sample characteristics per WTP statement (N = 5809)No HIS (n = 2215)At least one HIS (n = 3594)WTP = 0 (n = 1349)WTP > 0 (n = 4460)n%n%n%n%Gender Female113251.11189952.8480459.60222749.93 Male108348.89169547.1654540.40223350.07Age (years) 18–241074.833259.041188.753147.04 25–3426712.0565718.2826319.5066114.82 35–4435115.8576521.2931423.2880217.98 45–5441718.8364417.9229922.1676217.09 55–6440718.3757716.0518713.8679717.87 65 or older66630.0762617.4216812.45112425.20Education level High86739.14198255.1552739.07232252.06 Middle94442.62119733.3158743.51155434.84 Low40418.2441511.5523517.4258413.09Ability to make ends meet Easily35015.8057015.861158.5280518.05 Fairly easy89340.32154342.9341830.99201845.25 With some difficulty78035.21120633.5660244.63138431.03 With great difficulty1928.672757.6521415.862535.67Country Denmark22310.0754215.0816111.9360413.54 France40918.4742111.7125018.5358013.00 Germany38817.523088.5717312.8252311.73 Italy2189.8447013.0814710.9054112.13 Netherlands25411.4741411.5221315.7945510.20 Portugal2179.8048613.52846.2361913.88 Spain1707.6750614.0815411.4252211.70 United Kingdom33615.1744712.4416712.3861613.81Risk aversion Very low68420.66145929.1430822.83131229.42 Low37311.2768913.7615811.7155312.40 Moderate2617.8855511.081309.6445910.29 High199360.19230446.0275355.82213647.89Vaccination status No33415.082426.7352939.21471.05 Not yet, but I intend to351.58611.70554.08410.92 Yes, the first shot472.121574.37483.561563.50 Yes, both shots65429.53143239.8445934.03162736.48 Yes, three shots (booster)114551.69170247.3625819.13258958.05Peers’ vaccination status Most173178.15281178.2176456.63377884.71 About half1667.493008.3520214.972645.92 Just a few2119.5341711.6027120.093578.00 None1074.83661.841128.30611.37
In total, 23.2% of participants expressed a WTP of €0, whereas 76.8% expressed a WTP greater than €0. Moreover, 61.9% of participants reported experiencing a HIS (i.e., at least one COVID-19 case), whereas 38.1% reported not experiencing any HIS. Of those who reported experiencing a HIS, 29.4% reported one, 22.0% reported two, 12.4% reported three, 10.6% reported four, and 14.2% reported five. The remaining 11.4% reported between six and the maximum number of 20 HIS. A large majority of participants who reported experiencing a HIS indicated that their most recent one had occurred zero to two weeks before the survey (69.5% of those who experienced a HIS), whereas 11.5% indicated that it had occurred three to four weeks and 9.9% that it had occurred more than eight weeks before the survey.
On average, participants were willing to pay €48.58 for a booster vaccination. The WTP ranged from €0.00 to €7542.60. Participants who reported experiencing at least one HIS indicated having a higher WTP on average than those who reported not experiencing a HIS. The difference in the mean WTP between those with and those without a HIS varied across countries. With regard to the temporal proximity of a HIS, the mean WTP was €55.25 among individuals whose most recent HIS occurred in the two weeks before the survey and €60.62 among individuals whose most recent HIS occurred in the three to four weeks before the survey. Among individuals whose most recent HIS occurred more than four weeks before the survey, the WTP was lower than that among participants with a more recent HIS (5–6 weeks: €44.81, 7–8 weeks: €43.64, > 8 weeks: €47.57, Table 2).
Table 2. Mean WTP per country and HIS status HIS (n = 3594) No HIS (n = 2215)Overall (N = 5809)Mean(in €)SD (in €)Median (in €)Mean(in €)SD (in €)Median (in €)T-test HIS vs. No HISMean(in €)SD (in €)Median (in €) Overall 54.12144.3335.5639.58144.1019.81.000248.58144.429.40Country Denmark (n = 765)66.3076.5551.6245.9160.8133.89.000160.3672.8743.01 France (n = 830)41.1342.5029.7237.46296.8311.89.804239.32210.4319.81 Germany (n = 696)70.5178.4152.2951.7792.3929.05.003960.0686.9240.67 Italy (n = 688)49.8960.7535.5633.6858.2917.78.001044.7560.4131.11 Netherlands (n = 668)74.92376.4237.7128.5035.4518.86.013157.26297.8631.43 Portugal (n = 703)30.9843.1521.7124.1927.1114.48.011728.8839.0220.99 Spain (n = 676)38.1640.9928.0035.6395.0512.04.736637.5259.3424.00 United Kingdom (n = 783)68.72117.1947.0448.0694.2129.40.006459.85108.3535.28Time since most recent HIS 0–2 weeks55.25161.8836.13 3–4 weeks60.62115.2743.01 5–6 weeks44.8160.6432.53 7–8 weeks43.6442.4831.43 More than 8 weeks47.5789.6230.11Degree of personal connection to COVID-19 cases Household60.2474.9143.56 Family55.99210.2636.16 Friends50.0267.6334.54 Colleagues47.6465.8634.67Severity of majority of COVID-19 cases known by participant Milder than expected38.2762.6224.00 A bit milder than expected50.8270.5134.86 As severe/mild as expected60.12254.3638.54 A bit more severe than expected69.3081.9354.22 More severe than expected66.7461.5057.90 Mixed, i.e., half of cases more severe, half of cases milder than expected45.74118.5024.44HIS– Health information shock, SD - Standard deviation
With regard to the degree of personal connection to COVID-19 cases, the differences in WTP among participants were small. Among those whose closest COVID-19 case was in the household, the WTP for a booster vaccination was €60.24, followed by a WTP of €55.99 if the closest case was in the family, €50.02 if it was among friends, and €47.64 if it was among colleagues. With regard to the severity of HIS, the mean WTP for those who reported that the severity of the majority of cases they heard of or experienced was milder than expected was €38.27, with those reporting higher severity also indicating a higher mean WTP (Table 2).
Regression results
The results of Model 1 show that HIS was associated with the WTP for a booster vaccination (Table 3), with the report of any HIS being associated with an increase in WTP of €14.54 compared to no HIS. In Model 2, our findings suggest that the total number of reported HIS and the square of this number were also associated with WTP, with the squared number of HIS indicating that an increasing number of HIS was associated with a decrease in WTP, but with a tipping point at approximately six times the maximally reportable number of HIS.
Table 3. Regression results model 1 and model 2Model 1Model 2LogisticGammaAMELogisticGammaAMEEst.SEp value95%CIEst.SEp value95%CIEst.Est.SEp value95%CIEst.SEp value95%CIEst.Intercept0.74(0.05)< 0.00010.65,0.834.07(0.07)< 0.00013.94,4.200.80(0.04)< 0.00010.72,0.884.01(0.05)< 0.00013.90,4.12HIS (Yes)0.80(0.06)< 0.00010.67,0.920.12(0.08)0.1493-0.04,0.2814.54No. Of HIS0.32(0.03)< 0.00010.26,0.370.08(0.03)0.00770.02,0.147.26No. Of HIS²-0.02(0.00)< 0.0001-0.02,-0.010.00(0.00)0.1779-0.01,0.00-0.39AME– Average marginal effect, Est.– Estimate, No.– Number, SE– Standard error
In Model 3, which considered the duration since the most recent HIS, the association of a HIS with WTP was positive and stronger if the HIS occurred in the four weeks before the survey (AME for zero to two weeks: €20.05; AME for three to four weeks: €29.20) compared to no HIS (logistic: P <.003 for all temporal proximity levels, gamma: P =.0492 for reporting having experienced a HIS three to four weeks before the survey and all other levels P >.05). Moreover, WTP was positively associated with the severity of HIS: compared to the WTP among those who reported the majority of cases as being as severe or as mild as expected, the WTP was lower among participants who reported the majority of COVID-19 cases as being milder (AME: €-19.81, logistic: P <.0001, gamma: P =.0248) than expected. Other levels of severity were not associated with the WTP (Table 4).
Table 4. Regression results model 3 and model 4Model 3Model 4LogisticGammaAMELogisticGammaAMEEst.SEp value95%CIEst.SEp value95%CIEst.Est.SEp value95%CIEst.SEp value95%CIEst.Intercept0.74(0.05)<.00010.65, 0.834.07(0.06)<.00013.94, 4.191.57(0.37)<.00010.84, 2.304.44(0.31)<.00013.83, 5.05No. Of HIS0.12(0.03)0.00010.06, 0.170.03(0.02)0.04010.00, 0.072.34Temporal proximity 0–2 weeks since HIS1.04(0.11)<.00010.83, 1.250.19(0.11)0.0953-0.03, 0.4120.050.50(0.16)0.00250.17, 0.82-0.03(0.10)0.8060-0.23, 0.181.92 3–4 weeks since HIS1.03(0.16)<.00010.71, 1.340.34(0.17)0.04920.00, 0.6829.200.55(0.21)0.00950.14, 0.970.10(0.13)0.4427-0.16, 0.368.95 5–6 weeks since HIS0.86(0.19)<.00010.48, 1.240.07(0.22)0.7437-0.35, 0.5012.200.39(0.25)0.1221-0.10, 0.88-0.16(0.16)0.3311-0.47, 0.16-4.60 7–8 weeks since HIS0.82(0.27)0.00220.29, 1.340.02(0.30)0.9359-0.56, 0.619.600.26(0.33)0.4365-0.40, 0.920.00(0.22)0.9976-0.42, 0.431.80 More than 8 weeks since HIS0.80(0.16)<.00010.48,1.110.12(0.18)0.5106-0.24, 0.4814.090.22(0.20)0.2882-0.18, 0.610.02(0.13)0.8997-0.25, 0.282.30 No HIS.....Severity of HIS Milder than expected-0.70(0.12)<.0001-0.93, -0.46-0.31(0.14)0.0248-0.57, -0.04-19.81-0.41(0.16)0.0093-0.71, -0.10-0.08(0.10)0.4451-0.27, 0.12-6.14 A bit milder than expected-0.05(0.14)0.7283-0.32, 0.22-0.16(0.14)0.2297-0.43, 0.10-7.99-0.03(0.17)0.8767-0.35, 0.300.01(0.10)0.8871-0.18, 0.210.53 As severe/mild as expected..... A bit more severe than expected0.21(0.16)0.1852-0.10, 0.530.12(0.15)0.4333-0.17, 0.408.180.36(0.19)0.0589-0.01, 0.730.05(0.11)0.6595-0.16, 0.264.53 More severe than expected0.09(0.18)0.6228-0.27, 0.450.10(0.17)0.5744-0.24, 0.445.980.39(0.23)0.0842-0.05, 0.830.06(0.13)0.6625-0.20, 0.325.23 Mixed, i.e. half more severe, half milder than expected-0.42(0.18)0.0193-0.78, -0.07-0.23(0.20)0.2649-0.62, 0.17-13.84-0.40(0.23)0.0798-0.84, 0.05-0.06(0.15)0.6679-0.35, 0.23-5.48 No HIS.....Female0.20(0.08)0.01800.03, 0.36-0.02(0.06)0.7070-0.13, 0.090.19Age 18–24 years old-0.43(0.19)0.0245-0.81, -0.060.22(0.14)0.1067-0.05, 0.489.36 25–34 years old-0.65(0.16)<.0001-0.96, -0.350.02(0.11)0.8248-0.18, 0.23-2.63 35–44 years old-0.64(0.15)<.0001-0.93, -0.350.02(0.10)0.8023-0.16, 0.21-2.48 45–54 years old-0.78(0.14)<.0001-1.05, -0.50-0.01(0.09)0.9420-0.18, 0.17-4.87 55–64 years old-0.24(0.15)0.1185-0.53, 0.06-0.04(0.09)0.6790-0.21, 0.13-2.95 65 years old and older..Education level High0.12(0.13)0.3525-0.13, 0.370.15(0.09)0.0940-0.03, 0.337.67 Middle-0.11(0.13)0.3819-0.36, 0.140.19(0.09)0.04230.01, 0.377.99 Low..Level of making ends meet Easily1.96(0.19)<.00011.59, 2.330.47(0.14)0.00110.19, 0.7537.82 Fairly easy1.45(0.15)<.00011.17, 1.740.16(0.13)0.2140-0.09, 0.4216.80 With some difficulty0.67(0.14)<.00010.40, 0.940.08(0.13)0.5511-0.18, 0.338.07 With great difficulty..Country Denmark-0.03(0.17)0.8505-0.37, 0.31-0.04(0.11)0.7088-0.27, 0.18-2.24 Spain-0.28(0.17)0.0870-0.61, 0.04-0.43(0.12)0.0002-0.66, -0.20-19.16 France-0.16(0.16)0.2942-0.47, 0.14-0.47(0.11)<.0001-0.69, -0.24-20.11 Italy0.43(0.18)0.01430.09, 0.78-0.36(0.11)0.0018-0.58, -0.13-13.40 Netherlands-0.29(0.16)0.0786-0.61, 0.03-0.02(0.12)0.8371-0.26, 0.21-3.02 Portugal1.12(0.20)<.00010.74, 1.51-0.80(0.12)<.0001-1.02, -0.57-25.96 United Kingdom-0.30(0.17)0.0697-0.63, 0.02-0.16(0.11)0.1528-0.38, 0.06-9.10 Germany..Health Problematization Index0.00(0.01)0.8937-0.03, 0.020.01(0.01)0.3697-0.01, 0.030.40Risk to own health from COVID-19 No risk at all-1.40(0.20)<.0001-1.78, -1.02-0.31(0.15)0.0393-0.60, -0.01-22.92 Little risk-0.66(0.16)<.0001-0.98, -0.34-0.05(0.11)0.6249-0.26, 0.15-7.03 Moderate risk-0.31(0.15)0.0397-0.61, -0.01-0.14(0.09)0.1313-0.33, 0.04-9.13 High risk-0.17(0.16)0.2864-0.49, 0.15-0.04(0.10)0.6767-0.23, 0.15-3.27 Very high risk..Risk aversion Very low.. Low-0.22(0.14)0.1226-0.50, 0.06-0.18(0.10)0.0572-0.37, 0.01-11.21 Moderately-0.36(0.16)0.0206-0.67, -0.06-0.15(0.11)0.1594-0.36, 0.06-10.43 High-0.53(0.11)<.0001-0.74, -0.32-0.29(0.07)0.0001-0.44, -0.15-17.95Vaccination status No-4.31(0.19)<.0001-4.68, -3.94-0.04(0.27)0.8767-0.58, 0.49-48.96 Not yet, but I intend to-2.24(0.25)<.0001-2.74, -1.75-0.30(0.29)0.3016-0.87, 0.27-32.86 Yes, the first shot-1.03(0.21)<.0001-1.44, -0.62-0.18(0.17)0.2835-0.50, 0.15-16.80 Yes, both shots-1.02(0.10)<.0001-1.22, -0.82-0.22(0.07)0.0010-0.36, -0.09-18.74 Yes, three shots (booster)..Peers' vaccination status Most0.44(0.26)0.0905-0.07,0.94-0.23(0.25)0.3541-0.73, 0.26-8.85 About half-0.24(0.28)0.3942-0.78,0.310.20(0.27)0.4494-0.32, 0.739.94 Just a few0.00(0.27)0.9925-0.54,0.530.10(0.26)0.7008-0.41, 0.615.73 None...AME– Average marginal effect, CI– Confidence Interval, Est.– Estimate, No.– Number, SE– Standard error
In Model 4, which included control variables, the significance and effect sizes mostly decreased for the duration since the most recent HIS and the severity of HIS. Compared to reporting having not experienced any HIS, reporting that the most recent HIS had occurred in the two weeks or in the three to four weeks before the survey increased the WTP for a booster vaccination by €1.92 (logistic: P =.0025, gamma: P =.8060) and by €8.95 (logistic: P =.0095, gamma: P =.4427), respectively. These results suggest that having experienced a HIS was associated with being willingness to pay, but not with the height of the WTP (conditional on being positive). If the HIS was reported to have occurred between five and eight weeks before the survey, compared to reporting not having experienced a HIS, the AME decreased (€-4.60 and €1.80, respectively, all P >.05). Again, the severity of HIS was negatively associated with being willing to pay if the HIS was reported as having been milder than expected (€-6.14, logistic: 0.0093, gamma: 0.4451) and positively if it was reported as having been a bit more severe (€4.53, logistic: 0.0589, gamma: 0.6595) or more severe than expected (€5.23, logistic: 0.0842, gamma: 0.6625) compared to those who reported that the HIS was as severe or as mild as expected.
Discussion
Main findings
When willingness-to-pay (WTP) exercises and other forms of contingent valuation are used to elicit population preferences, the timing of elicitation relative to a relevant event might be associated with the results. To investigate this issue, we analyzed whether recent health information shocks (HIS) were associated with WTP.
The results of our regression analyses suggest that HIS are indeed positively associated with WTP for a booster vaccination for COVID-19, especially during the first four weeks after a HIS. This association may decrease over time but could nonetheless persist over a longer period. Our results also suggest that the association between HIS and WTP was especially pronounced through increasing the probability of having a positive WTP (as observed in the logistic regression), more so than with the height of the WTP conditional on being positive.
When an individual receives news of a potential exposure in the recent past, it seems plausible that they might place a higher valuation on a preventive measure, such as a booster vaccination. However, we did not measure whether our participants indeed had contact with an infected person. Another explanation could be that participants might re-evaluate the risk of developing COVID-19 themselves and the consequences of contracting it. The fact that the WTP associated with a HIS that occurred from two to four weeks before the survey was higher than the WTP associated with a HIS that occurred from zero to two weeks before the survey might be related to the time it takes for severe symptoms and their consequences to develop.
Experiencing a health information shock, which can be perceived as a threat to one’s own health, might have a lasting consequence on individuals’ risk perceptions and thus their WTP preferences. This is supported by empirical findings from different fields. Evidence from the United States (US), for example, has shown that regional flood insurance purchases are highly correlated with the level of flood damage in the region during the prior year [42]. Similarly, Dave et al. (2020) examined risk perceptions of smoking e-cigarettes before and during an outbreak of e-cigarette or vaping-related lung injuries in the US in 2019 and 2020. They reported that risk perceptions decreased when participants received more information regarding the source of the outbreak, but not to pre-outbreak levels [24]. Other health shocks, like flu outbreaks, have been hypothesized to be associated with sustained changes in hygiene practices in developing countries [43]. Further evidence suggests similar longer-lasting effects [44].
Limitations
Our study has a number of important limitations related to its setting, sample, measurement, and analysis that must be considered when interpreting its results. First, as we use cross-sectional data here, no causal claim can be made based on our results. Further, latent mechanisms driving both HIS and the booster intention might contribute to the associations observed in this study. For instance, individuals with a higher fear of COVID-19 might have tested themselves and their social environment more often for the virus, thus experiencing more HIS, than individuals with a lower fear of COVID-19. While the variable risk to own health attempts to proxy for a fear of COVID-19, other latent variables may have influenced our results, e.g. personality traits.
Second, the Omicron variant of the coronavirus was starting to spread in Europe at the time of data collection. Official European institutions recommended that people should receive a booster shot around the end of 2021 [45–47]. While this highlights the relevance of looking at booster shots in our study, the status of the countries’ national booster campaigns as well as the media coverage differed at the time of data collection. For instance, 48.3 booster shots per 100 people were administered in the UK by the end of 2021 compared to 29.0 booster shots per 100 people in Italy [48]. Additionally, our sample contained a higher proportion of individuals who had received a booster shot than in the general population (except for the participants from Portugal). We accounted for these circumstances by including vaccination status at the individual level and country fixed-effects in Model 4 (see Online Resource for analysis of boosted and not boosted individuals separately). Participants who reported experiencing a HIS may have furthermore incorrectly assumed that they would enjoy immediate protection from a booster shot [49]. This may have resulted in overly high valuations of the booster shot compared to a situation in which people have better information about the real effects of booster vaccinations.
Third, the high share of protest answers in our sample suggests that a substantial number of participants more fundamentally rejected participating in the WTP exercise. In particular, this appeared to be related to respondents expecting or demanding that governments or health insurers should cover the costs of a booster vaccination. Given the abovementioned public efforts in booster campaigns, it might have been difficult for individuals to immerse themselves in the hypothetical setting, which counterfactually states no expected coverage by a third party. Importantly, the majority of protesters appeared to place a positive value on the booster vaccination given that they indicated that another entity should be responsible for covering the costs; this suggests that participants rejected the payment vehicle (i.e., the out-of-pocket payment) rather than the booster vaccination itself. Indeed, observed zero valuations of the good on offer can mean that participants are not willing to pay for the good because they do not associate value with it (i.e., ‘true zeros’), but could also mean that they are not willing to pay because they reject the scenario (i.e., ‘protest zeros’) [50–52]. Protesters are often excluded from samples before analysis [50, 51], which can lead to a loss of sample representativeness or to bias if protesters’ and non-protesters’ characteristics differ significantly [50]. In our study, subsample analyses suggested that the characteristics of protesters were fairly similar to those of non-protesters (i.e., the analyzed sample). We therefore chose not to opt for econometric techniques to correct for this [50]. Indeed, a sensitivity analysis including all protesters in the sample and assigning them a WTP of €0 revealed only minor variations in estimates and significance compared to Model 4 due to the two-part model’s separate handling of zeros and non-negative values (see Online Resource).
Fourth, in our dataset we could not distinguish between experiencing a health shock (i.e., a COVID-19 infection) oneself or within one’s household, thus, between two quite distinct situations. Also, it is important to emphasize that we chose not to incorporate the degree of personal connection as a variable in our final models because the model selection criteria suggested that there was higher model complexity when including the variable but only minimal information gain.
Finally, we chose to examine the most recent HIS in the analysis because we assumed that this shock was the most relevant for the valuation of the booster shot as a preventive countermeasure. Furthermore, we controlled for the number of HIS as a covariate. Some individuals expressed having experienced multiple HIS in our survey. In these cases, we did not measure the severity of each HIS separately but rather asked the participants to state the severity of the majority of HIS they experienced among people they know (including themselves). When we excluded individuals who experienced multiple HIS, the peak in the increase in WTP for those experiencing the HIS three to four weeks before the elicitation exercise was approximately €5 lower, and the association of the severity of HIS with the WTP was lower.
Implications
Although WTP is a well-established instrument in health economics, methodological challenges remain. Our results suggest that recent health information that is relevant to the goods being valued can be associated with having a positive WTP in certain cases in the short term, especially by serving as a ‘nudge’ to decide if these goods are worth paying for. Researchers and policymakers may therefore wish to consider the timing of valuation exercises as well as how this relates to potential HIS. Finding the optimal point in time to measure WTP is difficult and may depend on the policy question under consideration, so that the optimal point in general may not exist. Given our findings, researchers may wish to elicit information about HIS in situations where they are likely to occur, aiding the interpretation of their findings.
From a population perspective, the probability of relevant HIS occurring may differ depending on the disease being studied. For example, the prevalence of diabetes mellitus among adults in Europe is high [53], so the probability of experiencing a HIS due to someone or oneself being diagnosed with diabetes or experiencing consequences of the disease may be comparatively high as well [54]. In contrast, the probability of experiencing a HIS related to rare conditions may, by definition, be considerably lower. If WTP values differ because the frequency of HIS varies depending on the disease, policy makers may wish to consider potential distributional consequences in their subsequent decision making.
Conclusion
We found that timing may matter when measuring WTP because relevant events, like health information shocks (HIS), may be associated with WTP. In our study, HIS appeared especially related to the probability of having a positive WTP (i.e., more people willing to pay for a booster) and less with the height of the WTP conditional on being willing to pay. Moreover, the association of HIS with WTP was especially visible in the short term but may also persist over the long term. Our findings suggest that researchers and policymakers should be aware of potential HIS when eliciting and interpreting results obtained through WTP exercises and other forms of contingent valuation.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Supplementary Material 1
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Our World in Data: Cumulative confirmed COVID-19 cases. Data source: World Health Organization COVID-19 Dashboard: (2023). https://ourworldindata.org/explorers/coronavirus-data-explorer?zoom To Selection=true%26;time=2021-12-22.2022-01-11%26;facet=none%26;picker Sort=desc%26;picker Metric=new_cases_smoothed_per_million%26;Metric=Confirmed+cases%26;Interval=Cumulative%26;Relative+to+Population=true%26;Color+by+test+positivity=false%26;country=GBR~DEU~FRA~ITA~NLD~ESP~DNK. Accessed 23 Aug 2023
- 2Our World in Data: SARS-Co V-2 variants in analyzed sequences: Data source: GISAID, via Co Variants.org: (2024). https://ourworldindata.org/grapher/covid-variants-area?time=2021-12-20.2022-01-17%26;country=GBR~DNK~FRA~DEU~ITA~NLD~ESP. Accessed 17 Apr 2024
- 3Sabat, I., Neumann-Böhme, S., Pita Barros, P., Brinkmann, C., Brouwer, W., van Exel, J., et al.: The European C Ovid Survey (ECOS): Technical Report (2024). https://www.hche.uni-hamburg.de/dokumente/research-papers/rp 30-ecos-technical-paper.pdf. Accessed 17 Apr 2024
- 4Zhang, C., Conrad, F.: Speeding in web surveys: The tendency to answer very fast and its association with straightlining. Surv. Res. Methods 8 (2014)
- 5Our World in Data: COVID-19 vaccine boosters administered per 100 people: (2022). https://ourworldindata.org/grapher/covid-vaccine-booster-doses-per-capita?time=2021-12-24.2022-01-11%26;country=DEU~GBR~ESP~PRT~NLD~ITA~DNK~FRA. Accessed 25 Oct 2022
- 6Sendi, P., Ramadani, A., Bornstein, M.M.: Prevalence of missing values and protest zeros in contingent valuation in dental medicine. Int. J. Environ. Res. Public. Health 18 (2021)10.3390/ijerph 18147219 PMC 830761134299670 · doi ↗ · pubmed ↗
- 7International Diabetes Foundation: IDF Diabetes Atlas: Europe: (2019). https://www.diabetesatlas.org/data/upload/download/eur_factsheet_en.pdf. Accessed 28 Oct 2022
