The temporal protection and declining health of the COVID-19 vaccinated in England: A 26-month comparison of the mortality involving and not involving COVID-19 among vaccinated vs. unvaccinated
Jarle Aarstad, Gregory Barnsley, Jarle Aarstad, Mario Coccia, Jarle Aarstad

TL;DR
The study compares mortality rates in vaccinated and unvaccinated people in England over 26 months, finding temporary protection from vaccination but higher non-COVID mortality later.
Contribution
A novel approach to compare vaccinated and unvaccinated groups by analyzing all-cause and non-COVID mortality differences over time.
Findings
All-cause mortality was initially higher in unvaccinated individuals but showed similar patterns for non-COVID mortality.
Vaccinated individuals experienced significant protection between July 2021 and January 2022.
Later, vaccinated individuals had a relative increase in non-COVID mortality compared to unvaccinated individuals.
Abstract
Comparing non-randomized groups, such as COVID-19 vaccinated and unvaccinated, even in the presence of seemingly relevant control variables, is challenging, but in this study, using English data, I show an achievable approach. First, I estimated age-standardized all-cause mortality among COVID-19 vaccinated and unvaccinated ten years and older, covering a 26-month period from Apr 21 to May 23. Then, I estimated mortality not involving COVID-19, and finally, I differentiated the calculations. First, I found that all-cause mortality among COVID-19 unvaccinated was higher than among vaccinated. But as the pattern was similar concerning mortality not involving COVID-19, the discrepancy is attributed mainly to unvaccinated having inferior health at the outset. There was nonetheless significant protection for vaccinated between July 21 and Jan 22. Absent of control variables as a means to…
Genes, proteins, chemicals, diseases, species, mutations and cell lines named across the full text — each resolved to its canonical identifier and authoritative record.
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCOVID-19 Clinical Research Studies · SARS-CoV-2 and COVID-19 Research · COVID-19 and healthcare impacts
Introduction
According to the UK Office for National Statistics, ^ 1 ^ rates for COVID-19 unvaccinated adults in England “were higher for Black Caribbean, Black African and White Other ethnic groups. Rates were also higher for those living in deprived areas, who have never worked or are long-term unemployed, who are limited a lot by a disability, … or who are male.” The statement indicates that unvaccinated have inferior health at the outset than vaccinated, inducing biased comparisons as the groups are not randomly assigned. Therefore, matching, balancing, ^ 2 ^ or controlling for potential confounders, e.g., ethnicity, employment-, disability-, socioeconomic status, and gender may debias the results. ^ 3 ^ However, variables accounting for potentially confounding effects are often unavailable or unknown, and including those available but unknowingly improper can increase bias. ^ 4 ^ In line with the reasoning, York (Ref. 4, p. 675) showed that “unless all potential confounding factors are included in an analysis (which is unlikely to be achievable with most real-world data-sets), adding control variables to a model in many circumstances can make estimated effects … less accurate.”
Due to the addressed issues, comparing non-randomized groups, such as COVID-19 vaccinated and unvaccinated, even in the presence of seemingly relevant control variables, is challenging, but in this study, using English data, ^ 5 ^ I show an achievable approach. Initially, I (i) estimated age-standardized all-cause mortality among COVID-19 vaccinated and unvaccinated ten years and older, covering a 26-month period from Apr 21 to May 23. Then, I (ii) estimated mortality not involving COVID-19, and finally, using xlincom,
^ 6 ^ an extension of Stata’s ^ 7 ^ lincom algorithm, I differentiated the results of (i) and (ii). As all-cause mortality estimates include cases involving COVID-19, I show that differentiating those from estimates not involving COVID-19 cases can identify potentially genuine effects of vaccination between populations with different health statuses at the outset.
Research has indicated that COVID-19 vaccination can prevent mortality, ^ 8– 11 ^ but the effect declines. ^ 12 ^ Applying my approach to the English data, I show how the results converge with the other studies.
Methods
I used publicly available data on the population in England ten years and older provided by the UK Office for National Statistics ^ 5 ^ for this study. Particularly, I analyzed their data on monthly age-standardized mortality by vaccination status and classification of deaths involving and not involving COVID-19. ^ 13, 14 ^ The period for which data were available and included in this study was between Apr 21 and May 23, 26 months.
To exemplify, in Apr 21, the age-standardized all-cause mortality rate among “ever vaccinated”, defined as vaccinated in this study, was 812.7 per 100,000 person-years, which were 2,124,523 that month. ^ 5 ^ The expression (812.7/100,000)*2,124,523 gives 17,266 estimated deaths in an estimated population of 25,494,276, which was reached by multiplying 2,124,523 by 12. I.e., the age-standardized all-cause mortality probability among vaccinated in Apr 21 was 17,266 divided by 25,494,276, taking the value of.068 percent. Similar estimations of all-cause mortality, mortality involving and not involving COVID-19, were carried out each month for vaccinated and unvaccinated.
The data were applied in logistic regressions using Stata 17, ^ 7 ^ followed by probability estimations using the margins effect command ^ 15 ^ and estimations with odds ratios (ORs). Concerning OR estimations, I particularly explain and show below how the xlincom algorithm, ^ 6 ^ an extension of Stata’s ^ 7 ^ lincom algorithm, was used to differentiate log odds (the logarithm of the ORs) estimates. Also, I explain the substantial interpretation of differentiated estimates.
Results
Here, I first present the empirical results of age-standardized mortality probabilities among vaccinated and unvaccinated ten years and older, shown in Figure 1. Aided by odds ratios (ORs) calculations shown in Figure 2, I then address the results’ substantial interpretation.
Monthly mortality probabilities in percent with 95% CIs.
Monthly ORs of mortality with 95% CIs.
Initial mortality probability analyses
Figure 1A shows that the all-cause mortality probability, particularly at the beginning of the period, was higher among unvaccinated than vaccinated. The mortality decreased among the unvaccinated, but among the vaccinated, it was relatively stable or had a slight increase. Consequently, the mortality among unvaccinated and vaccinated almost was tangent at the end of the period.
Figure 1B shows that the mortality probability not involving COVID-19 was similar to the all-cause mortality probability ( Figure 1A), except for a lower rate among unvaccinated between the last half of 21 and the beginning of 22. Figures 1C1 and 1C2, identical except for different scaling, show that the mortality probability involving COVID-19 was higher among unvaccinated than vaccinated, particularly between the last part of 21 and the beginning of 22.
An interpretation of Figure 1A can be that the vaccinated had a temporal but declining mortality protection, which aligns with previous research. ^ 12 ^ But as the pattern was similar concerning mortality not involving COVID-19 ( Figure 1B), the difference can alternatively be attributed to unvaccinated having inferior health at the outset. ^ 1 ^ The reason for the latter assumption is that there is no logical explanation as to how vaccination can prevent mortality that does not involve COVID-19. ^ 16 ^
Odds Ratio analyses
To gain more knowledge about the above issues, Figure 2A shows ORs of all-cause mortality and mortality not involving COVID-19 among unvaccinated compared to vaccinated as a reference group [ 1]. At the beginning of the period, the ORs of mortality among unvaccinated were about 2 and 2,5 compared to vaccinated, and significant (95% CIs). A similar pattern concerning all-cause mortality and mortality not involving COVID-19 indicates that vaccination did not have a preventive effect (as it logically cannot have a preventive effect against mortality not involving COVID-19). However, between the last half of 21 and the beginning of 22, the ORs were higher for all-cause mortality than for mortality not involving COVID-19, which indicates a temporal preventive vaccine effect.
Figure 2B adds further information showing that ORs of all-cause mortality compared to mortality not involving COVID-19 between July 21 and Jan 22 were significant (95% CIs), with most values above 1.2. The results were reached by using Stata’s ^ 7 ^ xlincom algorithm ^ 6 ^ first to differentiate the log odds (the logarithm of the ORs) of estimates reported in Figure 2A, and next generate the new ORs from the differentiated log odds [ 2]. Accordingly, a conclusion so far is that vaccinated were significantly (CIs 95%) protected between July 21 and Jan 22 [ 3].
How Odds Ratios and probability analyses indicate declining health among vaccinated
Figure 2D shows that while mortality not involving COVID-19 decreased among unvaccinated compared to the first observation month, it was high among vaccinated [ 4]. The results reflect mortality probabilities in Figure 1B, which were almost tangent at the end of the period. Also, they reflect the declining ORs of unvaccinated reported in Figure 2A, taking a non-significant value of a little over 1 at the end (95% CI). Hence, the data show a relatively high and relative increase in mortality not involving COVID-19 among vaccinated. An interpretation is that vaccination, despite temporary protection, increased mortality. ^ 16 ^ Strengthening the interpretation was relatively high mortality among vaccinated not involving COVID-19 counterintuitively following periods of excess mortality ( Figure 3) [ 5]. Further strengthening the interpretation was the relatively high mortality rate not involving COVID-19 among the vaccinated corresponding with the excess mortality rate during the same period (ibid.) [ 6].
Weekly UK excess mortality in percent and cumulative excess mortality.
Discussion
This study, describing and using an approach to compare non-randomized groups absent of control variables, found that COVID-19 vaccination temporally protected against mortality, which aligns with other research. ^ 8– 12 ^ A further interpretation of the data, nonetheless, indicated that COVID-19 vaccination, despite temporary protection, increased mortality. ^ 16 ^ It also aligns with other research suggesting that COVID-19 vaccination can have adverse effects ^ 17– 19 ^ and increase mortality. ^ 20 ^
During the study period, a share of people in the unvaccinated group were transferred to the vaccinated. Assuming they had inferior health status at the outset, it may explain the relative increase (decrease) in mortality among the vaccinated (unvaccinated). However, those who remained unvaccinated, on the contrary, had inferior health status at the outset, ^ 1 ^ making the above reasoning implausible. Ceteris paribus, one may even oppositely conclude that it would decrease (increase) relative mortality among vaccinated (unvaccinated) [ 7]. Since most elderly candidates had been offered vaccine before Apr 21, ^ 1, 21 ^ I nonetheless assume the estimates were not substantially skewed over the study period, as relatively few people die in younger age cohorts.
The study’s validity hinges on non-systematic skewness in classifying false positives concerning mortality involving COVID-19 and false negatives concerning mortality not involving COVID-19. However, I cannot see any substantial reason for substantial skewness in false positives and negatives between vaccinated and unvaccinated, but it may induce some cautiousness when interpreting the data.
This study included those ten years and older. I, therefore, encourage future research to analyze different age cohorts separately to assess how findings may converge or eventually diverge. As this study merely distinguished between those vaccinated and those who were not, I also encourage future research to distinguish between those who received one or more doses and different vaccine types, although it may be methodologically challenging.
Ethics and consent
Ethical approval and consent were not required.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1UK Office for National Statistics. Coronavirus (COVID-19) latest insights: Vaccines 2023. Reference Source
- 2King G Nielsen R : Why Propensity Scores Should Not Be Used for Matching. Polit. Anal. 2019;27(4):435–454. 10.1017/pan.2019.11 · doi ↗
- 3Wysocki AC Lawson KM Rhemtulla M : Statistical Control Requires Causal Justification. Adv. Methods Pract. Psychol. Sci. 2022;5(2):25152459221095823. 10.1177/25152459221095823 · doi ↗
- 4York R : Control variables and causal inference: a question of balance. Int. J. Soc. Res. Methodol. 2018;21(6):675–684. 10.1080/13645579.2018.1468730 · doi ↗
- 5UK Office for National Statistics: Deaths by vaccination status, England 2023. Reference Source
- 6Wakker W : XLINCOM: Stata module to estimate multiple linear combinations of parameters. 2023.
- 7Stata Corp. Version 17. College Station, TX: Stata Corp LP;2021.
- 8Lopez-Doriga Ruiz P Gunnes N Michael Gran J : Short-term safety of COVID-19 m RNA vaccines with respect to all-cause mortality in the older population in Norway. Vaccine. 2023;41(2):323–332. 10.1016/j.vaccine.2022.10.085 36376216 PMC 9637531 · doi ↗ · pubmed ↗
