Attending physicians’ annual service volume and use of virtual end-of-life care: A population-based cohort study in Ontario, Canada
Rebecca Rodin, Thérèse A. Stukel, Hannah Chung, Chaim M. Bell, Allan S. Detsky, Sarina Isenberg, Kieran L. Quinn, Masoud Behzadifar, Masoud Behzadifar, Masoud Behzadifar

TL;DR
This study examines how physicians' annual service volume relates to their use of virtual end-of-life care in Ontario, Canada, before and during the pandemic.
Contribution
The study identifies physicians' service volume as a novel factor associated with virtual end-of-life care use.
Findings
High service volume physicians were more likely to use virtual end-of-life care pre-pandemic.
The association between service volume and virtual care use diminished during the pandemic.
Physicians accounted for significant variation in virtual EOLC use pre-pandemic.
Abstract
Physicians and their practice behaviors influence access to healthcare and may represent potentially modifiable targets for practice-changing interventions. Use of virtual care at the end-of-life significantly increased during the COVID-19 pandemic, but its association with physician practice behaviors, (e.g., annual service volume) is unknown. Measure the association of physicians’ annual service volume with their use of virtual end-of-life care (EOLC) and the magnitude of physician-attributable variation in its use, before and during the pandemic. Population-based cohort study using administrative data of all physicians in Ontario, Canada who cared for adults in the last 90 days of life between 01/25/2018-12/31/2021. Multivariable modified Poisson regression models measured the association between attending physicians’ use of virtual EOLC and their annual service volume. We…
Genes, proteins, chemicals, diseases, species, mutations and cell lines named across the full text — each resolved to its canonical identifier and authoritative record.
Click any figure to enlarge with its caption.
Fig 1
Fig 2- —http://dx.doi.org/10.13039/501100000024Canadian Institutes of Health Research
- —Mount Sinai Hospital-University Health Network AMO Innovation Fund, and Health Canada, Health Care Policy and Strategies Program
- —Ontario Ministry of Health and the Ministry of Long-Term Care
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCOVID-19 and healthcare impacts · Telemedicine and Telehealth Implementation · Patient Satisfaction in Healthcare
Introduction
Physician practice behavior is an important determinant of health outcomes and patients’ access to clinical care [1–6]. Such behavior may be influenced by physician characteristics, training, practice guidelines, available resources, and financial incentives [7–9]. During the COVID-19 pandemic, virtual care rapidly expanded in Ontario via introduction of new physician fee codes on March 14, 2020, which reimbursed physician delivery of video- and telephone-based virtual care, including end-of-life care (EOLC). Virtual care has the potential to expand healthcare access, improve convenience and satisfaction with care, and reduce costs through improved clinical efficiency (e.g., reduced visit length, fewer no-shows, increased on-time appointments) [10–16]. Virtual visits may be uniquely beneficial for patients near the end of life, for whom mobility outside the home and access to in-person home visiting physicians may be limited [17]. However, the optimal balance of virtual and in-person care remains to be determined.
Health systems may seek interventions to modulate use of virtual EOLC to better achieve such balance. Doing so requires measures that are easily applied and correlated with the use of virtual EOLC. While some patient-level factors, such as age [18], socioeconomic status [19], and frailty [20], may contribute to virtual EOLC use, access to this care remains largely dependent on physician providers. Physicians’ use of virtual EOLC is potentially modifiable; their practice behaviors or other characteristics (e.g., age, sex, years in training, specialty) may be effective screening measures that predict which physicians are more or less likely to use virtual EOLC and therefore the most appropriate targets for intervention. At present, little is known about the extent to which such physician-level factors influence the use of this innovative EOLC delivery model.
Prior research demonstrated that physician practice behaviors, such as their annual referral rate to palliative care, was associated with their patients’ subsequent use of palliative care and dying at home [2]. The Diffusion of Innovation Theory holds that some people are more apt to adopt a new technology than others (e.g., ‘early adopters’ versus ‘laggards’), in part, because of the former’s greater need for such change [21]. Physicians with high service volume may be more likely to utilize a novel clinical delivery model, such as virtual EOLC, because of an expectation that it would improve clinical efficiency, allowing physicians to see a greater number of their patients each day [10–13]. Virtual EOLC has the potential to improve health outcomes, expand the pool of palliative care providers, and increase access to care where and when patients need it [14–16]. Conversely, overly broad use may result in unnecessary care delivery, thereby increasing overall healthcare costs [15, 22]. As a potential surrogate measure of virtual EOLC utilization, physicians’ annual service volume (i.e., the number of patient visits per year) may serve as a feasible measure to identify physicians who should be targeted for interventions to modulate their virtual EOLC use. To date, no studies have measured the association of a physician’s annual service volume with their use of virtual EOLC.
The objective of this study was to examine whether attending physicians’ annual service volume is associated with the use of virtual EOLC. We measured the magnitude of that variation, how it changed before and during the pandemic, and quantified the variation in use of virtual EOLC attributable to physicians. We hypothesized that physicians with high annual service volumes would be more likely to delivery virtual EOLC to their patients than those with low annual service volumes.
Methods
Study design and setting
We used health administrative data to conduct a population-based cohort study of physicians in Ontario, Canada who provided care to adults in the last 90 days of life. These datasets were linked using unique encoded identifiers and analyzed at ICES (formerly the Institute for Clinical and Evaluative Sciences). ICES houses a vast and secure array of large, linkable and coded health-related databases including administrative and demographic datasets, population-based surveys, disease registries and electronic medical records, as well as a growing number of other non-health administrative data. The description of linked ICES datasets has been provided in S1 Table.
The Mount Sinai Research Ethics Board granted a waiver of consent for this study. ICES is a prescribed entity under Ontario’s Personal Health Information Protection Act (PHIPA). Section 45 of PHIPA authorizes ICES to collect personal health information, without consent, for the purpose of analysis or compiling statistical information with respect to the management of, evaluation or monitoring of the allocation of resources to or planning for all or part of the health system. Projects that use data collected by ICES under section 45 of PHIPA, and use no other data, are exempt from REB review. The use of the data in this project is authorized under section 45 and approved by ICES’ Privacy and Legal Office.
Ontario is the most populous province, with nearly 15 million residents, and provides universal access to hospital care and medically necessary physician services to all residents. These data were linked using encoded identifiers and analyzed at ICES, which have been used in multiple prior studies evaluating EOLC delivery in Ontario [2, 23–26].
Study participants
Our study cohort included all attending physicians in Ontario who were most responsible for providing care to adults (≥18 years old) in the last 90 days of life who died from any cause over a 3-year period between January 25, 2018, and December 31, 2021. An attending physician was defined as the physician who provided the greatest number of outpatient visits for that person in the year prior to their index date, or who rostered that person as part of a primary care team. Each person had one unique attending physician.
The observation period was the last 90 days of life, beginning at an index date 90 days before death for each person. To partially disentangle the effects of the pandemic from those associated with physician service volume, we studied the periods before and during the pandemic–specifically, before and after March 14, 2020, when new specialized fee codes were introduced to enable virtual care during the pandemic. Physicians were grouped according to whether the care they provided to people in the last 90 days of life occurred before or after the introduction of specialized virtual fee codes on March 14, 2020.
We excluded people who were hospitalized for the entire observation period and those who resided in a nursing home as of the index date, as these individuals may have had limited or no access to virtual care. We also excluded individuals who had no outpatient visits in the last year of life and had not been rostered by a family physician in the last two years of life, as these individuals may be more likely to have died due to sudden, traumatic, or accidental causes, rather than due to a serious illness requiring physician care near the end of life.
Study measures and outcomes
All variables were obtained using records from the ICES database (S1 Table). We measured physician-level characteristics, including age, sex, graduation from a Canadian versus foreign medical school, specialty, status as a palliative care specialist, years in practice, rural practice setting, number of patients and visits in the preceding year, volume of virtual and non-virtual service fee claims for the assigned patient between index date and death, volume of total physician service fee claims in the year prior to the assigned index date, and number of end-of-life visits provided in the year prior to index date. Status as a palliative care specialist was determined using a validated method with a sensitivity of 76.0% and specificity of 97.8% [27].
We also measured the characteristics of their assigned patients in terms of demographic and clinical variables, including age, sex, neighborhood income quintile, location of residence (rural and home/community service networks known as LHINs), surname-based ethnicity [28], comorbidities and chronic conditions [29], Hospital Frailty Index scores [30], recent healthcare use (receipt of palliative care before the last 90 days of life, number of medications, emergency department visits, hospitalizations, and receipt of homecare services in past year) and year of death. The Hospital Frailty Index score is a comprehensive measure of a person’s comorbidity that reflects global illness severity; this score predicts greater risk of adverse outcomes, including hospitalization and 30-day mortality [30].
The main exposure was the annual service volume of a person’s attending physician in the year prior to their index date. The annual service volume is defined as the number of patient visits provided by a physician each year. This was measured for each physician using the number of outpatient visits the attending physician provided to all patients in the year prior to their assigned patient’s index date. We then categorized physicians into percentiles based on their relative annual service volume (“low” [bottom 25%], “high” [top 25%], and “average” [volumes within 25–75%]). We focused on comparing physicians with high vs. low annual service volume because these groups were expected to have the greatest relative difference in outcomes and efforts to modify physician behaviors, such as audit and feedback, are most effective when targeted to physicians with practice patterns at the extremes [31].
The primary outcome was the use of virtual EOLC, defined as ≥1 virtual care visit by an attending physician to their patient in the last 90 days of life. Prior to the pandemic, the only virtual care reimbursed by the universal healthcare plan in Ontario, Canada was for a maximum of two telephone encounters per week, or for specific video-based encounters that required patients to travel to an authorized center. During the pandemic, new specialized fee codes were introduced that reimbursed all video- and telephone-based encounters occurring anywhere within the province, including from a patient’s home. We also measured the proportion of variation in use of virtual EOLC attributable to physicians. The secondary outcomes were: 1) the number of unique visits of any kind provided by an attending physician to their assigned patient during the last 90 days of life; 2) the number of unique virtual visits provided by an attending physician to their assigned patient during the last 90 days of life; and 3) the proportion of virtual visits to total unique visits provided by the attending physician to their assigned patient from index date to death.
Data analysis
Modified Poisson regression was used to measure the association (relative risk) between the use of end-of-life virtual care by attending physicians for their patients and the annual service volume of those physicians, accounting for clustering of people within the same physician. We stratified these analyses by time period before and during the pandemic in order account for the widespread changes in healthcare utilization that occurred during the pandemic. Covariates included in the analytic models were chosen as potential confounders based on the clinical and research expertise of our team, including those that were imbalanced based on a measured standardized differences (SD) assessed at index date of >0.1 [32]. For example, the inclusion of physician age, sex, and specialty as covariates was based on studies showing that younger, female physicians in primary practice care for a fewer number of patients than physicians who are older, male, and specialized; and so these variables may confound measures of annual service volume [33, 34]. For each regression model, we calculated the variance partition coefficient (VPC), which measures the proportion of the variation in use of virtual EOLC that is attributable to physicians. All analyses were performed using SAS version 9.4 (SAS Institute, Cary, North Carolina).
Results
Characteristics of study participants
We included 35,825 unique attending physicians who were paired with 315,494 adults who died during the study period. Prior to the pandemic, there were 18,335 attending physicians, of whom 7,434 (41%) were low, 8,099 (44%) average, and 2,802 (15%) high volume providers. During the pandemic, there were 17,490 attending physicians, of whom 7,876 (45%) were low, 7,221 (41%) average, and 2,393 (14%) high volume providers (Table 1; S2 Table). Among the 315,494 patients in the study, there were 77,826 (25%) people paired with low annual service volume physicians, 158,068 (50%) people paired with average annual service volume physicians, and 79,600 (25%) people paired with high annual service volume physicians (Fig 1).
Creation of the study cohort.
Table 1: Baseline physician characteristics according to annual service volume before and during the pandemic.
Within each period, a greater proportion of high compared to low annual volume physicians were male, trained in family medicine, practiced in urban areas, graduated from an international medical school, and, by definition, conducted more patient visits per year (Table 1; S2 Table). The magnitude of these differences were not different before and during the pandemic. The characteristics of the people cared for by each attending physician in each period is shown in S3 Table.
Changes in virtual EOLC by physician annual service volume
Before the pandemic, 4.3% of people cared for by high volume attending physicians and 4.2% of people cared for by low volume attending physicians received at least 1 virtual EOLC visit. During the pandemic, these proportions rose to 58% and 52%, respectively (Table 2). After adjusting for physician- and patient-level characteristics, use of virtual EOLC was associated with receiving care from a high compared to low volume attending physician, though the magnitude of this association diminished during the pandemic (adjusted RR 1.25 [95% CI 1.14, 1.37] pre-pandemic and 1.10 [95% CI 1.08, 1.12] during the pandemic; Table 2). This was also observed for people with high compared to average volume physicians (adjusted RR 1.20 [95% CI 1.11, 1.30] pre-pandemic and 1.02 [95% CI 1.00, 1.03] during the pandemic; Table 2). Overall, the increase in EOLC during the pandemic included a nearly 20-fold increase in the proportion of EOLC visits that occurred virtually (Table 3). Measurement of the VPC showed that physicians accounted for 36% of the variation in use of virtual EOLC in the pre-pandemic period and 12% of this variation during the pandemic (Fig 2).
Primary analysis.Forest plot of the adjusted relative risk of the association between attending physicians’ annual service volume with the use of virtual end-of-life care for the pre-March 14, 2020 (blue squares) and post-March 14, 2020 (red circles) groups. The variance partition coefficient (VPC) estimated the magnitude of physician-attributable variation in the use of virtual end-of-life care.
Table 2: Association between attending physician service volume and use of virtual EOLC to assigned patients according to time period before and during the pandemic.
Table 3: Delivery of virtual and non-virtual care by a person’s attending physician in the last 90 days of life according to annual physician service volume, before and during the pandemic.
Changes in any EOLC by physician annual service volume
The delivery of any EOLC visits (in-person or virtual) by an attending physician increased in a similar manner to virtual EOLC according to annual physician service volume (Table 3). The delivery of unique EOLC visits of any kind increased during the pandemic, with high compared to low volume physicians delivering more EOLC visits to their assigned patients (2.2 vs. 1.92 visits pre-pandemic; 3.08 vs. 2.18 visits during the pandemic) (Table 3).
Discussion
This population-based study of 35,825 attending physicians most responsible for the care of 315,494 adults at the end of life measured the association between annual physician service volume and the use of virtual EOLC. We found that attending physicians with a high annual service volume were significantly more likely to use virtual EOLC compared to attending physicians with a low annual service volume. The magnitude of this association was attenuated during the pandemic. Further analysis demonstrated that attending physicians accounted for a significant proportion of the variation in the use of virtual EOLC. Taken together, these findings suggest that physician practice behavior (specifically, their annual service volume) and attending physicians themselves play a significant role in the use of virtual EOLC.
The present findings are consistent with prior work showing the impact of physician practice behaviors on clinical care, such as referral to palliative care [1, 4, 23, 35–37]. While patients accounted for most of the variation in receipt of virtual EOLC across both time periods, a substantial proportion remained attributable to physicians. Therefore, physicians may present modifiable targets for interventions to effect practice change in the use of virtual EOLC, which may include targeted audit and feedback, education, financial, and policy initiatives [31, 38].
The findings in this study suggest that annual service volume may be an easy and feasible method for identifying physicians most likely to respond to such targeted efforts to either increase or decrease their use of virtual EOL. At present, little is known about the quality, efficacy, and effectiveness of virtual EOLC, its impact on healthcare outcomes, and the optimal balance of in-person and virtual visits. Most research on virtual care was conducted before the onset of the COVID-19 pandemic, when virtual care was sparingly utilized [16, 39–42]. Recently published research in this domain has yielded inconsistent results, with some studies showing that an overreliance on virtual care is associated with increased healthcare utilization, including repeat virtual or in-person visits, hospitalizations, and emergency department visits [22, 43–45]. Other studies found no such association or mixed results, in addition to high patient satisfaction with virtual care [46–50], and public polling indicates that people want continued access to virtual care, particularly for chronic and non-urgent issues [51]. Ongoing efforts to establish the optimal balance of virtual and in-person EOLC can inform physician-targeted interventions to modulate its use, either by increasing or decreasing utilization of such care.
Strengths of this study include its use of a large, population-based sample that minimizes selection bias and the inclusion of a diverse sample of physicians who provided care near the end of life. The massive shift to virtual care delivery during the pandemic due to restrictions on in-person care allowed for the study of virtual EOLC utilization across an entire health system. Further, the relative stability of our sample characteristics before and during the pandemic minimizes the likelihood that our findings are confounded by changes in the types of physicians and patients utilizing virtual EOLC during the pandemic.
Our study also has limitations. First, we did not measure individual patient preferences and their ability to engage in virtual EOLC. Many patients still prefer virtual care, or desire it as a supplement to in-person care, in multiple circumstances including near end-of-life [17, 52], although others may be less able or willing to access virtual EOLC [53–55]. Second, the observational design of our study limits our understanding of the causal mechanisms related to our primary findings, which could be partly related to shifts in healthcare delivery during the pandemic. We explored this potential confounding bias by measuring the magnitude of the effects in the pre-pandemic and pandemic periods. The attenuated magnitude of our findings during the pandemic suggests that changes in healthcare delivery during the pandemic may have also had an important effect on virtual EOLC utilization. Third, we lacked information on the nature and quality of care delivered for each virtual EOLC visit, such as whether it focused primarily on palliative and supportive needs or acute or chronic medical management. Specialized fee codes for palliative-specific virtual care were not introduced in Ontario until January 2021, after data collection for this study was completed. Further research is needed to examine the impact of these palliative-specific virtual billing codes on overall end-of-life-care delivery. Fourth, selection bias may have arisen due to the inclusion of physicians who treat people near the end of life, but not of physicians who only treat people earlier in the course of illness. While these characteristics may affect the likelihood to use virtual care technology, this potential bias was mitigated by including a diverse sample of physicians across the health system. Fifth, the study findings may vary according to physician specialty, which we did not specifically examine, and may affect its generalizability, despite adjustment for physicians’ status as either a primary care physician, palliative or other specialist in our analytic models. Sixth, this study focused exclusively on end-of-life care in Ontario, Canada, so generalizability to other domains of care or to other health systems is not yet known.
Future research is needed to develop and evaluate physician-targeted interventions to effect practice change among physicians to either expand or restrict their utilization of virtual EOLC depending on the desired outcome. Policy-makers and health systems developing such interventions may utilize measures of physicians’ annual service volume to identify the physicians most suitable for these interventions, as such measures are easily applied and correlated with virtual EOLC utilization.
Conclusions
Physician practice behavior, as reflected by attending physicians’ annual service volumes, is associated with the use of virtual EOLC and physicians account for a substantial proportion of the variation in its use. Physicians may therefore be an appropriate and potentially modifiable target for interventions to help modulate and standardize access to this new model of EOLC delivery.
Supporting information
S1 ChecklistSTROBE statement- checklist of items that should be included in reports of cohort studies.(PDF)
S1 TableDescription of linked ICES datasets.(DOCX)
S2 TableBaseline physician characteristics according to annual service volume before and during the pandemic.(DOCX)
S3 TableBaseline characteristics of all community-dwelling adults in the last 90 days of life who died in Ontario according to their attending physician’s annual service volume before and during the pandemic.(DOCX)
S4 TableDelivery of virtual and non-virtual care by a person’s attending physician in the last 90 days of life according to annual physician service volume, before and during the pandemic.(DOCX)
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Quinn K.L., et al., Association between Physician Intensity of Antibiotic Prescribing and the Prescription of Benzodiazepines, Opioids and Proton-Pump Inhibitors to Nursing Home Residents: a Population-Based Observational Study. J Gen Intern Med, 2019. 34(12): p. 2763–2771.31576508 10.1007/s 11606-019-05333-8PMC 6854144 · doi ↗ · pubmed ↗
- 2Quinn K.L., et al., Association Between Palliative Care and Death at Home in Adults With Heart Failure. J Am Heart Assoc, 2020. 9(5): p. e 013844. doi: 10.1161/JAHA.119.013844 32070207 PMC 7335572 · doi ↗ · pubmed ↗
- 3Robbins J.A., et al., The influence of physician practice behaviors on patient satisfaction. Fam Med, 1993. 25(1): p. 17–20.8454118 · pubmed ↗
- 4Bertakis K.D., et al., The impact of physician practice style on medical charges. Journal of family practice, 1999. 48: p. 31–36.9934380 · pubmed ↗
- 5Xierali I.M., Physician Multisite Practicing: Impact on Access to Care. J Am Board Fam Med, 2018. 31(2): p. 260–269.29535243 10.3122/jabfm.2018.02.170287 PMC 5881375 · doi ↗ · pubmed ↗
- 6Udell J.A., et al., Primary Care Clinical Volumes, Cholesterol Testing, and Cardiovascular Outcomes. Can J Cardiol, 2023. 39(3): p. 340–349.36574928 10.1016/j.cjca.2022.12.016 · doi ↗ · pubmed ↗
- 7Armour B.S., et al., The Effect of Explicit Financial Incentives on Physician Behavior. Archives of Internal Medicine, 2001. 161(10): p. 1261–1266.11371253 10.1001/archinte.161.10.1261 · doi ↗ · pubmed ↗
- 8Davis D., et al., Impact of Formal Continuing Medical Education Do Conferences, Workshops, Rounds, and Other Traditional Continuing Education Activities Change Physician Behavior or Health Care Outcomes? JAMA, 1999. 282(9): p. 867–874. doi: 10.1001/jama.282.9.867 10478694 · doi ↗ · pubmed ↗
