Association between primary care physicians’ practice models and referral rates to specialists: A sex-based cross-sectional study
Bahram Rahman, David Kirkwood, Glenda Babe, Lauren E. Griffith, David Price, Rebecca H. Correia, Darly Dash, Lauren Lapointe-Shaw, Andrew P. Costa

TL;DR
This study examines how primary care physicians' practice models and sex influence their referral rates to specialists in Ontario.
Contribution
The study provides new insights into how primary care reforms and physician characteristics affect referral patterns in Ontario.
Findings
Female PCPs had higher unadjusted referral rates compared to male PCPs.
Fee-for-service and Family Health Group models had lower referral rates compared to Family Health Teams.
Younger, part-time PCPs and those in urban areas had higher referral rates.
Abstract
Referrals from primary care physicians (PCPs) to specialists are a key function of the primary care system, enabling access to secondary and tertiary health care services. Since the early 2000s, Ontario has implemented substantial primary care practice reforms, however, PCP referral patterns have not been examined since reforms were implemented. We conducted a cross-sectional study in Ontario analyzing PCPs’ referral patterns to specialists from January 1 to December 31, 2019. Data from physician administrative and Ontario Health Insurance Plan (OHIP) billing databases were linked for 9,301 PCPs practicing comprehensive primary care with 11.8 million patients. We calculated referral rates per physician and built a multivariable Poisson regression model stratified by physician sex, recognizing that female and male PCPs practice primary care differently, to examine the association between…
Genes, proteins, chemicals, diseases, species, mutations and cell lines named across the full text — each resolved to its canonical identifier and authoritative record.
Click any figure to enlarge with its caption.
Fig 1- —Ontario Ministry of Health
- —Ministry of Long-Term Care
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsHealthcare Systems and Technology · Healthcare Policy and Management · Primary Care and Health Outcomes
Introduction
Referrals from primary care physicians (PCPs) to specialists are a crucial function of the primary care system. In Ontario, specialists require a referral from a physician or a nurse practitioner to provide publicly funded secondary and tertiary health care services to patients [1,2]. Primary care physicians and specialists combined provide 81% of all medical services in Ontario in a 24-hour period [3]. In 2021/2022 alone more than 8.1 million consultations were provided by specialists referred by PCPs [4].
Since the early 2000s, Ontario’s primary care system has gone under continuous reform, including establishing new funding models for PCPs and specialists. These reforms have drastically changed the composition of the primary care physicians’ workforce (e.g., more female physicians entering medicine) and the ways physician services are funded and practiced [5–8]. One of the main goals of these reforms was to move away from solo fee-for-service practice models more toward team-based care models. Family Health Teams (FHTs), the largest team-based practice model, were introduced in 2005 and, since then, have been gradually expanded [9,10]. PCPs affiliated with a FHT are often paid in a blend of capitation, fee-for-service, pay-for-performance mechanisms or a salary adjusted to the number of patients they service. PCPs in FHTs are supported by a team of publicly funded allied health care professionals, such as nurse practitioners, psychologists, social workers, dietitians, physiotherapists, and others. FHTs were created with the goal of improving outcomes for patients and the health system, including reducing reliance on secondary and tertiary care [10]. Within FHTs, PCPs and allied health care professionals collaborate and provide comprehensive primary health care, primary mental health care, patient education, chronic disease management and preventive care [10]. Despite continued investments in FHTs, there is no consensus on whether they have improved patient outcomes, access to care, or reduced overall health system costs [10–14]. Furthermore, evidence concerning the impact of FHTs compared to other practice models on referrals to specialists is scarce. We sought to examine the referral patterns of PCPs to specialists by practice model, specialties, and their sex. Consistent with reform objectives, we hypothesized that those practicing within the FHT practice model would exhibit lower rates of specialist referrals.
Methods
Study design and setting
We conducted a cross-sectional study of PCPs’ referrals to specialists in Ontario between January 1, 2019, to December 31, 2019, with data accessed on August 6, 2023. Ontario has 16.2 million residents and is the most populous province in Canada [15]. Medically necessary physician services, including primary care and specialist care, are publicly funded. In 2022, there were 35,320 physicians in Ontario, of which 17,416 worked in general practice and family medicine, including comprehensive primary care services; 17,904 physicians practiced other specialties [16]. PCPs practice in one of several practice models including Family Health Groups (mix of fee-for-service, bonuses, and premiums), capitated non-team models (capitation, bonuses, premiums, and fee-for-service without interdisciplinary teams), Family Health Teams (allied health care professionals support with capitation bonuses, premiums, and fee-for-service or salaried payments), solo fee-for-service, and other patient enrollment or group-based salaried models [17]. Specialists tend to practice as solo providers, providers in teams in the community or in a hospital setting [8].
Data sources and study population
We linked multiple health administrative datasets at ICES (formerly known as the Institute for Clinical Evaluative Sciences). ICES is an independent, non-profit research institute whose legal status under Ontario’s health information privacy law allows it to collect and analyze health care and demographic data without consent for health system evaluation and improvement. We included all PCPs who practiced comprehensive primary care services actively between January 1, 2019, to December 31, 2019. Comprehensive primary care includes a broad spectrum of health services to meet the full range of patient’s health-related needs and arrange for the resources to deal with them (S1 Table includes billing codes used to identify comprehensive primary care physicians) [18]. We used data prior to the COVID-19 pandemic to reduce any risks of distortions caused by the pandemic lockdowns and post pandemic recovery. PCPs’ characteristics were obtained from the ICES Physician Database (IPDB). Ontario Health Insurance Plan (OHIP) billing data were used for information about PCPs’ patients and practice characteristics. These datasets were linked with unique coded identifiers and were analyzed at ICES. Fig 1 presents the complete exclusion criteria of the study population. The data used in this study, consisting of secondary and deidentified information accessed through ICES, is authorized under Section 45 of Ontario’s Personal Health Information Protection Act, 2004 and did not require approval from an ethics review board.
Inclusion and exclusion criteria.
Dependent variable
We calculated the rate of referrals to specialists per 100 rostered patients (included both formally enrolled and virtually rostered). We included only those specialist referrals that were requested by patient’s rostered PCP and completed (rendered a consultation) within the 12-month study period. We excluded follow-up visits requested by the specialist, referrals from a specialist to another specialist, referrals from PCPs other than the patients’ rostering PCP (e.g., walk-in clinic physician), and consults that were hospital-based or performed in an emergency department.
Independent variables
The main independent variable of interest was the PCP’s primary care practice model (categorized). We included rostered patients’ characteristics, such as the mean age of rostered patients, the proportion of rostered patients that were female and the proportion of rostered patients with twice the population’s average level of medical complexity, using the CIHI Population Grouper Methodology [19]. Physicians’ characteristics such as age, sex, roster size (categorized), practice distance (Kilometers) from an academic hospital (categorized), full-time equivalency (categorized), community size as a proxy for rurality (categorized) and PCP’s group size (categorized) were also included. (S2 Table includes a complete description of data sources for each variable.)
Statistical analysis
Means and standard deviations (for continuous variables, after testing for normal distribution) and proportions (for categorical variables) were calculated separately for female and male PCPs in recognition of previously reported differences in their practice patterns [20–25]. We calculated standardized differences to compare practice patterns between female and male PCPs with differences greater than 10% considered meaningful [26]. We used a multivariable Poisson regression model stratified by physician’s sex to estimate unadjusted and adjusted rate ratios for each dependent variable. We used a generalized linear mixed model (GLMM) with a Poisson distribution and a log link with an exchangeable correlation structure to account for clustering at the physician’s group level. An offset term of the log of the total number of rostered patients for the physicians divided by 100 was used to obtain the rate ratio per 100 rostered patients. The adjusted model included the following variables: mean age of rostered patients, percent of rostered female patients, percent of rostered patients twice or more complex than the provincial average, physician’s age, total roster size, distance of the practice from an academic hospital, physician’s FTE, community size and the PCP’s group size. These variables were selected based on existing evidence of their impact on PCP’s practice patterns and policy relevance. Subgroup analyses were conducted for different specialties: surgical, medical, diagnostics, and GP-focused practice (S3 Table includes physician specialties classification). We reported the results as adjusted rate ratios (RRs) with 95% confidence intervals (CIs). We considered a 2-tailed p-value of less than 0.05 significant. We conducted all analyses using SAS Enterprise Guide software, version 8.3 in the ICES Remote Access Environment (RAE).
Results
We identified 9,301 PCPs with 11.8 million rostered patients (Fig 1). There were 4,653 female PCPs and 4,648 male PCPs. Female PCPs tended to be younger (average age 47.2 years vs. 54.1 years for males; SMD=0.56), work part-time (32.1% vs. 17.9% for males; SMD=0.33), and had smaller patient roster (average 1,097.8 rostered patients vs. 1,442.1 for males; SMD=0.44). Female PCPs also tended to refer more often to other female specialists (32.5% vs. 25.4%; SMD=0.16). We did not observe meaningful differences between male and female PCPs regarding their affiliations to primary care practice models and the size of their group (Table 1).
Table 1: PCPs practice characteristics, Ontario, January 1, 2019, to December 31, 2019.
Female PCPs also had a higher proportion of rostered female patients (60.5% vs. 44.7% for males; SMD=0.32) and on average rostered younger patients. We did not observe a meaningful difference between male and female PCPs regarding the complexity of their rostered patients (Table 2).
Table 2: Patients’ characteristics, Ontario, January 1, 2019, to December 31, 2019.
PCPs in FHTs had a lower unadjusted referral rate per 100 rostered patients to any specialist than those in Capitated non-Team (32.6 vs 34.7; p-value <0.0001); however, they had a higher rate than other models (Table 3). This finding was consistent across all subspecialties. (S4 Table includes additional descriptive analysis by primary care practice model).
Table 3: Referral rates per 100 rostered patients by primary care practice model, Ontario, January 1, 2019, to December 31, 2019.
Overall, female PCPs had a higher unadjusted referral rate per 100 rostered patients to any specialist compared to male PCPs (32.9 vs. 29.9; p-value <0.0001) (Table 4).
Table 4: Referral rates per 100 rostered patients by PCP’s sex, Ontario, January 1, 2019, to December 31, 2019.
For both sexes, the top specialties for which a referral was made were general surgery, dermatology, OB/GYN, internal medicine, and GP-focused practice (Table 5).
Table 5: Top ten specialties that PCPs made a referral to (count and percent), Ontario, January 1, 2019, to December 31, 2019.
PCPs in Family Health Group (FHG) practices showed a lower referral rate to specialists compared to those in FHT practices. Both female and male PCPs in FHG practices had lower referral rates (female PCPs: RR=0.90, 95% CI=0.90–0.91 vs. male PCPs: RR=0.85, 95% CI=0.84–0.85) compared to PCPs in FHT practices. Similarly, both female and male PCPs in solo FFS practices had lower referral rates compared to those in FHTs (female PCPs: RR=0.72, 95% CI: 0.71–0.72 vs. male PCPs: RR=0.71, 95% CI=0.71–0.72). There were no statistically significant differences observed between PCPs in Capitated non-Team practices compared to FHT practices (Table 6). Younger and part-time PCPs had a higher rate of referrals to specialists compared to their older counterparts and those working full-time or more. Also, PCPs practicing in large or medium-sized urban areas had a higher specialist referral rate compared to those in rural areas (Table 6).
Table 6: Adjusted relative risk of specialist referrals, stratified by PCP’s sex, Ontario, January 1, 2019, to December 31, 2019.
Female and male PCPs in FHG and solo FFS practices had lower adjusted referral rates to medical and surgical specialties compared to those in FHT practices. PCPs in solo FFS practices had lower adjusted referral rates for diagnostic specialties compared to FHT practices. However, aside from solo FFS practices, all other practice models demonstrated higher adjusted referral rates to GP-focused specialties compared to FHTs (S1 Fig includes adjusted association of referral to different specialties).
Discussion
Our findings demonstrate differences in referral patterns between PCP practice models and PCPs’ sex. PCPs affiliated with fee-for-service practice models (FHG and solo FFS) had lower referral rates compared to those in FHT practices. Our finding aligns with previous studies that found an association between primary care model type and specialist referral at the population level where patients receiving care from a fee-for-service model had a lower referral rates compared to those in capitated or interdisciplinary models [27,28]. PCPs in FFS practice models have a financial incentive to provide more services within their practice instead of referring to specialists compared to PCPs in capitated and salaried models where most of their income is guaranteed regardless of their referral patterns. FHT practices also have access to more resources and support for their rostered patients, which could induce demand for more medical services that, in some cases, might not be required (e.g., a physiotherapist may suggest referral to an orthopedic specialist) [29–33]. There could also be unexplained variability in PCP’s decision to refer their rostered patients to one or more specialties [25].
We described PCPs’ specialist referral patterns and evaluated variations between female and male PCPs, without asserting the appropriateness of these referrals. Our study addresses key limitations of previous research, such as being conducted prior to primary care reform, relying on self-reported data, focusing solely on referrals from electronic consultation platforms, and not accounting for shifts in the physician workforce such as the growth in GP-focused specialties [34–37]. GP focused practices dedicate most of their clinic to one area such as sports medicine, pain medicine, sleep medicine, anesthesiology, dermatology and others [38].
We found differences in referral patterns between female and male PCPs, including their age, workload, and referrals made to different specialties. Our findings support an emerging body of evidence on variations between female and male PCP practice in primary care, including differences in workload and working hours [20,21], preference to refer to specialists of their own sex [21], and the impact of their practice patterns on their billing practices [24,25]. We found higher unadjusted referral rates for female PCPs compared to their male counterparts for all specialists, also reported by Liddy et.al (2014) [27] and across different specialties.
Our analysis also showed differences in referral rates across specialties, with PCPs in different practice models exhibiting distinct referral patterns. For instance, PCPs in FHG and solo FFS practices showed lower referral rates to medical and surgical specialties compared to those in FHT practices. On the other hand, PCPs in FHT practices had lower referral rates to GP focused practices. The lower referral rates to GP-focused practices may be explained by PCPs in capitated payment models, including those in FHT practices, being hesitant to refer their rostered patients to other GPs due to concerns about potential financial impacts on the bonus they receive for providing comprehensive primary care services within their rostering group. PCPs in FHT practices could also refer their rostered patients to allied health care services within their team (e.g., mental health, physiotherapy) instead of GP focused practices.
Policy implications
Efforts to expand FHTs need to consider the potential health system burden of more specialist referrals and could introduce interventions (i.e., incentives, quality improvement supports and accountabilities) to reduce unnecessary referrals. Policymakers could consider reforming the FHT practice model with clear performance goals, including reducing specialists and high-cost services as intended during the development of FHTs. Secondly, policymakers should carefully assess the impact of GP-focused practices on comprehensive primary care before expanding these programs. Such programs could strain on the primary care system by diverting funding and human resources away from comprehensive care. Finally, our findings highlight the need for ongoing monitoring and evaluation of referral patterns within primary care practices to identify areas for improvement and ensure equitable and timely access to specialist services. This could involve the development of standardized referral guidelines, decision support tools and quality indicators to monitor referral appropriateness and efficiency.
Limitations
The cross-sectional design of the study limits our ability to establish causal relationships between PCP characteristics and referral patterns. Longitudinal studies are needed to further explore factors influencing referral decisions over time, especially whether the PCPs changed behavior with the availability of virtual primary care and specialty services [39,40] and reported administrative burdens experienced by PCPs [41]. Our analysis relied on administrative data, which may not capture all relevant variables influencing referral patterns, such as clinical factors, patient preferences, referral wait-times, and PCP attitudes. Our data also excluded referrals that were not completed within the one-year period, which may underrepresent overall referral volumes. However, we expect this impact to be small and unlikely to change the overall conclusion of our findings. Further research could incorporate contextual explanatory methods providing deeper insights into the complex drivers of primary care physicians’ referral decision-making. Our study focused solely on referrals within the Ontario health care system, which may not be generalizable to other jurisdictions where a referral is not needed to access specialist care or they have a different configuration of team-based care models.
Conclusion
Primary care physicians’ referral rates in Ontario vary by practice model. Contrary to their policy goals, FHTs showed comparable rates to Capitated non-Team and higher rates compared to fee-for-service models. These findings underscore the importance anticipating referral volumes to specialists as practice models and provider characteristics change.
Supporting information
S1 TableComprehensive primary care codes.(DOCX)
S2 TableDescription of data sources and variables.(DOCX)
S3 TablePhysician specialties classification.(DOCX)
S4 TablePCPs’ and their patients’ characteristics by practice model, Ontario, January 1, 2019, to December 31, 2019.(DOCX)
S5 TableUnadjusted relative risk of specialist referrals, stratified by PCP’s sex, Ontario, January 1, 2019, to December 31, 2019.(DOCX)
S6 FileA brief description of Family Health Teams.(DOCX)
S7 FileSTROBE Statement—Checklist of items that should be included in reports of cross-sectional studies.(DOCX)
S1 FigAdjusted association of referrals to different specialties, stratified by PCP’s sex, Ontario, January 1, 2019, to December 31, 2019.(DOCX)
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Ontario Ministry of Health. Assessment and consultations [Internet]; 2023 [cited 2024 May 19]. Available from: https://files.ontario.ca/moh/moh-resources-physicians-assessment-and-consultation-en-2023-05-12.pdf
- 2College of Physicians and Surgeons of Ontario. CPSO - Transitions in care [Internet]; 2019 [cited 2024 May 19]. Available from: https://www.cpso.on.ca/Physicians/Policies-Guidance/Policies/Transitions-in-Care
- 3Jaakkimainen L, Premji K, Sibley LM, Frymire E, Glazier RE, Bayoumi I, et al. 24 hours in Ontario’s healthcare system: The ecology of healthcare services in Ontario [Internet]; 2024 [cited 2024 May 19]. Available from: https://inspire-phc.org/wp-content/uploads/2024/01/NAPCRG 2023-Ecology-1.pdf
- 4Jin Y-P, Canizares M, Buys YM. Differences by sex in supply, payments and clinical activity of family physicians in Ontario: a retrospective population-based cohort study. CMAJ Open. 2022 Apr;10(2):E 420–9. doi: 10.9778/cmajo.20210068 35580888 PMC 9188800 · doi ↗ · pubmed ↗
- 5Aggarwal M, Williams AP. Tinkering at the margins: evaluating the pace and direction of primary care reform in Ontario, Canada. BMC Fam Pract. 2019;20(128):1–14. doi: 10.1186/s 12875-019-1014-8 31510942 PMC 6739997 · doi ↗ · pubmed ↗
- 6Glazier R, Kopp A, Schultz S, Kiran T, Henry D. All the right intentions but few of the desired results: lessons on access to primary care from Ontario’s patient enrolment models. Healthc Q. 2012;15(2):17–21. 22986561 10.12927/hcq.2013.23041 · doi ↗ · pubmed ↗
- 7Office of the Auditor General of Ontario. Chapter 3: Health human resources. 2013 Annual report of the Office of the Auditor General of Ontario [Internet]; 2013 [cited 2024 May 19]. Available: https://www.auditor.on.ca/en/content/annualreports/arreports/en 13/407en 13.pdf
- 8Ontario Ministry of Finance. 2024 Ontario budget: Building a better Ontario [Internet]; 2024 [cited 2024 Jul 15]. Available from: https://budget.ontario.ca/2024/index.html
