Skip to main content

Main menu

  • Home
  • Content
    • Current issue
    • Past issues
    • Collections
  • About
    • General information
    • Staff
    • Editorial board
    • Open access
    • Contact
  • CMAJ JOURNALS
    • CMAJ
    • CJS
    • JAMC
    • JPN

User menu

Search

  • Advanced search
CMAJ Open
  • CMAJ JOURNALS
    • CMAJ
    • CJS
    • JAMC
    • JPN
CMAJ Open

Advanced Search

  • Home
  • Content
    • Current issue
    • Past issues
    • Collections
  • About
    • General information
    • Staff
    • Editorial board
    • Open access
    • Contact
  • RSS feeds
Research
Open Access

An interrupted time series study using administrative health data to examine the impact of the COVID-19 pandemic on alternate care level acute hospitalizations in Ontario, Canada

Sara J.T. Guilcher, Yu Qing Bai, Walter P. Wodchis, Susan E. Bronskill and Kerry Kuluski
July 12, 2023 11 (4) E621-E629; DOI: https://doi.org/10.9778/cmajo.20220086
Sara J.T. Guilcher
Leslie Dan Faculty of Pharmacy (Guilcher), University of Toronto; ICES UofT (Guilcher, Bai, Wodchis); ICES Central (Bronskill); Institute of Health Policy, Management and Evaluation (Guilcher, Bai, Wodchis, Bronskill, Kuluski), Dalla Lana School of Public Health, University of Toronto, Toronto, Ont.; Institute for Better Health (Wodchis, Kuluski), Trillium Health Partners, Mississauga, Ont.
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yu Qing Bai
Leslie Dan Faculty of Pharmacy (Guilcher), University of Toronto; ICES UofT (Guilcher, Bai, Wodchis); ICES Central (Bronskill); Institute of Health Policy, Management and Evaluation (Guilcher, Bai, Wodchis, Bronskill, Kuluski), Dalla Lana School of Public Health, University of Toronto, Toronto, Ont.; Institute for Better Health (Wodchis, Kuluski), Trillium Health Partners, Mississauga, Ont.
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Walter P. Wodchis
Leslie Dan Faculty of Pharmacy (Guilcher), University of Toronto; ICES UofT (Guilcher, Bai, Wodchis); ICES Central (Bronskill); Institute of Health Policy, Management and Evaluation (Guilcher, Bai, Wodchis, Bronskill, Kuluski), Dalla Lana School of Public Health, University of Toronto, Toronto, Ont.; Institute for Better Health (Wodchis, Kuluski), Trillium Health Partners, Mississauga, Ont.
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Susan E. Bronskill
Leslie Dan Faculty of Pharmacy (Guilcher), University of Toronto; ICES UofT (Guilcher, Bai, Wodchis); ICES Central (Bronskill); Institute of Health Policy, Management and Evaluation (Guilcher, Bai, Wodchis, Bronskill, Kuluski), Dalla Lana School of Public Health, University of Toronto, Toronto, Ont.; Institute for Better Health (Wodchis, Kuluski), Trillium Health Partners, Mississauga, Ont.
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kerry Kuluski
Leslie Dan Faculty of Pharmacy (Guilcher), University of Toronto; ICES UofT (Guilcher, Bai, Wodchis); ICES Central (Bronskill); Institute of Health Policy, Management and Evaluation (Guilcher, Bai, Wodchis, Bronskill, Kuluski), Dalla Lana School of Public Health, University of Toronto, Toronto, Ont.; Institute for Better Health (Wodchis, Kuluski), Trillium Health Partners, Mississauga, Ont.
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Tables
  • Related Content
  • Responses
  • Metrics
  • PDF
Loading

Abstract

Background: Many health systems struggle with delayed discharges (known as alternate level of care [ALC] in Canada). Our objectives were to describe and compare patient and hospitalization characteristics by ALC status, and to examine the impact of the initial period of the COVID-19 pandemic on ALC rates in Ontario, Canada.

Methods: We conducted an interrupted time series using linked administrative data for acute care hospital discharges in Ontario between Feb. 28, 2018, and Nov. 30, 2020. We measured the monthly ALC rate among discharges before and after the onset of the COVID-19 pandemic (Mar. 1, 2020). We used interrupted time series regressions to examine the association between the onset of the pandemic and average ALC monthly rates.

Results: We identified no meaningful differences in patient and admission characteristics, irrespective of time; however, differences were identified by ALC status. The overall average monthly rate of ALC discharges before the COVID-19 pandemic was 4.9% and after the onset of the pandemic was 5.0%. These discharges dropped to 4.3% (n = 3558) in March 2020 but then rebounded to their peak of 5.8% (n = 3915). There was no significant change in the average level of ALC rates per month after the onset of the pandemic (increase of 0.36% average per month, 95% confidence interval [CI] −0.11% to 0.83%) or monthly rate of change (slope) after the onset of the pandemic (−0.08%, 95% CI −0.15 to 0).

Interpretation: We identified a continued high rate of hospital discharges with an ALC component despite the considerable efforts in hospital to reduce hospital occupancy during the COVID-19 pandemic. Future research should examine why ALC rates remain high despite hospital efforts.

The COVID-19 pandemic radically altered the way in which health care was delivered. During the initial waves of COVID-19 in Canada, hospitals across the country quickly adopted measures to reduce in-patient occupancy in anticipation of a pending influx of patients with COVID-19. These anticipatory changes had a dramatic impact on which patients were hospitalized and discharged, and why and when. In particular, between March and June 2020, many hospitals in Ontario, Canada, reported drastic reductions in occupancy, from over 100% (before the pandemic) to as low as 50% (in preparations for anticipated COVID-19 surges).1–4 Although reductions in occupancy were, in part, due to cancelled surgeries and procedures, they were also related to patient occupancy and flow as patients were quickly transitioned out of hospital to other care settings, including interim care spaces in the community.2,5

Before the COVID-19 pandemic, many health systems have struggled with the long-standing issues related to patient flow and, more specifically, delayed discharges (known as alternate level of care [ALC] in Canada).6–15 An ALC status is designated by a physician or a delegate when a patient occupies a bed and no longer needs the intensity of services provided in the care setting.16 The Canadian Institute for Health Information (CIHI) reports that approximately 5.4% of hospital stays have ALC days.17,18 Delays occur when a patient has completed their medical treatment but remains in the hospital, often because their next point of care is not available (e.g., rehabilitation bed, long-term care bed, home care). Medical care usually decreases as individuals wait.19 Identifying and implementing solutions to address these delays, sometimes referred to as “hallway health care,”20 has been a major priority in Canada and particularly within Ontario for decades,15,20,21 but unfortunately the problem persists.

Patients with a delay in discharge were likely most affected by the sudden pandemic-related changes to service delivery and policy. Understanding the potential impact of these hospital policy changes on ALC rates (as described above) and who experienced ALC during the pandemic will provide important insights into the extent to which hospital admission and discharge policies may alleviate a long-standing policy ALC issue. As such, there is a unique opportunity to investigate how these policy changes may have affected overall rates of ALC (for the better or worse) and the characteristics of patients with ALC status compared with others hospitalized during the COVID-19 pandemic.

In this context, the objectives of the present study were to describe and compare the characteristics of individuals hospitalized by ALC status and admission characteristics before and during the onset of the pandemic in Ontario, and to examine whether there was an impact of the COVID-19 pandemic on hospital ALC rates across Ontario, using administrative health data. We expected that patients with ALC status would have more medical complexity, and unplanned and medical admissions during the pandemic, with increased likelihood of hospital harm due to policies restricting informal (e.g., family and friends) caregivers. We also anticipated differences in ALC rates because of the pandemic, specifically, reduced ALC rates due to efforts in discharging patients to settings other than the hospital.

Methods

We conducted an interrupted time series using linked administrative data from ICES (https://www.ices.on.ca). ICES is an independent, nonprofit research institute whose legal status under Ontario’s health information privacy law allows it to collect and analyze health care and demographic data, without consent, for health system evaluation and improvement. With a population of 14.8 million, Ontario is Canada’s most populous province. Guided by the Canada Health Act, Ontario provides publicly funded medical coverage to residents for medically necessary services, including emergency department, inpatient and outpatient hospital, and physician services.22 An interrupted time series was chosen as it allows for multiple observations before and after the pandemic onset while integrating time.23,24 Our study period was February 2018 to November 2020. The Strengthening the Reporting of Observational Studies in Epidemiology checklist with the Reporting of Studies Conducted Using Observational Routinely-collected Data extension was used as a guide to report the results.

Population and data sources

The population for this study included all people discharged from an acute hospital (inpatient care for necessary treatment designed for a short period of time) in Ontario between Feb. 28, 2018, and Nov. 30, 2020. Data sets were linked using unique encoded identifiers and analyzed at ICES (a prescribed entity under the Ontario Personal Health Information Protection Act), where repositories of all health care data for Ontario are deposited. These data are valid and reliable, as described by previous published studies.25–27 We captured all records of hospitalizations as well as procedures and diagnoses that occurred in hospital using the CIHI Discharge Abstract Database. We identified records of emergency department visits using the National Ambulatory Care Reporting System and records of outpatient physician visits and physician specialty information using the Ontario Health Insurance Plan database. We identified chronic comorbidities using a multimorbidity macro that leverages several ICES-derived cohorts from various data sets, including the Ontario Asthma Data Set, Congestive Heart Failure Data Set, Chronic Obstructive Pulmonary Disease Data Set, Ontario Hypertension Data Set, Ontario Diabetes Data Set, Ontario Rheumatoid Arthritis Data Set and the Ontario Dementia Database. Demographic information (e.g., age and sex), and mortality were obtained from the Ontario Registered Persons Database.28–34 The Ontario Drug Benefit Database (ODB) was used to capture prescription drug claims for those aged 65 years or older, receiving social assistance (Ontario Works, Ontario Disability Support Program), or coverage through the Trillium Drug Program (high-cost drug support).

Exposure

Our primary exposure was the documented onset of the COVID-19 pandemic in Ontario, defined as of Mar. 1, 2020. We had 2 defined periods, with the period before the pandemic set as June 1, 2019, to Feb. 29, 2020, and the period after the onset of the pandemic set as Mar. 1, 2020, to Nov. 30, 2020.

Outcome

Our main outcome of interest was a closed, monthly rate of discharges with an ALC component, calculated by the total number of discharges with an ALC status out of the total number of discharges per month multiplied by 100.18 The calculation is based on an established performance indicator on ALC.18

Other variables of interest

Sociodemographic and geographic characteristics

We identified patient age and sex. Neighbourhood income quintiles were calculated using Statistics Canada census and corresponding postal code information. We determined urban and rural residential location using the Rurality Index for Ontario. This index ranges from 0 to 100 and considers population factors and distance to referral centres. Locations with a score of greater than or equal to 40 are considered rural.35 These variables were identified from admission date.

Clinical characteristics before admission

Using a validated multimorbidity algorithm at ICES, comorbidities were classified by 16 possible conditions, which included acute myocardial infarction asthma, arthritis, depression, diabetes, cancer, chronic coronary syndrome, cardiac arrythmia, congestive heart failure, chronic obstructive pulmonary disease, dementia, hypertension, renal failure, rheumatoid arthritis and stroke.36 We used the ODB to capture records of prescription medications (based on unique drug name) dispensed to individuals insured through the provincial drug plan in the year before the admission. Individuals are eligible for drug coverage if they are aged 65 years or older, reside in long-term care homes, receive home care services, have high prescription medication costs in relation to their net household income, or receive social financial assistance through Ontario Works or Ontario Disability Support Program.

Admission characteristics

Hospital admission characteristics included the type of admission (planned, unplanned), clinical category (surgical, medical), frailty (decline in function in several organ systems)37 and hospital harm.38 Frailty was measured using a Hospital Frailty Risk Score (< 5 low risk, 5–15 moderate risk, > 15 high risk).37 We identified hospital harm using CIHI’s hospital harm methodology.38 The Canadian Institute for Health Information defines hospital harm as a hospitalization in which at least 1 unintended occurrence of a potentially preventable event occurs. Monthly rates of hospital harm were calculated by the total number of admissions that were associated with an incident of hospital harm per total number of admissions multiplied by 100. The 4 major categories of harm were health care– or medication-associated conditions (e.g., pressure injuries, wrong medications), health care–associated infections (e.g., surgical site infections), patient accidents (e.g., falls) and procedure-associated conditions (e.g., postoperative bleeding).38

Statistical analysis

We used descriptive statistics to examine demographic, clinical and hospital admission characteristics of the population admitted before the onset of the COVID-19 pandemic and after. Standardized differences were used to compare the populations admitted before and after pandemic onset because the very large samples can result in statistical significance of trivial differences. We considered differences unimportant when below 10% (0.1).39 The impact of the pandemic on hospital discharges started from Mar. 1, 2020. The association of the COVID-19 pandemic on ALC rates was examined using interrupted time series regression (Appendix 1, available at https://www.cmajopen.ca/content/11/4/E621/suppl/DC1), in which we assessed both the immediate change in the level of ALC in March 2020 and the subsequent change in trend over time.40 Models were examined for autocorrelation by inspecting a plot of residuals by time and the Durbin–Watson statistic. 41 The seasonality was examined using the F test. We ran stratified models by type of admission and clinical category. All analyses were conducted at ICES using SAS Enterprise Guide 7.1 (SAS Institute Inc.).

Ethics approval

The use of the data in this project is authorized under section 45 of Ontario’s Personal Health Information Protection Act42 and does not require review by a research ethics board.

Results

The number of hospital discharges during the 34 months of observation between Feb. 28, 2018, and Nov. 30, 2020, was 3 132 409 (2 356 428 prepandemic discharges and 775 981 discharges after the onset of the COVID-19 pandemic). Overall, there were no meaningful differences of individuals with discharges by ALC status before the pandemic and after the onset of the pandemic, as standardized differences were less than 0.1. However, differences were seen when comparing characteristics by ALC status irrespective of the time periods. Patients with discharges of an ALC status were older in age, and had more drug claims in the year before hospitalization, multimorbidity with 5 or more conditions, and frailty, irrespective of the 2 time periods. More drug claims might reflect that patients with ALC status were older and the drug claims data available are limited to those who are eligible for the Ontario Drug Benefit plan (Table 1).

View this table:
  • View inline
  • View popup
Table 1:

Baseline characteristics of individuals discharged from inpatient acute care during the study period in Ontario, stratified by time period (before and after the onset of the COVID-19 pandemic)

The overall rate of hospital harm during the observation window was 2.6% with no meaningful differences based on the onset of the COVID-19 pandemic. However, discharges with ALC status had higher rates of overall hospital harm compared with discharges with no ALC status in the periods before and after the onset of the pandemic (standardized differences > 0.1). There were more health care– and medication-associated conditions and health care–associated infections among ALC status hospitalizations compared with non-ALC status, with no meaningful differences on procedure-related harms and patient accidents.

During the prepandemic period, the average monthly rate of ALC discharges was 4.9%, and it had remained stable during this prepandemic period (changing 0.002% per month, 95% confidence interval [CI] −0.01% to 0.02%; Table 2). After the onset of the COVID-19 pandemic in March 2020, there was a nonsignificant change in the average level of ALC discharges per month (increase of 0.36% average per month, 95% CI −0.11% to 0.83%). After dropping to a low of 4.3% (n = 3558) in March 2020, the ALC rate rebounded to a peak level of 5.8% (n = 3915) by April 2020. Nonetheless, the effect of the pandemic onset on monthly rate of change (slope) in ALC rates was also nonsignificant (−0.08%, 95% CI −0.15 to 0).

View this table:
  • View inline
  • View popup
Table 2:

Interrupted time series model results summarizing the association of the COVID-19 pandemic onset with delayed acute hospital discharges

The overall monthly ALC rates and by admission type (planned, unplanned) are shown in Figure 1. Figure 2 shows ALC rates by major clinical category (surgical, medical and overall). There was an initial level drop in the month of March 2020 for both surgical- and medical-related hospitalizations with ALC status. After the initial level drop, rates rebounded in April, then stabilized. After April 2020, the rates remained relatively unchanged by admission type (planned or unplanned) or major clinical category (surgical or medical).

Figure 1:
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1:

Monthly alternate level of care (ALC) rate (%) over the 18 months of observation (February 2018 to November 2020) in Ontario, overall and by admission type (planned, unplanned). The dotted vertical line indicates the onset of the COVID-19 pandemic in Ontario, as of Mar. 1, 2020. The monthly ALC rate was calculated by the total number of ALC patients who were discharged per the total number of discharges per month multiplied by 100.

Figure 2:
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2:

Monthly alternate level of care (ALC) rates (% cases) by major clinical category (surgical, medical, overall) over the 18 months of observation (February 2018 to November 2020) in Ontario. The dotted vertical line indicates the onset of the COVID-19 pandemic in Ontario, as of Mar. 1, 2020. The monthly ALC rate was calculated by the total number of ALC patients who were discharged per the total number of discharges per month multiplied by 100.

No seasonality was detected. The p values for tests of stable seasonality (p = 0.2), moving seasonality (p = 0.1) and combined test for the presence of identifiable seasonality (p = 0.07) were greater than 0.05, indicating no seasonality effects were present. The Durbin–Watson test indicated that the autocorrelation was present (p = 0.046 at the first order).

Interpretation

Improving hospital flow and reducing discharge delays has been a major focus of health care in Canada and particularly within Ontario for decades.11,15,20 In this study, we identified that the ALC rate initially dropped, then rebounded, and remained relatively unchanged in the initial wave of the COVID-19 pandemic compared with the prepandemic period, despite substantial changes to hospital admission, procedure and discharge processes. Our findings have important implications for preventive care and cross-sector integrated care among those at risk for hospital admissions and, ultimately, at risk for ALC status.

First, our findings suggest that hospital-specific policies of reducing procedures and increasing efforts to discharge patients in a timely manner had minimal effect on ALC rates. The ALC rates remained consistent as a proportion of all discharges, thus highlighting the pressures hospitals experience in addressing this complicated challenge. Our data suggest that only focusing on 1 particular sector, such as hospital processes and policies, had minimal impact on overall ALC rates. This finding reinforces previous research that posits a need to focus across other sectors (e.g., primary care, home care, community services and long-term care) to address this complicated system flow issue.11 The unchanged ALC rates may also have been in part due to changes in long-term care admission policies during this period. In efforts to reduce SARS-CoV-2 transmission within long-term care facilities, new admissions were paused, creating a potential backlog in the acute hospitals.

In addition to the support of patients once they have been identified as having ALC status, upstream preventive efforts in the community, through more home care support, are required to substantially affect ALC rates with a focus on prevention and integrated care across sectors to minimize hospital-related avoidable admissions. Evidence supports integrated care, specifically multidisciplinary geriatric home care, for older adults with frailty.43 Integrated care can reduce potentially avoidable hospital admissions.43 Furthermore, a recent study in the United Kingdom identified a significant inverse association with home care supply and discharge delay, such that increased home care supply reduced rates of discharge delays.44 In Ontario, timely access to home care remains a challenge, as substantial physical or cognitive impairments are required to be eligible for services.45 Lack of timely access to appropriate community-based care can increase the risk of hospitalization.

Second, we found that people with ALC status were overall more at risk for hospital-related harm with being older, and having more frailty and comorbidities, and higher prescription drug claims than people hospitalized without an ALC status. This finding is similar to results of other studies and reinforces the potential vulnerability of patients with ALC status, especially given the heightened risk of substantial functional and cognitive decline as they wait to leave hospital.46 Inpatient therapy services, such as physical therapy or occupational therapy may decrease or stop altogether. The wait period combined with decreased therapeutic services often exacerbates an already heightened risk of functional decline and hospital-related harm (e.g., falls47–51 and infection).52 Hospitals implementing a no-visitor policy during the pandemic may have further exacerbated the risks of deconditioning among patients. Further research is warranted to examine the impact of the COVID-19 pandemic on patient and caregiver experiences, as well as health outcomes.

Limitations

Health systems evolved in response efforts with each wave of the pandemic, and as such, we cannot generalize that ALC rates remained consistent for subsequent waves. We were limited in our data at the time of analysis, and further follow-up is ongoing. The data represent rates within Ontario and cannot be generalized to other provinces or territories in Canada. Every province and territory had unique policies during the pandemic. Although interrupted time series estimate the change in outcome after an event or intervention within a population, it is possible that changes could be explained by unrelated temporal confounders. Also, since only descriptive unadjusted comparisons were made between patients who had ALC status and those who did not, we cannot assume observed differences such as hospital harm were caused by unnecessary hospital stays. Finally, the ODB database does not provide information on prescription drugs dispensed among all Ontarians; as such, more drugs dispensed among people with ALC status may be reflective of people being older and, thus, drugs dispensed being captured within the ODB database.

Conclusion

We identified relatively stable rates of delayed acute discharge throughout the early waves of the COVID-19 pandemic. Delayed discharge continues to be a recalcitrant issue that raises the importance of a cross-sector focus to mitigate the prevalence and negative impacts of delayed discharge.

Acknowledgements

The authors thank Aditi Desai and Lauren Cadel, who assisted with project management and manuscript formatting.

Footnotes

  • Competing interests: None declared.

  • This article has been peer reviewed.

  • Contributors: Sara Guilcher, Kerry Kuluski, Walter Wodchis, Yu Qing Bai and Susan Bronskill contributed to the concept and design. Sara Guilcher and Kerry Kuluski drafted the manuscript. Sara Guilcher, Kerry Kuluski, Walter Wodchis, Yu Qing Bai and Susan Bronskill contributed to critical revision for important intellectual content. Yu Qing Bai, Walter Wodchis and Sara Guilcher contributed to the statistical analysis. Sara Guilcher, Kerry Kuluski, Walter Wodchis and Susan Bronskill obtained funding. Yu Qing Bai contributed to administrative, technical or material support. Sara Guilcher and Kerry Kuluski supervised the study. All authors gave final approval of the version to be published and agreed to be accountable for all aspects of the work.

  • Funding: This study received funding from the Canadian Institutes of Health Research (CIHR) (grant no. 165593). This research was also supported by a grant from the Ontario Ministry of Health (MOH) to the Health System Performance Network (HSPN #694) and by ICES, which is funded by an annual grant from the Ontario MOH and the Ministry of Long-Term Care (MLTC). This document used data adapted from the Statistics Canada Postal CodeOM Conversion File, which is based on data licensed from Canada Post Corporation, and/or data adapted from the Ontario Ministry of Health Postal Code Conversion File, which contains data copied under licence from ©Canada Post Corporation and Statistics Canada. Parts of this material are based on data and information compiled and provided by the Canadian Institute for Health Information and the MOH. This study was supported by the Ontario Health Data Platform (OHDP), a Province of Ontario initiative to support Ontario’s ongoing response to COVID-19 and its related impacts. No endorsement by the OHDP, its partners or the Province of Ontario is intended or should be inferred. Adapted from Statistics Canada, this project used Census 2016; this does not constitute an endorsement by Statistics Canada of this product. The authors thank IQVIA Solutions Canada Inc. for use of its Drug Information File. The analyses, conclusions, opinions and statements expressed herein are solely those of the authors and do not reflect those of the funding or data sources; no endorsement is intended or should be inferred. At the time of this study, Sara Guilcher was supported by a CIHR Embedded Clinician Scientist Salary Award on Transitions of Care working with Ontario Health (Quality; formerly Health Quality Ontario). Dr. Guilcher is currently supported by the University of Toronto Centre for the Study of Pain Scientist Salary Award. Kerry Kuluski is the Mathias Gysler Research Chair in Patient and Family Centred Care and Walter Wodchis is the Research Chair in Implementation and Evaluation Science, both supported through Trillium Health Partners Foundation.

  • Data sharing: The data set from this study is held securely in coded form at ICES. While data sharing agreements prohibit ICES from making the data set publicly available, access may be granted to those who meet pre-specified criteria for confidential access, available at https://www.ices.on.ca/DAS. The full data set creation plan and underlying analytic code are available from the authors on request, understanding that the computer programs may rely on coding templates or macros that are unique to ICES and are therefore either inaccessible or may require modification.

  • Supplemental information: For reviewer comments and the original submission of this manuscript, please see www.cmajopen.ca/content/11/4/E621/suppl/DC1.

This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY-NC-ND 4.0) licence, which permits use, distribution and reproduction in any medium, provided that the original publication is properly cited, the use is noncommercial (i.e., research or educational use), and no modifications or adaptations are made. See: https://creativecommons.org/licenses/by-nc-nd/4.0/

References

  1. ↵
    1. Sibbald B
    (May 15, 2020) CMAJ News, What happened to the hospital patients who had “nowhere else to go”? Available: https://cmajnews.com/2020/05/15/covid-alc-1095873/. accessed 2022 Apr. 8.
  2. ↵
    1. Roberts D
    (Apr 1, 2020) Northern Ontario CTV News, Sudbury hospital to move ALC patients to hotel as first COVID-19 patient admitted. Available: https://northernontario.ctvnews.ca/sudbury-hospital-to-move-alc-patients-to-hotel-as-first-covid-19-patient-admitted-1.4877995. accessed 2022 Apr. 8.
    1. Zeidler M
    (Mar 20, 2020) CBC News, Thousands of hospital beds in B.C. cleared to make room for COVID-19. Available: https://www.cbc.ca/news/canada/british-columbia/bc-hospital-beds-covid-19-1.5505356. accessed 2022 Apr. 8.
  3. ↵
    1. Howlett K
    (Apr 5, 2020) Globe and Mail, Ontario hospital scramble to open more beds as they brace for surge in coronavirus cases. updated 2020 Apr. 6. Available: https://www.theglobeandmail.com/canada/article-ontario-hospitals-scramble-to-open-more-beds-as-they-brace-for-surge/. accessed 2022 Apr. 8.
  4. ↵
    1. Grant K,
    2. Ha TT
    (May 20, 2020) Globe and Mail, How shoring up hospitals for COVID-19 contributed to Canada’s long-term care crisis. updated 2020 May 21. Available: https://www.theglobeandmail.com/canada/article-how-shoring-up-hospitals-for-covid-19-contributed-to-canadas-long/. accessed 2022 Apr. 8.
  5. ↵
    1. Gaughan J,
    2. Gravelle H,
    3. Siciliani LJFS
    (2017) Delayed discharges and hospital type: evidence from the English NHS. Fisc Stud 38:495–519.
    OpenUrl
    1. Rojas-García A,
    2. Turner S,
    3. Pizzo E,
    4. et al.
    (2018) Impact and experiences of delayed discharge: a mixed-studies systematic review. Health Expect 21:41–56.
    OpenUrlCrossRefPubMed
    1. Tan WS,
    2. Chong WF,
    3. Chua KSG,
    4. et al.
    (2010) Factors associated with delayed discharges after inpatient stroke rehabilitation in Singapore. Ann Acad Med Singap 39:435–41.
    OpenUrlPubMed
    1. Amy C,
    2. Zagorski B,
    3. Chan V,
    4. et al.
    (2012) Acute care alternate-level-of-care days due to delayed discharge for traumatic and non-traumatic brain injuries. Healthc Policy 7:41–55.
    OpenUrlPubMed
    1. Challis D,
    2. Hughes J,
    3. Xie C,
    4. et al.
    (2014) An examination of factors influencing delayed discharge of older people from hospital. Int J Geriatr Psychiatry 29:160–8.
    OpenUrlCrossRefPubMed
  6. ↵
    1. Sutherland JM,
    2. Crump RT
    (2013) Alternative level of care: Canada’s hospital beds, the evidence and options. Healthc Policy 9:26–34.
    OpenUrlPubMed
    1. McCloskey R,
    2. Jarrett P,
    3. Stewart C
    (2015) The untold story of being designated an alternate level of care patient. Healthc Policy 11:76–89.
    OpenUrlPubMed
    1. Costa AP,
    2. Hirdes JP
    (2010) Clinical characteristics and service needs of alternate-level-of-care patients waiting for long-term care in Ontario hospitals. Healthc Policy 6:32–46.
    OpenUrlPubMed
    1. Costa AP,
    2. Poss JW,
    3. Peirce T,
    4. et al.
    (2012) Acute care inpatients with long-term delayed-discharge: evidence from a Canadian health region. BMC Health Serv Res 12:172.
    OpenUrlCrossRefPubMed
  7. ↵
    1. Walker D
    (2011) Caring for our aging population and addressing alternate level of care: report submitted to the Minister of Health and Long-Term Care (Queen’s Printer for Ontario, Toronto), pp 1–42.
  8. ↵
    (2016) Definitions and guidelines to support ALC designation in acute inpatient care (Canadian Institute for Health Information, Ottawa), pp 1–4.
  9. ↵
    Hospital stays in Canada (Canadian Institute for Health Information, Ottawa) Available: https://www.cihi.ca/en/hospital-stays-in-canada. accessed 2022 Jan. 31.
  10. ↵
    (2017) Alternate level of care (ALC): reference manual. Version 2 (Ontario Health (Cancer Care Ontario), Toronto) Available: https://ext.cancercare.on.ca/ext/databook/db2021/documents/Appendix/ALC_Reference_Manual_v2.pdf. accessed 2022 Apr. 8.
  11. ↵
    1. Everall AC,
    2. Guilcher SJT,
    3. Cadel L,
    4. et al.
    (2019) Patient and caregiver experience with delayed discharge from a hospital setting: a scoping review. Health Expect 22:863–73.
    OpenUrlPubMed
  12. ↵
    (2019) Hallway health care: a system under strain: 1st interim report from the Premier’s Council on Improving Healthcare and Ending Hallway Medicine (Ontario Ministry of Health and Long-Term Care, Toronto) Available: http://www.health.gov.on.ca/en/public/publications/premiers_council/docs/premiers_council_report.pdf, pp 1–35. accessed 2022 Apr. 8.
  13. ↵
    1. Cadel L,
    2. Guilcher SJT,
    3. Kokorelias KM,
    4. et al.
    (2021) Initiatives for improving delayed discharge from a hospital setting: a scoping review. BMJ Open 11:e044291.
    OpenUrl
  14. ↵
    1. Martin D,
    2. Miller AP,
    3. Quesnel-Vallée A,
    4. et al.
    (2018) Canada’s universal health-care system: achieving its potential. Lancet 391:1718–35.
    OpenUrlCrossRefPubMed
  15. ↵
    1. Lopez Bernal J,
    2. Cummins S,
    3. Gasparrini A
    (2019) Difference in difference, controlled interrupted time series and synthetic controls. Int J Epidemiol 48:2062–3.
    OpenUrlPubMed
  16. ↵
    1. Kontopantelis E,
    2. Doran T,
    3. Springate DA,
    4. et al.
    (2015) Regression based quasi-experimental approach when randomisation is not an option: interrupted time series analysis. BMJ 350:h2750.
    OpenUrlFREE Full Text
  17. ↵
    1. Ackroyd-Stolarz S,
    2. Bowles SK,
    3. Giffin L
    (2014) Validating administrative data for the detection of adverse events in older hospitalized patients. Drug Healthc Patient Saf 6:101–8.
    OpenUrl
    1. Levy AR,
    2. O’Brien BJ,
    3. Sellors C,
    4. et al.
    (2003) Coding accuracy of administrative drug claims in the Ontario Drug Benefit database. Can J Clin Pharmacol 10:67–71.
    OpenUrlPubMed
  18. ↵
    1. Steele LS,
    2. Glazier RH,
    3. Lin E,
    4. et al.
    (2004) Using administrative data to measure ambulatory mental health service provision in primary care. Med Care 42:960–5.
    OpenUrlCrossRefPubMed
  19. ↵
    1. Austin PC,
    2. Daly PA,
    3. Tu JV
    (2002) A multicenter study of the coding accuracy of hospital discharge administrative data for patients admitted to cardiac care units in Ontario. Am Heart J 144:290–6.
    OpenUrlCrossRefPubMed
    1. Gershon AS,
    2. Wang C,
    3. Guan J,
    4. et al.
    (2009) Identifying patients with physician-diagnosed asthma in health administrative databases. Can Respir J 16:183–8.
    OpenUrlCrossRefPubMed
    1. Gershon AS,
    2. Wang C,
    3. Guan J,
    4. et al.
    (2009) Identifying individuals with physician diagnosed COPD in health administrative databases. COPD 6:388–94.
    OpenUrlCrossRefPubMed
    1. Schultz SE,
    2. Rothwell DM,
    3. Chen Z,
    4. et al.
    (2013) Identifying cases of congestive heart failure from administrative data: a validation study using primary care patient records. Chronic Dis Inj Can 33:160–6.
    OpenUrlCrossRefPubMed
    1. Hux JE,
    2. Ivis F,
    3. Flintoft V,
    4. et al.
    (2002) Diabetes in Ontario: determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care 25:512–6.
    OpenUrlAbstract/FREE Full Text
    1. Guttmann A,
    2. Nakhla M,
    3. Henderson M,
    4. et al.
    (2010) Validation of a health administrative data algorithm for assessing the epidemiology of diabetes in Canadian children. Pediatr Diabetes 11:122–8.
    OpenUrlCrossRefPubMed
  20. ↵
    1. Tu K,
    2. Campbell NR,
    3. Chen Z-L,
    4. et al.
    (2007) Accuracy of administrative databases in identifying patients with hypertension. Open Med 1:e18–26.
    OpenUrlPubMed
  21. ↵
    1. Kralj B
    (2009) Measuring rurality: RIO2008_BASIC: methodology and results (Ontario Medical Association, Toronto).
  22. ↵
    1. Koné Pefoyo AJ,
    2. Bronskill SE,
    3. Gruneir A,
    4. et al.
    (2015) The increasing burden and complexity of multimorbidity. BMC Public Health 15:415.
    OpenUrlCrossRefPubMed
  23. ↵
    1. Gilbert T,
    2. Neuburger J,
    3. Kraindler J,
    4. et al.
    (2018) Development and validation of a Hospital Frailty Risk Score focusing on older people in acute care settings using electronic hospital records: an observational study. Lancet 391:1775–82.
    OpenUrlCrossRefPubMed
  24. ↵
    1. Chan B,
    2. Cochrane D
    (2016) Measuring patient harm in Canadian hospitals (Canadian Institute for Health Information, Ottawa) Available: https://www.cihi.ca/sites/default/files/document/cihi_cpsi_hospital_harm_en.pdf, pp 1–49. accessed 2022 Apr. 8.
  25. ↵
    1. Austin PC
    (2009) Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples. Stat Med 28:3083–107.
    OpenUrlCrossRefPubMed
  26. ↵
    1. Conell C,
    2. Flint AC
    (2016) Did the protocol change work? Interrupted time series evaluation for health care organizations (Kaiser Permanente, Oakland (CA)).
  27. ↵
    1. Durbin J,
    2. Watson GS
    (1950) Testing for serial correlation in least square regression. I. Biometrika 37:409–28.
    OpenUrlCrossRefPubMed
  28. ↵
    Personal Health Information Protection Act, 2004, S.O. 2004, c.3, Sched. A, Available: https://www.ontario.ca/laws/statute/04p03. accessed 2022 Jan. 31.
  29. ↵
    1. Di Pollina L,
    2. Guessous I,
    3. Petoud V,
    4. et al.
    (2017) Integrated care at home reduces unnecessary hospitalizations of community-dwelling frail older adults: a prospective controlled trial. BMC Geriatr 17:53.
    OpenUrlPubMed
  30. ↵
    1. Allan S,
    2. Roland D,
    3. Malisauskaite G,
    4. et al.
    (2021) The influence of home care supply on delayed discharges from hospital in England. BMC Health Serv Res 21:1297.
    OpenUrlPubMed
  31. ↵
    (2021) Common challenges, shared priorities: measuring access to home and community care and to mental health and substance use services in Canada (Canadian Institute for Health Information, Ottawa), 3.
  32. ↵
    1. Guilcher SJT,
    2. Everall AC,
    3. Cadel L,
    4. et al.
    (2021) A qualitative study exploring the lived experiences of deconditioning in hospital in Ontario, Canada. BMC Geriatr 21:169.
    OpenUrl
  33. ↵
    1. McCloskey R,
    2. Jarrett P,
    3. Stewart C,
    4. et al.
    (2014) Alternate level of care patients in hospitals: What does dementia have to do with this? Can Geriatr J 17:88–94.
    OpenUrlPubMed
    1. Swinkels A,
    2. Mitchell T
    (2009) Delayed transfer from hospital to community settings: the older person’s perspective. Health Soc Care Community 17:45–53.
    OpenUrlPubMed
    1. Wilson DM,
    2. Vihos J,
    3. Hewitt JA,
    4. et al.
    (2013) Examining waiting placement in hospital: utilization and the lived experience. Glob J Health Sci 6:12–22.
    OpenUrl
    1. Kortebein P,
    2. Ferrando A,
    3. Lombeida J,
    4. et al.
    (2007) Effect of 10 days of bed rest on skeletal muscle in healthy older adults. JAMA 297:1772–4.
    OpenUrlCrossRefPubMed
  34. ↵
    1. Bender D,
    2. Holyoke P
    (2018) Why some patients who do not need hospitalization cannot leave: a case study of reviews in 6 Canadian hospitals. Healthc Manage Forum 31:121–5.
    OpenUrl
  35. ↵
    1. Bai AD,
    2. Dai C,
    3. Srivastava S,
    4. et al.
    (2019) Risk factors, costs and complications of delayed hospital discharge from internal medicine wards at a Canadian academic medical centre: retrospective cohort study. BMC Health Serv Res 19:935.
    OpenUrlPubMed
  • © 2023 CMA Impact Inc. or its licensors
PreviousNext
Back to top

In this issue

CMAJ Open: 11 (4)
Vol. 11, Issue 4
1 Jul 2023
  • Table of Contents
  • Index by author

Article tools

Respond to this article
Print
Download PDF
Article Alerts
To sign up for email alerts or to access your current email alerts, enter your email address below:
Email Article

Thank you for your interest in spreading the word on CMAJ Open.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
An interrupted time series study using administrative health data to examine the impact of the COVID-19 pandemic on alternate care level acute hospitalizations in Ontario, Canada
(Your Name) has sent you a message from CMAJ Open
(Your Name) thought you would like to see the CMAJ Open web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
An interrupted time series study using administrative health data to examine the impact of the COVID-19 pandemic on alternate care level acute hospitalizations in Ontario, Canada
Sara J.T. Guilcher, Yu Qing Bai, Walter P. Wodchis, Susan E. Bronskill, Kerry Kuluski
Jul 2023, 11 (4) E621-E629; DOI: 10.9778/cmajo.20220086

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
An interrupted time series study using administrative health data to examine the impact of the COVID-19 pandemic on alternate care level acute hospitalizations in Ontario, Canada
Sara J.T. Guilcher, Yu Qing Bai, Walter P. Wodchis, Susan E. Bronskill, Kerry Kuluski
Jul 2023, 11 (4) E621-E629; DOI: 10.9778/cmajo.20220086
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Identifying people with post-COVID condition using linked, population-based administrative health data from Manitoba, Canada: prevalence and predictors in a cohort of COVID-positive individuals
  • Google Scholar

Similar Articles

Collections

  • Clinical
    • Infectious Diseases
      • COVID-19
    • Health services research
    • Geriatric Medicine
      • Long-term care
  • Nonclinical
    • Health Policy
      • Organization of health care

Content

  • Current issue
  • Past issues
  • Collections

About

  • General Information
  • Staff
  • Editorial Board
  • Advisory Panel
  • Contact Us
  • Reprints
  • Copyright and Permissions
CMAJ Group

Copyright 2025, CMA Impact Inc. or its licensors. All rights reserved. ISSN 2291-0026

All editorial matter in CMAJ OPEN represents the opinions of the authors and not necessarily those of the Canadian Medical Association or its subsidiaries.

To receive any of these resources in an accessible format, please contact us at CMAJ Group, 500-1410 Blair Towers Place, Ottawa ON, K1J 9B9; p: 1-888-855-2555; e: [email protected].

CMA Civility, Accessibility, Privacy

 

 

Powered by HighWire