This article has Open Peer Review reports available.
Developing a framework to guide the de-adoption of low-value clinical practices in acute care medicine: a study protocol
© The Author(s). 2017
Received: 26 October 2016
Accepted: 10 January 2017
Published: 19 January 2017
Healthcare systems have difficulty incorporating scientific evidence into clinical practice, especially when science suggests that existing clinical practices are of low-value (e.g. ineffective or harmful to patients). While a number of lists outlining low-value practices in acute care medicine currently exist, less is known about how best to initiate and sustain the removal of low-value clinical practices (i.e. de-adoption). This study will develop a comprehensive list of barriers and facilitators to the de-adoption of low-value clinical practices in acute care facilities to inform the development of a framework to guide the de-adoption process.
The proposed project is a multi-stage mixed methods study to develop a framework to guide the de-adoption of low-value clinical practices in acute care medicine that will be tested in a representative sample of acute care settings in Alberta, Canada. Specifically, we will: 1) conduct a systematic review of the de-adoption literature to identify published barriers and facilitators to the de-adoption of low-value clinical practices in acute care medicine and any associated interventions proposed (Phase one); 2) conduct focus groups with acute care stakeholders to identify important themes not published in the literature and obtain a comprehensive appreciation of stakeholder perspectives (Phase two); 3) extend the generalizability of focus group findings by conducting individual stakeholder surveys with a representative sample of acute care providers throughout the province to determine which barriers and facilitators identified in Phases one and two are most relevant in their clinical setting (Phase three). Identified barriers and facilitators will be catalogued and integrated with targeted interventions in a framework to guide the process of de-adoption in each of four targeted areas of acute care medicine (Emergency Medicine, Cardiovascular Health and Stroke, Surgery and Critical Care Medicine). Analyses will be descriptive using a combination of qualitative and quantitative analyses.
There is a growing body of literature suggesting that the de-adoption of ineffective or harmful practices from patient care is integral to the delivery of high quality care and healthcare sustainability. The framework developed in this study will map barriers and facilitators to de-adoption to the most appropriate interventions, allowing stakeholders to effectively initiate, execute and sustain this process in an evidence-based manner.
The challenge of implementing best evidence into clinical practice is a significant problem in modern healthcare  that can result in inappropriate, ineffective, inefficient and unsafe care. This is particularly problematic in acute care facilities, where large numbers of expensive therapies, technologies and treatments are used daily in an effort to save lives [2, 3]. There is a growing body of literature  which suggests that the removal (i.e. de-adoption) of ineffective and potentially harmful (i.e. low-value) clinical practices is integral to the delivery of high quality care and the sustainability of our healthcare system [5–8]. This is highlighted by the growing number of initiatives—such as the Choosing Wisely Campaign®—designed to reduce the use of low-value practices. Previous studies have produced a conceptual model for de-adoption,  and list of candidate practices to be de-adopted . However, few studies have examined how to successfully de-adopt an intervention that is already integrated into clinical practice . Thus, while there is an urgent need to de-adopt practices that are of low-value, the process of de-adoption remains poorly understood.
The challenge of translating research into clinical practice
Translating research evidence into clinical practice is important, especially for patients admitted to acute care facilities where expensive and rapidly evolving technologies are used to save lives and reduce suffering. Yet the lag between the development of scientific evidence through randomized controlled trials and the implementation of that evidence into routine clinical practice remains significant (~17 years) . The Institute of Medicine has identified six contributing factors: 1) limited knowledge of how to implement evidence into practice; 2) inefficient methods of dissemination; 3) limited evidence on comparative effectiveness to guide investments and use of technologies; 4) absence of national standards of care; 5) research groups and clinical communities working in isolation; and 6) inadequate assessment of the impact of cost, societal values and personal preferences [11, 12]. This results in three types of knowledge-practice gaps:[11, 13] over use (prescription of an intervention despite scientific evidence indicating it is ineffective or harmful), under use (little to no prescription of an intervention that science has shown to be effective) and misuse (prescription of an intervention that scientific evidence has shown to be effective, but it is prescribed for the wrong patients, under the wrong circumstances), which have important implications for patient care and outcomes .
The case for a focus on acute care facilities
Hospital-based care is a critical component of healthcare . Hospitals provide necessary treatment to patients with life and limb threatening illnesses, and play a vital role in the prevention of morbidity and mortality . Patients treated in acute care facilities are the sickest in the healthcare system, with a wide range of complex medical problems that require urgent treatment (e.g. casting fractures, complex surgical and medical interventions, life support technologies in intensive care units [ICU], etc.). In 2011, acute care facilities across member countries of the Organization for Economic Co-Operation and Development (OECD) recorded approximately 31 emergency department visits per 100 members of the population, marking a 5.2% increase in the total number of visits to emergency departments over the past decade . At the same time, hospitalisation rates have increased in about one-third of OECD countries, with curative or rehabilitative inpatient care accounting for more than a third of health spending in some countries . Rising utilization, resource constraints and resultant capacity strain threaten the current state of our acute care systems . Moreover, translating research evidence into best practice is especially problematic in the care of acutely ill patients where treatment is time sensitive and multiple expensive tests, treatments and technologies are concomitantly used in an attempt to preserve life or limb . Given existing fiscal climates, aging populations, and the proliferation of advanced clinical treatments, utilization of services may exceed the financial and human resource capacities of our healthcare system [21, 22].
The need to identify and de-adopt low-value clinical practices
Knowledge translation (KT) is a continuous quality improvement process largely focused on getting evidence into practice (i.e. adoption) . However, burgeoning emphasis has recently been placed on the advancement of healthcare agendas that preference the removal (i.e. de-adoption) of health technologies and clinical practices that are of low-value (i.e. ineffective or harmful to patients), given the strong potential to reduce preventable harm, simplify care, and reallocate resources to effective, high-value therapies. The push to expand KT activities to include de-adoption is essential, as challenges abound when it comes to the removal of established therapies no longer supported by evidence. For example, a number of studies published in top clinical journals [24, 25] have demonstrated that fluid resuscitation with albumin has no effect on meaningful clinical outcomes for the majority of patients, and is harmful when used in patients with traumatic brain injury . However, many patients (including some with traumatic brain injury) continue to be prescribed albumin . Given that a growing body of research suggests that low-value practices are common in medicine,  and that the existence and widespread publication of new, more robust evidence has repeatedly been shown to fall short of catalysing important clinical practice change, [27, 28] the challenge is to find effective ways to initiate, execute and sustain a process of de-adoption to improve quality and value in healthcare.
In direct response to this challenge, this study will catalogue top barriers and facilitators to de-adoption in the development of an applied framework to guide the systematic de-adoption of low-value clinical practices in acute care medicine. Specifically, the existing evidence base of published barriers and facilitators to de-adoption will be analyzed to inform stakeholder focus groups and the development of a survey instrument to determine top barriers and facilitators to de-adoption in a representative sample front line providers and decision-makers from 14 acute care facilities across Alberta, Canada. The outcome will be an applied strategy to facilitate the removal of practices that are no longer supported by best evidence.
To develop a strategy to guide the de-adoption of low-value clinical practices within adult acute care medicine. We intend to accomplish this objective through:
A systematic review of evidence-based barriers and facilitators to de-adoption and associated interventions.
An assessment of the top barriers and facilitators to de-adoption in a single healthcare system.
The development of a framework that integrates barriers and facilitators with specific interventions to guide the process of de-adoption.
We propose to identify and catalogue the top barriers and facilitators to the de-adoption of low-value clinical practices in a representative sample of adult acute care settings in Alberta in an effort to build an evidence-based applied framework that will guide the process of de-adoption. This three phase mixed methods study is the initial step in a program of research that will launch and sustain a systematic and customizable de-adoption strategy in adult acute care medicine. The framework of barriers and facilitators resulting from this project will ultimately support clinical and health policy decision-making and improve the quality of care patients receive. In line with the World Health Organization (WHO), we define acute care as a clinical service that responds to immediately life- or limb-threatening health conditions, encompassing a range of clinical healthcare functions, including emergency care, urgent care, short-term stabilization, pre-hospital care, critical care and trauma care & acute care surgery . Moreover, we divide low-value clinical practices into two categories: those that are ineffective (i.e. do not produce any significant or desired effect) and those that are harmful (i.e. where the risk of harm outweighs any benefit).
Study sites for data collection
• Foothills Medical Centre, Calgary, Alberta
• Peter Lougheed Centre, Calgary, Alberta
• Rockyview General Hospital, Calgary, Alberta
• South Health Campus, Calgary, Alberta
• Red Deer Regional Hospital, Red Deer, Alberta
• Grey Nuns Community Hospital, Edmonton, Alberta
• Misericordia Community Hospital, Edmonton, Alberta
• Royal Alexandra Hospital, Edmonton, Alberta
• University of Alberta Hospital, Edmonton, Alberta
• Sturgeon Community Hospital, St. Albert, Alberta
• Northern Lights Regional Health Centre, Fort McMurray, Alberta
• Queen Elizabeth II Hospital, Grand Prairie, Alberta
• Chinook Regional Hospital, Lethbridge, Alberta
• Medicine Hat Regional Hospital, Medicine Hat, Alberta
Systematic review (Phase one)
To conduct a systematic review of published barriers and facilitators to the de-adoption of low-value clinical practices in adult acute care medicine and associated interventions listed as effective. This protocol was developed according to the Preferred Reporting Items in Systematic Reviews and Meta-analyses (PRISMA) statement,  has been registered in PROSPERO International Prospective Register of Systematic Reviews (CRD42016050234) (Additional file 1). We define barriers and facilitators as factors that impede or promote use of best evidence in clinical practice. We define de-adoption as the discontinuation of a clinical practice after it has been previously adopted.4 A comparison group is not required as we will be looking for studies that describe barriers and facilitators including observational studies. However, if evaluation studies are identified, details on the comparison group will be assessed including patients and care setting.
The search strategy was designed using our existing published scoping review of de-adoption,  updating the systematic search and restricting our focus to citations describing barriers and facilitators. To update this review we will search the following electronic databases from March 5, 2014 to Fall 2016: PubMed, Medline, EMBASE, CINAHL and the Cochrane Library. A search of the ‘grey’ literature will also be conducted using the CADTH tool for searching grey literature. Bibliographies of retrieved articles will be searched for additional relevant articles. Additional information will be requested from study authors if necessary.
The search terms are specific to articles reporting de-adoption, including text words that include combinations and synonyms of de-adoption and healthcare technologies. Appropriate wildcards will be used to account for plurals and variations in spelling. Appendix outlines the proposed MEDLINE search strategy.
We will include English language citations that refer to barriers or facilitators to the de-adoption of any clinical practice in adult patients (age ≥ 18 years) with medical, surgical, or psychiatric illnesses in any healthcare setting. All original and non-original quantitative and qualitative research citations will be eligible.
The exact list of outcomes is unknown; however, it is likely to include: barriers, facilitators and interventions designed to target barriers or complement facilitators. We define barriers and facilitators as factors that influence the discontinuation of a clinical practice after it has been previously adopted
Prior to the screening of titles and abstracts, the citation screening form will be calibrated through pilot testing. Two investigators will independently review a random sample of 50 citations from the literature search, and the inclusion/exclusion criteria will be serially revised until citation selection is reliable (k > = 0.8). The same two investigators will then independently review citations through a two-step process. First, the titles and abstracts of all citations will be screened against inclusion criteria. Second, the full text of any citation categorized as include or unclear by either investigator will be reviewed to determine whether it meets eligibility criteria. Eligibility disagreements will be resolved between the reviewers by consensus, and a third reviewer will be consulted if necessary. Citations returned by the search will be imported into EndNote X7 (Thomas Reuters, Philadelphia, PA, USA).
Two reviewers (JPL, DN) will independently extract data from all included citations using a pre-designed electronic form that will be pilot tested using a random sample of 10 citations. Once data are consistently abstracted (κ ≥0.8),  reviewers will proceed with full data extraction. We will document the type of citation (e.g. original research), country, study design, study participants (e.g. disease and/or syndrome under investigation), focus of citation (e.g. identify low-value practices) recruitment and sampling and reference standard. For each barrier and facilitator we will document the name (e.g. lack of knowledge), type of practice (e.g. therapeutic vs. diagnostic, drug vs. non-drug), setting (specialty of unit), documented clinical application, the primary outcome (e.g. mortality, length of stay, days free of a particular organ failure), proposed interventions and the magnitude of the intervention’s effect (actual effect measure related to the primary outcome), and subsequent conclusions drawn by the authors. Any eligibility disagreements encountered during data extraction will be resolved by consensus, or arbitration by a third reviewer. Agreement between reviewers will be quantified using the κ statistic .
For original research studies, the same two reviewers will independently assess the quality of their methodology assessed using the framework of Caldwell et al.,  for evaluating both quantitative and qualitative study designs.
We will present a narrative synthesis of the results. Quantitative and qualitative analyses will be performed. Agreement on data abstraction and article classification will be assessed with Cohen κ reliability coefficients . Quantitative analysis will include summaries of the articles using counts, proportions, mean (standard deviation), or median (inter-quartile range, IQR) where appropriate. Qualitative analysis will include development of a comprehensive list of barriers and facilitators and proposed interventions identified in the literature and categorized and quantified using simple numerical counts. Translation of key concepts from all studies will be performed to identify novel concepts not explored by individual studies and their overlap, synthesized and refined to identify core themes.
All statistical analyses will be performed using Stata SE 13.1 (Stata Corp. LP, College Station, TX, USA). Qualitative analyses will be performed using NVivo-10 (QSR International Pty Ltd, Burlington, MA, USA).
A comprehensive summary of the de-adoption evidence base, including the identification of published barriers, facilitators and associated interventions.
Stakeholder focus groups (Phase two)
To describe perceptions pertaining to de-adoption among adult acute care stakeholders, including front-line providers (inclusive), managers and decision makers responsible for patient care, and patients and family members in an effort to identify important contextual factors and themes not published in the literature. Patients and family members have been added to this phase of the work because we are particularly interested in their perceptions of low value care, the role they feel they can play in de-adopting low value care practices (if any), and their perceptions of risks and benefits related to de-adoption.
Focus groups will be conducted with key stakeholders (e.g. front-line providers (inclusive), managers and decision makers responsible for patient care and patient and family members) in four Strategic Clinical Networks (Emergency, Cardiovascular Health and Stroke, Surgery and Critical Care) to elicit their perspectives of barriers and facilitators to de-adoption from the four areas of acute care medicine we are targeting. The focus group methodology was selected for this phase of work because it is an effective technique for exploring impressions and experiences and the contextual factors that influence those perspectives . Focus groups use interaction to build upon individual comments while encouraging the expression of unique thoughts, creating a synergy of ideas not available in one-on-one interviews .
We will conduct 3 focus groups (divided by providers, decision makers, and patients/family members) with adult acute care stakeholders in each of the four Strategic Clinical Networks (n = 12). Each network will nominate participants. Barriers, facilitators and associated interventions identified in Phase one will broadly be used to inform focus group guides. Moreover, an example for de-adoption of two practices—one related to harm and one related to no benefit—will be included to help frame discussion. This is important because the barriers and facilitators may be different between low-value and harmful practices. Customized practice examples will be chosen in each area of acute care medicine.
Sampling & recruitment
Focus groups rely on purposive samples, chosen in accordance with the project’s goals . We anticipate that participants may have different experiences relative to the following categories: a) geographic location (urban vs. regional); b) type of institution (teaching vs. non-teaching); and c) area of specialization (Emergency Medicine vs. Cardiovascular Health and Stroke vs. Surgery vs. Critical Care); d) stakeholder group (provider vs. decision maker vs. patient and family member). If variability related to resources, processes of care and institutional policies contribute to different impressions of de-adoption; these categories have a high likelihood of bringing them to light. Because different backgrounds are expected to correspond to different perspectives on de-adoption, we propose conducting specialty-specific focus groups. This should ensure that we capture a diversity of views, while maintaining the richness of perspective related to each area of specialization. We will not, however, separate focus groups by type of institution or geographic location, as we anticipate that any comparisons that might flow from these within-specialty differences will help to generate a richer more in-depth discussion. Thus, a total of 12 focus groups involving 96–120 participants (8–10/group) are planned. Participants will be engaged according to standard principles of qualitative research . A convenience sample of consecutive consenting acute care stakeholders, including patient and family members, front-line providers and managers and decision makers responsible for patient care from each of the four areas of specialization will be recruited.
Stakeholders will be eligible if they are currently affiliated with an acute care setting (or in the case of patients and family members, have had previous experiences in acute care) and if their spoken language is English. Written informed consent will be obtained prior to commencement of the focus group. Focus groups will be moderated by a researcher trained in qualitative methods (JPL), and a semi-structured focus group guide designed to elicit participants’ perceptions of barriers and facilitators to de-adoption in the acute care setting they are most affiliated with will be followed. Each focus group will include an overview to introduce the purpose and agenda, an icebreaker exercise to familiarize the participants with each other, a series of questions which proceed from general to specific, and a summary to highlight and verify key points . Domains of inquiry will be identified from the systematic review and discussion among the investigators. The focus group guide will be pilot-tested on a small group of specialty-specific stakeholders to refine the wording and flow of questions. Because we will use an iterative approach to data analysis, questions will likely be added or subtracted as the study progresses.
Focus groups will be audio taped, transcribed verbatim, de-identified, imported into NVivo-10 for data management and independently coded by two investigators with qualitative research experience, drawing on qualitative content analysis to identify themes and sub-themes. All focus group participants will be provided with a copy of the study report to review and comment on as a form of member-checking. There are no sample size considerations per se for the qualitative component of the proposed study. We will develop graphical summaries of the data to identify when asymptotes in data collection have been reached and no new themes (i.e. barriers and facilitators) are identified, indicating that the boundaries of the phenomenon have been tapped.
A description of stakeholder perceptions of de-adoption and the identification of important themes not published in the literature.
Stakeholder surveys (Phase three)
To determine which of the barriers and facilitators identified through the systematic review and focus groups are most relevant to frontline providers working in adult acute care settings.
Individual stakeholder surveys will be conducted with a representative sample of front line providers (e.g. nurses (bedside, clinician and practitioner), physicians (attending and resident), pharmacists), and those in leadership positions (e.g., medical director, unit manager) across 14 adult acute care facilities in Alberta. Survey items will be generated from the barriers and facilitators identified in the systematic review and focus groups, extending the generalizability of those findings. Using a 7-point Likert scale, survey respondents will be asked to rate barriers and facilitators according to their importance as opportunities for improving the de-adoption of low-value clinical practices (ineffective, harmful) within their specific settings (Emergency Department, Operating Room, Cardiovascular Coronary Care Unit and Intensive Care Unit) and suggest additional ideas using open response questions. Using a similar scale, providers will also be asked to rate proposed interventions according to their perceived level of effectiveness to initiate and sustain practice change within their specific clinical setting. All respondents will be asked to identify the top 5 barriers and facilitators that are most important in their clinical setting for the de-adoption of ineffective practices, the top 5 for harmful practices, and the top 5 interventions. We will request identifiable data in the survey (age, gender, number of years working in acute care, primary specialization, role in organization, type of institution currently working in) to determine whether and how perceptions differ by practice setting, hospital type (tertiary vs. community vs. regional) and provider characteristics (e.g. MDs vs. RNs vs. R.PH).
Sampling & recruitment
A stratified random sample (using the characteristics outlined below) of frontline providers across the provincial acute care spectrum (n = 2,285 providers sampled) will be targeted using a clear and easy to understand electronic survey (SurveyMonkey, Palo Alto, CA, USA). Our sampling frame will be developed from the frontline membership lists of the participating units (Emergency, Cardiovascular Health and Stroke, Surgery, Critical Care) and electronic surveys will be sent to potential respondents via email. Our targets include 400 completed surveys from each of the four target areas of acute care medicine (n = 1,600), with relatively equal distribution across hospital (n = 14), provider and unit characteristics (~30 surveys per unit from each of the 14 hospitals).
Our goal for survey recruitment is to capture a diverse representation of frontline providers, including nurses (bedside, clinician and practitioner), physicians (attending and resident), pharmacists and those in leadership positions (unit manager, member of the executive) with different characteristics (tertiary & community, teaching & non-teaching, variation in specialization) to generate a representative list of barriers and facilitators to de-adoption. Three survey reminders (two weeks apart) will be sent to everyone in the sampling frame.
Quantitative analyses will describe barriers (e.g. culture resistant to change) and facilitators (e.g. local champion) to de-adoption reported in the individual surveys, resulting in a comprehensive list. We will present global data to describe the importance of each barrier and facilitator using medians and interquartile range. We will also report the proportion of knowledge users that indicated specific barriers and facilitators as being among the top 5 most important along with their respective binomial 95% confidence. We will present detailed tabulations of survey responses by provider (RN, MD, R.PH), hospital (tertiary vs. community, teaching vs. non-teaching) and practice setting (e.g. surgery vs. critical care) characteristics. The significance of observed differences in reported barriers and facilitators will be evaluated using Chi-square tests and the analysis of variance (ANOVA). It is anticipated that we will perform quantitative analyses on approximately 1,600 stakeholder surveys (2, 285 surveys offered with 70% response rate targeted) that will provide binomial confidence intervals of ±2.4%.
Determination of which facilitators, barriers and interventions identified in the systematic review and focus groups are most relevant to frontline providers currently working in acute care.
Data from all three phases of work will be synthesized to inform the development of an applied framework to guide the process of de-adoption across the spectrum of acute care medicine. Specifically, barriers and facilitators to de-adoption identified through this work will be catalogued and differentiated by their applicability to practice setting (Emergency Department, Operating Room, Cardiovascular Coronary Care Unit and Intensive Care Unit), hospital characteristics (tertiary vs. community vs. regional), provider characteristics (MD vs. RN vs.R.PH) and the reason for de-adoption (lack of efficacy vs. potential to cause harm). We will then integrate findings with a developed list of targeted interventions (e.g. audit and feedback) to guide the process of de-adoption in each of the four areas of specialization (Emergency vs. Cardiovascular Health and Stroke vs. Surgery vs. Critical Care). The draft framework will be circulated to focus group or survey participants who indicate interest, for feedback and as a form of member-checking. While a number of lists outlining low-value practices in acute care medicine currently exist, [36, 37] this applied framework will map barriers and facilitators to de-adoption, allowing stakeholders to effectively utilize these lists to initiate, execute and sustain an evidence-based process.
Relevance of findings
Low-value clinical practices that are ineffective or potentially harmful to patients are common in healthcare, in part because implementing scientific evidence into clinical practice is often a difficult and complex process . This study is essential because it will determine barriers and facilitators to the de-adoption of low-value clinical practices in acute care medicine, and provide hospitals with an applied framework to guide the de-adoption process. Ensuring that patients receive the right care, at the right time is the ultimate goal of this study. This is especially important for the population of patients who enter into the acute care system requiring urgent life-or-limb saving treatment in a time sensitive manner. This project will help to build a foundation for the creation of effective strategies to improve the use of best-evidence by facilitating the removal of practices that are no longer supported by best evidence. This study is directly aligned with important system and healthcare needs to increase quality of care and value for money by facilitating the removal of unnecessary, ineffective and potentially harmful treatments and technologies in acute care medicine.
This study has the potential to improve the care that acutely ill patients receive during their hospital stay by identifying and cataloguing top barriers and facilitators to the de-adoption of low-value and harmful clinical practices to create an applied framework to guide the de-adoption process in acute care medicine. This is a first step towards improving patient care. We intend to test and implement our de-adoption strategy through a series of future projects: (1) evaluate the framework by pilot testing one KT intervention to de-adopt a single harmful or ineffective clinical practice that is relevant to each of the four areas of acute care included in this study (e.g. reducing the use of albumin for fluid resuscitation); (2) compare the impact of our de-adoption strategy for practices that are low-value vs. those that are harmful to patients; (3) Examine the relationship between de-adoption and long-term clinical and economic outcomes in a prospective cohort study.
This work was supported by the MSI Foundation of Alberta (M.S.I. Grant #882).
Availability of data and materials
All authors contributed to the conception (JPL, DN, HTS) or design (JPL, JB, DN, HTS) of the work; and drafting (JPL) or revising (DN, JB, HTS) the work for important intellectual content; and provide final approval of the manuscript and agree to be accountable for the accuracy and integrity of the work.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Research ethics board approval has been obtained from the Conjoint Health Research Ethics Board (CHREB), University of Calgary (REB16-1241). Written informed consent will be obtained from each participant prior to commencement of the focus group. Completion of the survey instrument will denote implied consent. Focus group identifiers will be encrypted and data stored on password-protected computers and locked offices at Foothills Medical Centre. Research staff will be indemnified to not disclose data and will sign confidentiality agreements. The systematic review (Phase one) will use only publically available literature and therefore does not require research ethics board approval. We anticipate that no ethical or safety considerations will arise from this research.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Wennberg JE. Unwarranted variations in healthcare delivery: Implications for academic medical centres. BMJ. 2002;325(7370):961–4.View ArticlePubMedPubMed CentralGoogle Scholar
- Halpern NA, Bettes L, Greenstein R. Federal and nationwide intensive care units and healthcare costs: 1986-1992. Crit Care Med. 1994;22(12):2001–7.PubMedGoogle Scholar
- Halpern NA, Pastores SM. Critical care medicine in the united states 2000-2005: An analysis of bed numbers, occupancy rates, payer mix, and costs. Crit Care Med. 2010;38(1):65–71.View ArticlePubMedGoogle Scholar
- Niven DJ, Mrklas KJ, Holodinsky JK, et al. Towards understanding the de-adoption of low-value clinical practices: A scoping review. BMC Med. 2015;13:255.View ArticlePubMedPubMed CentralGoogle Scholar
- Garner S, Littlejohns P. Disinvestment from low value clinical interventions: Nicely done? BMJ. 2011;343:d4519.View ArticlePubMedGoogle Scholar
- Elshaug AG, Watt AM, Mundy L, et al. Over 150 potentially low-value health care practices: An australian study. Med J Aust. 2012;197(10):556–60.View ArticlePubMedGoogle Scholar
- Joshi NP, Stahnishc FW, Noseworthy TW. Reassessment of health technologies: Obsolescence and waste. 2009. Canadian Agency for Drugs and Technologies in Health, https://www.cadth.ca/reassessment-health-technologies-obsolescence-and-waste. Accessed 7 Aug 2016.
- Cassel CK, Guest JA. Choosing wisely: Helping physicians and patients make smart decisions about their care. Jama. 2012;307(17):1801–2.View ArticlePubMedGoogle Scholar
- Niven DJ, McCormick J, Straus SE, et al. Reversal of scientific evidence and identifying opportunities for deadoption in critical care: A scoping review. [Under Peer Rev]. 2016Google Scholar
- Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: Understanding time lags in translational research. J R Soc Med. 2011;104(12):510–20.View ArticlePubMedPubMed CentralGoogle Scholar
- Institute of Medicine Committee on the Quality of Health Care in America. Crossing the quality chasm: A new health system for the 21st century. Washington DC: National Academy Press; 2001.Google Scholar
- Straus SE, Tetroe J, Graham ID. Knowledge translation in health care: Moving from evidence to practice. 2nd ed. Oxford: BMJ Books; 2013.Google Scholar
- Stelfox HT, Niven DJ, Clement FM, et al. Stakeholder engagement to identify priorities for improving the quality and value of critical care. PLoS One. 2015;10(10), e0140141.View ArticlePubMedPubMed CentralGoogle Scholar
- Prasad V, Ioannidis JP. Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices. Implement Sci. 2014;9:1.View ArticlePubMedPubMed CentralGoogle Scholar
- Organisation for Economic Co-operation and Development. Health care quality indicators - acute care. 2016. http://www.oecd.org/els/health-systems/hcqi-acute-care.htm. Accessed 8 Aug 2016.
- Hirshon JM, Risko N, Calvello EJ, et al. Health systems and services: The role of acute care. Bull World Health Organ. 2013;91(5):386–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Berchet C. Emergency care services: Trends, drivers and interventions to manage the demand. Paris: OECD Publishing; 2015. http://dx.doi.org/10.1787/5jrts344crns-en.View ArticleGoogle Scholar
- OECD. Health at a glance 2011: Oecd indicators. Paris: OECD Publishing; 2011.Google Scholar
- Soltani SA, Ingolfsson A, Zygun DA, et al. Quality and performance measures of strain on intensive care capacity: A protocol for a systematic review. Syst Rev. 2015;4:158.View ArticlePubMedPubMed CentralGoogle Scholar
- Sinuff T, Muscedere J, Adhikari NK, et al. Knowledge translation interventions for critically ill patients: A systematic review. Crit Care Med. 2013.Google Scholar
- Jacobs P, Noseworthy TW. National estimates of intensive care utilization and costs: Canada and the united states. Crit Care Med. 1990;18(11):1282–6.View ArticlePubMedGoogle Scholar
- Needham DM, Bronskill SE, Calinawan JR, et al. Projected incidence of mechanical ventilation in ontario to 2026: Preparing for the aging baby boomers. Crit Care Med. 2005;33(3):574–9.View ArticlePubMedGoogle Scholar
- Graham ID, Logan J. Innovations in knowledge transfer and continuity of care. Can J Nurs Res. 2004;36(2):89–103.PubMedGoogle Scholar
- Finfer S, Bellomo R, Boyce N, et al. A comparison of albumin and saline for fluid resuscitation in the intensive care unit. N Engl J Med. 2004;350(22):2247–56.View ArticlePubMedGoogle Scholar
- Caironi P, Tognoni G, Masson S, et al. Albumin replacement in patients with severe sepsis or septic shock. N Engl J Med. 2014;370(15):1412–21.View ArticlePubMedGoogle Scholar
- Jones D, McEvoy S, Merz TM, et al. International albumin use: 1995 to 2006. Anaesth Intensive Care. 2010;38(2):266–73.PubMedGoogle Scholar
- Prasad V, Cifu A, Ioannidis JP. Reversals of established medical practices: Evidence to abandon ship. Jama. 2012;307(1):37–8.View ArticlePubMedGoogle Scholar
- Elshaug AG, Hiller JE, Tunis SR, et al. Challenges in australian policy processes for disinvestment from existing, ineffective health care practices. Aust New Zealand Health Policy. 2007;4:23.View ArticlePubMedPubMed CentralGoogle Scholar
- Noseworthy T, Wasylak T, O’Neill B. Strategic clinical networks in alberta: Structures, processes, and early outcomes. Healthc Manage Forum. 2015;28(6):262–4.View ArticlePubMedGoogle Scholar
- Liberati A, Altman DG, Tetzlaff J, Mulrow C, et al. The prisma statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. Ann Intern Med. 2009;151(4):W65–94.View ArticlePubMedGoogle Scholar
- Caldwell K, Henshaw L, Taylor G. Developing a framework for critiquing health research: An early evaluation. Nurse Educ Today. 2011;31(8):e1–7.View ArticlePubMedGoogle Scholar
- Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.View ArticlePubMedGoogle Scholar
- Kitzinger J. Qualitative research. Introducing focus groups. BMJ. 1995;311(7000):299–302.View ArticlePubMedPubMed CentralGoogle Scholar
- Morgan LM, Krueger RA. Planning focus groups. Thousand Oaks: Sage Publications; 1997.Google Scholar
- Strauss AL. Qualitative analysis for social scientists. Cambridge: Cambridge University Press; 2003.Google Scholar
- Gnjidic D, Elshaug AG. De-adoption and its 43 related terms: Harmonizing low-value care terminology. BMC Med. 2015;13:273.View ArticlePubMedPubMed CentralGoogle Scholar
- Schwartz AL, Landon BE, Elshaug AG, et al. Measuring low-value care in medicare. JAMA Intern Med. 2014;174(7):1067–76.View ArticlePubMedPubMed CentralGoogle Scholar