- Open Access
- Open Peer Review
Knowledge translation and health technology reassessment: identifying synergy
BMC Health Services Researchvolume 18, Article number: 674 (2018)
Health Technology Reassessment (HTR) is an emerging field that shifts the focus from traditional methods of technology adoption to managing technology throughout its lifecycle. HTR is a mechanism to improve patient care and system efficiency through a reallocation of resources away from low-value care towards interventions and technologies that are high value. To achieve this, the outputs of HTR and its recommendations must be translated into practice. The evolving field of knowledge translation (KT) can provide guidance to improve the uptake of evidence-informed policies and recommendations resulting from the process of HTR. This paper argues how the theories, models and frameworks from KT could advance the HTR process.
First, common KT theories, models and frameworks are presented. Second, facilitators and barriers to KT within the context of HTR are summarized from the literature. Facilitators and barriers to KT include ensuring a solid research evidence-base for the technology under reassessment, assessing the climate and context, understanding the social an political context, initiating linkage and exchange, having a structured HTR Process, adequate resources, and understanding the roles of researchers, knowledge users, and stakeholders can enhance knowledge translation of HTR outputs. Third, three case examples at the individual (micro), organizational (meso), and policy (macro) levels are used to illustrate to describe how a KT theory, model or framework could be applied to a HTR project. These case studies show how selecting and applying KT theories, models and frameworks can facilitate the implementation of HTR recommendations.
HTR and KT are synergistic processes that can be used to optimize technology use throughout its lifecycle. We argue that the application of KT theories, models and frameworks, and the assessment of barriers and facilitators to KT can facilitate translation of HTR recommendations into practice.
Health technology reassessment (HTR) is an emerging field that shifts the focus from traditional methods of technology adoption to managing technology throughout its lifecycle. HTR is defined as “a structured, evidence-based assessment of the clinical, social, ethical, and economic effects of a technology, currently used in the healthcare system, to inform optimal use of that technology in comparison to alternatives” [1,2,3]. Therefore, HTR is a mechanism to improve patient care and system efficiency through a reallocation of resources away from low-value care towards interventions and technologies of a higher value [1, 3,4,5,6].
To harness the potential power of HTR to reassess technologies currently in use, the outputs and recommendations must be translated into practice. This ‘translational’ step of the HTR process is felt to be the most difficult . In a recent jurisdictional scan of HTR activities, Leggett et al. report that of the 16 organizations that had developed a HTR program, 54% had advisory capabilities with respect to the HTR decision, with less than 5% able to directly implement the decision . Methods in knowledge translation (KT) could help to improve the uptake of evidence-informed policies and recommendations that result from a HTR process. In this paper we will argue, how the theories, models and frameworks from KT could advance HTR process. First, common KT theories, models and frameworks are presented. Second, facilitators and barriers to KT within the context of HTR are summarized from the literature. Third, three case studies are illustrated on how selecting and applying KT theories, models and frameworks can facilitate the implementation of HTR recommendations. To our knowledge there are no other publications on this topic and the arguments presented in this paper provide critical and much needed debate in this area.
Clarifying the terminology of HTR
Before we begin to understand how KT theories, models and frameworks could advance HTR, it is important to understand the myriad of terms describing the field of HTR. The terminology surrounding HTR is vast; terms including waste, low-value, obsolescence, too much medicine, unnecessary care, overuse, disinvestment, de-adoption and de-implementation have all been used [3, 6]. In particular, terms such as disinvestment, de-adoption and de-implementation are used interchangeably with HTR. However, there are important differences among them. Disinvestment, is defined as the process of completely or partially withdrawing healthcare resources from currently funded areas that provide little benefit for their cost . Disinvestment can lead to full or partial withdrawal of a technology, contractual variation, restriction, or substitution and employs financial disincentives [5, 8]. De-implementation is defined as the process where the use of low-value care is reduced or stopped on a structural basis in a planned process that uses a set of activities, which can include financial disincentives, but also uses other activities such as data feedback, education, and system interventions . Finally, de-adoption is defined as the discontinuation or rejection of a clinical practice after it was previously adopted . HTR is conceptualized as a process that offers a holistic approach to optimal technology use with disinvestment, de-implementation and de-adoption as possible outputs of the process .
Conceptual model for HTR
Soril et al. recently proposed a conceptual model for HTR . Briefly, the model has three phases: phase 1-technology selection (identification and prioritization); phase 2-decision (evidence synthesis and policy development); and phase 3-execution (policy implementation, monitoring and evaluation) .
Phase 1 involves the identification and prioritization of technologies. Technologies can be identified by clinicians, selected from pre-existing lists of low-value care, through horizon scanning or data driven mechanisms as benchmarking and practice variations [3, 7, 10]. Phase 2 consists of a broad evidence synthesis using methods primarily from health technology assessment (HTA) to determine the clinical, economic, ethical and social effects of the technology being reassessed. It also entails a comparison of alternative technologies . Subsequently, based on the evidence synthesis and stakeholder input, a policy or practice recommendation is generated. At the end of this phase, there are four potential outputs: an increase in utilization or adoption, a decrease in utilization, no change in utilization, or withdrawing the technology completely . Phase 3 entails the implementation of the policy or practice recommendation followed by monitoring and evaluation. At the end of phase 3, the ultimate outcomes of the HTR process are assessed by determining if the change was achieved or not, or remained at status quo. Note, a distinction is being made between the outputs or activities that are the result of the process in phase 2 and the outcomes or the impact that has occurred as a result of implementing the activities in phase 3.
The model proposed by Soril et al. also has two cross-cutting foundational elements that span all three phases: meaningful stakeholder engagement and ongoing knowledge exchange and utilization. Stakeholder engagement involves individuals or groups throughout the HTR process who may be impacted by the decision. Stakeholders can include physicians, nurses, other clinicians, hospital managers, decision makers, government and the public . Continuous knowledge exchange is important throughout the HTR process and involves stakeholders in the selection, prioritization, and identification of reassessment topics, the development of research questions, knowledge generation, and interpretation of findings. Both foundational elements are necessary for the successful implementation of HTR recommendations . This paper addresses the question how do the outputs in phase 2 of this HTR model translate to the outcomes in phase 3 and can KT play a role here?
Relevant knowledge translation theories, models and frameworks
KT is defined as a dynamic and iterative process that includes the synthesis, dissemination, exchange and ethically-sound application of knowledge to improve the health of populations, provide more effective health services and products, and strengthen the healthcare system . Thus, KT has emerged as a field of medicine that bridges the gap between “what we should be doing” and “what we are actually doing” in practice [12, 13].
There are several KT theories, models, and frameworks that have been summarized in various narrative and scoping reviews. [11, 14,15,16,17]. Depending on the criteria used, there are between 40 to 60 KT models currently described in the literature [11, 14,15,16,17]. The most frequently cited models and frameworks are: RE-AIM (reach, efficacy, adoption, implementation and maintenance), translation research continuum or ‘T’ models also known as bench to bedside models, the Knowledge-to-Action (KTA) framework, the promoting action on research implementation in health services (PARiHS) framework, the evidence-based public health models, stages of progression (rocket model), interactive systems framework for dissemination and implementation, and the UK medical research council framework . These KT theories, models, and frameworks all acknowledge the gap between research and its application in practice and policy. They also acknowledge the challenge that exists in bridging this gap. Many provide a process through a description of key components or illustrate diagrammatically how evidence and evidence-based interventions can be applied in practice or policy. However, these KT theories, models, and frameworks often lack details of how to scale up interventions that are shown to be successful, none incorporate cost or cost-effectiveness as a factor in determining if an intervention will be adopted widely and many of these models have yet to be tested .
Knowledge translation science theories, models and frameworks can be classified using five categories of theoretical approaches (Table 1) . These categories classify KT theories, models, and frameworks based on their purpose and approach. The taxonomy provides a concise way to frame and select from the myriad of approaches that are available to the researcher based on the situation. Further, there may also be merit in combining approaches to understand and drive the implementation process. Thus, it may be entirely acceptable to use more than one theory, model or framework. Moreover, the use of these theories, models and frameworks will depend on the knowledge users themselves (clinicians versus policy makers); their goals, and the level at which the change is being implemented. These levels can be at the individual (micro level), organizational (meso level), or policy (macro level).
The field of KT and its application to HTR is currently untouched and underutilized. We argue that KT approaches be used in the HTR process to bridge the gap between the generation of recommendations regarding technology use and their implementation. We posit that the methods in KT are essential to the success of HTR. KT’s role within the HTR context is central, driving the entire process as described in Fig. 1. Subsequently, KT models, theories and frameworks when applied to HTR could be used to move knowledge into practice.
Barriers and facilitators to knowledge translation within the context of HTR
Prior to applying KT approaches to HTR, understanding the barriers and facilitators to KT within the context of HTR is important initial step. Assessment of these barriers and facilitators need to become common to the practice of HTR. Yet, making this happen remains elusive. To frame this discussion, we have used the World Health Organization’s classification of barriers and facilitators is used (Table 2) .
HTR involves the evidence synthesis of technologies that are currently used in the system. However, for some technologies, there may be a lack of evidence regarding their effectiveness and/or cost-effectiveness [18, 19]. A good evidence base for the identification of potential technologies is essential [3, 20]. Alternatively, mechanisms to obtain this evidence through ‘evidence generation activities’ could be undertaken [7, 18]. Additionally, there may be a lack of understanding and expertise of HTR, a lack of methods to identify and prioritize technologies, and a lack of transparent approaches to conduct a HTR [2, 18, 19]. Thus, a transparent, structured, evidence-based process for the reassessment of technologies with clear identification and prioritization criteria is required [3, 7, 10, 20]. In addition, the consideration of time, human and financial resources is needed to sustain a viable HTR process [19,20,21].
Climate and context in which the proposed change is to be implemented manifests itself in HTR through barriers related to a health care provider’s attitudes towards the change, the social, and political context. Although providers may have the best intentions to adhere to HTR recommendations, intentions do not automatically equate to behaviour change, particularly if they involve the decreased use or elimination of a technology. Providers may be resistant or reluctant to dismiss technologies . There may be a lack of incentives to decrease or remove technologies from the system . Psychologically, it is harder to stop something in practice . Additionally, providers could succumb to pressure from the patient in providing unnecessary tests or treatments. Facilitators to overcome these barriers include the use of KT strategies such as clinical champions to increase buy-in, and providing knowledge of the net benefit to patients if the technology is removed or decreased [2, 5, 8]. Knowledge translation and implementation of HTR recommendations could also be motivated by explicitly stating that the intention is to improve efficiency, patient safety and patient outcomes, rather than cost savings . A shared dialogue between providers and patients may also be required . Lastly, as part of the KT plan development, providers could be asked from their perspective, what their beliefs, knowledge, skills, experiences, attitudes and motives are with respect to a technology prior to undertaking a HTR .
Understanding the social and political context within which a HTR is being undertaken is also key [2, 19,20,21,22]. There could be public pressure or the need for government to follow another jurisdiction’s decision on a particular technology. Political support, collaboration with government, and building relationships are important mitigating factors [2, 5, 20, 21]. In addition, policy regulations and restrictions in funding could be the policy change levers used to implement HTR recommendations [3, 8].
A lack of appropriate linkage and exchange with all stakeholders (providers, patients, policy makers and other stakeholders) is another barrier to HTR. Meaningful stakeholder engagement and on-going knowledge exchange have been emphasized as cross-cutting foundational elements of the HTR model . Broad and early stakeholder engagement, trusting and respectful relationships, and face-to-face interactions are facilitators to ensure ongoing linkage and exchange. From a provider perspective, strong leadership, the use of clinical champions, and understanding their perceptions is key [2, 5, 20]. From the public/patient perspective, the concept of HTR or ‘low-value care’ may not be well understood . Moreover, cost savings as an objective of HTR is also viewed as unfavorable . Hence, having public representatives involved in the process to increase their knowledge and understanding, a shared dialogue amongst patients and providers, and framing low-value practices not as a ‘waste’ resulting from financial costs associated with unnecessary tests and treatments but as ‘harm’, including physical, emotional and financial harms, are strategies to support linkage and exchange [2, 20, 21, 24, 25]. From a policy maker perspective, encouragement of political discussion and raising awareness before and during implementation , coordination, collaboration, and professional understanding would all be important facilitators for ongoing linkage and exchange [5, 21].
Researchers involved in HTR may not understand their role within the process. Furthermore, these individuals may lack the necessary skills to communicate and interact with stakeholders. They may also lack knowledge in the use of KT theories, models, and frameworks or skills to facilitate implementation. Capacity building of these individuals in the fields of KT and change management is one way to address this barrier . Additionally, understanding KT theories, models, and frameworks and the use of effective and multifaceted KT interventions to implement HTR policy or practice recommendations is needed . Researchers, with stakeholder input, could develop a well-planned overall KT strategy that is aligned with the initial goal of the HTR, uses KT approaches, and is tailored to stakeholders to ensure the uptake of HTR recommendations [20, 22].
Stakeholders play a key role in the uptake of HTR evidence. Barriers such as lack of skills and the system’s poor capacity to access HTR exist [2, 19, 21]. There may also be the absence of strong leadership to undertake a HTR or implement its recommendations within an organization . These barriers can be mitigated through capacity building of stakeholders, raising awareness of HTR, and leadership support at all levels [1, 20]. The use of change agents or knowledge brokers to bridge the gap between those involved in the HTR process and decision makers could also enhance HTR efforts . Knowledge translation and implementation within the health system may not be the problem, but rather it is ensuring that operationalization of the recommendations occurs within a functional decision-making infrastructure . Decision-makers need to understand the HTR process and provide the support and mechanisms to implement its recommendations within the health care system.
As described in Table 2 there are several barriers and facilitators of KT within the context of HTR. Those that are significant to the implementation of HTR recommendations have been identified in the literature . Within the context of HTR, our position is that these are all critical and important to address if the recommendations from the HTR are to be implemented in practice.
Application of KT to HTR - Three examples
To better understand how KT theories, models and frameworks could fit within the context of the HTR, we propose three examples to illustrate the process at each of the three different levels within the healthcare system (individual-micro, organizational-meso, and policy-macro levels).
Individual level - Micro system example
The overuse of antipsychotics to treat the behaviour and psychological symptoms of dementia in long-term care settings is a major concern . With the assistance of the University of Calgary’s Health Technology Assessment unit, Alberta Health initiated a HTR . Subsequently, a practice recommendation was generated that results in the appropriate use of antipsychotics in long-term care settings. At this micro level, a process KT model could be applied to change this practice at a long-term care setting. The Ottawa model for research use could be used to assess, monitor and evaluate potential innovations to influence the prescribing patterns of providers. This model is useful to facilitate knowledge translation at the local context and its focus is on the continuity of care intervention which by its very nature is complex bridging sectors, settings and provider groups . The model has six key elements: evidence-based innovation; potential adopters; the practice environment; implementation of interventions; adoption of the innovation; and outcomes resulting from implementation of the innovation. KT interventions may include the use of clinical champions, clinical practice guidelines, staff education, monthly inter-professional medication reviews, clinician reminders, care plan reviews, involving family, and audit and feedback [5, 6, 18, 29,30,31]. In addition to this model, a combination of KT theories, models, and frameworks may be beneficial to assess barriers and facilitators to prescribing practices of these medications . In this example, prior to selecting interventions, interrogating which behaviour change interventions are effective may be useful. In fact the authors of the OMRU model suggest just that through the concept of ‘theoretical pluralism’ where other theories, models, frameworks could be applied to components of the model . The theoretical domains framework is based on a review of 33 psychological theories and constructs to determine those most relevant to behaviour change [16, 32, 33]. Fourteen domains of behaviour change, such as knowledge, skills, intentions, goals, etc. have been mapped to 137 behaviour change techniques. So, if knowledge was identified as a behaviour domain, education and information are behaviour change techniques that could be used to influence the prescribing patterns of providers .
Organizational level - Meso system example
Primary care networks in Alberta embarked on a HTR to reassess imaging for low back pain . A practice recommendation was generated to decrease imaging for patients with low back pain at all primary care practices in the province . At this meso level, a modified version of the KTA framework, the synthesis model for the process of de-adoption, could be applied . To our knowledge this is the first de-adoption model that has been created and the model may be useful to apply in the de-adoption of imaging for low back pain. This model was developed through the identification of themes common to frameworks from a scoping review on de-adoption and modification of the KTA framework. The de-adoption model focuses on the identification and prioritization of low-value clinical practices with stakeholder engagement and follows the action cycle of the KTA framework to move these low-value practices into action or to reduce their use . It is intuitive and easy to understand, however is has yet to be tested in practice. De-adoption change interventions could include information leaflets for patients, provider education, clinical decision support, a reduction toolkit, audit and feedback, and low back pain guideline changes for family physicians. These interventions would be tested, implemented, monitored and evaluated as part of the action phases of the KTA framework .
Policy-level – Macro system example
The Australian government initiated a review of the policy on in-vitro fertilization . At present, Australians are eligible for this subsidy regardless of age and prior treatment. Through the Medical Services Advisory Committee that makes recommendation to the Health Minister on which medical services should be publicly funded, a HTR was undertaken with key stakeholders. Subsequently, based on deliberative engagements with three key stakeholder groups, a policy recommendation to only publicly fund in-vitro fertilization for women between the ages of 21 and 45 was generated . At the macro level, the implementation of this recommendation may require a different KT model to be applied. The Linking Research to Action framework (RTA) is selected as it assesses efforts and provides activities to consider to inform health policy decisions . At the policy level, there are other factors that need to be addressed that may be different from the micro and meso levels. This model considers these factors through four elements: climate for research use, production of research and appropriate synthesis for policy makers, linking research to action strategies-push/pull/exchange efforts, and evaluation. The RTA framework could be adapted to assess the climate, including ethical considerations and perspectives of providers/patients; determine the level of research evidence required for policy makers; ascertain strategies to implement the policy, such as funding restrictions, and evaluate the policy post-implementation.
Thus, we contend that the selection of a KT theory, model or framework within the context of HTR will depend on the HTR outputs and the levels at which knowledge needs to be translated (i.e. individual, organizational, policy). These three examples provide suggestions of potential KT theories, models, and frameworks that could be used. None have been applied within the context of HTR, which has been identified as an area for further research [3, 6, 22, 36]. Moreover, KT theories, models and frameworks may need to be adapted and utilized early on within the HTR process [6, 23, 37].
This paper demonstrates the synergy between KT and HTR and the role KT can play in the translation of HTR recommendations. We posit that KT theories, models and frameworks in the implementation of HTR recommendations can be applied to facilitate implementation of HTR outputs at the micro, meso and macro levels. That is, in the HTR conceptual model, KT could facilitate the translation of outputs from phase 2 to the outcomes in phase 3. Research regarding which KT theories, models, and frameworks may be best suited alongside the HTR process is critically needed. Overall, HTR and KT are complimentary processes that could be used to optimize technology use throughout its lifecycle. Let the dialogue begin!
Health technology assessment
Health technology reassessment
Knowledge-to-Action (KTA) framework
Promoting action on research implementation in health services framework
Linking research to action framework
MacKean G, Noseworthy T, Elshaug AG, Leggett L, Littlejohns P, Berezanski J, et al. Health technology reassessment: the art of the possible. Int J Technol Assess Health Care. 2013;29(4):418–23.
Leggett LE, Noseworthy T, Zarrabi M, Lorenzetti D, Sutherland L, Clement F. Health technology reassessment of non-drug technologies: current practices. Int J Technol Assess Health Care. 2012;28(3):220–7.
Soril L, MacKean G, Noseworthy TM, Leggett LE, Clement FM. Achieving optimal technology use: a proposed model for health technology reassessment. Sage Open Med. 2017;5:1–7.
Joshi NPSF, Noseworthy TW. Reassessment of health technologies: obsolescence and waste. Ottawa: Canadian Agency for Durgs and Technologies in Health; 2009.
Daniels T, Williams I, Robinson S, Spence K. Tackling disinvestment in health care services. The views of resource allocators in the English NHS. J Health Organ Manag. 2013;27(6):762–80.
Niven DJ, Mrklas KJ, Holodinsky JK, Straus SE, Hemmelgarn BR, Jeffs LP, et al. Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Med. 2015;13(1):255.
Elshaug AG, Moss JR, Littlejohns P, Karnon J, Merlin TL, Hiller JE. Identifying existing health care services that do not provide value for money. Med J Aust. 2009;190(5):269–73.
van Bodegom-Vos L, Davidoff F, Marang-van de Mheen PJ. Implementation and de-implementation: two sides of the same coin? BMJ Qual Saf. 2017;26(6):495–501.
Rogers EM. The innovation-decision process. 5th ed. New York: New York: Free Press; 2003.
Paprica PA, Culyer AJ, Elshaug AG, Peffer J, Sandoval GA. From talk to action: policy stakeholders, appropriateness, and selective disinvestment. Int J Technol Assess Health Care. 2015;31(4):236–40.
World Health Organization. Knowledge Translation Framework for Ageing and Health. Geneva; 2012. p. 1–68.
Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Heal Prof. 2006;26(1):13–24.
Majumdar SR, McAlister FA, Furberg CD. From knowledge to practice in chronic cardiovascular disease: a long and winding road. J Am College of Cardiology. 2004;43(10):1738–42.
Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337–50.
Lokker C, McKibbon KA, Colquhoun H, Hempel S. A scoping review of classification schemes of interventions to promote and integrate evidence into practice in healthcare. Implement Sci. 2015;10:27.
Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:53.
Milat AJ, Li B. Narrative review of frameworks for translating research evidence into policy and practice. Public Health Res Pract. 2017;27(1):2711704.
Haines T, O'Brien L, McDermott F, Markham D, Mitchell D, Watterson D, et al. A novel research design can aid disinvestment from existing health technologies with uncertain effectiveness, cost-effectiveness, and/or safety. J Clin Epidemiol. 2014;67(2):144–51.
Hollingworth W, Rooshenas L, Busby J, Hine CE, Badrinath P, Whiting PF, et al. Using clinical practice variations as a method for commissioners and clinicians to identify and prioritise opportunities for disinvestment in health care: a cross-sectional study, systematic reviews and qualitative study. NIHR J Library. 2015;3(13).
Mayer J, Nachtnebel A. Disinvesting from ineffective technologies: lessons learned from current programs. Int J Technol Assess Health Care. 2015;31(6):355–62.
Rooshenas L, Owen-Smith A, Hollingworth W, Badrinath P, Beynon C, Donovan JL. “I won’t call it rationing...”: an ethnographic study of healthcare disinvestment in theory and practice. Soc Sci Med. 2015;128:273–81.
Polisena J, Clifford T, Elshaug AG, Mitton C, Russell E, Skidmore B. Case studies that illustrate disinvestment and resource allocation decision-making processes in health care: a systematic review. Int J Technol Assess Health Care. 2013;29(2):174–84.
Ward V, Smith S, Foy R, House A, Hamer S. Planning for knowledge translation: a researcher's guide. Evidence Policy. 2010;6(4):527–41.
Schlesinger M, Grob R. Treating, fast and slow: Americans’ understanding of and responses to low-value care. Milbank Q. 2017;95(1):70–116.
Rosenberg A, Agiro A, Gottlieb M, Barron J, Brady P, Liu Y, et al. Early trends among seven recommendations from the choosing wisely campaign. JAMA Intern Med. 2015;175(12):1913–20.
Kreindler SA. What if implementation is not the problem? Exploring the missing links between knowledge and action. Int J Health Plann Manage. 2016;31(2):208–26.
Alberta Health. Alberta Health evidence reviews (former Alberta Heatlh technologies decision process) 2018.http://www.health.alberta.ca/initiatives/health-evidence-reviews.html. Accessed 20 Feb 2018.
Graham ID, Logan J. Innovations in knowledge transfer and continuity of care. Can J Nurs Res. 2004;36(2):89–103.
Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8(6):iii–v. 1-72
Kennedy CC, Ioannidis G, Thabane L, Adachi JD, Marr S, Giangregorio LM, et al. Successful knowledge translation intervention in long-term care: final results from the vitamin D and osteoporosis study (ViDOS) pilot cluster randomized controlled trial. Trials. 2015;16:214.
Seniors Health Strategic Clinical Network. Appropriate Use of Antipsychotics (AUA) Toolkit For Care Teams: 2018 https://www.albertahealthservices.ca/scns/auatoolkit.aspx. Accessed 20 Feb 2018.
Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A, et al. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14(1):26–33.
Michie SJM, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically dervised behavioural determinants to behaviour techniques. Appl Psychol. 2008;57(4):660–80.
Choosing Wisely Canada: 2017. https://choosingwiselycanada.org/. Accessed 9 Dec 2017.
Hodgetts K, Hiller JE, Street JM, Carter D, Braunack-Mayer AJ, Watt AM, et al. Disinvestment policy and the public funding of assisted reproductive technologies: outcomes of deliberative engagements with three key stakeholder groups. BMC Health Serv Res. 2014;14:204.
Harris C, Green S. G. EA. sustainability in health care by allocating resources effectively (SHARE) 10: operationalising disinvestment in a conceptual framework for resource allocation. BMC Health Serv Res. 2018;17:632.
Rapport F, Clay-Williams R, Churruca K, Shih P, Hogden A, Braithwaite J. The struggle of translating science into action: foundational concepts of implementation science. J Eval Clin Pract. 2018;24(1):117–26.
Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care. 1998;7(3):149–58.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.
Rosmin Esmail is funded through an Alberta Innovates Graduate Studentship.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.