- Open Access
- Open Peer Review
Clinical interventions, implementation interventions, and the potential greyness in between -a discussion paper
BMC Health Services Researchvolume 17, Article number: 16 (2017)
There is increasing awareness that regardless of the proven value of clinical interventions, the use of effective strategies to implement such interventions into clinical practice is necessary to ensure that patients receive the benefits. However, there is often confusion between what is the clinical intervention and what is the implementation intervention. This may be caused by a lack of conceptual clarity between ‘intervention’ and ‘implementation’, yet at other times by ambiguity in application. We suggest that both the scientific and the clinical communities would benefit from greater clarity; therefore, in this paper, we address the concepts of intervention and implementation, primarily as in clinical interventions and implementation interventions, and explore the grey area in between.
To begin, we consider the similarities, differences and potential greyness between clinical interventions and implementation interventions through an overview of concepts. This is illustrated with reference to two examples of clinical interventions and implementation intervention studies, including the potential ambiguity in between. We then discuss strategies to explore the hybridity of clinical-implementation intervention studies, including the role of theories, frameworks, models, and reporting guidelines that can be applied to help clarify the clinical and implementation intervention, respectively.
Semantics provide opportunities for improved precision in depicting what is ‘intervention’ and what is ‘implementation’ in health care research. Further, attention to study design, the use of theory, and adoption of reporting guidelines can assist in distinguishing between the clinical intervention and the implementation intervention. However, certain aspects may remain unclear in analyses of hybrid studies of clinical and implementation interventions. Recognizing this potential greyness can inform further discourse.
There is increasing global awareness among scientists, healthcare professionals, and decision-makers, that regardless of how valuable clinical interventions may be, they scarcely implement themselves. Rather, the use of effective strategies to implement evidence-based clinical interventions into practice is necessary to ensure that patients receive the benefits. Thus, implementation has become a priority on a glocal level, that is, both globally and locally . Accordingly, there is a growing interest in implementation science in healthcare .
Implementation science is suggested to be “the scientific study of methods to promote the uptake of research findings”  (page 1). The increasing focus on implementation influences not only implementation science but other related scientific areas, such as research on clinical interventions. (Throughout this paper, the term ‘clinical’ conveys health care practice, directed to patients, health care professionals, or both.) While there are similarities between the scientific traditions of clinical research and implementation science, there are also disparities: theoretical and methodological standpoints and approaches may differ, influencing what researchers and health professionals consider important and customary. Clinical intervention trials were typically conducted prior to an implementation intervention study (if any); however, there are now an increasing number of studies comprising both clinical and implementation interventions, applying a so-called ‘hybrid’ design . Such hybrid designs may increase the potential ambiguity in relation to what comprises the clinical intervention and the implementation intervention.
This ambiguity may result from inaccuracy in the application of terms. Further, there may be conceptual as well as concrete grey zones in between a clinical intervention and an implementation intervention. We argue that both health care science and health care practice would benefit from further clarity on the matter of clinical interventions in relation to implementation interventions; teasing out similarities and differences and recognizing the grey areas in between could advance the scientific as well as the clinical discourse. In this discussion paper, we impart our experiences as implementation scientists in Australia, Canada, Sweden, United Kingdom and the United States of America to examine and discuss this issue; we address the concepts of intervention and implementation, primarily as in clinical interventions and implementation interventions, and explore the potential greyness in between, discussing particular approaches that could help to elucidate the greyness.
The suggested greyness: when and why it occurs, and how does it show?
Sometimes, the differentiation of a clinical intervention and an implementation intervention in a health care study is unambiguous - at other times, there is vagueness as to what is what. Ambiguity can transpire in various forms, and different degrees. At times, the greyness may be a result of lack of conceptual precision; in such case, researchers and clinicians can be aided by semantic definitions available. However, as this discussion will demonstrate, there is a potential greyness caused by the ties between a clinical intervention and an implementation intervention. At times these ties are possible to reconcile and it is possible to determine whether the outcomes are related to the clinical intervention or the implementation intervention. At other times, there is a lingering greyness between a clinical and an implementation intervention, originating from the design of the study, the theoretical or scientific propositions, or from the process of performing or reporting the study. Thus, there may be ambiguity in relation to the effect of the clinical intervention, the implementation intervention, or either one or both in a particular context. The researchers can usually recognize the greyness during or after a study; however, it may be others who question the lack of clarity over what is the clinical intervention and the implementation intervention. This greyness is often presented as an ambiguity if it is a question of the clinical intervention and the implementation intervention, the clinical intervention or the implementation intervention, or the clinical intervention versus the implementation intervention. In order to forward this issue in health care research, we consider how attention to issues such as study design, theories, frameworks, models, and reporting guidelines can be applied to aid understanding.
Defining the concepts of intervention and implementation
As a backdrop to the discussion, a semantic inquiry illustrates the congruence and dissonance, respectively, between the concepts ‘intervention’ and ‘implementation’ . To begin, the concepts have different origins: intervention is an inflection of ‘intervene’, originating from the Latin connotation ‘to come in between’, and implementation is an inflection of ‘implement’; the latter with its origin in Late Latin:’action of filling up’, which later became’to employ’ [6, 7].
As depicted in Tables 1 and 2, the terms resemble one another yet can be considered discrete; while ‘intervention’ indicates involving, in order to improve or help a situation, ‘implementation’ implies carrying something out, or putting (something) into action. Thus, from a semantic perspective, intervention and implementation could be used interchangeably, considering that implementation is itself an intervention. However, an intervention is not implementation per se; even if the noun is specified by adding ‘clinical’ (as in “clinical intervention”), it does not necessarily imply that intervention equates to implementation. Whilst intervention and implementation are not synonyms, from a semantic perspective there are similarities and potential overlaps between a clinical intervention and an implementation intervention.
In the health research context, a clinical intervention is described as any intentional action designed to result in an outcome . Thus, clinical interventions establish the magnitude of the effect of an intervention on health related outcomes [4, 9, 10]. This effect can be determined through the conduct of individual studies or knowledge syntheses (for example, systematic reviews), and knowledge tools (e.g. guidelines, decision aids, pathways) informed by a synthesis of the best available evidence [11–13]. Clinical interventions establish effects for specific clinical practices and programs, systems for the delivery of care, and even health related policies or legislation [4, 8]. Therefore, clinical interventions create the research evidence , knowledge , or, according to Lavis and colleagues  the ‘what’ to be implemented. As illustrated in this paper, this can be for example a falls prevention program or stroke rehabilitation guidelines, originating from clinical intervention studies.
In clinical research, the aim is generally to evaluate the efficiency or effectiveness of a specific clinical intervention, whereas implementation science considers the effectiveness of strategies to change behaviours, in line with the evidence of clinical effectiveness . The concept of implementation intervention can be broadened to any type of strategy that is designed to support a clinical intervention . Implementation interventions are usually complex, with methods or techniques designed to change behaviours at organisational, practitioner or patient levels [15, 16] and to enhance the adoption of a clinical intervention [4, 17]. Further, implementation interventions should be underpinned by appropriate theory to avoid overlooking factors that may be important determinants of practice, linking the theory to outcomes and exploring why, or why not, the implementation intervention was effective . Examples of implementation interventions include computer prompts, audit and feedback, internal facilitators, and in-house training [16, 17]. In this paper, the implementation intervention will be illustrated by a leadership program, as a means to support behaviours suggested to facilitate knowledge implementation.
Clinical intervention and implementation intervention cases
Falls prevention — a clinical intervention
There is convincing evidence that multiprofessional health care teams can prevent falls in older people via a three-step clinical intervention: 1) nursing assessment of the individual’s risk of falls at admission to a healthcare facility, 2) conduct of a medication review (to identify and alter therapies influencing balance), and 3) physical training and other activities tailored to the individual’s identified risk factors [19, 20]. With compelling research evidence at hand, these recommendations have been incorporated into clinical practice guidelines  and healthcare policies . However, falls are currently the leading cause of death from injury among older people [20, 23]. Further, falls in healthcare environments are largely attributed to a lack of evidence-based care [24, 25], resulting in calls to improve the implementation of falls prevention interventions .
Stroke rehabilitation — a clinical intervention
For a person affected by stroke with a residual limitation in activities of daily life (ADL), training in ADL in the home setting after discharge is a top priority ; the evidence is as credible for this clinical intervention as it is for the commencement of intravenous thrombolytic treatment within 3 h of the stroke onset . Without rehabilitation, there is a major risk for activity impairment, a negative impact on quality of life, and increased need for symptom relief . Most importantly, the ADL training should be performed in the stroke patient’s home. Yet, even with the evidence at hand, the application of rehabilitation recommendations is variable, indicating a gap between what should be done and what patients are provided in terms of evidence-based care .
An implementation intervention applied to clinical interventions for falls prevention and stroke rehabilitation
The decisions healthcare leaders make about priorities, commitments and support are critical for staff to change clinical practice and adopt new innovations [30–33]. Thus, an implementation intervention that focuses on leadership capacity building is likely to support the successful implementation of evidence-based practice, in this case, falls prevention and stroke rehabilitation practices. Consistent with previous research and theory on leadership for change [31–36], an implementation intervention focusing on leadership could include:
creating a sense of urgency to address the clinical issue (in this case: falls, and associated risks for injuries and mortality, and stroke rehabilitation practices),
understanding the gap between current practice and effective practice (e.g.: assessments, medication reviews, and exercise programs, including techniques and frequency) and setting priorities for change,
developing an implementation plan and choosing interventions that fit with the current context and barriers to change (e.g.: education, audit and feedback, reminders), and
supporting the implementation visibly and symbolically (e.g.: establishing clear department standards, recognising staff efforts to change).
Illustrating the differences and overlaps causing potential greyness between clinical and implementation interventions
While a clinical intervention can sometimes be supplemented with an implementation strategy (implicitly or explicitly), our cases illustrate the twofold interest for the clinical intervention and the implementation intervention [37, 38]. In both studies the primary outcomes were clinical: the impact of the falls prevention program on rates and severities of falls in older people, and the impact of rehabilitation on ADL function. To tease out the effects of the clinical intervention on these outcomes would involve looking at clinical practice of staff prior to, during and after the studies, that is: the conduct of falls risk assessments, medication reviews and exercise programs, and the conduct of (including the location of) stroke rehabilitation programs. By contrast, the outcomes of the implementation intervention (that is, the leadership program, including tools, training and support) would primarily be process related, including the ‘if’, ‘to what extent’, and ‘how’ the intervention participants conducted the leadership and implementation practices recommended to influence staff to conduct falls prevention or stroke rehabilitation practices.
Distinguishing the effects of the clinical intervention and the implementation intervention can be challenging. For example, poor outcomes may result from deficits related to the clinical intervention, such as lack of staff engagement in falls prevention practice or stroke rehabilitation according to guidelines, or the implementation intervention, such as poor attendance at the leadership program. The combination of the clinical intervention and implementation intervention may also trigger processes, influencing intended outcomes or providing unintended consequences. In our examples, this could be attributed to a lack of clinician buy-in for the intervention because it is not contextually appropriate, or because it differs considerably from accepted current practice. The implementation intervention might fail because of the way the leadership program was promoted and delivered. For example, leaders may state that they value the stroke rehabilitation guidelines, but fail to provide concrete application processes for clinicians. Further, as many implementation scientists recognise, the context in which the clinical intervention and implementation intervention are performed is likely to affect both the processes and outcomes . In the implementing falls prevention and stroke rehabilitation studies by way of a leadership program, we found contextual factors influenced processes and outcomes, for example: whether managers volunteered to participate, opportunities to set aside time for reflection, and the everyday collaboration between the first-line manager, staff reporting to them and relationships with more senior management. Further, while the perceived importance of the clinical intervention for the clinical context rendered effects during and after the leadership intervention, so too did the way the program was delivered and by whom. For example, unpacking a lack of commitment to alter leadership behaviours related to a combination of group dynamics in the leadership program, and the health care professionals’ lack of trust in the evidence proposed by a manager.
Demonstrating combinations of clinical interventions and implementation interventions, and the potential greyness in between
The potential greyness between clinical interventions and implementation interventions has been attended to for some time, with different methods suggested to address ambiguity. For studies evaluating clinical and implementation interventions, the concept of a hybrid design is proposed . With its aim to study both clinical effectiveness and implementation measures, the hybrid design takes a dual focus a priori, proposing three potential design types:
primary testing of the effects of a clinical intervention on relevant outcomes while also observing and gathering information on implementation;
dual testing of clinical and implementation interventions, and;
primary testing of an implementation intervention while also observing and gathering information on the clinical intervention's impact on relevant outcomes  (p 220).
Thus, a principal issue is to establish whether there is a solid (enough) evidence base. We have found this exercise can be aided by a 2×2 matrix, as suggested in fig. 1. This includes four potential cases (with ‘+‘indicating strong evidence, and ‘-‘weak evidence):
Scenario A illustrates a well-established evidence base for both the clinical intervention and the implementation intervention. In this case, greyness could occur in relation to what is an effect of the clinical intervention or the implementation intervention, or a combination of the two, in a new context.
Scenario B illustrates the example of undertaking trials with a primary focus on a clinical intervention, yet combined with an explicit (evidence-based) implementation intervention. In such cases, the effectiveness of the clinical intervention can influence or be influenced by the implementation intervention, and cause greyness. Thus, even with an emphasis on evaluating the clinical intervention, the implementation intervention should be considered, discretely and conjointly: the ‘if’, ‘how’, ‘when’, and ‘why’ it works (or not), in order to investigate how it may affect the clinical intervention.
Scenario C illustrates a case where the evidence is not settled with regards to the method or strategy to be applied for an implementation intervention while the evidence for the clinical intervention is strong. As the falls prevention and stroke rehabilitation cases elucidate, the primary focus is on testing the relevance of the implementation intervention, while data on the clinical intervention's impact on relevant outcomes are considered.
Scenario D (indicated by the twin minus-signs of the figure) illustrates cases where neither the evidence base for a clinical intervention is established, nor the evidence with regards to an implementation intervention. While we suggest these conditions are, to the best of our knowledge, rare in health care science, they may occur when a clinical intervention is trialed with an implicit implementation component (that itself is lacking evidence). Such initiatives require particular attention to attribution of observed effects .
This 2×2 matrix shares similarities to the hybrid design: a type 1 hybrid coincides with scenario B, and hybrid design three with scenario C (which was the case in our falls prevention and stroke rehabilitation examples). Scenarios A and D correspond more closely to the hybrid design type two. While the hybrid design helps clarify what is what, in terms of clinical and implementation interventions, and processes of data collection and analysis needed to tease out different aspects, we have found that application of the 2×2 matrix helps to further emphasize the evidence aspect relative to clinical and implementation interventions. In the falls prevention and stroke rehabilitation examples, the matrix illustrated the prevailing status in terms of evidence on the clinical intervention, and the need to establish the evidence with regards to the implementation intervention, making communication with health professionals, funding agencies and additional stakeholders more feasible. Even though this only partially addresses the potential greyness in clinical interventions and implementation interventions, these tools could be considered in designing and communicating a hybrid design health care study.
Using theories, models and frameworks to understand a potential greyness in clinical intervention and implementation interventions
As already noted, establishing a firm theoretical foundation for clinical and implementation interventions can leverage potential synergies and address challenges [40, 41]. There is a substantial body of literature on models and frameworks available, highlighting core concepts and distinguishing features running across multiple implementation frameworks [40, 42–44]. However, it is important to note that, at this point, frameworks are mostly descriptive, rather than predictive or prescriptive . Nevertheless, they offer a useful way to understand the potential greyness that can influence outcomes when clinical interventions and implementation interventions are studied together as hybrids, as presented in the falls prevention and stroke rehabilitation examples. In the case of the falls prevention example, the clinical intervention is based on evidence from clinical trials testing for example the influence of restraints, medications, or balance exercise , and for stroke rehabilitation, different types of exercise and team compositions . This demonstrates what we have found to be common, namely that the clinical intervention does not necessarily come with a theory, but with robust evidence (corresponding to the type C scenario in the 2x2), whereas the implementation intervention in our case is emphasized by a careful selection of theories .
To inform the testing of implementation strategies, hypotheses based on theory can support the identification of potential influences between the clinical intervention and the implementation intervention a priori, during or after a study with dual foci - and can thus assist in teasing out potential greyness. Yet, many implementation projects do not consider or incorporate theory in a systematic way; Davies et al.’s systematic review of implementation projects and program evaluations found that approximately 23% included a theoretical foundation . Yet, we have found that implementation interventions are reinforced by theories related to the content of the implementation and by process frameworks to guide the logistics of the implementation. If well integrated in the design of the project, theory can guide the direction of the study, and support the analysis and reporting of the process and its outcomes, which is beneficial for both the health care research and clinical communities.
Frameworks and models related to clinical intervention and implementation research have some key differences that can be used to address various variables [43, 44]. At a minimum, being aware of the characteristics will clarify what to look for when selecting frameworks. Generally speaking, clinical intervention frameworks tend to address innovation factors in a comprehensive way, whilst implementation frameworks typically have more stages, address sustainability, and cover more details about the degree and depth of strategies and evaluation .
A recently-developed generic implementation framework (GIF) offers an ‘aide-memoire’ to guide consideration of key concepts  including: the clinical intervention to be implemented; layers of context; different stages of the implementation process; and factors, strategies, and evaluative methods, and thus key concepts relevant to both clinical and implementation interventions. Inclusion of the core components of the implementation intervention could be helpful in cases where the clinical intervention itself is more clearly defined or has more evidence than the implementation intervention, as in the falls prevention and stroke rehabilitation examples. Researchers can then look to implementation frameworks to ensure comprehensive coverage of aspects informing implementation and evaluation . Similarly, in both the falls prevention and stroke rehabilitation examples, attention was given to details like the pre-implementation activities needed to secure leadership support, as well as evaluation of the implementation intervention. This can assist in detecting and understanding potential links between the clinical intervention and the implementation intervention. Reporting any ambiguity, or ‘greyness’, enhances transparency, providing the research and health care communities with greater opportunity to understand the complexities involved and to recognize needs for further research.
Teasing out greyness by means of reporting guidelines
Another aid in identifying and reporting greyness between clinical and implementation interventions is consistent reporting of clinical and implementation intervention studies. With challenges of testing and reporting findings from clinical interventions and implementation interventions equally well-documented [45–51], determinants of both healthcare practice and implementation have been outlined [40, 42]. However, reporting remains inconsistent: 97% of implementation intervention studies do not report on uptake, and 69% do not report the setting in which the implementation interventions took place .
Significant progress has been made on reporting guidelines for intervention studies over the last 20 years, beginning with the Consolidated Standards of Reporting Trials (CONSORT) [53, 54]. Lately, various extensions of the CONSORT statement have been produced, and there is an international network- Enhancing the Quality and Transparency of Health Research (EQUATOR) Network – with a mission to address the problem of inadequate reporting of research through coordinating and collating research reporting guidelines . The EQUATOR network database provides a useful reference point for guidelines that could be helpful in the reporting of hybrid clinical intervention-implementation intervention studies [40, 42–44]. With a limited number of guidelines to help address the potential greyness, we have examined two reporting guidelines for potential use with hybrid clinical and implementation interventions: the Criteria for Reporting the Development and Evaluation of Complex Interventions in healthcare (CReDECI2) andcbv the Template for Intervention Description and Replication (TIDieR). The CReDECI2 allows for a broad range of study designs and captures elements important to the contextual aspects of implementation . Likewise, TIDieR does not map onto a particular study design but focuses on healthcare interventions, requiring an explanation of theory, context, intermediaries, and outcomes . The latter provides a useful template for illustrating the greyness between clinical and implementation interventions by enabling a clearer picture of the details that distinguish the intervention from others like it, and the distinctions that are important for implementation. For example, TIDieR requires outlining the provider and types of location(s) of the clinical intervention; in the falls prevention example, providers could be nurses, rehabilitation professionals and unregulated staff, and the ‘locations’ residential care homes. By comparison, CReDECI would draw out the core components (for example, stroke rehabilitation), along with the theory underpinning the implementation intervention (in this case the Promoting Action on Research Implementation in Health Services framework and the Ottawa Model of Implementation Leadership) . Further, in the stroke rehabilitation study, the national stroke guidelines were assessed for feasibility and usefulness, and data on context was collected, including for example leadership, culture, and organizational structure, in alignment with the criteria of CReDECI related to facilitators, barriers, and external factors that influence implementation. Had they been reported, further transparency would have been provided on the applicability of a clinical intervention and how the implementation intervention worked in the particular context.
In reporting quality improvement studies in healthcare, the Standards for Quality Improvement Reporting Excellence (SQUIRE 2.0) guideline adds a system-level reporting lens with its link between clinical interventions and outcomes . The SQUIRE 2.0 in parts overlaps with TIDieR and the Standards for Reporting Phase IV Implementation Studies (STaRI). The 35-item checklist of STaRI focuses on defining the intervention: details, core components, and adaptations along with their relationship to treatment outcomes, implementation outcomes, and adverse events . The implementation focus of STaRI covers a breadth of factors including setting, participants, providers, and generalisability and transferability to other contexts, with an explicit distinction between clinical outcomes and implementation outcomes.
Considering the comprehensiveness of reporting guidelines, CReDECI2 and STaRI stand out in terms of the explicit reporting they require with regards to: theory underpinning both the clinical intervention and implementation intervention; outcomes (intervention impact) and process (implementation); context (internal and external), and; level of detail for the intervention, fidelity, costs, and adaptations during the project. While we have applied neither of these guidelines in the clinical intervention and implementation intervention studies presented in this paper, we suggest that both of these reporting tools offer promising routes to tease out potential greyness in clinical and implementation interventions in the future.
Conceptual, theoretical and practical aspects considered - where does it leave clinical and implementation interventions and the potential greyness in between?
The initial semantic exercise of this discussion proposes clarity of definitions as a primary means to avoid greyness in terms of intervention and implementation. Further, adding appropriate attributes would help distinguish a clinical intervention from an implementation intervention. Our discourse implies that researchers should address both deliberate and unintentional aspects of study processes and outcomes, in order to provide the most thorough illustration possible. This would support health care professionals to better judge whether or not particular findings apply, and scientists to make informed choices. We suggest a simple exercise such as the 2x2 matrix can aid in assessing what is the current state of the evidence (regarding the clinical intervention and the implementation intervention), indicating opportunities and measures required in hybrid design studies. As further illustrated, by means of the clinical interventions and implementation intervention examples, there are designs, theories, frameworks and models that can aid in addressing what is what, and any potential greyness prior to, throughout, and post a hybrid clinical-implementation intervention study. In addition, while there is a call for theoretical foundations to be reported in terms of the clinical intervention and implementation details (see Table 3), we have found no clear, one-size-fits-all approach either to theories, frameworks and models, or reporting guidelines. For the latter we have presented a selection with the proviso that these are available for free at http://www.equator-network.org/.
This paper is a reflection on clinical interventions and implementation interventions, and the potential greyness in between. While semantics illustrate similarity, we suggest that the terms are not synonymous. Our falls prevention and stroke rehabilitation cases illustrate potential greyness as to what is a clinical intervention and what is an implementation intervention, with opportunities to tease out some of the ambiguities. We suggest that using appropriate designs, frameworks and models, alongside reporting guidelines that lend themselves to hybrid clinical-implementation intervention studies offers a way to add clarity to the design, conduct and evaluation. This input may be beneficial to scholars and healthcare professionals alike. To conclude, we hope that this paper stimulates further clinical and academic exploration and discourse.
Activities of Daily Life
Consolidated Standards of Reporting Trials
Criteria for Reporting the Development and Evaluation of Complex Interventions in healthcare
Enhancing the Quality and Transparency of Health Research
Standards for Quality Improvement Reporting Excellence
Standards for Reporting Phase IV Implementation Studies
Template for Intervention Description and Replication
World Health Organization. Bridging the “Know–Do” Gap. Geneva, Switzerland; World Health Organization: 2006.
Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. Louis de la Parte Florida Mental Health Institute: University of South Florida; 2005.
Eccles MP, Mittman BS. Welcome to implementation science. Implement Sci. 2006;1:1.
Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs. Med Care. 2012;50:217–26.
Ogden CK, Richards IA. The meaning of meaning: a study of the influence of language upon thought and of the science of symbolism. New York: Harcourt; 1989.
Merriam-Webster’s Collegiate Dictionary. 11th ed. Springfield, Mass., USA: Merriam-Webster, Inc.; 2009.
The Penguin English Dictionary. 3rd ed. London, UK: Penguin Books Ltd.; 2007.
Schillinger D. An introduction to effectiveness, dissemination and implementation research. UCSF clinical and translational science institute (CTSI) resource manuals and guides to community-engaged research. In: Fleisher P, Goldstein E, editors. Clinical translational science institute community engagement program. San Fransisco: University of California San Francisco; 2010.
Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, Rind D, et al. GRADE guidelines 6. Rating the quality of evidence--imprecision. J Clin Epidemiol. 2011;64(12):1283–93.
Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 8. Rating the quality of evidence--indirectness. J Clin Epidemiol. 2011;64(12):1303–10.
Graham ID, Logan JL, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26:13–24.
Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7(1):50.
Lavis JN, Robertson D, Woodside JM, McLeod CB, Abelson J. How can research organizations more effectively transfer research knowledge to decision makers? Milbank Q. 2003;81(2):221–48.
Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008;3(1):1.
Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8(6):iii–iv. 1–72.
Øvretveit J. Understanding the conditions for improvement: research to discover which context influences affect improvement success. BMJ Qual Saf. 2011;20 Suppl 1:i18–23.
Stetler CB, Mittman BS, Francis J. Overview of the VA quality enhancement research initiative (QUERI) and QUERI theme articles: QUERI series. Implement Sci. 2008;3:8.
Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010;5:14.
Registered Nurses’ Association of Ontari. Prevention of falls and fall injuries in the older adult. In: Guideline supplement. Toronto, Canada: RNAO; 2011.
Gillespie LD, Robertson MC, Gillespie WJ, Sherrington C, Gates S, Clemson LM, et al. Interventions for preventing falls in older people living in the community. Cochrane Database Syst Rev. 2012;9:CD007146.
Panel on Prevention of Falls in Older Persons. Summary of the updated American geriatrics society/British geriatrics society clinical practice guideline for prevention of falls in older persons. J Am Geriatr Soc. 2011;59(1):148–57.
Government of Ontario. Long-term care homes Act. Ontario, Canada: Queen’s Printer for Ontario; 2007.
World Health Organization. WHO global report on falls prevention in older Age. Geneva, Switzerland: World Health Organization; 2007.
Government of Ontario. Independence, activity and good health: Ontario’s action plan for seniors. Ontario, Canada: Queen’s Printer for Ontario; 2013.
Public Health Agency of Canada. Seniors’ Falls in Canada Second Report. In. Ottawa, Canada: Public Health Agency of Canada; 2014.0.
Fixsen D, Scott V, Blase K, Naoom S, Wagar L. When evidence is not enough: the challenge of implementing fall prevention strategies. J Safety Res. 2011;42(6):419–22.
Wright L, Hill KM, Bernhardt J, Lindley R, Ada L, Bajorek BV, Barber PA, Beer C, Golledge J, Gustafsson L, et al. Stroke management: updated recommendations for treatment along the care continuum. Intern Med J. 2012;42(5):562–9.
Socialstyrelsen [The National Board of Health and Welfare]. Nationella riktlinjerna för strokesjukvård [National guidelines for stroke care]. http://www.socialstyrelsen.se/Accessed 29 Oct 2016.
Riksstroke [National Quality Registry on Stroke]. http://www.riksstroke.org/Accessed 29 Oct 2016.
Wallin L, Ewald U, Wikblad K, Scott-Findlay S, Arnetz BB. Understanding work contextual factors: a short-cut to evidence-based practice? Worldviews Evid-Based Nurs. 2006;3(4):153–64.
Aarons GA, Ehrhart MG, Farahnak LR, Sklar M. Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annu Rev Public Health. 2014;35:255–74.
Aarons GA, Sommerfeld DH. Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. J Am Acad Child Adolesc Psychiatry. 2012;51(4):423–31.
Gifford WA, Davies BL, Graham ID, Tourangeau A, Woodend AK, Lefebre N. Developing leadership capacity for guideline use: a pilot cluster randomized control trial. Worldviews Evid Based Nurs. 2013;10(1):51–65.
Yukl G, Gordon A, Taber T. A hierarchical taxonomy of leadership behavior: Integrating a half century of behavior research. J Leadersh Org Stud. 2002;9(1):15–32.
Gifford W, Davies B, Tourangeau A, Lefebre N. Developing team leadership to facilitate guideline utilization: planning and evaluating a 3-month intervention strategy. J Nurs Manag. 2011;19(1):121–32.
Gifford WA, Graham ID, Davies BL. Multi-level barriers analysis to promote guideline based nursing care: a leadership strategy from home health care. J Nurs Manag. 2013;21(5):762–70.
Palmcrantz S, Tistad M, Eldh AC, Holmqvist LW, Ehrenberg A, Tomson G, Olsson CB, Wallin L. Assessing feasibility and acceptability of study procedures: getting ready for implementation of national stroke guidelines in out-patient health care. BMC Health Serv Res. 2015;15:517.
Tistad M, Palmcrantz S, Wallin L, Ehrenberg A, Olsson CB, Tomson G, Widén Holmqvist L, Gifford W, Eldh AC. Developing leadership in managers to facilitate the implementation of national guideline recommendations: a process evaluation of feasibility and usefulness. IJHPM. 2016;5:1–10.
Richards DA, Rahm Hallberg I. Complex interventions in health. In: An overview of research methods. London & New York: Routledge; 2015.
Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:90.
Grol RP, Bosch MC, Hulscher ME, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007;85(1):93–138.
Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, et al. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:35.
Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337–50.
Moullin JC, Sabater-Hernández D, Fernandez-Llimos F, Benrimoj SI. A systematic review of implementation frameworks of innovations in healthcare and resulting generic implementation framework. Health Res Policy Syst. 2015;13:16.
Colquhoun H, Leeman J, Michie S, Lokker C, Bragge P, Hempel S, et al. Towards a common terminology: a simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implement Sci. 2014;9:51.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new M0edical Research Council guidance. BMJ. 2008;337:a1655.
Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42.
Pinnock H, Epiphaniou E, Sheikh A, Griffiths C, Eldridge S, Craig P, et al. Developing standards for reporting implementation studies of complex interventions (StaRI): a systematic review and e-Delphi. Implement Sci. 2015;10:42.
Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21.
Rycroft-Malone J, Wilkinson JE, Burton CR, Andrews G, Ariss S, Baker R, et al. Implementing health research through academic and clinical partnerships: a realistic evaluation of the Collaborations for Leadership in Applied Health Research and Care (CLAHRC). Implement Sci. 2011;6:74.
Titler MG. Methods in translation science. Worldviews Evid Based Nurs. 2004;1(1):38–48.
Pinnock H, Taylor S, Epiphaniou E, Sheikh A, Griffiths C, Eldridge S, et al. Developing standards for reporting phase IV implementation studies (StaRI). Edinburgh, UK: University of Edinburgh; 2013.
Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Int J Surg. 2011;9(8):672–7.
Simera I, Moher D, Hoey J, Schulz KF, Altman DG. A catalogue of reporting guidelines for health research. Eur J Clin Invest. 2010;40(1):35–53.
Möhler R, Köpke S, Meyer G. Criteria for reporting the development and evaluation of complex interventions in healthcare: revised guideline (CReDECI 2). Trials. 2015;16:204.
Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.
Ogrinc G, Davies L, Goodman D, Batalden P, Davidoff F, Stevens D. SQUIRE 2.0 (Standards for QUality Improvement Reporting Excellence): revised publication guidelines from a detailed consensus process. BMJ Qual Saf. 2015;25:986-92.
The EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network. [http://www.equator-network.org/] Accessed 15 March, 2016.
The Oxford Dictionary of synonyms and antonyms. 2nd ed. Oxford, UK: Oxford University Press; 2007.
Oxford Advanced Learner’s Dictionary of Current English. 8th ed. Oxford, UK: Oxford University Press; 2010.
Cambridge Advanced Learner’s Dictionary. 3rd ed. Cambridge, UK: Cambridge University Press; 2008.
Macmillan Collocations Dictionary. Oxford, UK: Macmillan Publishers Ltd.; 2010.
The team of authors and ACE in particular are grateful to Professor A. Kitson, University of Adelaide, Australia for sharing the initial 2x2-illustration and providing opportunities for discussing its role in the paper.
There has been no particular funding of the work.
Availability of data and materials
The outline and general content of this paper was drafted at the Knowledge Utilization colloquium in Ottawa, Canada, June 2015, by all authors (ACE, JA, KDW, WG, GH, HH, DK, SM, LW and JY). Sub-teams of all authors were formed at that point, who prepared the main sections for the manuscript (ACE, JY and JA for concepts; WG, HH, LW and ACE for clinical cases; DK and SM for theories and frameworks; and KDW and GH for reporting guidelines). ACE constructed a full paper, uniting and reforming the manuscript. The full paper was critically revised by all authors in a series of editions, prior to submission (ACE, JA, KDW, WG, GH, HH, DK, SM, LW and JY). All authors read and approved the final manuscript.
Consent for publication
Ethics approval and consent to participate
The authors declare that they have no competing interests.