We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
A categorisation of problems and solutions to improve patient referrals from primary to specialty care
BMC Health Services Researchvolume 18, Article number: 986 (2018)
Improving access to specialty care has been identified as a critical issue in the delivery of health services, especially given an increasing burden of chronic disease. Identifying and addressing problems that impact access to specialty care for patients referred to speciality care for non-emergent procedures and how these deficiencies can be managed via health system delivery interventions is important to improve care for patients with chronic conditions. However, the primary-specialty care interface is complex and may be impacted by a variety of potential health services delivery deficiencies; with an equal range of interventions developed to correct them. Consequently, the literature is also diverse and difficult to navigate. We present a narrative review to identify existing literature, and provide a conceptual map that categorizes problems at the primary-specialty care interface with linkages to corresponding interventions aimed at ensuring that patient transitions across the primary-specialty care interface are necessary, appropriate, timely and well communicated.
We searched MEDLINE and EMBASE databases from January 1, 2005 until Dec 31, 2014, grey literature and reference lists to identify articles that report on interventions implemented to improve the primary-specialty care interface. Selected articles were categorized to describe: 1) the intervention context, including the deficiency addressed, and the objective of the intervention 2) intervention activities, and 3) intervention outcomes.
We identified 106 articles, producing four categories of health services delivery deficiencies based in: 1) clinical decision making; 2) information management; 3) the system level management of patient flows between primary and secondary care; and 4) quality-of-care monitoring. Interventions were divided into seven categories and fourteen sub-categories based on the deficiencies addressed and the intervention strategies used. Potential synergies and trade-offs among interventions are discussed. Little evidence exists regarding the synergistic and antagonistic interactions of alternative intervention strategies.
The categorization acts as an aid in identifying why the primary-specialty care interface may be failing and which interventions may produce improvements. Overlap and interconnectedness between interventions creates potential synergies and conflicts among co-implemented interventions.
In response to the increasing prevalence of chronic conditions and the associated shift in the global burden of disease  there is pressure to improve chronic care [2,3,4,5]. New models for the delivery of care have been proposed, emphasising better integration between primary and specialty care, coupled with systems for better patient self-management. The goal is a patient centric system, easily navigable, with seamless transitions, that ensures patients receive appropriate services in a timely manner [6,7,8]. Achieving this goal requires reshaping of the health system through health services delivery interventions; transitioning from a compartmentalized system that is structured in terms of health care services, to an integrated system that is restructured in terms of patient focused chronic care pathways.
Improving access to specialty care, which includes any specialized medical services that can only be provided by a physician specialist, has been identified as an important system level issue, as patient outcomes may be compromised when disease management is delayed. However, accessibility is not easily decoupled from the broader need for the co-ordination of primary and speciality care  to ensure that patients are diagnosed and receive timely and effective treatment to manage their conditions, as early as possible. Access to specialty care requires that such services can be provided either locally or remotely. Here, we focus only on the former, as the latter case is deserving of focused consideration. Given that specialty care is locally available, the management of the primary-specialty care interface is important both at a patient level, as a determinant of health outcomes, experience, and satisfaction, and at a systems level as a determinant of patient flows as this interface is prone to inefficiencies .
The primary-specialty care interface centres on the referral. There are many reasons a patient might be referred to specialty care including diagnosis, management advice, and treatment beyond the scope of the primary care physician . With growing demand for specialty care, but limited resources to meet demand, referral quality is increasingly important to ensure efficient patient flow across the primary-specialty care interface; referrals should be necessary, appropriate, timely, and well communicated . In addition, the health system must support the referral process by maintaining efficient information exchange and patient flow, especially given the broader need for the co-ordination of primary and speciality care .
The primary-specialty care interface is complex , with a breadth of potential deficiencies impacting the patient journey through the primary-specialty care interface and an equal breadth of interventions. Previous reviews [10, 14, 15] have synthesized evidence on interventions to improve the primary-specialty care interface. However, while in practice, symptoms of a poorly functioning primary-specialty care interface may be easy to recognize, their causes may not be. In addition, the primary-specialty care interface may be impacted by a breadth of potential deficiencies; with an equal breadth of interventions developed to correct them. The complexity of the primary-specialty care interface requires consideration for both multitude of influencing factors and potential consequences of any given intervention, as well as the interactions amongst interventions, both synergistic and antagonistic . Theory driven approaches are necessary ; approaches that consider mechanisms of causality [17, 18] by mapping out the deficiencies, why they arise, and which strategies can be used to intervene based on evidence showing effectiveness.
In this review we deconstruct the primary-specialty care interface to produce a conceptual map between deficiencies that impact access of patients with chronic conditions who are referred to specialty care for non-emergent procedures, interventions and subsequent impacts. The objective is to create an organizational structure that enables system deficiencies to be identified and linked to potential intervention strategies, while considering potential interactions amongst intervention strategies, both synergistic and antagonistic. We focus on the system perspective, where the objective is to optimize the system to improve access to specialty care for non-emergent patients. Consequently, the patient and provider experience are not captured explicitly in this context. The practical outcome is the creation of a resource for health care organizations seeking to optimize the primary care/specialty care interface to improve access to specialty care for non-emergent patients.
The categorization was developed through an iterative two staged process.
Stage 1: Narrative literature review
Narrative literature reviews provide a flexible methodology to collect, map and summarize current state of knowledge amongst diverse studies, where a key advantage of the narrative review is the ability to examine a wide breadth of literature and to address multiple research topics . This is appropriate here, as we seek to understand a wide range of problems that impact the necessity, appropriateness, timeliness and communication of the referral, as well as how the health system supports the referral process by maintaining efficient information exchange and patient flow. It is important to note that an inherent trade-off with narrative reviews is possible subjectivity in study selection that potentially leads to biases and non-replicability. To maintain transparency, the search strategy is appended. However, the goal of our search is not to inform a comprehensive systematic review, but rather serves to capture a representative sample of the literature sufficient to inform our categorization . An iterative search strategy was developed to capture interventions that address deficiencies at the primary-specialty care interface that impact patient access to specialty care. Given our broad focus on the primary-specialty care interface we sought to limit our search to ensure a manageable number of results. Specifically, we limited our search to peer-reviewed literature published over the most recent 10 year time frame (from January 1, 2005 until May 31, 2014, at time of search), indexed in the MEDLINE and EMBASE databases (see Additional file 1). Medline and EMBASE were selected due to their broad subject coverage including clinical care, public health, health policy development and health services research. Databases such as the CINAHL database, which is a database of nursing and allied health literature, were not included. A grey literature search was also conducted. Studies of interventions meeting all inclusion criteria were considered to be eligible for review: 1) in English 2) report on intervention to correct deficiencies that impact the necessity, appropriateness, timeliness and communication of patient transitions across the primary-specialty care interface, and 3) report on human subjects via primary data, secondary data (review articles) or data validated computer simulation of a health system. Articles were screened by two reviewers at three sequential levels: title, abstract and full text. Quality criteria were not used as our objective was to be inclusive. Selected articles were categorized to identify broad classes of interventions to improve the necessity, appropriateness, timeliness, and communication of referrals. This initial categorization was completed in December 2014. Following this initial categorization, we conducted targeted searches of MEDLINE and EMBASE databases to locate peer-reviewed literature up to December 31, 2014, and searched reference lists of included articles to identify additional relevant articles.
We captured pertinent information from each selected article using a data extraction form, including: specialty, intervention strategy, intervention objective, study design, methods, reported impacts, limitations, and conclusions. Quality of evidence was not scored. Data extractions were completed by a single reviewer and reviewed by a second.
Stage 2: Categorization development
To develop our categorization we described the change process, beginning with contextualizing the need for change, and then detailing the mechanisms for change, including contextual factors which are associated or influence outcomes . The purpose was to assimilate and categorize a broad range of interventions to both highlight their individual functions as well as their relationships. Our end-goal was to develop a categorization based on the broad types of deficiencies that are observed at the primary-specialty care interface. The practical difficulty encountered was that much of the reviewed literature describes the causal mechanisms through which the intervention operates with a forward focus; providing explanations of how the intervention generates change via the intervention’s actions. Explanations and evidence as to why the performance of the primary-specialty care interface is failing were not always provided. As such, to achieve our objective, backwards extrapolation was used to identify deficiencies in the primary-specialty care interface and their causes based on the form of intervention and its actions. The process proceeded through four steps.
In the first step the intervention objectives and activities were recorded as reported in the reviewed articles. Accordingly, we described: 1) the context and the objective of the intervention; 2) intervention activities; and 3) intervention outcomes. In the second step, root causes were extrapolated by considering each intervention action in the context of its objective and identifying the root causes the identified action served to remedy. The data extracted from the included papers were then synthesized as themes and categorized with a focus on high level deficiencies and their causes thereby creating the categorization scheme . In step three, the previously recorded intervention objectives and activities were remapped within the new categorization scheme. In the final step, a summary of reported impacts were linked to the intervention activities and we finished by discussing potential synergies and conflicts among intervention strategies. Although the above process is presented as linear, in practice the four steps were iterative allowing the categorization to evolve to its final form.
Stage 1: Narrative literature review
The results of the literature search are presented in Fig. 1 (PRISMA diagram). The search returned 4893 records (Medline: 1679, Embase 3010, Articles Identified through targeted and citation searches 204). In total, 4787 records were identified as not meeting the inclusion criteria based on their title. Abstracts were reviewed in the remaining 368 articles. In total, 228 articles were excluded based on the information found in the abstract. 140 articles were extracted and reviewed in full text, with 106 of those included in this review.
Reviewed articles included systematic reviews, data validated computer simulations and empirical studies ranging from quality improvement reports, to time series analyses, and randomized controlled trials. Given the wide range of studies included in this review, the quality of the evidence reported varies among the reviewed articles. As previously noted, quality of evidence was not formally assessed here, as our objective is to provide an organizational structure that enables system deficiencies to be identified and linked to potential intervention strategies. Once the categories of intervention strategies are identified, evidence demonstrating intervention effectiveness can be reviewed as a next step. In particular, it will be important to determine if available evidence for a given category of intervention is highly context specific, or if there is a broad base of evidence that demonstrates the effectiveness of the intervention in variety of health services delivery applications and contexts.
Stage 2: Categorization
Four categories of health services delivery deficiencies were identified: deficiencies based in 1) clinical decision making, 2) information management, 3) the system level management of patient flows between primary and secondary care, 4) quality-of-care monitoring. Each is detailed below and mapped to intervention strategies, and reported impacts. Interventions were divided into seven categories and fourteen sub-categories based on the deficiencies addressed and the intervention strategies used. Figure 2 presents an overview of the categorization, with details captured in Tables 1 and 2.
Identified deficiencies at the primary-specialty care interface (Table 1)
D.1. Deficiencies based in clinical decision making encompass referral errors that pertain to the necessity, appropriateness, timeliness and communication of referrals. Note that the parameters defining the necessity, appropriateness and timeliness of a referral, as well as the information and diagnostics needed to support the referral vary between specialities and are set by current standards of care. Referral errors deviations from the defined parameters that are the result of the diagnostic process, which is probabilistic in nature and implies uncertainty and error. Four types of error were identified:
Unnecessary and inappropriate referrals are the product of false positives, which occur when the patient is inappropriately/unnecessarily identified as needing a referral to specialty care.
Delayed referrals are the product of false negatives, which occur when a referral to specialty care is necessary but is not made, resulting in patients not being referred until their condition reaches late stages [22,23,24].
Triaging errors result when patients are improperly prioritized based on the severity of their condition.
D.2. Deficiencies based in information management encompass delays that result due to technological communication breakdowns at the primary-specialist care interface. Traditionally the referral letter has been the principal means of communication and its importance is well recognized . However, unnecessary delays result from the reliance on antiquated communication technologies as a means of transmitting referral requests and subsequent communications and diagnostics between primary and specialty care. Modern information technologies can facilitate improved linkages between primary care providers and specialists [28, 29] and help limit communication delays.
D.3. Deficiencies based in the management of patient flows between primary and specialty care (Supply and demand management) encompass both the organization of care pathways traversing the primary-specialty interface and their management. The care pathway is a key determinant of the patient flows from primary to specialty care, dictating the options available to primary care providers and influencing how demand is distributed across specialty care providers and diagnostic service providers. Care pathways are designed to incorporates all relevant factors necessary to provide quality care, but should be as efficient as possible, ensuring that patients receive the appropriate care as quickly as possible. Three types of issues were identified in the management of patient flows between primary and specialty care:
Care pathway management. Inefficient care pathway structure and resource use hinders patient flows.
Role management (Inter-professional workload imbalance). Surplus demand placed on specialty care providers, creates bottlenecks within the care pathway (Short term and sustained).
Queue/Referral management (Intra-professional workload imbalance). Unmanaged distribution of referrals amongst specialty care providers may create an imbalance in specialist utilizations that unnecessarily increases average wait times.
D.4. Deficiencies in the monitoring of quality-of-care and system performance result when measurement frameworks, needed to provide decision makers the capability for strategic decision making, are lacking. Quality-of-care/performance improvement is promoted as a core value in the healthcare field, with numerous frameworks developed to measure and track the performance of health systems [30,31,32].
The impact of these four categories of deficiencies is significant, creating unnecessary delays to appropriate specialty services. At a system level, such deficiencies impact the efficiency of the health system, creating access delays for all referred patients, increased costs and extra strain on care providers. At a patient level, such errors result in a poor patient experience, and potential delays in diagnosis and therapy initiation compromising patient outcomes (e.g. rheumatoid arthritis [33, 34] and chronic kidney disease ). A lack of quality-of-care/performance monitoring compounds these issues, making it difficult to identify, evaluate the severity, and prioritise problems that arise at the primary-specialty care interface.
Intervention strategies and outcomes (Table 2)
I.1. Interventions to reduce referral error
1. Preventive interventions to reduce the occurrence of false positives, false negatives, triaging errors and communication delays.
Preventive interventions serve to improve referral quality and reduce the occurrence of referral errors. Referral guidelines [36,37,38,39,40,41,42,43,44,45,46,47] and education programs [48,49,50,51,52] targeting primary care providers generally serve as the foundation for such interventions. However, guidelines and education alone may be ineffective without feedback opportunities [43, 53,54,55,56] and relationship building . Similarly, peer review or shared/supported patient assessment may also reduce rates of unnecessary/inappropriate or delayed referrals and can be implemented via primary care triage clinics [58, 59], multidisciplinary team based diagnosis , and peer consult groups [60, 61]. The introduction of a referral process that employs standard referral forms, criteria checklists, diagnostic checklists, scoring systems [14, 62, 63] and assessment tools developed specifically for primary care use [64,65,66,67,68,69,70,71,72] serves to improve referral quality. Local health services providers should be included in dissemination activities, allowing the intervention to adapt to local circumstances [10, 50, 73].
2. Screening interventions to detect false positives, false negatives, triaging errors and communication delays.
Screening interventions serve to catch referral errors that do occur. Reassessing patients on wait lists for need and appropriateness can reduce wait lists . Clerical screening of referrals ensures completeness in terms of needed information and diagnostics . Clinical screening of diagnostics prior to a specialist consult may redirect unnecessary or inappropriate referrals [10, 76]. Screening referrals also allows referrals be triaged based on urgency. Triaging may be conducted through various means, from reviewing clinical findings and diagnostic test results to the development of specific scoring systems [77,78,79,80, 81, 82]. Previous reviews of triaging systems concluded that further evidence is required regarding the effectiveness and reliability of triaging , and whether triaging improves patient outcomes  and waiting times [83, 85]. It is difficult to identify interventions developed to catch type II errors. Since type II error results when a patient should be referred to specialty care but is not, such errors must be caught by the patient themselves. Improved patient awareness may encourage patients to voice their concerns with their primary care provider, or seek a second opinion. Various strategies are outlined for Rheumatoid arthritis . For example, internet based education sites and public awareness campaigns can be used to raise patient awareness. Community screening/outreach programmes provide patients direct access to healthcare professionals and provide alternative means for undiagnosed patients to enter specialist care [87, 88].
I.2. Interventions to improve information management- electronic referral systems and electronic medical records to expedite information sharing
Electronic referral systems (eReferrals), supplemented with electronic medical records (EMRs) enable improved information management, improving workflow efficiency and quality-of-care through better linkages between primary and specialty care, improved dialogue, and better coordination of primary and specialty care resources [28, 29, 89]. eReferrals also help facilitate transmision of diagnostics [28, 90], reduce duplicate testing  and in some cases enable referral triaging, which can improve the appropriate use of clinic time and significantly improve wait times for patients needing to see specialists [48, 92,93,94]. While eReferral systems hold great promise, in practice, the successful development and implementation of such systems has been difficult . Barriers include the high cost and extensive strategic planning required for development, privacy and data security, and technical barriers such as interoperability between proprietary EMRs . The benefits of eReferrals may well outweigh these costs but further empirical evidence is required.
I.3 Interventions to improve system level patient flows between primary and secondary care
1. Care pathway management - streamlining
Patient flows between primary and secondary care may be improved by the removal of unnecessary gatekeeping along the referral pathway, providing direct or open access. Examples include allowing patients to self-refer for follow up on uncertain diagnoses , allied health workers to refer directly to specialists , and allowing primary care physicians to circumvent preliminary specialist assessments in favour of proceeding straight to advanced diagnostics [26, 97,98,99,100,101,102,103,104, 105, 106] and even surgery . A similar strategy involves specialties running rapid access clinics to triage and provide care to urgent patients [108,109,110,111]. The inherent trade-off that comes with providing direct or open access is the potential for increased rate of inappropriate referrals or diagnostic requests. For example, one study found that in an open access system for endoscopic procedures, agreement between GPs and specialists was poor to moderate, with specialists viewing 22.1% of referrals as inappropriate .
2. Human resource management - Scope of practice restructuring.
In systems constrained by workforce shortages, improved patient flows may be achieved by allocating selected tasks to alternative health care professionals with similar scopes of practice (e.g. ). For example, extending the roles of nurses and nurse practitioners in specialty areas such as rheumatology , cardiology [114, 115] and oncology  can reduce demand for specialists while providing equivalent care with no greater risk of poorer outcomes. Similar roles may be played by allied health care providers such as physiotherapists [117, 118], and primary care physicians [119, 120]. The formation of multi-disciplinary care teams (MDTs) that provide an integrated approach to healthcare and may improve load sharing between medical and allied health professionals who work collaboratively (e.g. ). MDTs have become the standard of care in Oncology , enabling better patient access to a wide range, but increasingly specialized health care services for disease management [123, 124], but are also thought to be an effective model for chronic diseases requiring complex management strategies . Current evaluations of MDT care focus on clinical benefit to the patient [126, 127] and information on system level outcomes and cost-effectiveness is lacking .
3. Queue/referral management - Centralized intake of referrals to improve access to specialty care.
Referral management via centralized intake provides a mechanism for manage demand intra-professionally [121, 129,130,131] and to mitigate the effects of fluctuations in staffing, facility availability, and caseload (emergent, urgent, non-urgent, etc.). Centralized intake has been implemented through dedicated referral management centres, which are tasked with handling all incoming referrals for all specialties, and specialty based clinical assessment clinics. Systematic evaluations of referral management centres are lacking [10, 14]. There is evidence showing speciality based clinics offer improved urgency-based access to specialists [58, 121, 132,133,134]. While specialty based clinics have demonstrated a decreased wait period from referral to first consult, other wait periods may remain unchanged, such as the wait period from referral to surgery [135, 136]. Specialty triage clinics may also reduce the overall rate of unnecessary and inappropriate referrals, resulting in patients being appropriately diverted from specialist care .
I.4 Interventions to monitor and improve quality and/or performance - continuous quality improvement
Guavara et al.  review performance measures for the specialty referral process, categorizing performance measures into 4 principle domains: 1) referral initiation (reason and rates of referral), 2) accessibility to specialty care 3) coordination of primary and secondary care, and 4) quality (timeliness and satisfaction), with the majority of measures reporting on referral structures. Performance measures for referral processes and outcomes are lacking, and although most of the reviewed measures included assessments of validity, few reported on reliability.
Synergies and trade-offs
We end by identifying potential synergies and conflicts among intervention strategies. Recognizing synergies or trade-offs is important when attempting to manage multiple intervention strategies that may seek to achieve common or conflicting objectives .
Potential synergies amongst the reviewed interventions were identified. For example, centralized intake of referrals may facilitate the introduction of a standardized referral process, with supporting guidelines, especially if implemented with eReferrals [93, 140,141,142] improving workflow efficiency by ensuring the completeness of the referral and providing access to relevant information and diagnostics thus hastening the screening of the referral [28, 90]. In addition, standardized referral forms ensure the patient’s information, history, physical exams, laboratory tests and urgency are communicated to the specialist [143,144,145], improving triaging. Centralized intake may also facilitate the introduction of both preventive and screening interventions to reduce inappropriate/unnecessary referrals. When coupled with EMRs, referrals can be clinically screened, reducing the need for face-to-face assessment, instead allowing referrals and diagnostics to be reviewed remotely [48, 93, 94]. Triaging may be coupled with rapid access services to reduce wait times between referral and patient assessment .
Identifying potential conflicts between intervention strategies requires an understanding of the mechanisms of causality that explain why deficiencies arise, and how they are corrected via intervention. For example, our discussion of referral errors (false positives and false negatives) and the corresponding corrective interventions would not be complete without acknowledging that in many cases a trade-off will need to be made between inappropriate /unnecessary referrals and delayed referrals. Indeed, a decreased specificity and increased sensitivity will result in fewer false negatives but increased false positives, which will increase the demand for specialty services. Alternatively, an increased specificity and decreased sensitivity will result in fewer false positives but an increased number of false negatives which will increase the number of patients remaining undiagnosed and improperly managed. Interventions are needed to not only improve the sensitivity and/or specificity of the decision process, but also to optimise the balance between the sensitivity and specificity. Similarly, interventions designed to reduce or catch referral errors (sometimes called gatekeeping) may be in conflict with accessibility. For example, screening interventions to reduce rates of unnecessary and inappropriate and/or delayed referrals may introduce additional waiting periods. Such processes must be effective in redirecting inappropriate referrals in order to offset additional delays and costs that are introduced. If the false positive/negative error rates are sufficiently low, then it may be of benefit to move towards a more direct, or open access, referral system that eliminates one or more screening steps along the traditional referral pathway. Conversely, removal of screening processes to improve access times to diagnostics and specialty services may increase the frequency of inappropriate/unnecessary referral to these services, increasing wait times for all patients (appropriately and inappropriately referred). Finally, balance between system, provider, and patient perspectives is always needed. For example, when assessing referral management strategies such as centralized intake, caution is required not to limit focus purely to system efficiency. Both primary and specialist provider participation is crucial for effective centralized intake systems. Reasons for non-participation include loss of autonomy, loss of primary-specialist care relationships, and loss of control over case-loads . Patients may prefer the option to have input into the scheduling of appointments , but appropriateness may decrease . Interestingly our search revealed little if any discussion regarding the strategic balancing of these effects.
There is a large literature pertaining to interventions that impact the necessity, appropriateness, timeliness and communication of patient transitions across the primary-specialty care interface. The literature is broad and can be difficult to navigate due to complexity of the primary-specialty care interface, the breadth of potential deficiencies, and the equal breadth of interventions developed to correct them. As such, we present a narrative review that describes linkages between deficiencies at the primary-specialty care interface, which impact access to specialty services for non-emergent patients, with interventions and subsequent effects.
This review was focussed only on deficiencies at the primary-specialty care interface that impact access to specialty services to address our objective on these specific problems. The review does not consider deficiencies at the primary-specialty care interface that impact the broader patient and service provider experience. While improving access to specialty care is a critical issue in the delivery of health services, more broadly, health system performance is measured in terms of quality of care criteria in multiple dimensions. Improving access to care must be done in the context of the broader objective of improving the overall quality of care provided to patients suffering from chronic diseases.
This review is unlikely to be complete, especially given the broad scope of our topic. The literature on health services interventions applied at the primary-specialty care interface is vast, spanning many fields from clinical practice to economics and operations research. Inevitably there are bodies of work that will be revealed to have been left out. For example, the omission of CINAHL in our search strategy may have resulted in missed studies pertaining to the roles and impact of allied health care workers and nurse practitioners in reducing wait times for specialist services when the service the patient required could be provided by a nurse practitioner or an allied health care provider. Moreover, as the primary-specialty care interface continues to evolve, new problems will inevitably arise and future research will produce new innovative health system interventions.
We did not summarise the context and assess the quality of each study. Our aim and focus were to note that from a system perspective, the literature is fragmented. Specifically, the studies reviewed were generally highly context specific; developed to document improvements to in-use, specialty specific, referral systems experiencing specific difficulties (e.g. long wait times). Such an approach does not lend itself to establish the effectiveness of the intervention in the broader health systems context. Consequently, it is not clear if the available evidence pertaining to intervention effectiveness can be taken out of context. The reviewed studies were not developed to demonstrate intervention effectiveness in variety of applications and contexts.
The key strength of this review is its emphasis on the identification and categorization of deficiencies in the primary-specialty care interface by cause. Within the literature, interventions are commonly framed in terms the practical actions taken to create improvements in system performance as measured through specific outcomes such as reduced wait times between referral and consult. However, simply detailing an intervention’s actions and outcomes without describing the deficiencies the intervention is designed to correct can lead to potential mis-application. The potential issue here is one of logical verification; the logic that supports the adaptation and implementation of the reviewed interventions to new contexts can only be verified through an understanding as to why the performance of the primary-specialty care interface is failing in the first place. The intention is that such a causal approach will facilitate the development of complex integrated health system interventions that consist of multiple coordinated intervention components, managing different shortfalls in the referral system that arise at the primary-specialty care interface. The categorization serves as a necessary first step to facilitate the development and evaluation of such complex interventions. The practical outcome is the creation of a resource for health care organizations seeking to optimize the primary care/specialty care interface to improve access to specialty care for non-emergent patients from a systems perspective.
The results of this review demonstrate the breadth of deficiencies that impact access to specialty services for non-emergent patients via primary-specialty care interface and an equal breadth of corrective interventions. Although interventions developed to improve the referral process at the primary-specialty care interface hold great promise, much work remains to better understand the potential utility of such interventions. Deficiencies that limit access to specialty care for non-emergency patients, as outlined here, arise independent of context. As such, general intervention strategies that can be adapted and applied in broad range of contexts are needed.
Electronic medical records
Vos T, et al. Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990-2010: a systematic analysis for the global burden of disease study 2010. Lancet. 2012;380(9859):2163–96.
Pruitt S, Annandale S, World Health Organization. Noncommunicable Disease and Mental Health Cluster., Innovative care for chronic conditions building blocks for action : global report. In: Noncommunicable diseases and mental health. Geneva: World Health Organization; 2002.
Institute of Medicine (U.S.). Committee on Quality of Health Care in America. and ebrary Inc. Crossing the quality chasm a new health system for the 21st century. Washington, D.C: National Academy Press; 2001. p. xx, 337 p.
Institute of Medicine (U.S.) and ebrary Inc. Crossing the quality chasm, in Richard and Hinda Rosenthal lectures 2001. Washington, D.C: National Academy Press; 2003. p. vii, 38 p.
Bodenheimer T. Coordinating care - a perilous journey through the health care system. N Engl J Med. 2008;358(10):1064–71.
Wagner EH, Austin B, VonKorff M. Organizing care for patients with chronic illness. Milbank Q. 1996;74(4):511–44.
Wagner EH, et al. Quality improvement in chronic illness care: a collaborative approach. J Qual Improv. 2001;27(2):63–80.
Koh H, et al. Analysis & commentary: a proposed ‘health literate care model’ would constitute a systems approach to improving patients’ engagement in care. Health Aff. 2013;32(2):357–67.
McDonald KS, Sundaram V, Bravata DM, Lewis R, Lin N, Kraft SA, McKinnon M, Paguntalan H, Owens DK. In: Shojania KM, Wachter RM, Owens DK, editors. Closing the Quality Gap: A Critical Analysis of Quality Improvement Strategies. Rockville: Agency Healthc Res Qual; 2007.
Imison C, Naylor C. Referral management: Lessons for success. London: The King’s fund; 2010.
Redfern J, Bowling A. Efficiency of care at the primary-secondary interface: variations with GP fundholding. Health Place. 2000;6(1):15–23.
Blundell N, Clarke A, Mays N. Interpretations of referral appropriateness by senior health managers in five PCT areas in England: a qualitative investigation. Qual Saf Health Care. 2010;19(3):182–6.
Baxter SK, et al. Using logic model methods in systematic review synthesis: describing complex pathways in referral management interventions. BMC Med Res Methodol. 2014;14:62.
Akbari A, et al. Interventions to Improve outpatient referrals from primary care to secondary care [Systematic Review]: The Cochrane collaboration. Wiley; 2011. 4 CD005471. 8 Oct. 2008, https://doi.org/10.1002/14651858.CD005471.pub2
Blank L, et al. Referral interventions from primary to specialist care: a systematic review of international evidence. Br J Gen Pract. 2014;64(629):e765–74.
De Silva MJ, et al. Theory of change: a theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials. 2014;15:267.
Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, et al. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance BMJ. 2008;337:a1655.
Ferrari R. Writing narrative style literature reviews. Med Writing. 2015;24(4):230.
Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8:45.
Anderson LM, et al. Using logic models to capture complexity in systematic reviews. Res Synth Methods. 2011;2(1):33–42.
Roderick P, et al. Late referral for end-stage renal disease: a region-wide survey in the south west of England. Nephrol Dial Transplant. 2002;17(7):1252–9.
Clark M, Thomas J. Delay in referral to a specialist soft-tissue sarcoma unit. Eur J Surg Oncol. 2005;31(4):443–8.
Khattak I, Eardley N, Rooney P. Colorectal cancer - a prospective evaluation of symptom duration and GP referral patterns in an inner city teaching hospital. Color Dis. 2006;8(6):518–21.
Gandhi TK, et al. Communication breakdown in the outpatient referral process. J Gen Intern Med. 2000;15(9):626–31.
Jack C, Hazel E, Bernatsky S. Something’s missing here: a look at the quality of rheumatology referral letters. Rheumatol Int. 2012;32(4):1083–5.
Foot CN, Imison C. The quality of GP Diagnosis and Referral. London: The King’s Fund; 2010.
Fontaine P, et al. Systematic review of health information exchange in primary care practices. J Am Board Fam Med. 2010;23(5):655–70.
Chen AH, Murphy EJ, Yee HF. eReferral - a new model for integrated care. N Engl J Med. 2013;368(26):2450–3.
Musgrove P, Creese A, Preker A, Baeza C, Anell A, Prentice T. With contributions from Cassels A, Lipson D, Tenkorang DA and Wheeler M. Link to report: http://www.who.int/whr/2000/en/whr00_en.pdf.
OECD (2010). Improving Value in Health Care: Measuring Quality, OECD Health Policy Studies. Paris: OECD Publishing; https://doi.org/10.1787/9789264094819-en.
Mongan JJ. Framework for a high-performance health system for the United States. New York: Commonwealth Fund; 2006. https://www.commonwealthfund.org/sites/default/files/documents/___media_files_publications_fund_report_2006_aug_framework_for_a_high_performance_health_system_for_the_united_states_commission_12.
Choy E, et al. Treating rheumatoid arthritis early with disease modifying drugs reduces joint damage: a randomised duble blind trial of sulphasalzaine vs diclofenac sodium. Clin Exp Rheumatol. 2002;20(3):351–8.
van der Linden M, et al. Long-term impact of delay in assessment of patients with early arthritis. Arthritis Rheumatol. 2010;62:3537–46.
Smart NA, Titus TT. Outcomes of early versus late nephrology referral in chronic kidney disease: a systematic review. Am J Med. 2011;124(11):1073–80 e2.
Emery P, et al. Early referral recommendation for newly diagnosed rheumatoid arthritis: evidence based development of a clinical guide. Ann Rheum Dis. 2002;61(4):290–7.
Hulsemann J, et al. Early diagnosis of arthritis and spondyloarthritis within the framework of integrated health care in Lower Saxony. Zeitschrift Fur Rheumatologie. 2006;65(1):70–4.
Potter S, et al. Referral patterns, cancer diagnoses, and waiting times after introduction of two week wait rule for breast cancer: prospective cohort study. BMJ. 2007;335(7614):288.
Imkampe A, Bendall S, Chianakwalam C. Two-week rule: has prioritisation of breast referrals by general practitioners improved? Breast. 2006;15(5):654–8.
Hill VA, Wong E, Hart CJ. General practitioner referral guidelines for dermatology: do they improve the quality of referrals? Clin Exp Dermatol. 2000;25(5):371–6.
Matowe L, et al. Effects of mailed dissemination of the Royal College of Radiologists’ guidelines on general practitioner referrals for radiography: a time series analysis. Clin Radiol. 2002;57(7):575–8.
Eccles M, et al. Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial. Lancet. 2001;357(9266):1406–9.
Elwyn G, et al. Influencing referral practice using feedback of adherence to NICE guidelines: a quality improvement report for dyspepsia. Qual Saf Health Care. 2007;16(1):67–70.
Griffiths CE, et al. The impact of psoriasis guidelines on appropriateness of referral from primary to secondary care: a randomized controlled trial. Br J Dermatol. 2006;155(2):393–400.
Dey P, et al. Implementation of RCGP guidelines for acute low back pain: a cluster randomised controlled trial. Br J Gen Pract. 2004;54(498):33–7.
Engers AJ, et al. Implementation of the Dutch low back pain guideline for general practitioners: a cluster randomized controlled trial. Spine. 2005;30(6):559–600.
Jiwa M, et al. Implementing referral guidelines: lessons from a negative outcome cluster randomised factorial trial in general practice. BMC Fam Pract. 2006;7:65.
Fautrel B, et al. Early referral to the rheumatologist for early arthritis patients: evidence for suboptimal care. Results from the ESPOIR cohort. Rheumatology. 2010;49(1):147–55.
Fautrel B, et al. Early arthritis: early act. A community-based knowledge transfer program to improve ability of general practitionner to rapidly detect and refer to the rheumatologist patients with early arthritis. Arthritis Rheum. 2010;62:984.
Adams SG, et al. Effect of a primary care continuing education program on clinical practice of chronic obstructive pulmonary disease: translating theory into practice. Mayo Clin Proc. 2012;87(9):862–70.
Lester H, et al. REDIRECT: cluster randomised controlled trial of GP training in first-episode psychosis. Br J Gen Pract. 2009;59(563):e183–90.
Suris X, et al. A rheumatology consultancy program with general practitioners in Catalonia, Spain. J Rheumatol. 2007;34(6):1328–31.
Wright J, Wilkinson J. General practitioners’ attitudes to variations in referral rates and how these could be managed. Fam Pract. 1996;13(3):259–63.
Gagliardi A. Use of referral reply letters for continuing medical education: a review. J Contin Educ Heal Prof. 2002;22(4):222–9.
Junghans C, et al. Effect of patient-specific ratings vs conventional guidelines on investigation decisions in angina: appropriateness of referral and investigation in angina (ARIA) trial. Arch Intern Med. 2007;167(2):195–202.
Sibbald B, McDonald R, Roland M. Shifting care from hospitals to the community: a review of the evidence on quality and efficiency. J Health Serv Res Policy. 2007;12(2):110–7.
Berendsen AJ, et al. Collaboration with general practitioners: preferences of medical specialists--a qualitative study. BMC Health Serv Res. 2006;6:155.
Maddison P, et al. Improved access and targeting of musculoskeletal services in Northwest Wales: targeted early access to musculoskeletal services (TEAMS) programme. Br Med J. 2004;329(7478):1325–7.
Rymaszewski L, et al. A team approach to musculo-skeletal disorders. Ann R Coll Surg Engl. 2005;87(3):174–80.
Evans E. The Torfaen referral evaluation project. Qual Prim Care. 2009;17(6):423–9.
Evans E, Aiking H, Edwards A. Reducing variation in general practitioner referral rates through clinical engagement and peer review of referrals: a service improvement project. Qual Prim Care. 2011;19(4):263–72.
Arnett G, Hadorn DC, Steering Committee of the Western Canada waiting list project. Developing priority criteria for hip and knee replacement: results from the Western Canada Waiting List Project. Can J Surg. 2003;46(4):290–6.
Fitzgerald A, et al. Relative urgency for referral from primary care to rheumatologists: the priority referral score. Arthritis Care Res. 2011;63(2):231–9.
Maksymowych W, Rheumatologists A. Development of a web-based screening tool for early rheumatoid arthritis - ERASE: the E-triage RA study in early arthritis. J Rheumatol. 2008;35(6):1205–6.
Bell M, et al. Validation of early inflammatory arthritis detection tool within primary care practices in Canada. J Rheumatol. 2010;37(6):1317.
Tavares R, Wells GA, Bykerk VP, Guillemin F, Tugwell P, Bell MJ. Validation of a self-administered inflammatory arthritis detection tool for rheumatology triage. J Rheumatol. 2010;37(6):1277.
Bell MJ, et al. Development of a self-administered early inflammatory arthritis detection tool. BMC Musculoskelet Disord. 2010;11:50.
Beattie K, et al. The GALS screening tool: a quick and easy screen for MSK conditions in the primary care setting. Arthritis Rheum. 2008;58(9):S749–50.
Beattie K, et al. The sensitivity and specificity of the GALS (gait, arms, legs, spine) examination when used by physiotherapists to detect rheumatoid arthritis. J Rheumatol. 2010;37(6):1338.
Beattie KA, et al. Validation of the GALS musculoskeletal screening exam for use in primary care: a pilot study. BMC Musculoskelet Disord. 2008;9:115.
Campbell S, et al. Bridging the gap between primary and secondary care: use of a clinical pathway for the investigation and management of deep vein thrombosis. J Health Services Res Policy. 2008;13(SUPPL. 1):15–9.
Hobbs JA, et al. Development of a unique triage system for acute care physical therapy and occupational therapy services: an administrative case report. Phys Ther. 2010;90(10):1519–29.
Naylor C, Imison C. Referral management. Rational ways to rein in referrals. Health Serv J. 2010;120(6230):22–3.
Stainkey LA, et al. The challenge of long waiting lists: how we implemented a GP referral system for non-urgent specialist’ appointments at an Australian public hospital. BMC Health Serv Res. 2010;10:303.
Fyie K, et al. Evaluating the primary-to-specialist referral system for elective hip and knee arthroplasty. J Eval Clin Pract. 2014;20(1):66–73.
Moya M, et al. The impact of a telehealth web-based solution on neurosurgery triage and consultation. Telemed J E Health. 2010;16(9):945–9.
Sathi N, Whitehead E, Grennan D. Can a rheumatologist accurately prioritize patients on the basis of information in the general practitioner referral letters? Rheumatology. 2003;42(10):1270–1.
Graydon S, Thompson A. Triage of referrals to an outpatient rheumatology clinic: analysis of referral information and triage. J Rheumatol. 2008;35(7):1378–83.
Barbour J, et al. Evaluation of a screening tool for inflammatory joint disease. Ann Rheum Dis. 2003;62(2):187–8.
Harrington J, Walsh M. Pre-appointment management of new patient referrals in rheumatology: a key strategy for improving health care delivery. Arthritis Care Res. 2001;45(3):295–300.
Chandratreya AP, Spalding TJ, Correa R. Development and efficiency of an acute knee trauma list. Injury. 2006;37(6):502–6.
Kindrachuk D, Fourney D. Spine surgery referrals redirected through a multidisciplinary care pathway: effects of non-surgeon triage including MRI utilization. J Neurosurg Spine. 2014;20:87–92.
Harding KE, et al. Effect of triage on waiting time for community rehabilitation: a prospective cohort study. Arch Phys Med Rehabil. 2012;93(3):441–5.
Harding K, Taylor N, Leggat S. Do triage systems in healthcare improve patient flow? A systematic review of the literature. Aust Health Rev. 2011;35:371–83.
Harding KE, et al. Reducing waiting time for community rehabilitation services: a controlled before-and-after trial. Arch Phys Med Rehabil. 2013;94(1):23–31.
Villeneuve E, et al. A systematic literature review of strategies promoting early referral and reducing delays in the diagnosis and management of inflammatory arthritis. Ann Rheum Dis. 2013;72:13–22.
Deane KD, et al. Identification of undiagnosed inflammatory arthritis in a community health fair screen. Arthritis Rheum. 2009;61(12):1642–9.
Eberhardt K, et al. Detection of suspected inflammatory joint disease with a new simple self-administered hand test. Br J Rheumatol. 1988;27(6):457–61.
Williams L, et al. A web-based electronic neurology referral system: a solution for an overburdened healthcare system? Ir Med J. 2012;105(9):301–3.
Dennison J, et al. An effective electronic surgical referral system. Ann R Coll Surg Engl. 2006;88(6):554–6.
Collin S, et al. Implementation of computerised physician order entry (CPOE) and picture archiving and communication systems (PACS) in the NHS: quantitative before and after study. BMJ. 2008;337:a939.
Patterson V, et al. Email triage is an effective, efficient and safe way of managing new referrals to a neurologist. Qual Saf Health Care. 2010;19(5):e51.
Aziz SR, Ziccardi VB. Telemedicine using smartphones for oral and maxillofacial surgery consultation, communication, and treatment planning. J Oral Maxillofac Surg. 2009;67(11):2505–9.
Borooah S, et al. Using electronic referral with digital imaging between primary and secondary ophthalmic services: a long term prospective analysis of regional service redesign. Eye. 2013;27(3):392–7.
Heimly V. Electronic referrals in healthcare: a review. Stud Health Technol Inform. 2009;150:327–31.
Pace AV, Dowson CM, Dawes PT. Self-referral of symptoms (SOS) follow-up system of appointments for patients with uncertain diagnoses in rheumatology out-patients. Rheumatol. 2006;45(2):201–3.
Hemingway DM, et al. Straight to test: introduction of a city-wide protocol driven investigation of suspected colorectal cancer. Color Dis. 2006;8(4):289–95.
Prades J, et al. Implementing a Cancer fast-track Programme between primary and specialised care in Catalonia (Spain): a mixed methods study. Br J Cancer. 2011;105(6):753–9.
Team DT. Cost-effectiveness of magnetic resonance imaging of the knee for patients presenting in primary care. Br J Gen Pract. 2008;58(556):e10–6.
Shaw IS, et al. Limited impact on endoscopy demand from a primary care based ‘test and treat’ dyspepsia management strategy: the results of a randomised controlled trial. Br J Gen Pract. 2006;56(526):369–74.
Simpson GC, et al. Impact of GP direct-access computerised tomography for the investigation of chronic daily headache. Br J Gen Pract. 2010;60(581):897–901.
Simpson GC, Forbes K, Teasdale E, Tyagi A, Santosh C. Primary care access to computed tomography for chronic headache. Br J Gen Pract. 2010;60(575):426–30.
Eley KA, Fitzgerald JE. Quality improvement in action. Direct general practitioner referrals to audiology for the provision of hearing aids: a single Centre review. Qual Prim Care. 2010;18(3):201–6.
Gough-Palmer AL, Burnett C, Gedroyc WM. Open access to MRI for general practitioners: 12 years’ experience at one institution -- a retrospective analysis. Br J Radiol. 2009;82(980):687–90.
Mariotti G, et al. Improving the appropriateness of referrals and waiting times for endoscopic procedures. J Health Services Res Policy. 2008;13(3):146–51.
Mukherjee S, et al. The ‘straight to test’ initiative reduces both diagnostic and treatment waiting times for colorectal cancer: outcomes after 2 years. Colorectal Dis. 2010;12(10 Online):e250–4.
Ali R, et al. Efficacy of a direct booking system: a prospective cohort study. Ambul Surg. 2010;16(2):28–33.
Beiri A, et al. Trauma rapid review process: efficient out-patient fracture management. Ann R Coll Surg Engl. 2006;88(4):408–11.
Forde JC, et al. A rapid access diagnostic clinic for prostate cancer: the experience after one year. Ir J Med Sci. 2011;180(2):505–8.
Gartner M, et al. Immediate access rheumatology clinic: efficiency and outcomes. Ann Rheum Dis. 2012;71(3):363–8.
Valentin-Lopez B, et al. Assessment of a rapid referral pathway for suspected colorectal cancer in Madrid. Fam Pract. 2012;29(2):182–8.
Suter E, et al. Optimizing the interprofessional workforce for centralized intake of patients with osteoarthritis and rheumatoid disease: case study. Hum Resour Health. 2015;13:41.
Ndosi M, et al. The effectiveness of nurse-led care in people with rheumatoid arthritis: a systematic review. Int J Nurs Stud. 2011;48(5):642–54.
Schadewaldt V, Schultz T. Nurse-led clinics as an effective service for cardiac patients: results from a systematic review. Int J Evid Based Healthc. 2011;9(3):199–214.
Harris MD. Shared medical appointments after cardiac surgery-the process of implementing a novel pilot paradigm to enhance comprehensive postdischarge care. J Cardiovasc Nurs. 2010;25(2):124–9.
Lewis R, et al. Nurse-led vs. conventional physician-led follow-up for patients with cancer: systematic review. J Adv Nurs. 2009;65(4):706–23.
MacKay C, et al. Expanding roles in orthopaedic care: a comparison of physiotherapist and orthopaedic surgeon recommendations for triage. J Eval Clin Pract. 2009;15(1):178–83.
MacKay C, et al. A single group follow-up study of non-surgical patients seen by physiotherapists working in expanded roles in orthopaedic departments: recall of recommendations, change in exercise and self-efficacy. BMC Res Notes. 2012;5:669.
Salisbury C, et al. Evaluation of a general practitioner with special interest service for dermatology: randomised controlled trial. BMJ. 2005;331(7530):1441–6.
Levell NJ, Penart-Lanau AM, Garioch JJ. Introduction of intermediate care dermatology services in Norfolk, England was followed by a 67% increase in referrals to the local secondary care dermatology department. Br J Dermatol. 2012;167(2):443–5.
Bungard T, et al. Cardiac EASE (ensuring access and speedy evaluation) - the impact of a single-point-of-entry multidisciplinary outpatient cardiology consultation program on wait times in Canada. Can J Cardiol. 2009;12:697–702.
Prades J, et al. Is it worth reorganising cancer services on the basis of multidisciplinary teams (MDTs)? A systematic review of the objectives and organisation of MDTs and their impact on patient outcomes. Health Policy. 2014;119. https://doi.org/10.1016/j.healthpol.2014.09.006.
Nouraei SA, et al. Reducing referral-to-treatment waiting times in cancer patients using a multidisciplinary database. Ann R Coll Surg Engl. 2007;89(2):113–7.
Lee A, et al. A UK hospital based multidisciplinary balance clinic run by allied health professionals: first year results. J Laryngol Otol. 2011;125(7):661–7.
Baker DP, Day R, Salas E. Teamwork as an essential component of high-reliability organizations. Health Serv Res. 2006;41(4 Pt 2):1576–98.
Tan SB, Williams AF, Kelly D. Effectiveness of multidisciplinary interventions to improve the quality of life for people with Parkinson’s disease: a systematic review. Int J Nurs Stud. 2014;51(1):166–74.
Crossland V, et al. Is there evidence to support multidisciplinary healthcare working in rheumatology? A Systematic Review of the Literature. Musculoskeletal Care. 2015;13:51–66. https://doi.org/10.1002/msc.1081
Villeneuve E, et al. A systematic literature review of strategies promoting early referral and reducing delays in the diagnosis and management of inflammatory arthritis. Postgrad Med J. 2013;89(1050):231–40.
Fomundam S, Hermann J. A Survey of Queuing Theory Applications in Healthcare. ISR technical Report. Maryland: The Institute for Systems Research, University of Maryland; 2007.
Cattani K, Schmidt G, The Pooling Principle. INFORMS Trans Educ. 2005;5:17–24.
Singh N, et al. The Auburn elective surgery pilot project. ANZ J Surg. 2005;75:768–75.
Cox JM, et al. Do referral-management schemes reduce hospital outpatient attendances? Time-series evaluation of primary care referral management. Br J Gen Pract. 2013;63(611):e386–92.
Kim C, et al. Referral management and the care of patients with diabetes: the translating research into action for diabetes (TRIAD) study. Am J Manag Care. 2004;10(2 Pt 2):137–43.
Novak K, Veldhuyzen Van Zanten S, Pendharkar SR. Improving access in gastroenterology: the single point of entry model for referrals. Can J Gastroenterol. 2013;27(11):633–5.
LLP, D.a.T., Evaluation of Central Intake and Assessment Centres for Hip and Knee Replacement: Final Report. 2011.
Vaskalis CS, Sobolev B, Kuramoto L, Levy A. A simulation study of scheduling clinic appointments in surgical care: individual surgeon versus pooled lists. J Oper Res Soc. 2011;58:202–11.
University, C.R.C. Referral Management Pilots In Wales - Follow Up Review. Final Report. Cardiff: National Leadership and Innovation Agency for Healthcare; 2007.
Guevara J, Hsu D, Forrest C. Performance measures of the specialty referral process: a systematic review of the literature. BMC Health Serv Res. 2011;11:168.
Shiell A, Hawe P, Gold L. Complex interventions or compex systems? Implications for health economic evaluation. BMJ. 2008;336:1281–3.
Angstman KB, et al. Impact of e-consults on return visits of primary care patients. Health Care Manag. 2009;28(3):253–7.
Hofstetter PJ, et al. The impact of telehealth on wait time for ENT specialty care. Telemed J E-Health. 2010;16(5):551–6.
Roberts NJ, Partridge MR. Telephone consultations in secondary care. Respir Med. 2007;101(8):1665–9.
Thompson A, Graydon S, Zibrowski E. The Canadian arthritis referral study (CARS): an initial evaluation of the Canadian arthritis referral tool (CART). Arthritis Rheum. 2009;60:323.
Hazlewood G, Martin L, Barr S. The impact of a centralized referral system in rheumatology. Arthritis Rheum. 2009;60:326.
Gormley G, et al. Can diagnostic triage by general practitioners or rheumatology nurses improve the positive predictive value of referrals to early arthritis clinics? Rheumatol. 2003;42(6):763–8.
Bentley J, Fletcher D. Choosing and using: patient choice in ‘Choose and Book’. Br J Community Nurs. 2007;12(12):558–62.
Pisipati S, Chow K, Payne SR. Choose and book: an audit of the appropriateness of referrals and their effect on patients’ attendance to an inner city hospital secondary care provider. Br J Med Surg Urol. 2009;2(3):111–6.
Ke KM, et al. Are multidisciplinary teams in secondary care cost-effective? A systematic review of the literature. Cost Eff Resour Alloc. 2013;11(1):7.
JGL was employed a research associate at the University of Calgary during this project and funded by the PRIHS grant awarded to DM and LW. LJ was employed as a research assistant at the University of Calgary on this project and funded by the A.E Child Chair grant awarded to DM. Thank you to Yoojin Kwon, MLS (Master of Library Science), for her assistance developing the search strategy for this review.
This project was funded by a Partnership for Research and Innovation in the Health System (PRIHS) grant provided by Alberta Innovates Health Solutions DM is supported by a Canada Research Chair, Health Services and Systems Research and the Arthur J.E. Child Chair in Rheumatology Outcomes Research. LJ was supported through the Arthur J.E. Child Chair in Rheumatology Outcomes Research.
Availability of data and materials
Data sharing not applicable to this article as no datasets were generated or analysed during the current study.
Ethics approval and consent to participate
Consent for publication
JGL and LJ declare the following interests: None
DM declares the following interests: Ad hoc consulting for Optum, a health economics and outcomes research global company. Honoraria and travel expenses as a member of Pfizer HTA Advisory Board, honoraria and travel expenses for a seminar for Abbvie, honoraria and travel expenses for a presentation for Novartis, honoraria and travel expenses for a presentation for Janssen.
Unpaid officerships - President and member of Board of Directors, International Society for Pharmacoeconomics and Outcomes Research, and member of Board of Directors, Health Technology Assessment International, Editorial Board The Patient, Editorial Board, International Society for Technology Assessment in Health Care.
LW declares the following interests: Funding from Eli Lilly for myostatin trial design and serving on an advisory board for myostatin development.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Search strategy. Details of the search strategy used. (DOCX 13 kb)