We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
Improving accessibility for outpatients in specialist clinics: reducing long waiting times and waiting lists with a simple analytic approach
BMC Health Services Researchvolume 18, Article number: 827 (2018)
Lack of resources is often cited as a reason for long waiting times and queues in health services. However, recent research indicates these problems are related to factors such as uncoordinated variation of demand and capacity, planning horizons, and lower capacity than the potential of actual resources.
This study aimed to demonstrate that long waiting times and wait lists are not necessarily associated with increasing demand or changes in resources. We report how substantial reductions in waiting times/wait lists across a range of specialties was obtained by improvements of basic problems identified through value-stream mapping and unsophisticated analyses.
In-depth analyses of current operational processes by value-stream mapping were used to identify bottlenecks and sources of waste. Waiting parameters and measures of demand and resources were assessed monthly from 12 months before the intervention to 6 months after the intervention. The effect of the intervention on reducing waiting time and number of patients waiting were evaluated by a difference-in-differences analysis.
Mean waiting time across all clinics was reduced from 162 + 69 days (range 74–312 days) at baseline to 52 + 10 days (range 41–74 days) 6 months after the intervention. The time needed to achieve a waiting time of 65 days varied from 4 to 21 months. The number of new patients waiting was reduced from 15,874 (range 369–2980) to 8922 (range 296–1650), and the number of delayed returning patients was reduced from 18,700 (310–3324) to 5993 (40–1337) (p < 0.01 for all). Improvement in waiting measures paralleled a significant increase in planning horizon.
Significant improvements in accessibility for patients waiting for service may be achieved by applying unsophisticated methods and analyses and without increasing resources. Engagement of clinical management and involvement of front line personnel are important factors for improvement.
In many modern healthcare systems, patients may experience long waiting times (WT) for public health services. Constraining costs while providing adequate and timely access to services based on equity is challenging. Studies on whether political initiatives targeting long WT translate into improved access for patients have shown that success varies across policies [1,2,3,4].
There is substantial evidence that adding more resources will not necessarily improve accessibility and decrease queues, meaning understanding the mechanisms behind queuing is crucial [5,6,7]. If demand exceeds capacity, queues would increase indefinitely. A situation in which long WT are stable over time combined with steady demand and resources should trigger the hypothesis that resources are adequate and long WT are associated with organizational malfunctions. A study by Allder et al. from the National Health Service (NHS) suggested that wait lists often are relatively stable, that growing wait lists are unusual, and that a mismatch between the variation in demand and capacity often is a major cause of queuing . Understanding the significance of an uncoordinated capacity and demand variation is important [2, 6]. Furthermore, reports from the NHS Institute and Norway show that patient admissions and completed consultations per consultant can vary by over 100% across hospitals in the same healthcare system [9,10,11,12]. This suggests that there would be substantial gain if lower-level performers could be improved to operate at the average level. Of note, actual capacity of a given resource may depend on the skill mix and how resources are organized [12,13,14,15,16].
In Norway, political initiatives to reduce WT include a legislated maximum waiting time guarantee (introduced in 1997 as a 6-month limit and gradually tightened), activity-based financing of hospitals (from 1997), and granting patients the right to free choice of hospital combined with removal of county border barriers (in 2001). Although some effects of these initiatives have been reported [1, 17], long WT did not improve in Norwegian hospitals until the last 3 years. Despite a near doubling of budgets in the last decade, the perception that long wait lists and WT are caused by deficit of resources has dominated the debate, with proponents insisting that Norway’s strong economy should trigger increased funding for hospitals.
However, despite the strong Norwegian economy, increasing resources as a sole solution is unsustainable, particularly given the health professional workforce deficit faced by most health systems; an imbalance complicated by changing population demographics and increasing demand for resources. Moreover, The Norwegian Institute for Studies of the Medical Profession has reported that only 50% of physician working time is spent with patients , suggesting it is important to identify suboptimal use of resources across health professional groups.
Numerous studies are available describing techniques that may be useful in this context. Two well-known specialized methods from industry which focuse on looking for waste, improving work flow and creating more value with less effort is the LEAN method (originating from the Toyota car manufacturing system) and Six Sigma (originating from Motorola). LEAN  has been applied in various healthcare settings and multiple clinical specialties [20,21,22,23,24,25,26,27,28]. Kullar et al. [29,30,31,32,33] used LEAN principles to improve efficiency, and Gijo et al.  applied Six Sigma to reduce WT [29,30,31,32,33]. However, several of these reports have discussed that implementing LEAN in clinical cultures may present other, more demanding challenges than implementing the model in industry. Whereas manufacturing companies seeking to adopt the “Toyota Method” often succeed with a continuous focus on solutions to improve processes, the necessary engagement of management and capability of continuously questioning existing solutions to solve identified problems by involving front-line personnel seems to be more challenging to implement among clinical leaders than other sectors [34,35,36].
Based on the current literature, the LEAN method remains disputed in clinical settings, and Moraros et al.  concluded that available evidence does not support the idea that LEAN leads to quality improvements in healthcare. Costa et al.  noted a need for more studies that show LEAN healthcare applications not limited to specific areas, along with studies from more countries as current LEAN reports are from a limited number of countries (mainly the US and UK). Daultani  concluded that there are knowledge gaps in determining the path a general or multi-specialty hospital should follow in implementing LEAN, and that there is limited research to guide managers in choosing an appropriate portfolio of LEAN projects within a given time frame. Furthermore, Radnor and Walley  warned against an implementation approach focused solely on LEAN tools, and noted that the majority of academic literature on LEAN in the public sector is descriptive and developmental in nature. Although there is increasing literature regarding LEAN in healthcare, synthesizing these reports to make evidence based knowledge is rather challenging as pointed out by Rotter et al. .
Our team has extensive experience of LEAN work in a variety of settings and we derived our methods in the current project from LEAN. However, as our primary goal was to reduce WT that breached the legal threshold within a fairly short period, we were not able to engage in improvements across entire organizations, and did not focus on in debt learning of LEAN as a method. We therefore chose not to aim for a full LEAN methodology, but rather focus on targeted actions, adapted to each clinic but based on some common principles.
Background for the project
The Regional Health Authority South East, covering approximately 50% of Norwegian hospital services, addressed persisting long WT in 2014 through intensified efforts aiming to achieve the national standard average WT of 65 days in all hospitals. One initiative was launching a task force to assist selected clinics with the most extensive problems. This paper reports on changes in wait lists and WT following the work of this task force in 12 different outpatient clinics from four hospitals.
Aim and scope of this paper
The project of this paper had a two-fold aim. First, we examined the association between long WT, demand, and resources in the 12 months before the intervention to build knowledge in this area. Second, we explored how application of targeted approaches, learned from LEAN principles, combined with unsophisticated Microsoft Excel analyses may affect long WT and wait lists across different medical specialties and clinics.
Participating clinics were chosen at the discretion of the Health Authority South East, based on those with the longest WT or wait lists in their specialty in the region. Of 17 selected clinics, one chose to discontinue the process, and it was not possible to assess resource measures in four clinics because these data were integrated in larger units. Therefore, we included 12 clinics specialized in cardiology, pulmonology, gastroenterology, gastro-surgery, orthopedics, ear-nose- throat, ophthalmology, and neurology from four hospitals that could provide access to data for a 6-month follow-up period after the project ended.
During our project period, there was a general focus in all hospitals on improving accessibility. We therefore used a control group of 26 other clinics in the four hospitals that had WT > 65 days but where we did not intervene. These were used to compare our results for WT and PW in the period.
Reports of Norwegian wait lists and WT are published regularly on an open, publicly accessible platform . Providing such information to stakeholders is useful to assess status and identify possible tradeoffs or inadequacies in responses to primary political goals. For example, there is concern that government-set priorities and targets to minimize time to start of treatment have triggered system behavior resulting in lower prioritization of returning patients (RP) who need follow-up [7, 8, 40, 41].
Measures of WT vary among OECD countries . Examples of measures used in many national datasets are inpatient WT (from addition to the specialist list to treatment), referral-to-treatment WT (from referral by a GP/family doctor to treatment), WT for all patients on the list, and numbers on wait lists. These parameters are usually assessed by mean or median values, WT distribution across percentiles, and the number of patients waiting more than a specified threshold (e.g., 3–6 months in most systems). We used three time-related variables: evaluation time, measured as the time from GP referral of a new patient (NP) is received by a hospital to when that patient is added to the specialist list; the average WT for all patients on the list; and time to treatment (TTT), measured from GP referral to treatment. We also used three variables to measure the number of patients waiting: number of NP waiting, number of RP waiting for follow-up, and total number of patients waiting (TPW) as the sum of NP and RP. When we started our project, we disclosed a hitherto unknown problem with a large number of RP that had not been followed up according to their individual schedule (delayed RP), and capacity for treatment of this group became an unanticipated challenge in our work.
As a proxy for planning horizon, we used percent of TPW who were booked for an appointment. For activity data during the interventions we measured the total number of consultations as well as consultations in various diagnostic subgroups and procedures. These data were sufficiently detailed to allow analysis on an hourly basis for the purposes of later booking and planning. We used weekly data from each clinic for waiting and activity parameters, which were analyzed in weekly follow-up with the clinics. Resource data were sampled monthly from the regional salary system and measured by full time equivalents (FTE) for physicians, nurses, and other personnel in each department. Categorizing these data into more specific groups (e.g., secretarial or other patient-related personnel) was not possible because they were integrated in larger units.
Because the topic with delayed RP had not been identified prior to our work, we did not have access to such data in the 26 control clinics where we did not intervene. Neither did we have access to resource data. Our comparison with the control group is therefore limited to development of the monthly WT and NW.
Each project started by interviewing the clinical management and identifying staff members and front-line personnel to participate. Rather than spending too much time on LEAN education itself, we focused on methods and tools that could identify and resolve problems in individual clinics. Accordingly, we prioritized a simple approach and common structure that could be adapted for application across different departments.
A basic principle was that no extra resources to resolve current problems should be expected during the project period. We focused on practical adaptation of the tools most relevant to our context that would be easy for clinical staff to implement and that could contribute to resolving actual problems without unnecessary delays.
None of our analyses of WT, demand, or resources revealed any characteristics that explained the elevated WT in the 12 months before the intervention. An unanticipated problem was that in addition to a long wait list among the NP, all clinics had extensive RP backlogs. Based on these characteristics, we approached all clinics with a standard concept of simple methods (Table 1) and a common set of targets to be achieved (Table 2).
Outpatient appointment strategy
Although the tactical and operational approach to booking patients was considered specifically for each clinic, we developed a template that could be adapted and applied across different specialties. Improved planning based on a clearly defined outpatient booking strategy and booking horizon became a priority target in all clinics, because treatment of NP and WT reduction had to be balanced against the large group of delayed RP with significant clinical needs, a previous unknown problem that our project disclosed.
First, we defined the capacity needed for NP and RP, and defined an appropriate set of medical-based priorities. We considered our clinics as multistage (providing multiple services at contact) and multi-server (multiple doctors providing services) . We usually experimented with various service times based on patient diagnosis, predicted complexity, and equipment-related medical services, differentiated for NP and RP where possible. In appropriate cases, some follow-up patient groups were allocated lower service time than NP of the same category. In some clinics we also considered targeted patient selection from the wait list to optimize patient sequences during appointment days as well as whether some overbooking could be relevant. To establish a controllable strategy for eliminating long wait patients and RP backlog, simple rules such as “booking the top 30” long wait or RP backlog each week were applied.
All actions to implement new procedures were started following an agreed time schedule and based on root problems identified in the value stream analyses. We focused on targets with small steps which were considered most likely to succeed, and assumed that if we could not measure the process, we could not improve it. We avoided any changes in organizational structures. To ensure that all front-line personnel involved knew what was happening, the leaders ensured that everyone in the clinic was kept adequately informed.
Analyses to measure results were performed weekly and results provided to the relevant teams. There was a continuous focus on discovering new challenges and working out how to assess adjustments. We met several employees who had become rather demoralized by the previous situation, and we quickly realized the importance of communicating rapidly with anyone who was skeptical about the process and might resist change. We carefully chose measurements that were considered relevant to the clinical activities studied and communicated positive results as soon as they were agreed to be reliable.
Measures used to assess the development of projects
Although TTT would have been a logical measurement and is a useful measure from a clinical perspective, we anticipated that this measure would increase as clinics started to treat patients having extremely long WT, and thus might appear as a “worsening” of the status. Therefore, we focused on WT and TPW, as these measurements were expected to decline if implemented improvements resulted in approaching the prime goal of 65 days WT.
We used STATA version MP 15 for the analyses. The non-parametric Wilcoxon signed-rank test for related samples (paired) was performed to compare data from the 12 clinics for the project start (baseline), 65 days WT, and 6 months after the intervention. To compare our project clinics with the control clinics, we used a difference-in-differences method  to estimate the effect of the intervention on the study variables.
Analyses from the 12 months before the intervention
Figure 1 presents the results for the 12 clinics and multiple variables. None of the participating clinics experienced increased demand in this study period, and resources (as measured by physicians and nurses) were constant or slightly increasing. Figure 1 shows that although these variables were fairly constant in the 12 months before the intervention, long WT persisted (and in some clinics increased) despite a declining number of NP waiting.
Descriptive data from the intervention
Our results from the intervention period are presented on an aggregated level because of the large number of variables analyzed across the 12 clinics (Table 3), although some variables are depicted at the clinic level (Figs. 2 and 3). The time to attain a WT of 65 days varied from 4 to 21 months, with the longest projects occurring in clinics with the largest numbers of NW and RP. A total of 19,660 patients were removed from wait/backlog lists (6952 NP and 12,708 delayed RP). The most extreme case was a department with 2800 NP and 3324 RP, and a WT of 312 days. This was reduced to 500 NP waiting and a WT of 37 days at 6 months after the intervention ended. Although Table 3 does not show any significant change in TTT, this variable increased considerably during the first phases of the projects, probably indicating that patients with extreme WT were treated.
Although adding new resources was not an option in our intervention, extra working hours were used in selected clinics for short periods, and some RP who were extremely overdue for follow-up were transferred to other providers. The apparent increase in FTE physicians in the period after 65 days WT resulted from increased staffing in a department that extended its services with a new treatment during the follow up, and one department that was merged with another unit. Apart from minor periodic variations, no other significant changes in staffing were recorded.
Figure 2 shows that the time needed to achieve 65 days WT and the pace of reduction in the number of NPs waiting varied substantially across clinics, and indicates rather stable demand and physician resources during the study period.
In all clinics, there was substantial variation in the daily activity on the same weekdays over time, beyond what could be explained by variation in resources. For example, a two-fold variation in activity on the same weekdays throughout the year unexplained by resource variation, was observed in all clinics. This is depicted for one clinic in Fig. 3. A striking finding was that the planning horizon for future activity was short. In most clinics, only 15–20% of waiting patients had been scheduled for treatment. This booking window was less than 1–2 months ahead and in some cases was only 2–3 weeks, despite pools of NP and RP that in some cases constituted almost 1 year of activity. This represents an extremely short perspective of capacity planning.
We observed an increase in the number of consultations per FTE physician ranging from 4 to 33% in nine of the 12 clinics; two clinics did not change, and one fell by 12%. It increased significantly in the total cohort and the improved physician productivity paralleled an increase in the planning horizon. A naive illustration of this relationship in the total cohort is depicted in Fig. 4 for a 10-month period that included data from all clinics. The percentage increase in physician productivity paralleled an increase in the percentage of patients booked.
Comparison with non-project clinics
The development of average WT and average NW in our clinics and the control units is shown in Fig. 5. Our clinics had significantly higher starting levels of both WT and NW, and ended up with lower WT than the control clinics. In the difference-in-differences regressions (Table 4), the variable Post Treat Period had a significant effect on the development of both waiting parameters, indicating that our intervention improved the accessibility compared with control clinics.
The use of difference-in difference to identify the intervention effects relies on the parallel trend assumption, that is, that project and control group developed in parallel before the intervention and that the trend for the outcome (waiting parameters) in both groups would have continued to be parallel in the absence of the intervention. The graphs below show development in the project and control group 18 months before and up to 18 months from the start of the intervention.
The results from the difference-in-differences regression analysis (Table 4) show the effect of the intervention on the waiting parameters in the project/intervention group compared with the control group in each post-treatment period. The variable Post Treat Period is an interaction between being in the project/intervention group and receiving an intervention in each post-treatment period (1–18 months).
The sessions with value stream analysis revealed several common circumstances across all clinics; unpredictable team communication and unclear procedures between staff, multi-professional autonomy, and hierarchical structures. The front personnel involved in patient treatment often had limited knowledge regarding their mutual tasks, and arenas for regular meetings to follow-up and solve current problems were scarce. This caused bottlenecks, duplicated work, and process delays, resulting in considerable waste, and indicates that organizational factors were important.
The combination of a short planning horizon and a large group of patients who had been waiting for several years without knowing their current status generated numerous patient enquiries which consumed a substantial amount of secretarial resources. In turn, this choked the planning and booking resources.
A major finding of this study was that apparently resistant problems such as extreme WT and RP backlogs in a variety of clinical settings were responsive to relatively simple interventions. Through techniques based on value stream analyses and targeted improvement combined with a focus on planning and increased front personnel involvement, participating clinics were able to reduce WT without adding significant resources. The stable long WT before our intervention was not correlated with increases in demand or obvious changes in resources. Improvements in physician productivity paralleled increases in the planning horizon.
Several organizational issues appeared to be important factors underlying the identified problems. Our findings confirmed that there was a substantial leakage of resources in all clinics due to continuous inquiries from patients seeking lost follow-up appointments or wanted re-bookings. It is not surprising that a planning horizon of a few weeks is not optimal when wait lists correspond to almost 1 year of activity. This problem dropped after the intervention in most clinics.
Despite an observed increase in physician productivity, the large variability in activity on the same weekdays persisted. This is a clear limitation of the impact of the interventions and indicates potential for further improvements. Its not be surprising that the extensive backlogs and large wait lists we observed may crate overload on involved personnel and extend the time needed to obtain gains, and all clinics reported a reduction in overload over time.
Although we derived our methods from LEAN, we did not focus on in debt learning of LEAN as a method as we had to focus on the prime goal of reducing WT within shortest possible time span. The literature suggests that successful LEAN requires a considerable investment in resources, time, and effort . We chose to compromise on the time and resources used for training and theoretical education (important elements in LEAN philosophy and methods), and our approach was more related to focus groups . We did not include steering groups as we considered such functionality to be an important responsibility of clinical management and essential for engagement. Nevertheless, we observed a significant spin-off effect as many of the units started to apply similar methodology beyond the initial focus of our interventions, although there was marked variability in the degree of engagement and sustainability of management involvement and among the different participating actors. A crucial factor was creating a palpable picture of the potential to improve resource use and alleviate stress for front line personnel to facilitate understanding of the usefulness of investing time in the intervention. Our experience was that halfhearted engagement slowed progress, whereas analyses and reports that were targeted to patient accessibility and weekly performance of the units created significant engagement among all personnel groups.
Physicians were the most challenging group to engage because they frequently argued that their time should be prioritized for clinical work. Engagement of physicians may be a crucial factor for several reasons ; they are important stakeholders and spokespeople, and have significant influence on various aspects of a clinic’s performance. However, physicians have skills and competence that parallel the core concepts of continuous improvements (as in LEAN). In their everyday patient-related work, physicians’ clinical methods depend on documenting facts and assessment of whether a treatment plan succeeds. This daily documentation is a cornerstone for medical quality and safety in the treatment process, and represents the same basic principles as the core elements of most continuous improvements processes; plan, do, check, and act. This concept has been described by several previous studies. Batalden and Stoltz  translated Deming’s “Profound Knowledge” concept into a healthcare context . They pinpointed that traditional improvement driven by intellectual disciplines and professional values may differ from improvement based on knowledge regarding systems, variation, and knowledge theory. We support their idea that quality improvement in healthcare must be based on joined, continuous effort from all healthcare professionals to make changes that will lead to better patient outcomes (health), better system performance (care), and better professional development (learning), with an acknowledgement that this must become an intrinsic part of everyone’s job, every day, and in every part of the system. Improvement thinking should not be considered as a method, but as a workplace culture.
Despite substantial differences among participating clinics, we standardized our methods because we observed several similarities across all units. We were able to adapt our template for all cases, and concluded that similar principles created improvements across different specialties and organizational structures.
Planning horizon and booking strategy
When we considered how to approach improvements in planning and booking strategies, we drew on literature regarding research on outpatient appointment systems (OAS). Since early pioneering studies by Bailey  and Welch , there has been growing literature regarding OAS and strategies to balance patient WT and personnel idle time. Previous reviews by Cayirli  and Ahmadi-Javid  summarized a number of studies from this perspective. However, the majority of relevant papers are based on theoretical and mathematical models that simulate the effects of various strategies. Such theoretical models are challenging to apply in the clinical world, as health personnel may have little background in understanding such complicated relationships. A review by Liu  suggested that little is known from real life studies regarding the effect of a booking window on efficiency, no-shows, and out of hospital WT. Tailoring optimal booking strategies depends on the technology used by the institution, and traditional medical patient record systems allow little flexibility to adjust and model different types of booking strategies. As this was also the case our clinics, we prioritized simple strategies that had potential to create immediate effects on our prime targets. Our results provide an example of real life findings in this respect, as we identified large gains from increasing the planning horizon.
Of particular importance in all clinics was the balance between treating new patients versus follow-up for delayed RPs. Most clinics did not regard the RP backlog as a serious problem, possibly because this was not the focus of any political goals and had no economic consequences. Having a large number of delayed RP is unacceptable and the basic principle we used to resolve this problem was similar across all cases. We analyzed and compared the size of the problem and current capacity for each diagnosis group, with capacities continuously adjusted based on medical criteria to balance different patient categories. Of course, the significance of this problem depended on the number of RP compared with the volume of the actual clinic, as a given number in a small clinic may be more serious than the same number in a larger clinic.
Strengths and weaknesses of this study
We focused our analyses on measurements that clinicians regarded as most clinically relevant. The unsophisticated analyses and methods we used (mostly performed and developed with Microsoft Excel spreadsheets) appeared to be useful across multiple specialties. Much of the OAS literature is based on complex scientific methods and mathematical algorithms that may be unfamiliar to health personnel and therefore have limited impact at the bedside. We believe that clinical monitoring based on simple measures that are directly related the personnel’s everyday work may spark more action among clinicians than more advanced techniques.
Although the participating clinics succeeded in resolving major problems with relatively simple tools, such extreme challenges as we observed may not be encountered in many other contexts. Therefore, care should be taken in generalizing the effect of our methods. The short planning horizon that we observed should also be considered when interpreting the relationship between the booking window and physician productivity. This relationship should also be studied in clinics with less extreme waiting problems.
The LEAN method requires substantial knowledge and practice of its differing elements. We compromised on several LEAN principles to obtain concrete goals in limited time periods. This may jeopardize the long-term results if the studied clinics do not build on their experiences and establish a persisting culture for improvement. Accordingly, we do not know whether our intervention created a culture for continuous improvement beyond our 6-month observation period after the intervention. This will depend on whether the change in culture during our project had power to create continuity among the clinical managers and leaders.
Our study was performed across a variety of specialties and clinical settings. Although this may create potential to generalize some of our findings, there are several factors that need to be considered. We would have preferred to have more detailed resources data, and “consultations” may vary considerably across medical specialties. In some specialties, multiple procedures may be performed by nurses, whereas this is rare in other specialties. However, more detailed data were not available for our study. The participating clinics also faced different challenges; we observed different problems in their processes, and the results showed some variability. Pooling data for a variety of clinics might have resulted in inaccuracies. Nevertheless, our main interpretation that simple methods created substantial improvements in all of the studied clinics is sustained.
We only worked with outpatient clinics. Such clinical activities may closely interact with hospitalized treatment, which might have influenced some of the studied variables of particular resources. Furthermore, several specialties are developing in a way that creates an increasing number of patients in need of chronic, lifelong follow-up. Measuring the volume of such groups is complicated, and these patients may increase demand in a way that might be missed.
Some improvements could be made to the study design. The involvement of physicians should have been more of a focus, as we observed more progress when physicians were engaged. In addition, we should have worked thoroughly across all professions to achieve acceptance that changes were needed. Our experience supported reflections by Bamford and Lodge, who stated that the recognition that change in current operational procedures is needed may often appear late and allow problems to develop too far .
Our study indicates that substantial reductions in WT and waiting lists may be achieved using unsophisticated methods across a variety of medical services, and that the study clinics performed better than a control group. Planning horizons and a focus on capacity are crucial factors. We found no obvious relationship between long WT and demand or resources. Engagement of front line personnel seems important to improve patient availability across differing specialties. Reducing waste and improved use of resources was observed in all participating clinics. Although most clinics showed an increase in physician productivity, the daily activity varied more than the variation in resources. This may indicate potential benefits if the days and periods with the lowest performance are improved to approach the average level in each clinic.
Physicians’ engagement appears to be crucial for success. They should be involved as drivers or champions for such processes by applying the principles and methods from their clinical activities. More research is needed to identify appropriate strategies to achieve physician engagement, and there should be more focus on innovative programs for medical students and resident doctors to integrate improvement skills into professional education and training. Such programs may also be useful for other professions.
National Health Service (UK)
New patient (patient referred for a first appointment)
Returning patients (patients returning for follow up)
Total number of patients waiting (includes new and returning patients)
Time to treatment
Ringard A, Hagen TP. Are waiting times for hospital admissions affected by patients' choices and mobility? BMC Health Serv Res. 2011;11:170.
Harrison A, Appleby J. Reducing waiting times for hospital treatment: lessons from the English NHS. J Health Serv Res Policy. 2009;14(3):168–73.
Silvester K, Lendon R, Bevan H, Steyn R, Walley P. Reducing waiting times in the NHS: is lack of capacity the problem? Clin Manag. 2004;12:1–5.
Siciliani L, Moran V, Borowitz M. Measuring and comparing health care waiting times in OECDcountries. Health Policy. 2014;118(3):292–303.
Kenis P. Waiting lists in Dutch health care: an analysis from an organization theoretical perspective. Journal of health organization and management. 2006;20(4):294-308.
Eriksson H, et al. Reducing queues: demand and capacity variations. Int J Health Care Qual Assur. 2011;24(8):592–600.
Allder S, Silvester K, Walley P. Managing capacity and demand across the patient journey. Clin Med. 2010;10(1):13–5.
Allder S, Walley P, Silvester K. Is follow-up capacity the current NHS bottleneck? Clin Med. 2011;11(1):31–4.
Aragon MJA, Castelli A, Gaughan J. Hospital Trusts productivity in the English NHS: Uncovering possible drivers of productivity variations. UK. PloS one. 2017;12(8):e0182253.
Castelli A, Street A, Verzulli R, Ward P. Examining variations in hospital productivity in the English NHS. Eur J Health Econ. 2015;16(3):243-54.
Street A, Castelli A. Productivity variation persists in the NHS. Health Serv J. 2014;124(6390):16–7.
Johannessen KA, Kittelsen SA, Hagen TP. Assessing physician productivity following Norwegian hospital reform: a panel and data envelopment analysis. Soc Sci Med. 2017;175:117–26.
Bank AJ, Gage RM. Annual impact of scribes on physician productivity and revenue in a cardiology clinic. Clinicoecon Outcomes Res. 2015;7:489–95.
Grimshaw H. Physician scribes improve productivity. Oak street medical allows doctors to spend more face time with patients, improve job satisfaction. MGMA Connex. 2012;12(2):27–8.
McDonnell WM, et al. Relative productivity of nurse practitioner and resident physician care models in the pediatric emergency department. Pediatr Emerg Care. 2015;31(2):101–6.
Rumbold BE, et al. Improving productive efficiency in hospitals: findings from a review of the international evidence. Health Econ Policy Law. 2015;10(1):21–43.
Hagen TP, Kaarboe OM. The Norwegian hospital reform of 2002: central government takes over ownership of public hospitals. Health Policy. 2006;76(3):320–33.
Rosta J, Aasland OG. Doctors’ working hours and time spent on patient care in the period 1994 - 2014. Tidsskr Nor Laegeforen. 2016;136(16):1355–9.
Womack JP, Jones DT, Roos D. Machine that changed the world: Simon and Schuster; 1990.
Costa LBM, Godinho Filho M. Lean healthcare: review, classification and analysis of literature. Prod Plann Control. 2016;27(10):823–36.
Moraros J, Lemstra M, Nwankwo C. Lean interventions in healthcare: do they actually work? A systematic literature review. Int J Qual Health Care. 2016;28(2):150–65.
Yadav G, Desai TN. Lean Six Sigma: a categorized review of the literature. Int J Lean Six Sigma. 2016;7(1):2–24.
Radnor Z, Walley P. Learning to walk before we try to run: adapting lean for the public sector. Public Money Manage. 2008;28(1):13,20.
Chiarini A, Bracci E. Implementing lean six sigma in healthcare: issues from Italy. Public Money Manage. 2013;33(5):361–8.
Bhat S, Gijo EV, Jnanesh NA. Application of lean six sigma methodology in the registration process of a hospital. Int J Product Perform Manag. 2014;63(5):613–43.
Eller A. Rapid assessment and disposition: applying LEAN in the emergency department. J Healthc Qual. 2009;31(3):17–22.
Casey JT, Brinton TS, Gonzalez CM. Utilization of lean management principles in the ambulatory clinic setting nature reviews. Urology. 2009;6(3):146.
Waldhausen JH, Avansino JR, Libby A, Sawin RS. Application of lean methods improves surgical clinic experience. J Pediatr Surg. 2010;45(7):1420–5.
Lodge A, Bamford D. Health service improvement through diagnostic waiting list management. Leadersh Health Serv. 2007;20(4):254–65.
Andersen H, Rovik KA. Lost in translation: a case-study of the travel of lean thinking in a hospital. BMC Health Serv Res. 2015;15:401.
Andersen H. How to design Lean interventions to enable impact, sustainability and effectiveness. A mixed-method study. J Hosp Admin. 2015;4(5):1.
Gijo EV, Antony J. Reducing Patient Waiting Time in Outpatient Department Using Lean Six Sigma Methodology. Qual Reliab Eng Int. 2013;30(8):1481–91.
Kullar P, et al. The use of lean thinking techniques in implementing the Department of Health, UK, 18-week waiting time directive for cochlear implantation. Cochlear Implants Int. 2010;11(3):133–45.
Denis J. Exploring the dynamics of physician engagement and leadership for health system improvement prospects for Canadian. Toronto. scholar.google.com: Institute of Health Policy, Management and Evaluation, University of Toronto; 2013.
Rutman L, et al. Improving patient flow using lean methodology: an emergency medicine experience. Curr Treat Options Pediatr. 2015;1(4):359–71.
Pomey M-P, et al. Toward systematic reviews to understand the determinants of wait time management success to help decision-makers and managers better manage wait times. Implement Sci. 2013;8(1):61.
Daultani Y, Chaudhuri A, Kumar S. A Decade of Lean in Healthcare: Current State and Future Directions. Glob Bus Rev. 2015;16(6):1082–99.
Rotter T, et al. What is lean Management in Health Care? Development of an operational definition for a Cochrane systematic review. Eval Health Prof. 2018:163278718756992.
NorwegianPatientRegistry, Monthly waiting time statistics. https://statistikk.helsedirektoratet.no/bi/Dashboard/6fd742be-498b-48cb-ae35-806236b02d9c?e=false&vo=viewonly.
Kolås A. Norske sykehus manipulerer med ventelister. forskning.no, 2016. https://forskning.no/helsepolitikk-partner-universitetet-i-oslo/norske-sykehus-manipulerer-med-ventelister/417579.
Storvik AG, N.l., Uoffisielle ventelister avdekker 167 907 brutte pasientavtaler. Dagens Medisin. 2017.
Cayirli T, Veral E. Outpatient scheduling in health care: a review of literature. Prod Oper Manag. 2003;12(4):519–49.
Blundel R, Dias C. Alternative approaches to evaluation in empirical microeconomics. J Human Res. 2009;44(3):565–640.
Trebble TM, Hydes T. Redesigning services around patients and their doctors: the continuing relevance of lean thinking transformation. Clin Med. 2011;11(4):308–10.
Powell RA, Single HM. Focus groups. Int J Qual Health Care. 1996;8(5):499–504.
Lee TH, Cosgrove T. Engaging Doctors in the Health Care Revolution. Harv Bus Rev. 2014;92(6):104–11.
Batalden PB, Stoltz PK. A framework for the continual improvement of health care: building and applying professional and improvement knowledge to test changes in daily work. Jt Comm J Qual Improv. 1993;19(10):424–47 discussion 448-52.
Deming W. Out of the crisis. Cambridge, MA: MIT Center for Advanced Engineering Study; 1986.
Bailey NT. A study of queues and appointment systems in hospital out-patient departments, with special reference to waiting-times. Journal of the Royal Statistical Society. Series B (Methodological). 1952;14(2):185-199.
Welch JD, Bailey NJ. Appointment systems in hospital outpatient departments. Lancet. 1952;259(6718):1105–8.
Ahmadi-Javid A, Jalali Z, Klassen KJ. Outpatient appointment systems in healthcare: a review of optimization studies. Eur J Oper Res. 2017;258(1):3–34.
Liu N. Optimal choice for appointment scheduling window under patient no-show behavior. Prod Oper Manag. 2016;25(1):128–42.
We are sincerely grateful to the members of the task force group in Sykehuspartner HF that have contributed significantly to the development of the concept of the methods and the data collection. Anne May Brekke, Alexander Dahlseide, Pål Jostein Didriksen, Marit Eskeland, Marit Løken, Morten Lykke Nilsen, Nicolai Møkleby, Marthe Westlie, have all been engaged in several of the projects for their complete period.
We thank Audrey Holmes, MA, from Edanz Group (www.edanzediting.com/ac) for editing a draft of this manuscript. We appreciate friendly discussions and suggestions from Terje P. Hagen and Geir Godager during the preparation and revision of this manuscript.
Availability of data and materials
The data that support the findings of this study are available from the first author at reasonable request, but restrictions apply to the availability of the data from the clinical units which were used under license for the current study and therefore are not publicly available.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.