We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
Factors determining the patients’ care intensity for surgeons and surgical nurses: a conjoint analysis
BMC Health Services Researchvolume 15, Article number: 395 (2015)
Surgeons and nurses sometimes perceive a high workload on the surgical wards, which may influence admission decisions and staffing policy. This study aimed to explore the relative contribution of various patient and care characteristics to the perceived patients’ care intensity and whether differences exist in the perception of surgeons and nurses.
We invited surgeons and surgical nurses in the Netherlands for a conjoint analysis study through internet and e-mail invitations. They rated 20 virtual clinical scenarios regarding patient care intensity on a 10-point Likert scale. The scenarios described patients with 5 different surgical conditions: cholelithiasis, a colon tumor, a pancreas tumor, critical leg ischemia, and an unstable vertebral fracture. Each scenario presented a mix of 13 different attributes, referring to the patients’ condition, physical symptoms, and admission and discharge circumstances.
A total of 82 surgeons and 146 surgical nurses completed the questionnaire, resulting in 4560 rated scenarios, 912 per condition. For surgeons, 6 out of the 13 attributes contributed significantly to care intensity: age, polypharmacy, medical diagnosis, complication level, ICU-stay and ASA-classification, but not multidisciplinary care. For nurses, the same six attributes contributed significantly, but also BMI, nutrition status, admission type, patient dependency, anxiety or delirium during hospitalization, and discharge type. Both professionals ranked ‘complication level’ as having the highest impact.
The differences between surgeons and nurses on attributes contributing to care intensity may be explained by differences in professional roles and daily work activities. Surgeons have a medical background, including technical aspects of their work and primary focus on patient curation. However, nurses are focused on direct patient care, i.e., checking vital functions, stimulating self-care and providing woundcare.
Surgeons and nurses differ in their perception of patients’ care intensity. Appreciation of each other’s differing interpretations might improve collaboration between doctors and nurses and may help managers to match hospital resources and personnel.
Western European and North American hospitals are forced to improve efficiency while using limited available resources. This increases pressure on the overall quality of patient care, but also on the caregivers involved. Physicians and nurses form the main body of caregivers in the hospital setting. Hence, optimum staffing of physicians and nurses is crucial for patient safety, staff working conditions, retention and hospitalization costs [1, 2]. Patients receiving insufficient care due to high workload because of insufficient staffing are at risk for higher morbidity and mortality rates [3–5]. A high workload also has a significant impact on job satisfaction .
Nowadays, financial arguments mainly determine the staffing of physicians and nurses in European hospitals [7, 8]. Subsequently, many physicians and nurses perceive a high workload [9–11] and inefficient teamwork, as their perceived workload seems different and not transparent . However, it is hard to substantiate this with objective measures that are intelligible for both disciplines as well as managers.
The caregivers’ workload is generally determined by the demand for care, personnel characteristics and orga-nizational characteristics . Several studies searched for predictors of the demand for medical and nursing care. In a recent systematic review no accurate models were found, although some separate predictors appeared useful . However, these predictors explained the demand for care in terms of required resources and hospitalization costs rather than physician or nurse staffing or workload . For nurses, attempts have been made to match the patients’ demand for nursing care with nurse staffing supplies, for instance by measuring patient-related workload. This workload is the result of the demand for nursing care, and is defined here as (nursing) care intensity . Little is known about the care intensity physicians perceive and which factors they believe influence care intensity. It is also unclear whether clinicians, in particular physicians and nurses, perceive this care intensity in the same way, as they are involved in other aspects of hospitalized patient care.
Workload is of particular importance for physicians and nurses working on surgical wards, because more than 50 % of adverse events are related to surgical procedures . Therefore the risks of direct harm and high hospitalization costs are substantial for surgical wards. Hence, we investigated the perceptions of surgeons and nurses working in clinical settings regarding determining factors of care intensity. For this purpose we used a conjoint analysis (CA), presenting the clinicians 20 scenarios of hospitalized patients with five surgical conditions. In doing so, we attempted to detect the relative contribution of various patient and care characteristics to the perceived patients’ care intensity and possible differences in appreciation between surgeons and nurses.
The conduct and description of this study was done according to the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) checklist for conjoint analysis (CA) applications in healthcare research . Our local medical ethics review board (Academic Medical Center, Amsterdam, The Netherlands) approved the study but waived the need for ethical approval as the study had no effect on the participants’ wellbeing. Yet, all participants received an explanation about the study and gave consent by participating in the study.
We performed a CA study in which participants were to appraise the caring intensity of fictional hospitalized patient scenarios (“vignettes”). These scenarios share the same set of so-called attributes (e.g., age), but the levels (e.g., below or above 65 years) of each attribute vary across the different scenarios.
Originally, CA is a method of eliciting consumer preferences in marketing research, and allows estimation of the relative importance of different characteristics (attributes) for the valuation of rate descriptions of a good. This method has also been applied successfully in the realm of healthcare .
Each scenario described a patient admitted to a surgical ward and characterized by thirteen attributes. These attributes represent various patient and care characteristics, e.g., age, polypharmacy, complication level, and American Society of Anesthesiologists classification (ASA class) (Table 1). Possible relevant attributes were derived from a systematic review and a pilot study on the use of hospital care services of surgical patients [13, 14].
All attributes were divided into an appropriate number of levels, e.g., ASA classes I, II, and III. However, the number of levels within each attribute was kept to a minimum in order to limit the number of scenarios required to present a representative range of different scenarios.
Subsequently, a small group of 6 surgeons and 8 surgical nurses (with different specialty and experience) were invited to a single Delphi round , in order to generate a set of apparently influencing characteristics. The contents of the final scenarios were generated by the orthogonal design in SPSS (Statistical Package for the Social Sciences v. 20; IBM SPSS Inc., Armonk, NY, USA).
Setting and participants
Surgeons and surgical nurses from university centers, teaching hospitals and community hospitals in the Netherlands were invited to participate in the questionnaire. Surgeons, including residents, belonging to the regional surgical resident teaching program educational area of the Academic Medical Center were invited via e-mail. A total of two reminders were sent to reach a response rate of 60 %.
Surgical nurses were approached by advertising in three Dutch nursing journals (both paper and web pages), a call on a LinkedIn forum, Twitter, Facebook, and the science webpage of one of the teaching hospitals.
Conjoint analysis questionnaire
The researchers eventually selected 20 plausible scenario’s for data collection. This is an ample number as compared to current literature [20, 21]. An example of the composition of the scenarios is given in Table 2, and a full example of a scenario is given in Additional file 1. A pilot study was conducted among four surgeons and two nurses to test whether any vital information in the 20 scenarios was missing. This was corrected if necessary.
By means of a digital questionnaire (www.Surveymonkey.com), the surgeons and surgical nurses were asked to score the care intensity of the 20 scenarios on a 10-point Likert scale, ranging from 0 (“very low intensity”) to 10 (“very high intensity”). In addition surgeons and nurses were asked to state their top-5 of attributes contributing most to care intensity.
Continuous variables regarding the respondents’ characteristics and scenario scores were expressed as means and standard deviations (SD). The relative importance of each of the attributes as to the perceived care intensity was determined by means of a fixed effect linear multi-level analysis to account for the multilevel structure of the scenarios (level 1) as rated by surgeons and nurses (level 2).
The effect size of each attribute was expressed as a β-coefficient with its 95 % confidence interval (CI). β-coefficients above or below 0 (the reference value) indicate the attribute contributes to a higher or lower care intensity score, respectively. The attribute top-five for surgeons and nurses was assessed based on their mean rating scores per attribute. P-values <0.05 were considered significant.
A total of 82 surgeons and 146 surgical nurses completed the questionnaire, resulting in 4560 rated scenarios, 912 per condition. Characteristics of the responding surgeons and nurses are summarized in Table 3. The majority of the surgeons was male, with a mean age of 46.4 (SD 9.7), while the majority of the nurses was female; mean age 33.2 (SD 12.0). Most respondents worked in a tertiary referral hospital and were employed in trauma or gastro-intestinal surgery. No significant associations between surgeons’ or nurses’ characteristics (i.e., age, gender, surgical specialty of employment, years of experience, or hospital type) and care intensity judgments were observed.
The overall mean care intensity scores for the 20 scenarios were 6.21 (SD 2.08) among surgeons and 5.76 (SD 2.26) among nurses, which did not differ significantly.
Figure 1 shows the contribution to care intensity of the significant attributes as perceived by surgeons and nurses.
According to the surgeons, 6 out of the thirteen attributes significantly influenced care intensity; age, polypharmacy, medical diagnosis, ASA-classification, complication level, and Intensive Care Unit (ICU) stay.
Surgeons assigned significantly more caring intensity to ASA classes II and III (β1.51; p < 0.001, and β2.12; p < 0.001, respectively), patients suffering from more severe complications (β1.58; p < 0.001), and ICU-stay (β1.36; p = 0.016). Furthermore, patients using less than 5 medications (β-1.30; p = 0.037), patients with medical diagnoses as colon or pancreatic cancer (β0.63; p = 0.017 and β0.72; p = 0.013), and those above 65 years of age (β0.83; p < 0.001) were also perceived as more care intensive.
All except one attribute significantly influenced the judgments of the scenarios for nurses. Again, the attribute ‘multi-disciplinary treatment’ was redundant.
Nurses perceived ICU-stay as most care-intensive (β6.92; p < 0.001), followed by patients diagnosed with critical leg ischemia (β5.06; p < 0.001), a bad nutrition status (β4.23; p < 0.001) pancreas cancer (β3.93; p < 0.001), a complication at level 2 (β3.11; p < 0.001), and an emergency admission (β2.53; p < 0.001). Being 65 or older, having a diagnosed cholelithiasis, a complication level 1 (β1.78; p < 0.001) and sending home after discharge (β1.39; p < 0.001) contributed slightly but significantly more to care intensity. Surprisingly, patients classified as ASA II (but not ASA III) were considered less care-intensive than patients classified as ASA I. Furthermore, partly or totally dependent patients were perceived as less care-intensive than independent patients (β-0.44; p = 0.004, and β-1.79; p < 0.001). Patients with complications were assigned higher care intensity. However, patients with the most severe complications (apart from mortality), for instance patients with polyneuropathy, were considered to be less care-intensive (β-2.01; p < 0.001) as well as anxious and delirious patients (β3.33; p < 0.001).
Fifty-nine (72 %) surgeons and ninety-four (64 %) nurses gave their ranking. Both surgeons and nurses indicated that the occurrence of complications was most influential for care intensity (Table 4). Three out of the top-five of attributes were the same among surgeons and nurses, i.e., medical diagnosis, complication level and ICU-stay. However, the mean ratings differed: the surgeons’ mean score for medical diagnosis in their top-five was 3.73, as compared to 5.85 for nurses.
This study shows that 13 attributes contribute to a patient’s care intensity according to both surgeons and nurses; age, polypharmacy, medical diagnosis, complication level, ICU-stay and ASA-classification. In general, nurses assigned more weight to these attributes than surgeons. In addition, nurses also considered BMI, nutrition status, admission type, patients’ physical dependency, anxiety or delirium during hospitalization and discharge type as important factors influencing caring intensity.
The differences between surgeons and nurses on which attributes contribute to care intensity may be explained by differences in professional roles and daily work activities. Surgeons have a medical background, including technical aspects of their work and primary focus on patient curation and the direct results of the surgical procedure, which involves (multi-specialist) discussions on high risk patients and planning diagnostic or surgical interventions . Nurses on the other hand are more focused on direct patient care, i.e., checking their vital functions, stimulating patients towards self-care, providing wound care and the related documentation . Tasks which are substantial for patients diagnosed with critical leg ischemia. Furthermore, estimating care intensity can be difficult as its concept tends to be confounded with the concept’care complexity’. As nurses assigned less care intensity to patients classified as ASA II, patients with lasting damage due to a complication (level 3), and patients who were partly or totally dependent or had a delirium, the suspicion rises that nurses appreciated care complexity rather than care intensity, e.g., they only scored highly what they thought was beyond their routine and complex work to perform. Surgeons, in contrast, seemed to focus more on the workload and consequences they anticipate with increasing disease severity (higher ASA-class, more complex surgical interventions, more postoperative complications, more need for intensive care). Overall, nurses assigned more extreme weights than surgeons. This raised the suspicion that nurses appreciated care complexity instead of care intensity.
To our knowledge, this is the first study on the interpretation of the patients’ care intensity by surgeons and on the comparison between surgeons and nurses as to the care intensity they perceive. Awareness of the factors contributing to caring intensity is of major relevance to hospital managers who aim at optimizing the care processes on clinical wards. First, because this information helps managers to align the surgeons’ and nurses’ organizational processes and even tailor their personnel and resources on the wards. For instance, the finding that more attributes play a role for nurses than for surgeons regarding the patients’ care intensity should be an important new criterion for planners of patient admissions, since this apparently depends on several factors that may be different from, and on top of, those perceived by surgeons.
Second, knowing these differences may help surgeons and nurses to understand each other’s care intensity criteria, and better synchronize their patient care. Understanding, appreciating and respecting each other’s work has a positive impact on patient safety and provides learning possibilities for caregivers as well as improving working conditions [24, 25].
Some limitations of our study merit discussion. Not all characteristics that influence the patients’ caring intensity could be included in the scenarios. For instance, comorbidities or an Early Warning Score (EWS) to account for physical deterioration could not be taken into account. However, as we conducted a single Delphi round before creating the scenarios, these factors were not considered as influential. Moreover, these attributes are highly correlated with polypharmacy and ICU-stay, which are more suitable attributes because they contain fewer levels. Another suitable attribute would have been the Charlson comorbidity index as a weighted measure for patient comorbidity . However, this measure is, besides in the Hospital Standard Mortality Rate (HSMR), not commonly used for registration in the surgical departments in the Netherlands, and was therefore not included. Furthermore, only the main effects of the attributes could be measured. Possible interactions between main effects are unknown, e.g., between age and ASA-classification, or between age and polypharmacy. Finally, the caregivers’ workload is not only determined by demand for care, but also by personnel and organizational factors . The latter two factors were not included in this study, because too few personnel and organizational factors could be collected to adequately address this issue.
According to surgeons and nurses, six patient-related factors influence the care intensity of hospitalized surgical patients, of which ‘complication level’ ranked highest. Nurses also considered another six factors as important, possibly due to the nature of their daily work activities and the way they interpreted care intensity. It is worthwhile to explore the (differences in) perceived care intensity by physicians and nurses in different populations and healthcare organizations. Therefore, the results need to be further explored, but awareness of these factors may help managers optimize the work processes on nursing wards, in terms of staff planning and aligning the activities of surgeons and nurses. Furthermore, surgeons and nurses may better appreciate each other’s care intensity. Future research is needed to explore whether an objective measure for care intensity can foster this and may positively affect patient safety on clinical wards.
Sochalski J. Quality of care, nurse staffing, and patient outcomes. Policy Polit Nurs Pract. 2001;2:9–18.
Pronovost PJ, Angus DC, Dorman T, Robinson KA, Dremsizov TT, Young TL. Physician staffing patterns and clinical outcomes in critically ill patients: a systematic review. JAMA. 2002;288:2151–62.
Aiken LH, Sloane DM, Bruyneel L, Van den Heede K, Griffiths P, Busse R, et al. Nurse staffing and education and hospital mortality in nine European countries: a retrospective observational study. Lancet. 2014;383:1824–30.
Yasunaga H, Hashimoto H, Horiguchi H, Miyata H, Matsuda S. Variation in cancer surgical outcomes associated with physician and nurse staffing: a retrospective observational study using the Japanese Diagnosis Procedure Combination Database. BMC Health Serv Res. 2012;12:129.
Michtalik HJ, Yeh HC, Pronovost PJ, Brotman DJ. Impact of attending physician workload on patient care: a survey of hospitalists. JAMA Intern Med. 2013;173:375–7.
Aiken LH, Clarke SP, Sloane DM. International Hospital Outcomes Research Consortium. Hospital staffing, organization, and quality of care: cross-national findings. Int J Qual Health Care. 2002;14:5–13.
Karanikolos M, Mladovsky P, Cylus J, Thomson S, Basu S, Stuckler D, et al. Financial crisis, austerity, and health in Europe. Lancet. 2013;381:1323–31.
Legido-Quigley H, Otero L, la Parra D, Alvarez-Dardet C, Martin-Moreno JM, McKee M. Will austerity cuts dismantle the Spanish healthcare system? BMJ. 2013;346:f2363.
Royal College of Nursing. Beyond breaking point: a survey report of RCN members on health, wellbeing and stress. London; 2013. [http://www.rcn.org.uk/__data/assets/pdf_file/0005/541778/004448.pdf]. Accessed 15/04/2014
Royal College of Physicians. Hospitals on the edge? The time for action. London; 2012. [http://www.rcplondon.ac.uk/sites/default/files/documents/hospitals-on-the-edge-report.pdf]. Accessed 15/04/2014
Fieldston ES, Zaoutis LB, Hicks PJ, Kolb S, Sladek E, Geiger D, et al. Front-line ordering clinicians: matching workforce to workload. J Hosp Med. 2014;9:457–62.
O’Brien-Pallas L, Meyer RM, Hayes LJ, Wang S. The Patient Care Delivery Model-an open system framework: conceptualisation, literature review and analytical strategy. J Clin Nurs. 2011;20:1640–50.
van Oostveen CJ, Ubbink DT, Huis in het Veld JG, Bakker PJ, Vermeulen H. Factors and models associated with the amount of healthcare services as demanded by hospitalized patients: a systematic review. PLoS One. 2014;9:e98102.
van Oostveen CJ, Vermeulen H, Gouma DJ, Bakker PJ, Ubbink DT. Explaining the amount of care needed by hospitalised surgical patients. BMC Health Serv Res. 2013;13:42.
Fagerström L, Ainio A, Auhala A, Nojonen K. Validation of a new method for patient classification, the Oulu Patient Classification. J Adv Nurs. 2000;31:481–90.
Baines RJ, Langelaan M, de Bruijne MC, Asscheman H, Spreeuwenberg P, van de Steeg L, et al. Changes in adverse event rates in hospitals over time: a longitudinal retrospective patient record review study. BMJ Qual Saf. 2013;22:290–8.
Bridges JF, Hauber AB, Marshall D, Lloyd A, Prosser LA, Regier DA, et al. Conjoint analysis applications in health-a checklist: a report of the ISPOR Good Research Practices for Conjoint Analysis Task Force. Value Health. 2011;14:403–13.
Ryan M, Farrar S. Using conjoint analysis to elicit preferences for health care. BMJ. 2000;320:1530–3.
Jones J, Hunter D. Consensus methods for medical and health services research. BMJ. 1995;311:376–80.
Koedoot CG, de Haes JC, Heisterkamp SH, Bakker PJ, De Graeff A, De Haan RJ. Palliative chemotherapy or watchful waiting? A vignette study among oncologists. J Clin Oncol. 2002;20:3658–64.
Oudhoff JP, Timmermans DR, Knol DL, Bijnen AB, Van der Wal G. Prioritising patients on surgical waiting lists: a conjoint analysis study on the priority judgements of patients, surgeons, occupational physicians, and general practitioners. Soc Sci Med. 2007;64:1863–75.
Westbrook JI, Ampt A, Kearney L, Rob MI. All in a day’s work: an observational study to quantify how and with whom doctors on hospital wards spend their time. Med J Aust. 2008;188:506–9.
White DE, Jackson K, Besner J, Norris JM. The examination of nursing work through a role accountability framework. J Nurs Manag. 2013. [Epub ahead of print].
Klipfel JM, Carolan BJ, Brytowski N, Mitchell CA, Gettman MT, Jacobson T. Patient safety improvement through in situ simulation interdisciplinary team training. Urol Nurs. 2014;34:39–46.
Chang WY, Ma JC, Chiu HT, Lin KC, Lee PH. Job satisfaction and perceptions of quality of patient care, collaboration and teamwork in acute care hospitals. J Adv Nurs. 2009;65:1946–55.
Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373–83.
We thank the surgeons and nurses of the surgical departments for their effort to develop and judge the scenarios for care intensity. Furthermore, we are grateful to Susan van Dieren for her assistance with the mixed model analysis.
The authors have no support of funding to report.
The authors declare that they have no competing interests.
CO, DU, HV and DG were responsible for the study concept and design; CO and END analysed the data; CO, DU and HV wrote the article; CO had primary responsibility for final content; DG and END was responsible for editing the article. All authors read and approved the final manuscript.
Availability of data and materials
Clinical scenario. (PDF 118 kb)
About this article
- Conjoint analysis
- Physician intensity
- Nurse intensity
- Surgical wards
- Patient care intensity
- Clinical scenarios
- Hospital resources
- Demand for care