- Research article
- Open Access
- Open Peer Review
Assessment of the multidisciplinary education for a major change in clinical practice; a prospective cohort study
BMC Health Services Researchvolume 9, Article number: 28 (2009)
New approaches are often introduced to the neonatal intensive care unit (NICU) and other areas of the health service in either a haphazard or cataclysmic fashion. The needs of staff education are often addressed incompletely or too late. Rarely is education assessed after the introduction of a major change. We changed the basis of our NICU respiratory support. We conducted a major educational and support program before this intervention. This study documented and assessed the educational components of this change in our health service provision.
Senior medical and nursing staff attended training abroad and an education program was applied for one year prior to the change. Multidisciplinary educational support for doctors, nurses and allied health was continued after the change. Assessment was by anonymous questionnaire, prior to change, at one and at nine months. Our hypothesis was that dissatisfaction with education would be greatest at one month.
Both theory education and practical education aspects of the new approach were rated as good to very good and this did not change with time. Difficulty of applying the technique was rated as ambivalent initially but decreased significantly over 9 months until it was rated easy to very easy (p < 0.001). Over all, the change was rated by staff as beneficial, both at the end of the education period and at nine months, with no decrease at one month.
If education and training reaches all staff, with a system of mutual and continued support, even large changes in clinical practice can be achieved without the dissatisfaction with the educational process that is often otherwise seen.
Neonatal intensive care is an area of medical and nursing care that has been an early convert to evidence-based approaches; the origins of the Cochrane Collaboration are to be found in perinatal medicine . This means that new technologies and innovative approaches are also integral to this still developing field of care. As in other areas of health service, in our extensive experience, over three countries, these new approaches are introduced to the neonatal intensive care unit in a less than ideal way, often in a haphazard and piecemeal fashion. Alternately they may be introduced in a cataclysmic, overnight manner, with no prior education or appropriate support for the medical and nursing staff. Neither approach favours education, understanding or co-operation between staff . The needs of staff education are often addressed after the change has occurred and may be incomplete, leading to neglect of some staff, such as those on night duty . Rarely is there assessment of any educational approaches that are undertaken, even after the introduction of a major change.
Much of the care in neonatal intensive care units through the 1990s had been centred on improving the ventilatory support provided to sick infants using more and more complex technology. After reviewing the evidence and the experience of a number of other centres, we decided to switch to a system of respiratory support that was less invasive and might lead to less iatrogenic damage and thus reduce our incidence of chronic lung disease (CLD) [4–6], a condition with both short term and long term morbidity and mortality for premature infants. We planned to change to a Continuous Positive Airway Pressure (CPAP) based respiratory support, as used in the Columbia Presbyterian Medical Center in New York, as the model for our approach to respiratory care in the neonatal intensive care unit, following a report of its successful implementation away from the immediate support of the Columbia unit . Briefly, this approach centres around the aggressive use of short-prong nasal CPAP, permissive hypercarbia, targeted oxygen saturations and an increased use of blood gas trends, but is more fully described elsewhere [4, 7–9]
We conducted an extensive and prolonged educational and support program, prior to, during and after the introduction of this intervention. The purpose of this study was to document and assess the educational components of this change in our service provision.
For one year prior to the change, education was conducted. Senior medical staff attended training abroad and then a nurse educator and a clinical nurse specialist visited further units overseas for practical experience. A program of education and assessment of that education was devised, using a variety of modalities suitable for adult learners . Three small-group fixed resource sessions were written covering the theory of Columbia Respiratory Care (CRC) and the practical aspects of the CPAP system to be introduced. Two of these sessions were didactic in nature, based around a series of slides, but with frequent 2-way interaction with the multidisciplinary learners throughout the presentation. The third was a hands-on session allowing a small group to gain practical experience with the CPAP system equipment to be used, in a controlled environment using manikins. These three presentations were repeated over a 3 month period until all day and night staff had had the opportunity to attend each session at least once. With well over 100 staff, many on fractional appointments or on a casual list, this typifies the difficulties facing services such as ours. Many staff chose to attend a session on more than one occasion and this was encouraged. Sessions were attended by nursing staff, medical staff and a number of allied health staff working on the neonatal unit. Practical skills were reinforced by a further visit from external experts that had been involved in original research dealing with this approach to respiratory care of the newborn . Outside learning, with links to further resources provided, was encouraged but not documented. Anecdotally this was taken up by very few. The change to CRC was undertaken on a pre-set date, with the approach to a number of areas basic to neonatal intensive care changing overnight. The clinical aspects involved in our change to CRC have been reported  and our outcomes have been assessed by prospective cohort studies [11, 12].
After the change had taken place further support was provided by a series of group meetings, attended by both medical and nursing staff, allowing practical solutions to problems to be devised and disseminated through mutual support among the staff. Further information and attention to detail was highlighted by a series of newsletters over the first 6 months, in addition to constant nurse educator support.
We assessed our educational interventions by means of an anonymous questionnaire [see Additional file 1] administered the week prior to the change and then repeated at one month and nine months after the change. Our hypothesis was that any dissatisfaction with education would be greatest at one month. Our sample size was calculated (Statmate, GraphPad Software Inc, San Diego, CA) to demonstrate a 25% decrease in satisfaction with the education received around the time of a major change. The questionnaire asked about the suitability of educational input, both theoretical and practical, about the appropriateness of support for the change, perceived ease of application of the techniques and perceived overall benefit of the new system. Answers were recorded on a 9 centimetre linear scale with annotation to indicate the scale running from very favourable to very adverse, with ambivalence at the mid point. Annotations were transcribed into results in centimetres and analysed as continuous variables (median and interquartile ranges). Data was not normally distributed so was analysed with non-parametric methods, using Instat (GraphPad Software Inc, San Diego, CA).
Results were available for 62 subjects; repeated analysis was available for 48 members of staff, including senior and junior medical staff and a cross-section of the nursing staff who work within our service. Analysis, using Mann Whitney, of those subjects where repeated measures were available revealed no differences from the pooled analysis, and therefore further analysis was carried out, using Wilcoxon signed rank, on the subset where paired sampling was available. No detailed data were available on those that did not respond to the survey but the proportion of medical to nursing staff was no different and the proportion of part-time to full time staff within the unit was no different between the sampled population and the unit as a whole (p > 0.05).
The education provided in the theory of CRC was rated as good to very good and did not drop below this, even with a statistically significant change at one month (p = 0.018) (Table 1). Although the rating of the training in practical aspects of the new approach was good to very good throughout, there was also a significantly lower rating at one month (p = 0.03). These concerns were lost with time and further experience. Difficulty of applying the technique was rated as ambivalent initially, before its use, but decreased significantly over the 9 month period until it was rated as easy to very easy (p = 0.007). Support was rated as good for the first month and slightly decreased at 9 months to between average and good (p = 0.027). Over all, the change was rated by staff as beneficial, both at the end of the education period and at nine months, with no decrease at one month.
In contrast to the more common methods of introduction of change in many healthcare environments, we devised a specific education program intended to inform and empower all members of staff including senior medical staff, junior medical staff, nurse practitioners, permanent and casual nursing staff and our allied health staff. In addition we continued the support and the education process for some months after the change to CRC was introduced.
A number of problems with the introduction of innovation are predictable in the NICU environment, including but not restricted to, a large complement of staff, large proportion of staff with short hours and a large staff complement on night shifts . Our previous experience of the introduction of much lesser changes, in a less organised, way led to our hypothesis that dissatisfaction would be maximal at one month. Protocol and guidelines are a well established part of the neonatal intensive care environment, making sudden change in many areas a potential threat to sometimes long established local norms.
Ideally staff would have been randomised to receive the education period or not, to fully establish the effectiveness of the education program. Clearly that would have been very difficult to maintain in our service environment, with a coherent staff body with mixed and varying shift patterns. Although we did not plan it, the intervention that we undertook was essentially that of the Rogers' model of diffusion of innovation (Figure 1) . This was developed to describe the innovation-decision process within large organisations. It was not specifically designed for any particular area, but does provide a useful framework for health service practice changes. In the first stage knowledge was acquired from overseas experience by a few key staff. Next a stage of "persuasion" was undertaken. This in fact occurred in two cycles, as in order to move on to the third stage of "decision" there had to be initial communication of knowledge and persuasion to senior medical and nursing staff in order to achieve a consensus before more widespread education could be undertaken. It could be argued that this second iteration of the "decision" stage was not truly a decision point. We were very clear that the intervention, the introduction of the Columbia Respiratory Care approach, was highly dependent on the involvement and participation of the majority of the staff and therefore a clear rejection at this stage would indeed have led to a failure to proceed to the next stage of implementation. Stage 4, that of implementation occurred at a pre-set time and further support continued at and after this time. Finally, confirmation was both subjective and objective. Subjectively the questionnaire clearly shows that the staff considered the change to be of benefit to the babies cared for within our service. Objectively, our other studies have demonstrated an improvement in outcome for the babies in our care [11, 12].
The education prior to a major innovation has been compared to the process of marketing of an idea and has many features in common with commercial marketing. Landrum looked at this process in the context of innovation in a hospital environment; the marketing involved in the "persuasion" component of Roger's theory is clearly applicable to a variety of clinical environments . Our results are compatible with successful "marketing" of the proposed changes, in that the respondents unanimously considered it of benefit prior to the commencement of any change. A study of the introduction of changes in asthma management in Dutch primary health care, using the diffusion of innovation model , again showed success and related this partly to the relationship between the demonstration of successful results and continued enthusiasm for the innovations. In our study we also demonstrated both a real improvement and continued perceived effectiveness. The demonstration of improved introduction of innovations has been shown in medical education where immediate feedback of results is provided using live patient simulators . In other healthcare settings innovation has not been associated with sustained change when the perceived benefit has not been apparent . Our use of a graded approach over a long period in part represents resource restriction but also represents the view expressed by innovation and management expert W. Edwards Deming that "Long-term commitment to new learning and new philosophy is required of any management that seeks transformation. The timid and the fainthearted, and the people that expect quick results, are doomed to disappointment" .
In summary we have shown that with a large effort, ensuring that education and training reach all staff and with a system of mutual and continued support, even large changes in clinical practice within a health service can be achieved and sustained. We have shown that this can be done in the neonatal intensive care unit without the dissatisfaction with the process of change that we have so often seen.
neonatal intensive care unit
chronic lung disease
Continuous Positive Airway Pressure
Columbia Respiratory Care.
Chalmers I, Enkin M, Keirse MJNC: Effective care in pregnancy and childbirth. 1989, New York: Oxford University Press
Walsh M: Nursing Frontiers: accountability and boundaries of care. 2000, Oxford: Butterworth-Heinemann, 141-150.
McCarthy KA: Breaking tradition. A night shift educator. Crit Care Nurse. 2004, 24 (3): 78-79.
Avery ME, Tooley WH, Keller JB, Hurd SS, Bryan MH, Cotton RB, Epstein MF, Fitzhardinge PM, Hansen CB, Hansen TN, et al: Is chronic lung disease preventable? A survey of 8 centers. Pediatrics. 1987, 19: 26-30.
Furman L, Baley J, Borawski-Clark E, Aucott S, Hack M: Hospitalisation as a measure of morbidity among very low birthweight infants with chronic lung disease. J Pediatr. 1996, 128: 447-52. 10.1016/S0022-3476(96)70353-0.
Graziani LJ, Spitzer AR, Mitchell DG, Merton DA, Stanley C, Robinson N, McKee L: Mechanical ventilation in preterm infants: neurosonographic and developmental studies. Pediatrics. 1992, 90: 515-522.
De Klerk A: Successful implementation of Columbia respiratory support system. Proceedings of 1st Annual Congress of the Perinatal Society of Australia and New Zealand: 16–24 March, 1997; Freemantle, Australia. Sydney, PSANZ. 1997, A50.
De Klerk AM, De Klerk RK: Nasal continuous positive airway pressure and outcomes of preterm infants. J Paediatr Child Health. 2001, 37 (2): 161-167. 10.1046/j.1440-1754.2001.00624.x.
Graham S: Continuous positive airway pressure. Journal of Neonatal Nursing. 2004, 10: 130-134.
Caffarelia R: Planning programs for adult learners: A practical guide for educators, trainers and staff developers. 1994, San Francisco: Jossey Bass
Stark M, Gill AW, Glover RM, Wake CH, Wright IMR: The preterm infant with respiratory symptoms – are major adverse respiratory outcomes preventable?. Proceedings of 4th Annual Congress of the Perinatal Society of Australia and New Zealand: March 12–15, 2000;Brisbane, Australia. Sydney, PSANZ. 2000, 7.
Holberton J, Gill AW, Glover RM, Wake CH, Wright IMR: The term infant admitted with respiratory symptoms – Does a CPAP-based approach improve outcomes?. Proceedings of 4th Annual Congress of the Perinatal Society of Australia and New Zealand: March 12–15, 2000; Brisbane, Australia. Sydney, PSANZ. 2000, 74.
Rogers EM: Diffusion of Innovation. 1983, New York, The Free Press, Simon & Schuster
Landrum BJ: Marketing innovations to nurses, Part 2: Marketing's role in the adoption of innovations. J Wound Ostomy Continence Nurs. 1998, 25 (5): 227-232.
Meertens RM: Monitoring the dissemination of an educational protocol on pediatric asthma in family practice: a test of associations between dissemination variables. Health Education & Behavior. 1999, 26 (1): 103-120. 10.1177/109019819902600109.
Krick HJ, Thomas JW, Wu YC: Dissemination of an innovative technical therapy through an evaluated practical workshop using live patient simulators. Journal of Medical Education. 1981, 56 (7): 607-609.
Kristal AR, Biener L, Varnes J, Feng Z, Glanz K, Stables G, Chamberlain RM, Probart C: Durability and diffusion of the nutrition intervention in the Working Well Trial. Preventive Medicine. 1998, 27 (5): 668-673. 10.1006/pmed.1998.0342.
Edwards Deming W: Out of the crisis. 2000, Cambridge, MA, MIT Press
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/9/28/prepub
The authors would like to acknowledge the valuable assistance of Ms K Evans, Clinical Nurse Specialist, in the administration of the staff questionnaire.
The authors declare that they have no competing interests.
IW conceived and designed the study, undertook the statistical analysis and drafted the paper; CW assisted in study design and reviewed the paper; HA assisted in study design, collected data and reviewed the paper; SG assisted in study design, collected data and helped draft the paper. All authors reviewed and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.