- Research article
- Open Open Peer Review
Identified obstacles and prerequisites in telenurses’ work environment – a modified Delphi study
BMC Health Services Researchvolume 17, Article number: 357 (2017)
Telenursing is an expanding part of healthcare, staffed with registered nurses whose work environment is typical of a call centre. Work-related stress has been shown to be a major problem in nurses’ work environments and of importance to the outcome of care, patient safety, nurse job satisfaction and burnout. Today, however, we have a limited understanding of and knowledge about the work environment for telenurses. The aim of the present study is to explore and reach consensus on perceived important obstacles and prerequisites in telenurses’ work environment.
A modified Delphi design, using qualitative as well as quantitative data sequentially through three phases, was taken. Data were initially collected via semi-structured interviews (Phase I) and later using a web survey (Phase II-III) between March 2015 and March 2016.
The findings present a consensus view of telenurses’ experiences of important obstacles and prerequisites in their work environment. Central to the findings are the aspects of telenurses having a demanding work, cognitive fatigue and having no opportunity for recovery during the work shift was ranked as important obstacles. Highly ranked prerequisites for managing were being able to focus on one caller at a time, working in a calm and pleasant environment and having technical support 24/7.
Managers need to enable telenurses to experience control in their work, provided with possibilities to control their work and to recover during work; shortening work time could improve their work environment. Limited possibilities to perform work might contribute to feelings of stress and inability to perform work.
Telephone advice nursing (henceforth telenursing) is an expanding part of healthcare in many western countries, including the UK, the US, Canada, Australia, Denmark and the Netherlands [1, 2]. Telenursing services are organized in call centres and intended to steer patient flows so as to avoid unnecessary patient visits and ease the strain on limited healthcare resources. Telenursing services are staffed with registered nurses (RNs, henceforth telenurses). Their work environment is typical of a call centre, in that they sit in front of a computer wearing headsets and handling incoming calls [2, 3]. During a short period of time, telenurses make an assessment of the care-seekers need for care, independently triage the need for care, give individualized care (e.g., give self-care advice, information and support), and refer the care-seeker to the appropriate healthcare provider, all using only communicative strategies [1, 2]. Telenurses do not only receive calls from their own county council/region but over the entire country due to collaboration among call-centre sites. If a call-centre have long telephone ques, calls will be forwarded to a call-centre with the shortest que. Hence, the work also demands that telenurses be well versed in healthcare organization [4, 5]. Placing the caring nature of nursing within a call centre context is not uncomplicated; previous studies [6, 7] have shown how telenurses are exposed to conflicting demands and how employees call for efficiency as well as unequivocal and evidence-based advice. These conflicting demands are likely to lead to experiences of stress. Work-related stress has been shown to be a major problem in nurses’ work environment in other fields of nursing [8–10]. Work environment has also shown to be of importance to the outcome of care, patient safety , nurse job satisfaction and burnout [11, 12] within other fields of nursing. Today, however, there is little understanding of and knowledge about the work environment for telenurses. The present study aims to explore and reach consensus on perceived important obstacles and prerequisites and in telenurses’ work environment.
In Sweden, the national healthcare service Swedish Healthcare Direct (SHD) was introduced during 2003 and is today one of Sweden’s largest healthcare providers, with approximately 5.5 million citizens contacts during 2015. SHD has 23 different call centres spread throughout the country. The Swedish service is quite similar to the UK service NHS Direct, the difference being that Sweden does not have call handlers who first triage callers’ need for care and forward the appropriate calls to the telenurses. SHD is staffed by approximately 1100 telenurses  with the assistance of a computerized decision support system (CDSS). The CDSS used at SHD, as well as at NHS Direct, can be entered either based on symptoms or diagnosis, and it covers various symptoms and medical conditions among children, adolescents, adults and older people .
The work environment at SHD (and NHS Direct) is typical of a traditional call centre, in that all patient contacts are made via telephone without any possibility to have physical contact with the care seeker. At SHD, all calls are recorded and call time, number of answered call per hour, level of referral and queue time are registered, monitored and evaluated [3, 13]. Telenurses employed at SHD have described how they perceive a conflict between nursing care, where every patient should be treated as an individual, and managers’ demands for efficiency, with short queue times and short calls [7, 14]. According the quality goals of SHD, calls should be answered within 3 min, and during periods of increased illness (e.g., influenza season), long telephone queues are common . Previous studies have shown that telenurses feel long queue times lead to dissatisfaction and threats from callers [7, 14]. The telenurses cannot influence the number of calls to SHD; all calls are forwarded to the telenurses and placed in the telephone queue. Telenurses working at SHD are constantly reminded of the actual length of the telephone queue via their computer .
Karasek and Theorells  model describes how the relationship between demands and control in work determine if the work leads to positive or negative stress. Work situations with high psychological demands and low decision latitude, such as nurses and telephone operators is at greater risk of developing work related illness compared to work situations with high psychological demands and high decision latitude such as engineers and physicians. The demand – and control model describes how the effects of psychological demands on employees co-variates with the level of control, hence acting space and decision latitude. The effects of psychological demands also co-variates with the level of support offered from the organization to the employees. According to the model, the worst work situation is iso-tensed situations whereas the employee is exposed to high demands, with low levels of support and low possibility to influence. According to the literature, there is a consensus that iso-tensed work is a risk factor for the development of cardiovascular diseases .
Telenursing is a complex kind of care, telenurses create a picture of the caller’s condition using communicative strategies only. In addition to asking the right questions, the telenurses must use non-verbal communicative strategies to verify or exclude serious symptoms . It is also essential that telenurses, though communication, enable trust and a caring relationship with the caller . If the telenurse misjudges the caller’s need for care, the consequences may be fatal and lead to malpractice claims against the individual telenurses. To enable adequate and safe nursing care, nurses need feedback on their work. This is accomplished daily within traditional care, where continuity of patient care is more common. Within telenursing, the opportunity for feedback is lacking, because telenurses are never given the possibility to follow-up on callers.
Work-related stress is a major problem within nurses’ work environment and leads to physical illness  as well as decreased job satisfaction. Stress can also result in impaired patient satisfaction with care provision , insufficient quality of care , increased patient mortality , and increased risk of medical errors. In a study investigating medical errors within SHD, the results showed that work stress and unclear work descriptions (lack of information) were identified as contributing factors. Secondary findings from previous studies conducted within the research team have indicated deficiencies in these factors for telenurses working within SHD [14, 15, 22–24]. The telenurses experience conflicts within their work, stressful situations and problems referring the caller to the appropriate healthcare provider . Access to essential structural conditions has shown fewer stress symptoms, higher job satisfaction  and improved work effectiveness [26–28]. Today, there is little understanding of and knowledge about the work environment, obstacles and important prerequisites in telenursing.
The concept of work environment is here understood as involving several parts, the physical work environment, the psychological and the social work environment, the latter commonly described as the psychosocial work environment. Physical work environment relates to aspects such as light, surrounding sound and tool needed to perform work such as computers, desks and chairs. Psychological work environment relates to work load and work related stress. Social work environment relates to aspects of cooperation between colleagues, social relations at work and support within the work group. Psychosocial work environment relates to aspects such as stress, control, demand, leadership, communication, influence/power, social support and balance between work and private life [16, 28].
The present study is a part of a research project focusing on telenurses’ work environment. Because work environment has been shown to be important to the outcome of care , the present study aims at exploring and reaching consensus on perceived important obstacles and prerequisites in telenurses’ work environment, hence at identifying potential deficits and thereby enabling interventions that promote a healthy and productive work environment.
The aim of the study were to explore and reach consensus on perceived important obstacles and prerequisites in telenurses’ work environment.
Design and setting
A modified Delphi design, using qualitative as well as quantitative data sequentially through three phases, was taken. A description of the data collection method and sample size is presented in Fig. 1. The Delphi design was chosen because it is widely used within healthcare research [29, 30] to explore and gain consensus within a group of participants who have experience of the topic of interest to the researchers . The SHD service is provided via 23 call centers, located throughout the country, linked via a network. The study included participants from six call centers located in different parts of Sweden and the centers varied on the dimensions, e.g., geographical location, large (more than 1.4 inhabitants) vs. small (22.000 inhabitants) city, northern vs. southern Sweden.
For Round I, the inclusion criterion was having worked at the present workplace for at least half a year at the time of the interview. Twenty-four telephone advice nurses, all female, between 33 and 67 years of age (mean 55.4 SD 1.7) with 2.5 to 35 years’ (mean 6.2 SD 0.9) experience of telephone advice nursing participated in the interviews. For Round II and III, an additional 106 telenurses employed within SHD were invited to participate in the web survey. The participants in Round II and III varied in age from 33 to 73 years (mean 56.5 SD 0.9) with 7 months to 33 years’ (mean 6.9 SD 0.5) experience of telephone advice nursing. Two of the participating telenurses were male. The participating telenurses worked for pubic non-profit as well as private for-profit provider organizations, distributed throughout the country.
The data collection was conducted between March 2015 and March 2016 in three rounds, and the results from each round of the Delphi are presented in the results section. An overview of the methods and participants for each round of the study is presented in Fig. 1. Data were initially collected via semi-structured interviews (Round I) (n = 24) using an interview guide with predetermined question areas such as “Can you describe your work environment at SHD?” The participant was also asked about “What obstacles do you experience in your work environment” and “What prerequisites are important in your work environment”. Probing questions such as “Can you please tell me more?” were asked to deepen the telenurses’ descriptions of their reflections on their work environment . The interviews were conducted from March until May 2015; 15 interviews were conducted via personal meeting and 9 interviews were conducted via telephone by the first author. The interviews lasted between 33 and 107 min (mean time 62.7 min) and were recorded on an MP3 player. After the qualitative data analysis, the identified categories (henceforth items), indicating obstacles and prerequisites were sent to the participants and an additional 106 telenurses using a web survey (Sun-net Survey) for ranking based on importance on a 7-grade Likert scale (Round II), (1 = not at all important, 2 = low importance, 3 = slightly important, 4 = moderately important, 5 = important, 6 = very important, 7 = extremely important). Criterion for consensus and re-rating in Round III was set to at least 55% of the participating telenurses rating an item as 5 (important) to 7 (extremely important). Items (obstacles and prerequisites) showing consensus (>55%) were selected for Round III and sent back to the participants. The results from Round II were, as recommended by Keeney et al. , then returned to the participants in the web survey, showing the overall group response from Round II. The participants were asked to reconsider their initial response from the previous round (Round II) and again rank the items (obstacles and prerequisites) based on their importance using the 7-grade Likert scale. For a description of the identified obstacles and important prerequisites and the ranking in Round II and III, see Tables 1 and 2. In Round II, 69 out of 130 (53%) participants completed the web survey, and in Round III 54 out of 69 (78.3%) did so.
The interview data were analysed by the first and last author using manifest qualitative content analysis . All interviews were transcribed verbatim, read and re-read several times to get a sense of the content. The interview text were put into a single text word-document and analysed using an inductive qualitative content analysis in line with Elo and Kyngäs . Words and sentences e.g. meaning units related to obstacles and prerequisites were extracted, condensed and abstracted and labelled with a code that described the content of the meaning unit. The codes were sorted into categories based on similarity and differences and 45 categories (henceforth items) were found. Categories was formulated with the ambition of remaining close to the concepts and words used in the respondents’ answers. Theses 45 items consisted of 28 items of obstacles and 17 items of prerequisites, see Table 1. To achieve acceptable methodological quality the analysis was an on-going process involving all authors. Quantitative data from the web survey were entered into IBM SPSS Statistics for Windows for analysis, and descriptive statistics were used to explore median (Md), mean and quartiles (Q) as well as frequencies and proportions for individual items and ranking. Criterion for consensus and re-rating in Round III was set to at least 55% of the participating telenurses rating an item as 5 (important) to 7 (extremely important) . All data collection was performed by the same author, using an interview-guide to ensure that all participants were asked the same questions. To enhance dependability all of the interviews were made by one author (AE). Data analysis was performed by two authors (AE and ACW) in order to strengthen credibility of the findings. Discussions were held until consensus was reached regarding names for the items. The result of the analysis, hence the identified items were presented to telenurses and managers within SHD for establishing face-validity on two occasions.
Data collection and the results from each round of the Delphi are presented in the results section owing to the iterative nature of the study. The results are based on the interviews (Round I) and the result of the responses collected in the two questionaries’ (Round II and III).
The initial interviews were conducted with 24 telenurses, all employed within SHD. Analysis of the qualitative interview data resulted in a total of 45 items, 28 items of obstacles and 17 items of prerequisites, see Table 1. This study finds a variety of important obstacles and prerequisites within telenurses work environment. These 45 items are a description of the important obstacles and prerequisites the telenurses expressed within the interviews. To enable consensus on important obstacles and prerequisites in telenurses work environment the results, 45 items of obstacles and prerequisites, identified in the interviews were entered into a web-survey (Sun-net Survey) and sent back to the 24 telenurses participating in the interviews and additional 106 telenurses for ranking based on importance on a 7-grade Likert scale (Round II).
A total 69 (out of 130 (53%)) participants completed the web survey in Round II. As one of the aims of the study was to achieve consensus on the important factors in the work environment, the authors agreed to set the criterion for consensus in Round II, and thereby re-rating in Round III, to at least 55% of the participating telenurses rating an item as 5 (important) to 7 (extremely important) . In Round II, 35 out of 45 items met the pre-determined acceptance for Round III criterion. The median values of respondents’ ratings of the 28 items in Round II regarding important Obstacles varied from “not having the callers’ medical charts”(nr.11) (Md = 2.0) to the seven items “cognitive fatigue”(nr.2), “unclear guidelines and lack of structure at the workplace”(nr.26), “no opportunity for recovery during the work shift”(nr.19), “lacking availability among other healthcare providers”(nr.10), “lack of support and appreciation from managers”(nr.8), “disturbing sounds”(nr.4) and “technical problems”(nr.24) (Md = 6.0). The median values for important Prerequisites varied from “regular feedback on one’s own calls”(nr. 40) and “being able to call callers back” (nr.30)(Md = 5.0) to the nine items “being able to focus on one caller at a time”(nr.32), “possibility to influence their work time“(nr.39), “structure and support via CDSS”(nr. 43), “support from management”(nr.44), “calm and pleasant environment”(nr.33), “collegial support”(nr.34),”having a stimulating work”(nr. 41),”possibility to adjust the work station” (nr.38)and “technical support” (nr.45)(Md = 7.0); see Table 2.
In Round III, the web survey was structured with the highest ranked item placed first together with the ranking the item received in Round II. The analysis of the final round resulted in an interdependent ranking of the 18 items regarding important Obstacles, which varied from “unclear guidelines and lack of structure at the workplace” (no. 26) (Md = 4.5) to “cognitive fatigue” (no.2), “no opportunity for recovery during the work shift” (no.19) and “lacking availability among other healthcare providers” (no.10) (Md = 6.0); see Table 1. The median values for important Prerequisites varied from “joint coffee and lunch breaks” (no.37) and “being able to call callers back” (no.30) (Md = 5.0) to the five items “ability to focus on one caller at a time”(no.32),” possibility to influence work time”(no.39),” being able to choose the size of their workroom”(no.31), “calm and pleasant environment”(no.33) and “technical support 24/7”(no.45) (Md = 7.0); see Table 2. The items, e.g. obstacles (11 items) and prerequisites (10 items) receiving the highest rank in Round III are presented in Tables 3 and 4. Two items (item 10 and item 11) of obstacles received the same ranking and thereby 11 items for obstacles.
The findings from the current Delphi study present a consensus view of telenurses’ experiences of obstacles and prerequisites in their work environment. Central to the findings are the aspects of “cognitive fatigue”(no.2), “having no opportunity for recovery during the work shift”(no.19) and “lacking availability among other healthcare providers” (no.10) all received the highest rankings in Round II as well as Round III. In a previous study , the results showed that the main reason for medical errors within SHD was telenurses failing to listen to the caller and asking too few questions, perhaps as a result of cognitive failure and tiredness. According to the telenurses, stress and fatigue were involved in the malpractice claims and were described as contributing factors . The identified problem with lacking availability among other healthcare providers has been described in a previous study , where it was the most common reason for an incident report within SHD.
Three of the highest ranked items regarding prerequisites in both Round II and III were related to having control of the work situation, hence the “being able to focus on one caller at a time”(no.32), “possibility to influence work time”(no.39) and “being able to choose the size of their workroom”(no.31). Having a sense of control is an important factor for healthy work . Many of the items receiving high ranks in Round II and III regard lack of control of the work situation, and based on evidence in the literature, they should be addressed by the organizations employing the telenurses to prevent work-related illness. The control and demand model  explains that the effects of psychological demands co-vary with the degree of control, e.g. decision latitude. The effect of psychological demands also co-varies with the level of support offered to employees by the organization. According to the model , the worst work situation is when employees have high demands and low levels of support combined with low possibility to influence and affect their work situation, e.g., iso-strain. Today, there is consensus in the research that iso-strained work is a risk factor for development of heart disease and psychiatric illness. Telenurses are subjected to many conflicting demands in their work , and it is necessary to increase their ability to control their work, because high demands can be manageable when combined with control . The results of the present study could also be reflected on the findings of the Job Demand – resources model (JD-R) that suggests that working conditions can be categorized into two different categories: job demands and job resources . The obstacles and prerequisites found within the present study could be regarded as examples of these kind of job demands and job resources. Job demands includes the aspects of work that requires sustained cognitive and emotional efforts from the employee and these demands are associated with costs for the individual . These kind of costs were explicit found within the present study whereas “cognitive fatigue” (no.2) and “having no opportunity for recovery during the work shift” (no.19) was two of the highest ranked items in Round III.
The present results also revealed high levels on items related to lack of support, from managers as well as from other healthcare providers. Support is an important part of Karasek and Theorell’s model ; they state that low levels of support, excessive demands and poor decision latitude lead to mental fatigue as well as low back pain. In the present study, the participants indicated that sedentary work, which leads to physical strain, is an obstacle in their work. But based on Karasek and Thorell’s model , other factors – e.g., lack of support and appreciation from managers (no.8), lack of understanding and being exposed to critic from other healthcare providers (no.9) – may also cause their experience of physical strain, not only the fact that their work is sedentary. Having support was ranked as important; both collegial support (no.34) and support from management (no. 44) were ranked as important items in Round II and III. A previous study showed how collegial support affected job performance and could also enhance the quality of care. The study also showed that nurses with high social support had lower perceived job stress and increased nurse retention . The most common sources of stress in nursing care include a high workload, poor collegial support, role conflict and role ambiguity. These factors are similar for all nurses irrespective of type of ward or nursing specialty and would appear to be inherent to the nursing role . In the present study, three of these factors were described, e.g., high workload, poor collegial support and ambiguity on how to preform work (e.g. unclear guidelines). Coaching and task support are the types of social support most predictive of job tenure . In the present study, these were regarded as important prerequisites and as obstacles when they were not available.
One strength of the present study is the prolonged engagement of the participants throughout the course of the study. As there was no previous research on the topic, an exploratory approach using Delphi technique was chosen [29, 39]. The technique has been shown to be flexible and to have several advantages when searching for consensus on a specific topic. Because there are no recommendations regarding the appropriate sample sizes for the different phases, a decision was made to include 24 experts (telenurses) in the first qualitative round. In Round I, all participating telenurses were female, which may limit the generalizability of the study. Male telenurses were included in Round II and III, which could be regarded as a strength. Due to the small sample, it was not possible to study differences between groups based on gender and age. The stability of the data, e.g. the small changes in item ratings in Round II and III, indicates that the identified items are representative of the context. The response rate for Round II was limited (53.1%). However, the 106 new telenurses had not been asked about their interest in participating in the study prior to sending out the web survey. But regarding the respective groups, of the 24 telenurses participating in Round I, 21 completed Round II. In Round III, the overall response rate was 54 out of 69 (78.3%). This indicates the importance of including participants early in the study, because this decreases dropout. The level for consensus in Round II was set at 55% of participants ranking the item 5–7 in a 7-grade Likert scale. The literature provides few clear guidelines on what consensus to set. Depending on the importance of the topic, the literature suggests consensus levels varying from 100% in life-and-death issues to Loughlin and Moore’s  suggestion that consensus be equated with 51% agreement among respondents. In Round III, we decreased the number of items and only included items that were ranked as important by more than 55% of participants in Round II. The reason for the reduction was to avoid duplication and to reduce participant fatigue . For establishing face-validity the result of the analysis, hence the identified items were presented to telenurses and managers within SHD at two occasions.
Managers need to enable telenurses to experience control in their work. Given the nature of telenursing, e.g., high levels of demand and subsequent tiredness due to long working periods, telenurses need to be provided with possibilities to control their work and to recover during work. Moreover, shortening work time could improve their work environment. Healthcare organizations (politicians) need to address the problems associated with limited resources, because lacking availability among other healthcare providers has long been a problem in Swedish Healthcare. Limited possibilities to perform work might contribute to feelings of stress and inability to perform work.
Snooks HA, Williams AM, Griffiths LJ, et al. Real nursing? The development of telenursing. J Adv Nurs. 2008;61(6):631.
Rutenberg C, Greenberg ME. The art and science of telephone triage: how to practice nursing over the phone. NJ: Pitman; 2012.
Ernesater A, Engstrom M, Winblad U, et al. Telephone nurses’ communication and response to callers’ concern-a mixed methods study. Appl Nurs Res. 2016;29:116.
Marklund B, Strom M, Mansson J, et al. Computer-supported telephone nurse triage: an evaluation of medical quality and costs. J Nurs Manag. 2007;15(2):180.
Andersson Bäck, M. (2008). Conceptions, conflicts and contradictions in the introduction of a Swedish Health Call Centre. University of Gothenburg, Sweden (Doctoral thesis).
Knowles E, Munro J, O’Cathain A, et al. Equity of access to health care. Evidence from NHS Direct in the UK. J Telemed Telecare. 2006;12(5):262.
Holmstrom I, Dall’Alba G. Carer and gatekeeper’ - conflicting demands in nurses’ experiences of telephone advisory services. Scand J Car Sci. 2002;16(2):142.
Jennings B. Work Stress and Burnout Among Nurses: Role of the Work Environment and Working Conditions. In: Hughes R, editor. Patient Safety and Quality: An Evidence-Based Handbook for Nurses. Rockville: Agency for Healthcare Research and Quality; 2008. Chapter 26.
Simpson KR, Lyndon A, Ruhl C. Consequences of Inadequate Staffing Include Missed Care, Potential Failure to Rescue, and Job Stress and Dissatisfaction. J Obstet Gynecol Neonatal Nurs. 2016;45(4):481.
Trousselard M, Dutheil F, Naughton G, et al. Stress among nurses working in emergency, anesthesiology and intensive care units depends on qualification: a Job Demand-Control survey. Int Arch Occup Environ Health. 2016;89(2):221.
Hanrahan NP, Kumar A, Aiken LH. Adverse events associated with organizational factors of general hospital inpatient psychiatric care environments. Psychiatr Serv. 2010;61(6):569.
Rios-Risquez MI, Garcia-Izquierdo M. Patient satisfaction, stress and burnout in nursing personnel in emergency departments: A cross-sectional study. Int J Nurs Stud. 2016;59:60.
Ernesater A, Winblad U, Engstrom M, et al. Malpractice claims regarding calls to Swedish telephone advice nursing: what went wrong and why? J Telemed Telecare. 2012;18(7):379.
Wahlberg AC, Cedersund E, Wredling R. Telephone nurses’ experience of problems with telephone advice in Sweden. J Clin Nurs. 2003;12(1):37.
Ernesater A, Engstrom M, Winblad U. A comparison of calls subjected to a malpractice claim versus ‘normal calls’ within the Swedish healthcare direct: a case-control study. BMJ Open. 2014;4(10):e005961.
Karasek R, Theorell T. Healthy work: stress, productivity, and the reconstruction of working life. New York: Basic Books; 1990.
Wahlberg AC, Cedersund E, Wredling R. Bases for assessments made by telephone advice nurses. J Telemed Telecare. 2005;11(8):403.
Travelbee J. Interpersonal aspects of nursing. Philadelphia: Davis; 1971.
Gonge H, Jensen LD, Bonde JP. Do psychosocial strain and physical exertion predict onset of low-back pain among nursing aides? Scand J Work Environ Health. 2001;27:388.
Aiken LH, Clarke SP, Sloane DM, et al. Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. JAMA. 2002;288(16):1987.
Leveck ML, Jones CB. The nursing practice environment, staff retention, and quality of care. Res Nurs Health. 1996;19(4):331.
Wahlberg AC, Cedersund E, Wredling R. Factors and circumstances related to complaints in emergency medical dispatching in Sweden: an exploratory study. Eur J Emerg Med. 2003;10(4):272.
Ernesater A, Engstrom M, Holmstrom I, et al. Incident reporting in nurse-led national telephone triage in Sweden: the reported errors reveal a pattern that needs to be broken. J Telemed Telecare. 2010;16(5):243.
Ernesater A, Holmstrom I, Engstrom M. Telenurses’ experiences of working with computerized decision support: supporting, inhibiting and quality improving. J Adv Nurs. 2009;65(5):1074.
Engstrom M, Skytt B, Nilsson A. Working life and stress symptoms among caregivers in elderly care with formal and no formal competence. J Nurs Manag. 2011;19(6):732.
Blanck S, Engstrom M. District nurses’ prescribing practice and its link to structural conditions. J Am Assoc Nurse Pract. 2015;27(10):568.
Engstrom M, Westerberg Jacobson J, Martensson G. Staff assessment of structural empowerment and ability to work according to evidence-based practice in mental health care. J Nurs Manag. 2015;23(6):765.
Lindberg P, Vingård E. Den goda arbetsmiljön och dess indikatorer 2012;2012:7:1.(In Swedish)
Keeney S, Hasson F, McKenna H. Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nurs. 2006;53(2):205.
Linstone HA, Turoff M. The Delphi method: techniques and applications. Reading, Mass. 1975.
Patton MQ. Qualitative evaluation and research methods. Newbury Park: Sage; 1990.
Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qualitative health research. 2005;15(9):1277.
Elo S, Kyngas H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107.
Roing MIK. Lessons learned from malpractice claims in Swedish telenursing - interviews with telenurses and managers. Nursing Research. 2014;64(1):35.
Demerouti E, Bakker AB, Nachreiner F, et al. The job demands-resources model of burnout. J Appl Psychol. 2001;86(3):499.
Bakker AB, Demerouti E. The job demands-resources model: State of the art. J Manage Psychol. 2007;22(3):309.
AbuAlRub RF, Al-Zaru IM. Job stress, recognition, job performance and intention to stay at work among Jordanian hospital nurses. J Nurs Manag. 2008;16(3):227.
Harris I, Winskowski A, Engdahl B. Types of Workplace Social Support in the Prediction of Job Satisfaction. Career Dev Q. 2007;56(2):150–6.
Loughlin KG, Moore LF. Using Delphi to achieve congruent objectives and activities in a pediatrics department. J Med Educ. 1979;54(2):101.
Mead DM, Mosley LG. The use of Delphi as a research approach. Nurse Researcher. 2001;8(4):4.
The research team would like to thank the participating telenurses for sharing their experiences and reflections during the study and to the managers in charge for their support.
The study was funded by the Faculty of Health and Occupational Studies, University of Gavle.
Availability of data and materials
The datasets generated and/or analysed during the current study are not publicly available due to regulations from the The Regional Ethics Board in Uppsala for protection of participants’ integrity and risk of compromising individual privacy but are available from the corresponding author on reasonable request.
A B: obtaining funding, designing and planning of study, data collection, data analysis, and manuscript preparation. ME: designing and planning of study, data analysis and manuscript preparation. AO: designing and planning of study, data analysis and manuscript preparation. ACW: designing and planning of study, data analysis and manuscript preparation. All authors have agreed on the final version and meet at least one of the following criteria recommended by the ICMJE
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Permission to conduct the study was obtained from The Regional Ethics Board in Uppsala, Sweden (Ref. no. 2014/409). Participating telenurses were given oral and written information regarding the study and gave their informed consent to participate.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.