- Research article
- Open Access
- Open Peer Review
Implementing solutions to improve and expand telehealth adoption: participatory action research in four community healthcare settings
- Received: 7 March 2015
- Accepted: 23 November 2015
- Published: 1 December 2015
Abstract
Background
Adoption of telehealth has been slower than anticipated, and little is known about the service improvements that help to embed telehealth into routine practice or the role of frontline staff in improving adoption. This paper reports on participatory action research carried out in four community health settings using telehealth for patients with Chronic Obstructive Pulmonary Disease and Chronic Heart Failure.
Methods
To inform the action research, in-depth case studies of each telehealth service were conducted (May 2012–June 2013). Each service was then supported by researchers through two cycles of action research to implement changes to increase adoption of telehealth, completed over a seven month period (July 2013–April 2014). The action research was studied via observation of multi-stakeholder workshops, analysis of implementation plans, and focus groups.
Results
Action research participants included 57 staff and one patient, with between eight and 20 participants per site. The case study findings were identified as a key source of information for planning change, with sites addressing common challenges identified through this work. For example, refining referral criteria; standardizing how and when patients are monitored; improving data sharing; and establishing evaluation processes. Sites also focused on raising awareness of telehealth to increase adoption in other clinical teams and to help secure future financial investment for telehealth, which was required because of short-term funding arrangements. Specific solutions varied due to local infrastructures, resources, and opinion, as well as previous service developments. Local telehealth champions played an important role in engaging multiple stakeholders in the study.
Conclusions
Action research enabled services to make planned changes to telehealth and share learning across multiple stakeholders about how and when to use telehealth. However, adoption was impeded by continual changes affecting telehealth and wider service provision, which also hindered implementation efforts and affected motivation of staff to engage with the action research, particularly where local decision-makers were not engaged in the study. Wider technological barriers also limited the potential for change, as did uncertainties about goals for telehealth investment, thereby making it difficult to identify outcomes for demonstrating the added value over existing practice.
Keywords
- Technology
- Telehealth
- Adoption
- Implementation
- Action research
- PDSA
- Community nursing
- Service improvement
- Long-term conditions
Background
Implementation of telehealth, defined as technologies that enable patients and clinicians to exchange information about their health state remotely [1], has suffered from slow adoption and ‘pilotitis’ in parts of the UK and Europe [2, 3]. Reasons for the failure of telehealth to become part of routine care are multi-faceted, with the mixed evidence of cost effectiveness often cited as one of the leading factors [4–6]. More specifically, inconclusive results from the Whole Systems Demonstrator trial in England are often referenced in discussions about the inability of telehealth to be scaled up in the UK [7–9]. One of the challenges to evaluating the effects of telehealth relates to the limited knowledge of how factors affecting both adoption, which we define as the ‘processes involved in making the decision to use the technology…located at different levels (individual, organizational, regional, national)’ ([10]: p96), and implementation, which we refer to as the ‘active and planned efforts to mainstream an innovation within an organisation’ ([11]: p582), may influence the results [1]. However, little research has examined the on-going processes of implementing telehealth or focused on how challenges can be overcome to increase adoption and embed telehealth into routine care [2, 12, 13].
More recent studies have started to identify barriers affecting implementation, which include limitations of telehealth equipment, technological and organizational barriers to sharing patient data and working across service boundaries, low staff awareness and engagement, increased staff workload, inefficient resources to support service delivery, difficulties assessing patient suitability for telehealth, and uncertainty about the structures and processes that are required to monitor patients remotely [14–17]. Whilst certain barriers affecting adoption are specific to telehealth, other identified factors are evident in research examining adoption of new innovations more generally [18]. For example, fear of increased workload and concerns about job roles and patient care, not involving frontline staff in planning and service design, poor staff training, and conversely, the importance of frontline champions who can help to increase awareness and spread success [11].
For telehealth, the range of devices and applications that are now available, and the multiple stakeholders and mechanisms involved in any single service adds further complexity to implementation, and consequently to the challenges of normalizing into healthcare delivery [4]. Each implementation of telehealth is both unique to the specific clinical setting and patient population, but also to the service design and specification [6]. Local configuration and management of health and social care provision also shape deployment and implementation of new technologies [1]. Moreover, because there are competing visions and goals for telehealth [19], there are resulting mixed opinions about what it should and can achieve [15]. This highlights the social complexities surrounding both the intervention and the system into which it is introduced [20], and raises additional questions about evaluation when what we are deploying is ambiguously defined.
Examining the active and planned efforts to implement telehealth in different healthcare settings, and identifying solutions to address identified barriers to normalizing telehealth, is therefore essential if we are to inform the development of local services that can avoid current pitfalls and problems, and to help design future studies that can better examine effectiveness. A recognized challenge of moving from research to practice is that pilots and trials are often time-limited, with little consideration to what will happen beyond completion [3]. Current research has focused more upon measuring clinical outcomes and describing patient experience within the context of randomised controlled trials [7–9, 12], but few studies have examined the implementation of telehealth within routine care, or the efforts to use telehealth over an extended time period. This paper reports the findings of a two-phase action research study, which aimed to identify the factors affecting telehealth adoption, and test solutions to address prioritized areas for improvement and expansion.
Methods
Study design
In-depth qualitative case studies were conducted to inform the development of a programme of participatory action research to improve adoption of telehealth, carried out using principles of the Plan Do Study Act (PDSA) service improvement tool [21]. The research took place within four community nursing settings using telehealth to monitor the symptoms of patients with Chronic Obstructive Pulmonary Disease (COPD) and Chronic Heart Failure (CHF) who were living at home. These conditions were selected for the study because they are two of the most common long-term conditions for which telehealth is currently used [6].
It is important to note that, given the emergent nature of the evidence base regarding clinical and cost-effectiveness of telehealth, the researchers approached the action research from a neutral position on the issue of whether telehealth should be expanded. The researchers recognise the implicit complexity of maintaining a neutral standpoint, particularly as the research rationale set by the funders was to identify solutions to help mainstream telehealth. To manage this complexity, and in keeping with the principles of participatory action research, participants in each site were encouraged to draw upon the case study findings and their own local knowledge of their telehealth service to select actions to test as part of the study, and to define and assess improvement as part of this process.
Study sites
Study site characteristics
Research site identifier | Site A | Site B | Site C | Site D |
---|---|---|---|---|
Telehealth deployment | ||||
Year of introduction | 2007 | 2009 | 2006 | 2010 |
Equipment purchased (P) or leased (L) | P | P | L | P |
No. of telehealth units available for usea | 165 | 79 | n/a | 40 |
No. of telehealth units in useb | 104 | 39 | 200 | 34 |
Referral routes into telehealth | ||||
Community matrons | ✓ | ✓ | ✓ | ✓ |
Case managers | ✓ | ✓ | ||
Specialist respiratory nurses | ✓ | ✓ | ✓ | |
Specialist heart failure nurses | ✓ | ✓ | ✓ | |
GPs | ✓ | |||
Telehealth stakeholders | ||||
NHS community healthcare provider | ✓ | ✓ | ✓ | |
NHS hospital trust | ✓ | ✓ | ||
Clinical commissioning group | ✓ | ✓ | ||
Equipment manufacturer | ✓ | ✓ | ✓ | ✓ |
Local authority | ✓ | ✓ | ✓ | |
Community interest company | ✓ | ✓ | ||
Private company | ✓ | ✓ |
The telehealth equipment provided to patients to monitor their symptoms varied by functionality and complexity, and had been purchased or leased by different technology suppliers in each site. One site used smart phone and mobile broadband technology; others used specialist telehealth units and either wireless or wired connection in patients’ homes. All units utilized vital sign peripherals (e.g. blood pressure cuffs, weighing scales) and asked questions on screen about a patient’s health and symptoms. Units automatically uploaded patient data to a secure online platform owned by the technology provider, which compared patients’ readings against individual parameters and generated alerts for patients whose symptoms indicated a potential problem.
All sites checked the system daily for alerts, and had developed a triage system to make sure that patients who required clinical input would be contacted by their community nurse. The daily monitoring and first line triage of patients using telehealth varied across the sites and over time as the services developed, using registered nurses, clinical support workers, administrative staff, or outsourcing the role to a telehealth company or local authority.
Ethical approval
The South West–Frenchay National Research Ethics Committee in the UK granted ethical approval for the study (reference 13/SW/0036). Access to NHS sites was granted via local NHS research offices, and for participating local authorities, community interest groups and private companies via internal governance procedures.
Phase one – case studies
In-depth case studies were carried out to examine referral and care pathways for telehealth; explore usage and acceptance among staff and patients; and to identify factors affecting telehealth adoption. Detailed findings from this work are reported elsewhere [15]. The case studies also helped to identify the main stakeholder groups involved in telehealth and were a resource to inform the development of solutions to improve telehealth in phase two.
Case study participant types
Participant type | Site A | Site B | Site C | Site D | Total |
---|---|---|---|---|---|
Registered community nursesa | 15 | 13 | 12 | 18 | 58 |
Other frontline staffb | 4 | 4 | 3 | 5 | 16 |
Clinical leads and service managers | 2 | 0 | 6 | 2 | 10 |
Other managers | 6 | 6 | 7 | 2 | 21 |
Patients | 9 | 6 | 12 | 13 | 40 |
Carers | 1 | 1 | 4 | 6 | 12 |
Total | 37 | 30 | 44 | 46 | 157 |
Phase two – participatory action research
The second phase comprised a seven month programme of action research in each study site, conceptualized as ‘the study of a social situation carried out by those involved in that situation in order to improve both their practice and the quality of their understanding’ ([24]: p8). Two researchers worked in partnership with participants in each site as they planned, tested and evaluated solutions that they identified and agreed would help to improve telehealth adoption. The PDSA approach was employed to structure the action research around making improvements to their existing telehealth service, while still facilitating stakeholder engagement and shared learning [21].
One of the central features of PDSA is that more than one cycle takes place [25]. In this study, two three-month cycles of PDSA and a series of multi-stakeholder action research workshops were planned in each site, which created opportunities for shared reflection and action; a principle that is central to action research [26]. The workshops were held at the beginning of the action research (Month 1), at the mid-point following the first cycle (Month 4), and at the end following the second cycle (Month 7).
The main purpose of the initial workshop was to develop an implementation plan (PLAN). To facilitate this, participants were presented with findings from the case studies after which a whole group discussion was convened to identify, agree, and plan activities for the action research. To ensure that the work would be feasible, sites were asked to select approximately three to six actions. For each action, an Action Inquiry Group (AIG) was established, with members completing a detailed implementation plan of how the work would be carried out and evaluated, including identifying outcomes and data that could be collected for evaluation. AIG leads were given responsibility to take forward the plan during the subsequent three month cycle (DO), and review progress and summarize any learning in order that the action research could be evaluated (STUDY).
The purpose of the second workshop was to review and reflect on the work carried out, and either extend, discontinue or modify plans for the next cycle (ACT). In the final workshop, participants were asked to review the success of the action research and assess the feasibility of implementing changes that had been piloted, which is a central component of PDSA and reflects the iterative nature of service improvement methodology [27].
Action research participants
Action research participant types
Participant type | Site A | Site B | Site C | Site D | Total |
---|---|---|---|---|---|
Community matrons and nurse specialists | 8 | 4 | 5 | 4 | 21 |
Other frontline clinical and support staff | 1 | 1 | 7 | 7 | 16 |
Clinical leads and service managers | 5 | 1 | 3 | 5 | 14 |
Other managers | 0 | 1 | 5 | 0 | 6 |
Patients | 0 | 1 | 0 | 0 | 1 |
Carers | 0 | 0 | 0 | 0 | 0 |
Total | 14 | 8 | 20 | 16 | 58 |
Although patients and their carers were not excluded from phase two of the research, only one of the AIGs in site B included a patient representative, who was only able to attend the initial workshop. The implementation plans for all sites focused upon service design and delivery issues, and given that patient acceptance was not perceived as a major barrier to adoption in the participating services [15], the site collaborators decided that it was not ethically appropriate to explicitly include patients and carers. Many of the issues to be addressed in phase two highlighted the uncertainty of and problems within the telehealth services, and collaborators were concerned how this would affect patients who relied on telehealth as part of the care they received.
Data collection and analysis
The action research was completed between July 2013 and April 2014. To examine both the process and outcomes of the action research, the study employed a combination of observation, primary data collection, and participant and researcher reflection. Two researchers worked together throughout the study period, working closely with AIG leads to enhance opportunities for reflection and interpretation. Reflective discussion during each workshop and during regular de-briefing sessions for the researchers formed part of the analytical process. Field notes from workshops and communication with participants outside of the workshops also formed a central element of the observation work, and implementation plans were updated to review progress of individual actions.
Action research participants per workshop
Number of participants attending | Site A | Site B | Site C | Site D | Total |
---|---|---|---|---|---|
Workshop One | 8 | 6 | 10 | 14 | 38 |
Workshop Two | 9 | 5 | 13 | 7 | 34 |
Workshop Three (focus groups) | 6 | 4 | 9 | 9 | 28 |
Total participants per site | 14 | 8 | 20 | 16 | 58 |
Research quality
The research used a standardized approach to data collection in phase one and phase two, and an audit of processes was kept to create dependability [28]. Respondent validation was the key mechanism through which credibility of the research was assured, with key findings of each phase shared with all participants, and at multi-stakeholder workshops in each site where they were corroborated by those attending. In phase two, reflexivity within the research team, and between the researchers and action research participants, facilitated a critical and open approach to data analysis and interpretation, which is an important marker of quality in action research [29]. The final focus group conducted with phase two participants has provided further assurance of the authenticity of the findings generated from this research.
Results
All sites identified five or six actions that would be feasible and were agreed as important to work on during the action research window. Individual AIGs were established for each action during the first workshop, each with between one and four members. All sites completed both cycles of PDSA, although some actions were discontinued in cycle two due to the limited progress made or other changes happening outside of the study. Although 58 people took part, participation shifted over time due to new emerging stakeholders and also the challenges to some frontline nursing staff of being able to attend all meetings. Participation therefore varied from four people attending a workshop to 14 (see Table 4).
Main activities for action research by site
Type of Activity | Site A | Site B | Site C | Site D |
---|---|---|---|---|
1. Establishing a telehealth pathway | ||||
e.g. establishing clear referral criteria and process; considering options for effective discharge | ✓ | ✓ | ✓ | ✓ |
2. Improving patient assessment and review | ||||
e.g. reviewing current caseload of patients to establish goals for use and examine telehealth activity | ✓ | ✓ | ✓ | ✓ |
3. Improving service delivery | ||||
e.g. improving monitoring and triage of telehealth patients; establishing new roles for telehealth work | ✓ | ✓ | ✓ | |
4. Improving data sharing and access | ||||
e.g. opening up data channels, improving electronic patient record systems | ✓ | ✓ | ✓ | |
5. Raising awareness of telehealth | ||||
e.g. staff training and information sessions, championing, events to promote telehealth service | ✓ | ✓ | ✓ | ✓ |
6. Improving evaluation of telehealth | ||||
e.g. capturing telehealth activity on patient record system, identifying and agreeing outcomes to measure | ✓ | ✓ | ||
7. Securing financial investment for telehealth | ||||
e.g. working with commissioners and industry, scoping out equipment needs for a future sustainable service | ✓ | ✓ |
The following sections provides a summary of the work undertaken and the challenges encountered. Staff quotations from the focus groups are used to illustrate findings throughout.
Establishing a telehealth pathway
“We have offered some step down, so we’ve offered lean peripherals for patients and we’ve also offered telephone support calls. And it’s worked really well hasn’t it, for a lot we don’t need the peripherals because they’ve got their own.” (Site A participant)
Two sites also piloted new electronic referral forms in cycle two. Feedback revealed difficulties with inter-operability between different electronic systems and restrictive data sharing protocols, which meant that some clinical teams could not access the new form. Participation of IT staff in the action research helped to identify potential solutions to address this, which were to be introduced following the end of the study.
Improving patient assessment and review
“Now we do say to [patients] that it’s either for six weeks … so they know very well up front that it’s not there as a long term … on the referral form we’ve got now length of time and when we have put a couple of new patients on … we have put a review date on.” (Site A participant)
To help determine how long patients should use telehealth for, all sites looked at the feasibility of introducing regular reviews. In the second workshop, participants identified a lack of clarity about what outcomes to measure and the limited availability of patient data as barriers to introducing this. Rather than abandon the activity, the researchers suggested completing an audit of current telehealth users to facilitate further learning, and worked with participants to design an audit template. The audit was completed in three sites during cycle two. Findings helped participants to identify which patients could be discharged from the service; what data to capture for reviewing patients; and how to refine existing referral and review criteria, for example, introducing a date for review of eligibility and options to share data across the patient’s care record.
Improving service delivery
“I think the [case study] being an independent evaluation of how that kit was working, how it was used, was very useful because it was undermining a lot of the confidence in it, and if we’d actually just shouted about it, it would have been one provider shouting at another provider you know. Whereas it was an independent review of “is this working for patients?” … and it wasn’t.” (Site C participant)
Additional analysis to identify common barriers and facilitators across the four sites in phase one also proved valuable, highlighting potential solutions which other sites had successfully introduced to improve their telehealth service. For example, two sites considered the feasibility of introducing a clinical role for triaging patients and providing telephone support, which in one site was initiated at the end of the study. Participants were partly motivated by learning that this had been successfully implemented in another study site, which having already created a telehealth nurse role, focused on developing protocols for the shared accountability of care between community nursing and telehealth staff. These sites also explored options for offering telehealth to patients outside the community nursing service, using the telehealth nurse role to provide the daily clinical advice and signposting to other services that would be required to support these patients.
Although some progress was made in each site, service improvements were inhibited by difficulties securing investment for new roles and equipment to support improved processes. Features associated with the current telehealth equipment also acted as a barrier, with limited flexibility and poor connectivity making it difficult to improve monitoring practices.
Improving data sharing and access
“The first thing we’ve put on the [referral] template is “can you make sure your records are shared?”. We kind of built that in the template at the very beginning so hopefully it’ll prompt referral and the records being shared…we can’t make people press buttons, but it’s there as a prompt.” (Site D participant)
Two sites worked with the company who had developed the electronic patient record system and local NHS IT departments, and were able to create new templates and links for accessing telehealth software and capturing telehealth activity. Attempts to open up data sharing between the different clinical teams involved in telehealth were hindered by interoperability problems and strict data protection protocols within local NHS Trusts, which as a wider organizational barrier would take time to address.
Raising awareness of telehealth
“That would come with new kit … it’s very difficult to do much work with what we’ve got at the moment. We can go out and do training on what we’re using but it’s limited in its application and that makes it a barrier in itself.” (Site D participant)
Improving evaluation of telehealth
“We can’t even tell whether the patients are benefiting in terms of the four objectives we were set … We have got no access to that [data] yet. So it’s kind of a catch 22 you know, we believe we are showing value and have some benefits for the patients.” (Site C participant)
Securing financial investment for telehealth
“We haven’t got much time to influence the commissioners you see and, for me it is about keeping the pressure on if you like because if we don’t and we don’t realise the potential of what we need to invest in there will be very little put into future tenders.” (Site B participant)
“I think we are better placed to know what we want and therefore we are not happy just to accept oh this is what we’ve got, we actually have a vision now of how we are going to utilize it, we’ve learnt as we’ve gone along, it’s not been a complete waste of time…” (Site A participant)
Discussion
Action research and PDSA are promoted as useful tools for studying implementation and for improving service quality [27]. Although a recent evaluation of improvement projects identified key challenges to achieving goals for change and showed mixed results of impact [30], findings from this study demonstrate the prospective value of combining case study and action research methodologies to achieve planned incremental improvements and standardization to an existing telehealth service, a process that can otherwise be constrained by the temporal and practical barriers imposed by everyday practice [30]. Having said that, the potential for achieving change through action and cycles of improvement in this research was limited by the need throughout the study to determine the utility of telehealth and to prove evidence of benefit, which have both been identified elsewhere as key enablers for successful future integration of telehealth [2, 10, 15].
Ambiguity about telehealth and what it could achieve was prominent throughout the study. Uncertainty about how to implement sustainable telehealth led some participants to question the value of improving a service that was unlikely to be normalized due to the short-term funding arrangements and challenges to securing future investment, a barrier also identified in other studies of telehealth implementation [13, 17, 31]. Still, other participants were more pragmatic and believed that, to be able to expand telehealth in the future, understanding what works and why is an important first step to improve adoption and, ultimately, to normalize the practice of delivering care with new technologies into clinical routine. This dilemma within the study between having to demonstrate feasibility and effectiveness, or workability, and at the same time seek to understand the factors that lead to successful implementation, or integration [32], is a central concern for implementation research [32–34], and one that is captured by May [32], who draws attention to the social and political processes through which healthcare innovations are adopted, and subsequently normalised into practice.
May and Finch [33], through examining processes of implementation, including e-health initiatives [35], identified four generative mechanisms through which healthcare innovations are normalised: coherence; cognitive participation; collective action; and reflexive monitoring. In this research, there was evidence of all four mechanisms in operation across the study sites. This was accelerated in phase two of the project by employing principles of participatory action research and PDSA, which served to create a shared and dedicated regular space for stakeholders to work together in driving forward service improvements and engage in continuous sense-making, a cyclical and reflective process through which coherence can be achieved [36]. The role of researchers in the action research also helped to stimulate cognitive participation and reflexive monitoring, through employing facilitation skills as a mechanism to break down power structures between and within stakeholder groups and encourage collective planning and action. Additionally, drawing upon the case study findings and other research helped to stimulate the sense-making work associated with cognitive participation.
The underpinning PDSA approach in phase two helped to focus participants on making improvements, generating iterative cycles of collective action and reflexive monitoring. This shared practice of continuous sense-making also helped to shape plans for future expansion and evaluation of telehealth, and provided an opportunity to discuss uncertainties that remained. For example, which patients would benefit the most and how to determine the optimal duration for telehealth; issues that have yet to be addressed in studies of effectiveness. In fact, the mixed opinions and understanding of telehealth observed during both study phases, which are a barrier to frontline staff adoption [15], meant that achieving greater coherence was, in some sites, prioritised over action, and became an outcome in itself. Although wider enduring organisational and technological barriers impeded service delivery and improvement efforts, the importance of sense-making is identified in other recent studies examining implementation [19, 36].
The action research methodology proved fruitful in stimulating the social mechanisms associated with normalisation. However, the achievements accomplished during the study period would not have been possible without the continual work of telehealth champions, who helped to prioritize the research agenda and engage clinical teams. The important role local champions play in encouraging others to adopt new innovations is well recognized, and Wade et al., argue that they play ‘a critical role in the subsequent conversion of a project to an ongoing service’ ([17]: p688). Findings from the study reported here support this assertion; however, they also draw attention, as do Hendy and Barlow [37], to the complex system of stakeholder networks, infrastructures and processes that local champions must contend with, and the personal investment and passion that is required to initiate change. This raises questions about who should take responsibility for delivering such a complex service, and the training and support that may be required if frontline staff are expected to add these duties to their existing role.
The multiple stakeholder map and fragility of adoption processes raises an equally important question about who should act as the local lead for service improvement projects, and the implications this might have for engaging relevant stakeholder groups. In this study, despite the combined efforts of the research team and telehealth champions, certain key actors, including primary care providers and new clinical commissioners, were difficult to engage, without whom it proved difficult to embed change and make improvements or expansions that required additional finance. What’s more, although feedback was sought from users of telehealth about discharge options and new equipment, their exclusion as stakeholders in the action research raises questions about whom the service improvements were for, and whether or not they reflected the needs of end users. These points demonstrate the importance of engaging all stakeholders as equal partners if we are to maximize the potential for achieving change through action and ensure that plans for improvement meet the needs of all parties [38].
Difficulties measuring the impact of action research pose an additional limitation of using this method for service improvement and learning [25]. In this study, improvement was defined in various ways, depending on local acceptance and opinion of telehealth, and the implementation issues that emerged over time in each site. This made it difficult for participants to select outcomes to measure, and although the process of sense-making and the incremental improvements and standardization were reported to improve telehealth adoption, in reality the impact of these changes were difficult to quantify.
The non-linearity and inter-relatedness of adoption processes pose another challenge for research that attempts to generate knowledge about the factors that may enable, or alternatively, inhibit adoption of new innovations, or that focuses on implementation without paying attention to how this may influence, and be influenced by, adoption at the individual, organisational and national levels [10, 18]. The longitudinal nature of this research, which enabled processes of adoption to be studied in four sites over a two year period, further validates the need to examine implementation over time [1], which in this study increased understanding of the inter-relatedness of organisational, technological and clinical changes required to embed telehealth into a healthcare system that is constantly in flux; and the difficulties of driving forward such change when one or two key barriers cannot be overcome.
Conclusions
Mainstreaming telehealth remains on the policy agenda, and despite the mixed evidence of effectiveness, solutions for embedding the use of remote care technologies continue to be pursued [39]. In this study, action research and service improvement methodology helped to accelerate key social mechanisms associated with the normalisation of new innovations, and allowed them to flow more freely across multiple stakeholder networks. However, while key improvements were achieved, uncertainty about the future of telehealth remained, and the appropriateness of employing these methods to embed complex innovations into routine practice is less certain, particularly when, for interventions like telehealth, consensus around evidence of clinical and cost effectiveness is yet to be established. Uncertainty about evidence of benefit was identified as an enduring barrier to mainstreaming telehealth, affecting adoption in practice and making it difficult to secure investment within organizations increasingly driven to prioritize cost savings over other, equally important, policy goals.
The study timing is also an important consideration, because of the type of telehealth applications being deployed and the significant organisational and technological changes within the English National Health Service during the period of research [40]. In the study sites, this resulted in many of the local decision-makers changing, existing networks being weakened or dismantled, and services and technologies being re-configured and modernised. These changes acted as a barrier to engaging relevant stakeholders in the action research, and limited the capacity of some participants to achieve change due to other emerging priorities. The study findings should therefore be interpreted temporally, and it could be that in a more static climate, service improvement projects are more successful; however, the interplay of factors that can affect adoption and implementation of new and complex innovations are likely to require an improvement approach that is embedded into service design, as opposed to a standalone project.
Like other research, this study draws attention to the limitations of applying strictly controlled trial conditions to examine the effects of telehealth [4, 31], which as a technology is still, to some extent, at an early stage of being developed and understood [41]. Although further developmental and feasibility research could help to determine why and how telehealth can be applied in particular settings, the complexity of technology-enabled care services means that evidence of cost effectiveness may on its own not provide the certainty that will encourage investment and normalisation [20, 41]. Increasingly, evaluations of complex interventions adopt a range of different approaches and methods to understand the processes and factors affecting implementation [27, 31, 42, 43]. However, for complex technologies that involve new stakeholders, networks and data not previously part of the healthcare environment, perhaps research now needs to turn its attention to identifying and testing new outcomes in order that future studies can apply more appropriate techniques for measuring the impact of telehealth, and to help inform the development of robust tools to evaluate local service provision.
Declarations
Acknowledgements
The authors thank all participating staff for their time and valuable contributions, particularly the local lead collaborators in each site without whom the study would not have been possible. This study was funded by a grant from the Assisted Living Innovation Platform, with support from the Technology Strategy Board and the Economic and Social Research Council.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Authors’ Affiliations
References
- Hendy J, Chrysanthaki T, Barlow J, Knapp M, Rogers A, Sanders C, et al. An organisational analysis of the implementation of telecare and telehealth: the whole systems demonstrator. BMC Health Serv Res. 2012;12:403. doi:10.1186/1472-6963-12-403.View ArticlePubMedPubMed CentralGoogle Scholar
- Lluch M, Abadie F. Exploring the role of ICT in the provision of integrated care – evidence from eight countries. Health Policy. 2013;111(1):1–13. doi:10.1016/j.healthpol.2013.03.005.View ArticlePubMedGoogle Scholar
- Kuipers P, Humphreys JS, Wakerman J, Wells R, Jones J, Entwistle P. Collaborative review of pilot projects to inform policy: A methodological remedy for pilotitis? Aust New Zealand Health Policy. 2008;5:17. doi:10.1186/1743-8462-5-17.View ArticlePubMedPubMed CentralGoogle Scholar
- Law LM, Wason JM. Design of telehealth trials–introducing adaptive approaches. Int J Med Inform. 2014;83(12):870–80. doi:10.1016/j.ijmedinf.2014.09.002.View ArticlePubMedGoogle Scholar
- Udsen FW, Hejlesen O, Ehlers LH. A systematic review of the cost and cost-effectiveness of telehealth for patients suffering from chronic obstructive pulmonary disease. J Telemed Telecare. 2014;20(4):212–20. doi:10.1177/1357633X14533896.View ArticlePubMedGoogle Scholar
- Mistry H. Systematic review of studies of the cost-effectiveness of telemedicine and telecare. Changes in the economic evidence over twenty years. J Telemed Telecare. 2012;18(1):1–6. doi:10.1258/jtt.2011.110505.View ArticlePubMedGoogle Scholar
- Cartwright M, Hirani SP, Rixon L, Beynon M, Doll H, Bower P, et al. Effect of telehealth on quality of life and psychological outcomes over 12 months (Whole Systems Demonstrator telehealth questionnaire study): nested study of patient reported outcomes in a pragmatic, cluster randomised controlled trial. BMJ. 2013;346:f653. doi:10.1136/bmj.f653.View ArticlePubMedPubMed CentralGoogle Scholar
- Henderson C, Knapp M, Fernandez JL, Beecham J, Hirani SP, Cartwright M, et al. Cost effectiveness of telehealth for patients with long term conditions (Whole Systems Demonstrator telehealth questionnaire study): nested economic evaluation in a pragmatic, cluster randomised controlled trial. BMJ. 2013;346:f1035. doi:10.1136/bmj.f1035.View ArticlePubMedGoogle Scholar
- Steventon A, Bardsley M, Billings J, Dixon J, Doll H, Hirani S, et al. Effect of telehealth on use of secondary care and mortality: findings from the Whole System Demonstrator cluster randomised trial. BMJ. 2012;344:e3874. doi:10.1136/bmj.e3874.View ArticlePubMedPubMed CentralGoogle Scholar
- Ulucanlar S, Faulkner A, Peirce S, Elwyn G. Technology identity: the role of sociotechnical representations in the adoption of medical devices. Soc Sci Med. 2013;98:95–105. doi:10.1016/j.socscimed.2013.09.008.View ArticlePubMedGoogle Scholar
- Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. doi:10.1111/j.0887-378×.2004.00325.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Brewster L, Mountain G, Wessels B, Kelly C, Hawley M. Factors affecting front line staff acceptance of telehealth technologies: a mixed-method systematic review. J Adv Nurs. 2014;70(1):21–33. doi:10.1111/jan.12196.View ArticlePubMedGoogle Scholar
- Joseph V, West RM, Shickle D, Keen J, Clamp S. Key challenges in the development and implementation of telehealth projects. J Telemed Telecare. 2011;17(2):71–7. doi:10.1258/jtt.2010.100315.View ArticlePubMedGoogle Scholar
- Sanders C, Rogers A, Bowen R, Bower P, Hirani S, Cartwright M, et al. Exploring barriers to participation and adoption of telehealth and telecare within the Whole System Demonstrator trial: a qualitative study. BMC Health Serv Res. 2012;12:220. doi:10.1186/1472-6963-12-220.View ArticlePubMedPubMed CentralGoogle Scholar
- Taylor J, Coates E, Brewster L, Mountain G, Wessels B, Hawley MS. Examining the use of telehealth in community nursing: identifying the factors affecting frontline staff acceptance and telehealth adoption. J Adv Nurs. 2015;71(2):326–37. doi:10.1111/jan.12480.View ArticlePubMedGoogle Scholar
- Fairbrother P, Ure J, Hanley J, McCloughan L, Denvir M, Sheikh A, et al. Telemonitoring for chronic heart failure: the views of patients and healthcare professionals-a qualitative study. J Clin Nurs. 2014;23(1-2):132–44. doi:10.1111/jocn.12137.View ArticlePubMedGoogle Scholar
- Wade VA, Eliott JA, Hiller JE. Clinician acceptance is the key factor for sustainable telehealth services. Qual Health Res. 2014;24(5):682–94. doi:10.1177/1049732314528809.View ArticlePubMedGoogle Scholar
- Rogers EM. Diffusion of Innovations. 5th ed. New York: The Free Press; 2003.Google Scholar
- Greenhalgh T, Procter R, Wherton J, Sugarhood P, Shaw S. The organising vision for telehealth and telecare: discourse analysis. BMJ Open. 2012;2(4). doi:10.1136/bmjopen-2012-001574.
- May C. Agency and implementation: understanding the embedding of healthcare innovations in practice. Soc Sci Med. 2013;78:26–33. doi:10.1016/j.socscimed.2012.11.021.View ArticlePubMedGoogle Scholar
- Eather B, Chiarella M, Donoghue J. Plan, Do, Study, Act cycles, as an alternate to action research for clinically based inquiry. Int J Res Nurs. 2013;4(2):34–9.View ArticleGoogle Scholar
- Achterkamp MC, Vos JFJ. Investigating the use of the stakeholder notion in project management literature, a meta-analysis. Int J Proj Manage. 2008;26(7):749–57. doi:10.1016/j.ijproman.2007.10.001.View ArticleGoogle Scholar
- Spencer L, Ritchie J, O’Connor W. Analysis: practices, principles and processes. In: Ritchie J, Lewis J, editors. Qualitative Research Practice: A Guide for Social Science Students and Researchers. London: Sage; 2003. p. 199–218.Google Scholar
- Winter R, Munn-Giddings C. A Handbook for Action Research in Health and Social Care. London: Routledge; 2001.View ArticleGoogle Scholar
- Taylor MJ, McNicholas C, Nicolay C, Darzi A, Bell D, Reed JE. Systematic review of the application of the plan-do-study-act method to improve quality in healthcare. BMJ Qual Saf. 2014;23(4):290–8. doi:10.1136/bmjqs-2013-001862.View ArticlePubMedGoogle Scholar
- Reason P, McArdle K. Brief notes on the theory and practice of action research. In: Becker S, Bryman A, editors. Understanding Research Methods for Social Policy and Practice. London: The Polity Press; 2004.Google Scholar
- Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ. 2013;347:f6753. doi:10.1136/bmj.f6753.View ArticlePubMedGoogle Scholar
- Guba E, Lincoln Y. Competing paradigms in qualitative research. In: Denzin N, Lincoln Y, editors. Handbook of Qualitative Research. Thousand Oaks, CA: Sage; 1994. p. 105–17.Google Scholar
- Bradbury-Huang H. What is good action research?: Why the resurgent interest? Act Res. 2010;8(1):93–109. doi:10.1177/1476750310362435.View ArticleGoogle Scholar
- Dixon-Woods M, McNicol S, Martin G. Ten challenges in improving quality in healthcare: lessons from the Health Foundation’s programme evaluations and relevant literature. BMJ Qual Saf. 2012;21(10):876–84. doi:10.1136/bmjqs-2011-000760.View ArticlePubMedPubMed CentralGoogle Scholar
- Chrysanthaki T, Hendy J, Barlow J. Stimulating whole system redesign: Lessons from an organizational analysis of the Whole System Demonstrator programme. J Health Serv Res Policy. 2013;18(1 suppl):47–55. doi:10.1177/1355819612474249.View ArticlePubMedGoogle Scholar
- May C. A rational model for assessing and evaluating complex interventions in health care. BMC Health Serv Res. 2006;6:86. doi:10.1186/1472-6963-6-86.View ArticlePubMedPubMed CentralGoogle Scholar
- May C, Finch T. Implementing, Embedding, and Integrating Practices: An Outline of Normalization Process Theory. Sociology. 2009;43(3):535–54. doi:10.1177/0038038509103208.View ArticleGoogle Scholar
- Seligman L. Sensemaking throughout adoption and the innovation‐decision process. Eur J Innov Manage. 2006;9(1):108–20. doi:10.1108/14601060610640050.View ArticleGoogle Scholar
- May C, Harrison R, Finch T, MacFarlane A, Mair F, Wallace P, et al. Understanding the normalization of telemedicine services through qualitative evaluation. J Am Med Inform Assoc. 2003;10(6):596–604. doi:10.1197/jamia.M1145.View ArticlePubMedPubMed CentralGoogle Scholar
- Lloyd A, Joseph-Williams N, Edwards A, Rix A, Elwyn G. Patchy ‘coherence’: using normalization process theory to evaluate a multi-faceted shared decision making implementation program (MAGIC). Implement Sci. 2013;8:102. doi:10.1186/1748-5908-8-102.View ArticlePubMedPubMed CentralGoogle Scholar
- Hendy J, Barlow J. The role of the organizational champion in achieving health system change. Soc Sci Med. 2012;74(3):348–55. doi:10.1016/j.socscimed.2011.02.009.View ArticlePubMedGoogle Scholar
- Kirchner JE, Parker LE, Bonner LM, Fickel JJ, Yano EM, Ritchie MJ. Roles of managers, frontline staff and local champions, in implementing quality improvement: stakeholders’ perspectives. J Eval Clin Pract. 2012;18(1):63–9. doi:10.1111/j.1365-2753.2010.01518.x.View ArticlePubMedGoogle Scholar
- NHS Commissioning Assembly. Technology Enabled Care Services: Resource for Commissioners. 2015. http://www.england.nhs.uk/ourwork/qual-clin-lead/tecs/.
- Checkland K, Harrison S, Snow S, McDermott I, Coleman A. Commissioning in the English National Health Service: What’s the Problem? J Soc Policy. 2012;41(3):533–50.View ArticleGoogle Scholar
- Zanaboni P, Wootton R. Adoption of telemedicine: from pilot stage to routine delivery. BMC Med Inform Decis Mak. 2012;12:1. doi:10.1186/1472-6947-12-1.View ArticlePubMedPubMed CentralGoogle Scholar
- Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. doi:10.1136/bmj.a1655.View ArticlePubMedPubMed CentralGoogle Scholar
- McEvoy R, Ballini L, Maltoni S, O’Donnell CA, Mair FS, Macfarlane A. A qualitative systematic review of studies using the normalization process theory to research implementation processes. Implement Sci. 2014;9:2. doi:10.1186/1748-5908-9-2.View ArticlePubMedPubMed CentralGoogle Scholar