Research article | Open | Open Peer Review | Published:
Quality assurance for care of the dying: engaging with clinical services to facilitate a regional cross-sectional survey of bereaved relatives’ views
BMC Health Services Researchvolume 18, Article number: 761 (2018)
Globally, having the ‘patient and /or family voice’ engaged when measuring quality of care for the dying is fundamentally important. This is particularly pertinent within the United Kingdom, where changes to national guidance about care provided to dying patients has heightened the importance of quality assurance and user-feedback. Our main aim was to engage with clinical services (hospice, hospital and community settings) within a specific English region and conduct a bereaved relatives’ cross-sectional survey about quality of care. Our secondary aim was to explore levers and barriers to project participation as perceived by organisational representatives.
Each organisation identified a consecutive sample of next-of-kin to adult patients who died between 1st September and 30th November 2014. Those who had an unexpected death or were involved in a formal complaint were excluded. The ‘Care Of the Dying Evaluation’ (CODE™) questionnaire was posted out three months following the bereavement. One-to-one interviews were undertaken with a purposive sample of organisational representatives to explore experiences about project participation.
Of the 30 invited organisations, 18 were able to participate comprising: 7 hospitals, 7 hospices and 4 community settings. There were 1774 deaths which met the inclusion criteria but 460 (26%) were excluded due to inaccurate next-of-kin details. Subsequently, 1283 CODE™ questionnaires were sent out, with 354 completed (27% response rate). Overall, most participants perceived good quality of care. A notable minority reported poor care for symptom control and communication especially within the hospital. Nine interviews were conducted - levers to project participation included the ‘significance of user-feedback and the opportunity to use results in a meaningful way’; the main barrier was related to ‘concern about causing distress to bereaved relatives’.
Overall, being able to engage with 18 (60%) organisations within the region and conduct the bereaved relatives’ survey showed success of this initiative and was supported by interview findings. The potential to be able to benchmark user-feedback against other organisations was thought to help focus on areas to develop services. This type of quality assurance project could form a template model and be replicated on a national and international level.
Calls to ensure the ‘patient and family voice’ is encapsulated into the measurement of quality of care for the dying is well-established . Hence, on a global basis, bereaved relatives’ evaluations (both using surveys and telephone interviews) form a key part of the evaluation of end-of-life care, especially within North America, Japan, and parts of Europe [2,3,4,5,6]. To ensure the highest level of care provision, it is important to be able to robustly evaluate the quality of current care .
This evaluation is especially pertinent within the United Kingdom (UK), as within recent years, care for dying patients has featured heavily within public and professional forums. Additionally, significant changes have occurred to national guidance underpinning the way that care should be provided [8, 9]. The Liverpool Care Pathway for the Dying Patient (LCP) , an integrated care pathway aiming to improve quality of care in the last days of life, came under intense media scrutiny. The LCP was a nationally endorsed document and used internationally to support the provision of care when it was recognised that an individual may be in the last days of life. A subsequent review of care for the dying advised that the LCP should be phased out by July 2014 . Forty-four key recommendations were provided within the report, including the need for more individualised care and improving skills and competencies for clinical staff caring for dying patients . Following this, the ‘One chance to get it right’ report identified five ‘priorities for care’ and highlighted that clear, sensitive, and timely communication is fundamental to ensure good quality of care is provided to dying patients and their families . A recommendation for ‘individualised end-of-life care plans’ was made and the recent publication of the NICE guidelines for End-of-life care helped provide a framework for best clinical practice .
The most recent National UK ‘End of Life Care Audit – Dying in Hospital’ based on data collected in 2015, demonstrated improvements compared with the previous audit in 2013: a higher proportion of patients were recognised to be dying in a timely manner and for 95% of these, there was a documented discussion about this recognition with those identified as important to the patient . There was, however, a reduction in the rates of anticipatory prescribing for symptoms commonly seen in the last days of life. While this could be perceived as positive and in keeping with NICE guidelines about individualised prescribing, a regional survey of first year doctors reported one of their main needs was for formal guidance with symptom control. These doctors reported difficulties with remembering doses of anticipatory medication . Importantly, the 2015 National audit also highlighted variability in the results between individual hospitals and the continued limited availability of 24/7 palliative care services .
In view of these major changes in end-of-life healthcare policy, a quality assurance project was undertaken within a specific English region to assess current care provided to dying patients and their families in three healthcare settings: hospital, hospice, and community. In order to focus on care in the last days of life and immediate post-bereavement period, we used the ‘Care Of the Dying Evaluation’ (CODE™) questionnaire  as our post-bereavement tool. CODE™ seeks perceptions about quality of patient care and level of family support and contains sections on symptom control; nursing and medical care; communication; provision of fluids; place of death; and emotional and spiritual support. It is a shortened version of the original questionnaire, ‘Evaluating Care and Health Outcomes – for the Dying (ECHO-D), which was developed, validated and used within a hospice and hospital setting [15,16,17]. CODE™ has also been assessed for validity and reliability , has been used nationally within the National Care of the Dying Audit – Hospitals , and is currently the focus of an international project involving seven European and Latin American counties .
Undertaking robust research for those who are dying is challenging due to the sensitive and emotive area of enquiry. Ethical, moral and practical challenges exist, influencing recruitment, retention, difficulty in identifying suitable outcomes measures and the level of investment in research [20,21,22,23,24]. With this in mind and key for the context of this quality assurance project, it is important to identify a distinction between measurement for judgement and measurement for improvement. It has been argued that in order to facilitate the process of service improvement “we need just enough information to take a next step in learning” . Benchmarking methodology offers a way in which to generate ‘just enough information’, through facilitating assessment, comparison and reflection of ‘relevant’ information on care delivery, to identify both gaps in performance and examples of best practice [26, 27]. This methodology promotes a collaborative rather than competitive approach to assessment focussing on sharing information, which is integral to continually improving the quality of care . This ethos underpins the methodology of this reported quality assurance project.
Within a specific English region, the primary aim was to engage with clinical services across hospital, hospice and community settings to explore the current quality of care provided to dying patients and their families, from the perspective of bereaved relatives. In order to achieve this aim, we undertook a cross-sectional regional survey of bereaved relatives’ using the CODE™ questionnaire. The project was known as the Regional CODE™ survey and the conduct and results from this survey represents the main focus of this manuscript.
As a secondary aim, we wanted to explore views on project participation as perceived by representatives from individual organisations. To achieve this aim, one-to-one evaluation interviews with organisational representatives were undertaken. Within the context of this manuscript, we will focus on summarising key feedback about the levers and barriers to project participation.
Cross-sectional survey of bereaved relatives’ views
Participating organisations compiled a consecutive sample of the patients’ next-of-kin (NOK) according to eligibility criteria (Table 1) . Organisations posted CODE™ information packs to the NOK three months following the patient’s death. The information pack included a:
CODE™ questionnaire with unique identifier
freepost envelope for returning the questionnaire
information about accessing the web-based tool if on-line completion preferred.
To remain ethically sensitive and, as this was the first time a survey of this nature had been conducted regionally, no reminder letters were sent.
Evaluation interviews with named organisational representatives
A purposive sample of ‘named organisational representatives’ were approached to represent service leads from all three care settings (hospice, hospital and community). A letter of invitation and a Participant Information Sheet was posted to potential participants. Following written informed consent, those willing to participate, undertook a one-to-one semi-structured interview conducted by one of three experienced researchers (MG, HM, TM). Using an evaluation interview, where a ‘narrative’, conversational approach [29, 30] was employed, rather than a researcher developed evaluation form with a set of pre-determined questions and response options, was believed to promote a more participant led assessment. At the same time, it offered the opportunity for clarification and elaboration of important elements of feedback to aid understanding. These conversations were largely focused into: the current process for gaining and dealing with patient and relative feedback and complaints; reasons for participating in the project; general perspectives on taking part in the project (positives and negatives). Interviews were conducted prior to publication of the overall final report. However, an automated report of the CODE™ survey results for individual organisations was available to download via the data entry tool. This provided an opportunity for all participants to review the results for their individual organisation(s) and begin the process of action planning ahead of the final report.
An interview ‘topic guide’ was used to encourage the conversational ‘flow’ if this was not naturally occurring. Some specific areas covered were:
Role of the interviewees
Existing bereaved relative feedback processes within organisation (e.g. including the management and feedback of these user-views)
Perceived levers and barriers to project participation (e.g. team format, operational processes, anticipated barriers and overcoming these).
Depending on preferences, interviews were conducted either face-to-face or via the telephone.
Bereaved relatives’ survey
CODE ™ data was analysed using descriptive statistics (number, percentage) for each individual question. Median (M) and Inter Quartile Ranges (IQR) were used where appropriate. All missing data is presented within the tables (but excluded from the descriptive analysis). In terms of project feedback, each participating organisation was given their own report detailing results from their bereaved relatives’ survey. Subsequently, they were also given a report detailing how their own results compared with other organisations within the region. Within this manuscript, we provide an example of how individual organisations’ results for the key outcomes could be compared with regional and national results.
Each interview was audio-recorded, transcribed and analysed with a thematic approach using the “substance of the interview”  to formulate overarching themes and categories. One of the researchers (MG) read, and re-read the data from all 9 interviews, recorded initial impressions and developed thematic codes. Further discussion of codes was conducted with the wider team (TM, CM) to reach overall agreement on substantive categories representing the data as a whole. For the purposes of this manuscript, the codes relating to levers and barriers to project participation form the main focus.
From 30 eligible organisations, 19 initially agreed to participate (7 hospitals; 7 hospices; 5 community settings) although one community organisation subsequently was not able to participate due to resource issues. Of those who declined, the main reason was because they were already undertaking a bereaved relatives survey (n = 8); other reasons being ‘too few deaths’ within the inclusion period (n = 2) and one organisation simply reported that they were unable to participate on this occasion.
From 3402 deaths, just over half (52%, n = 1774) met the initial inclusion criteria. Approximately a quarter of these (n = 491, 28%) could not subsequently be included, with the main reason due to inaccurate NOK data (Fig. 1). From 1283 CODE™ questionnaire packs sent out, 354 returned completed questionnaires (28% response rate). The hospice setting had the largest response rate (82/225, 36%) compared with other settings (hospital 218/849, 26%; community 54/209, 26%).
Demographics (Table 2)
Overall, deceased patients were evenly split in terms of gender (n = 170 males, 52%) and, except for the hospice, tended to be from an older age group (n = 259, 70 years or older, 77%). More hospice (n = 74, 90%) and community (n = 44, 81%) patients had a cancer diagnosis compared with the hospital (n = 70, 32%).
Participating bereaved relatives tended to be female (n = 225, 67%) and aged between 40 and 69 years (n = 196, 59%). Participants tended to be the spouse or partner to the patient (n = 160, 59%), with the exception of the hospital setting, where participants tended to be the ‘son / daughter’ (n = 87, 42%) completing the questionnaire. The majority of relatives and patients in this sample were ‘White British’ and of a ‘Christian’ religious affiliation.
CODE™ questionnaire results
Key outcomes (Table 3)
Overall, about three-quarters of respondents reported the patient was ‘always’ treated with dignity and respect by both doctors and nurses (doctors: n = 245, 72%; nurses: n = 257, 75%). A notable minority, primarily from the hospital setting, reported the patient was ‘never’ treated with dignity and respect by doctors (n = 12, 6%) and nurses (n = 9, 4%). The majority of bereaved relatives (n = 272, 82%) reported they were adequately supported in the last days of life.
Symptom control (Table 4)
The most commonly reported symptom was ‘restlessness’ with 225 respondents (65%) perceiving their family member appeared restless ‘some’ or ‘all of the time’. A small but notable minority perceived their family member had the following symptoms ‘all of the time’ in the last days of life (‘pain’ n = 37, 11%; ‘restless’ n = 51, 15%; ‘noisy rattle’ n = 57, 17%). Pain and restlessness being present ‘all of the time’ was most commonly reported by hospital respondents and ‘noisy rattle’ by hospice respondents.
For those reporting that their family member had experienced pain, almost three quarters responded that enough had been done by the healthcare team to control this symptom (n = 214, 71%). This proportion reduced, however, to around half for restlessness and noisy rattle (n = 139, 53% and n = 90, 48% respectively). For all three symptoms, respondents perceived that symptom control was best optimised by the hospice healthcare team and least likely by the hospital healthcare team.
Communication (Table 4)
Overall, the majority of respondents perceived that nurses (n = 268, 78%) and doctors (n = 274, 81%) had time to listen and discuss the patient’s condition with them (answered ‘agree’ or ‘strongly agree’). Around one-fifth of hospital respondents either disagreed or strongly disagreed to the statement about nurses having time to listen (n = 43, 20%) and a similar proportion about doctors (n = 37, 18%).
In terms of detecting areas of unmet need, discussions about the appropriateness of giving clinically assisted hydration (CAH) were not routinely undertaken and occurred least frequently within the community setting. Overall, for those who hadn’t had a discussion about CAH (n = 245), 124 (51%) would have found these types of discussion helpful.
Around half of all respondents (n = 176, 51%) were told what to expect when their family member was dying. Of those who weren’t told (n = 187), just over three quarters (n = 144, 77%) perceived that these types of conversation would have been helpful.
Cross-comparison analysis of results between organisations
Each Clinical Commissioning Group (CCG) (the organisation responsible for commissioning health services for a particular area within the region) was provided with a report of the results for its responsible provider organisations. An example of the CODE™ results for the key outcome questions for two hospitals (within a single CCG) is shown in Fig. 2.
Responses were also compared with CODE™ results from the National Care of the Dying Audit – Hospitals (NCDAH) 2013/2014 and with collated results from all participating hospitals within this Regional CODE™ survey. Comparisons suggest that perceptions about quality of care within Hospital ‘A’ tended to be higher compared with Hospital ‘B’, with NCDAH data and with collated regional results. Each organisation was then tasked with using the CODE™ results to develop action plans to help further develop clinical services.
Views of representatives from participating organisations
Nine individual interviews were conducted representing views across 11 services (4 hospices, 4 hospitals and 2 community settings) as one representative came from an integrated service (combined hospice / hospital /community). The interviewees’ roles were: Consultant in Palliative Medicine (n = 2); Clinical Nurse Specialist & Team Leader (n = 2); Clinical Services Manager (n = 2); Outreach Services Manager (n = 1), and Senior Manager (for End-of-life care / evaluation and quality) (n = 2). Two interviews were conducted face to face with the remainder by telephone. Interviews lasted between 35 and 60 min.
The main themes identified as ‘levers’ to present and future project participation were: ‘lack of existing feedback processes’ to obtain user-representation views about the service; ‘clear operational processes’, including a user-friendly electronic tool, written guidance and a telephone helpline; ‘significant user-feedback and opportunity to use results in a meaningful way’ which would help inform future care provision. The main theme relating to ‘barriers’ was the ‘fear of causing distress to bereaved relatives’ (which was subsequently not found to be the case in this project). Additional themes were: current ‘organisational systems not set up to capture information’; lack of organisational ‘buy in’ and lack of administrative support (Table 5).
Overall, this was the first bereaved relatives’ survey spanning across three healthcare settings undertaken within this specific English region. The ability to engage with 18 (60%) of all organisations, and the fact that the main reason for non-participation was due to current participation in bereaved relatives’ surveys, was testament to the success of this quality assurance initiative. This model of providing quality assurance is one which could be replicated within other regions and across countries as a whole. Providing opportunities for user feedback towards services is a key health care priority both nationally and internationally. Within the UK, this commitment is outlined within the NHS constitution  and NHS Mandate . Improving support to and engagement with bereaved relatives is also a key objective within the Next Steps On The NHS Five Year Forward View . Results from this project confirm that the majority of these regional organisations did not have formal mechanisms to capture bereaved relatives’ views. CODE™ is a valid and reliable tool which could bridge this clinical need and support organisations to obtain feedback of this nature. Interviewees reported that the data generated was perceived to provide valuable local information to better understand experiences of care in the last days of life. Additionally, the opportunity to subsequently benchmark their results with others regionally was seen as a positive outcome.
Generally, the majority of bereaved relatives reported good perceptions of care, although a small but significant minority reported poor experiences. Those who experienced care within the acute hospital settings were more likely to report issues in terms of the care received or the level of family support provided. Motivations for organisations’ participation could have been influenced by the expectation that bereaved relatives’ perceptions were likely to be favourable. Responses, however, demonstrated variability in the care provided, implying that the motivation was to genuinely seek user-feedback about their service. Although concerns were raised by interviewees about potential distress to bereaved relatives, in reality there were few complaints from bereaved relatives who participated in this project. This finding would reinforce previous research suggesting that bereaved relatives are keen to be given the opportunity to engage in research due to a number of different motivations [35, 36].
The project was not without limitations. There was a high proportion of missing or inaccurate NOK details and, as it was imperative the CODE™ questionnaire was sent to the most appropriate individual, this limited the total number of potential participants. Additionally, this may have led to selection bias as, within some organisations, those who were engaged with Specialist Palliative Care services were more likely to have their details documented accurately. The wider implications of inaccurate details include the potential impact on providing bereavement support if NOK can’t be accurately contacted. By being involved with the quality assurance project, however, this helped highlight to individual organisations some of the limitations of their internal reporting mechanisms and facilitated the potential development of solutions in these organisations.
Overall the response rate of returned and completed CODE ™ questionnaires (27%) was lower than expected (estimated to be 35–40%). It was also lower compared with previous studies of this nature including those which have used CODE™ [14, 18]. One reason for the lower response rate was the decision at the project outset not to use reminder letters, a method recognised to increase response rates . Ongoing developments for the CODE™ questionnaire include further Public and Patient engagement to ascertain the best methods to approach and recruit potential participants for these types of surveys .
We did not obtain the demographic details of non-responders. This would have enabled a comparison between respondents and non-responders and provided information about the representativeness of our sample compared with the population as a whole. This is especially pertinent due to the fact that most participants were of white ethnic origin and stated they had a ‘Christian’ religious affiliation. The key element of the project, however, was to assess whether it was possible to engage with clinical services and hence a balance needed to be met between making it sufficiently feasible for individual organisations to participate versus the ideal methodology for conducting a survey of this nature.
Overall, perceptions about hospital care were poorer compared with hospice and community settings especially in terms of symptom control and communication. These areas are recognised themes from patients and family carer feedback  although for pain control, findings from previous studies have varied. One recent study demonstrated that those who died in hospital were more likely to have experienced pain compared with those who died at home  but others have not supported this finding . It is noteworthy, however, that the deceased patient populations differed between care settings, with hospitals having a greater prevalence of non-cancer patients. In the most recent UK National VOICES survey, findings also suggested that pain control was potentially better met for those with a cancer diagnosis compared with those dying from non-malignant disease .
The greatest proportion of discussions about fluids at the end-of-life was reported by the hospital participants and the lowest within the community setting. This may relate to the fact that it is more challenging to provide clinically assisted hydration (CAH) in home or care home facilities. And in turn, healthcare professionals may not have broached this issue due to these types of concerns. The greatest degree of unmet information need about CAH was in the hospital setting, although across all settings, participants would have appreciated discussions. This may be in part due to the generally positive views of CAH by family members [40, 41] and the symbolic meaning that it brings . It is important to understand that making ‘blanket’ assumptions about the appropriateness of engaging in such discussions cannot be supported, and sensitive communication, using open screening questions is likely to be required to promote the provision of individualised and responsive care .
CODE™ specifically focuses on care of patients in the last days of life and family support, and this is the first time it has been used to assess the quality of care in a number of different healthcare settings (hospice, hospital and community). Due to the methods of questionnaire administration, the survey allows each organisation to have individual and personalised feedback about bereaved relatives’ perceptions of care. Previous national surveys of this nature have tended to feedback at a regional or CCG area level . Additionally, the project subsequently enabled individual organisations to ‘benchmark’ themselves with findings from other similar organisations which offers the opportunity to facilitate cross-site learning. Although not conducted within the scope of this project, future follow-up interviews with the representatives from participating organisations would be beneficial to establish the key actions undertaken to help improve their clinical services. Additionally, future developments may include the opportunity to repeat the post-bereavement survey to assess the impact of changes over time. By assessing the feasibility that an evaluation such as this was possible within this region, a future post-bereavement evaluation would offer the opportunity to undertake more robust survey methodology to help further address any confounding factors.
Some of the real strengths of this project include the ability for individual organisations to:
demonstrate active engagement with bereaved relatives and have user-views about their service; this is particularly pertinent to provide evidence for the regulator organisations such as the ‘Care Quality Commission’ within the UK
have a quick ‘at a glance’ report to highlight the strengths of the organisation and areas that require further development
compare their own findings with other similar organisations as a whole and with others within their locality; additionally, for hospitals being able to ‘benchmark’ their data with previous national findings
With the national recommendations to use individualised care plans for dying patients, the optimal way to evaluate the impact of these and provide assurance that care is being delivered in a timely and sensitive manner should be determined. Post-bereavement questionnaires are recognised to be a useful way to do this and CODE™ represents a valid and reliable outcome measure to use. The successful engagement with the project is testament to the commitment of staff and organisations with the clear desire to seek user-feedback to improve care. The model of evaluation and the use of a ‘benchmarking’ approach, could be used at a local, national and international context to help drive an ongoing continuous quality improvement programme to improve care for dying patients.
Clinically Assisted Hydration
Clinical Commissioning Group
Care Of the Dying Evaluation
Evaluating Care and Health Outcomes – for the Dying
Inter Quartile Ranges
Liverpool Care of the Dying Pathway
National Care of the Dying Audit – Hospitals
Teno JM. Putting patient and family voice back into measuring quality of care for the dying. Hosp J. 1999;14(3–4):167–75.
Lawson B, Van Aarsen K, and Burge F. Challenges and strategies in the administration of a population based mortality follow-back survey design. BMC Palliat Care 2013; 12: 28. Published online 2013 Aug 6. https://doi.org/10.1186/1472-684X-12-28
Teno JM, Clarridge BR, Casey V, Welch LC, Wetle T, Shield R, et al. Family perspectives on end-of-life care at the last place of care. JAMA. 2004;291(1):88–93. https://doi.org/10.1001/jama.291.1.88.
Beccaro M, Costantini M, Rossi PG, Miccinesi G, Grimaldi M, Bruzzi P, et al. Actual and preferred place of death of cancer patients. Results from the Italian survey of the dying of cancer (ISDOC). J Epidemiol Community Health. 2006;60:412–6 https://doi.org/10.1136/jech.2005.043646.
Office of National Statistics. National survey of bereaved people (VOICES) England 2015. Quality of care delivered to people on the last three months of life. https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/healthcaresystem/bulletins/nationalsurveyofbereavedpeoplevoices/england2015 (last accessed 25th April 2018).
Miyashita M, Morita T, Sato K, Tsuneto S, Shima Y. A nationwide survey of quality of end-of-life cancer care in designated cancer Centre, inpatient palliative care units and home hospices in Japan: the J-HOPE study. J Pain Symptom Manag. 2015 Jul;50(1):38–47 e3. doi: https://doi.org/10.1016/j.jpainsymman.2015.01.007 Epub 2015 Feb 2.
Curtis JR, Patrick DL, Engelberg RA, et al. A measure of the quality of dying and death: initial validation using after-death interviews with family members. J Pain Symptom Manage. 2002;24(1):17–31.
Department of Health. More care, less pathway. A review of the Liverpool Care Pathway. Department of Health: Crown Copyright; 2013. https://www.gov.uk/government/publications/review-of-liverpool-care-pathway-for-dying-patients (last accessed 25th April 2018
Department of Health. One chance to get it right. Improving people’s experience of care in the last days and hours of life. Leadership Alliance of the Care of Dying People. June 2014 https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/323188/One_chance_to_get_it_right.pdf (last accessed 25th April 2018).
Ellershaw J, Wilkinson S. Care of the dying. A pathway to excellence: Oxford University press; 2003.
National Institute for Health and Care Excellence. Care of dying adults in the last days of life. End of life care for adults. 2015. https://www.nice.org.uk/guidance/ng31?unlid=995330362201632233924 (last accessed 25th April 2018).
Royal College of Physicians. National care of the dying audit for hospitals. 13th August 2015 (https://www.rcplondon.ac.uk/projects/outputs/national-care-dying-audit-hospitals (last accessed 25th April 2018).
Murray-Brown F, Curtis M, Gibbons J. Survey of foundation year 1 doctors caring for the dying; what do they see, need and do to perform this role, following removal of the Liverpool care pathway. Palliat Med. 2015;29(10):975–6.
CR Mayland, C Lees, A Germain, B Jack, TF Cox, SR Mason, A West and JE Ellershaw. Caring for those who die at home: the use and validation of ‘care of the dying evaluation’ (CODE) with bereaved relatives. BMJ Support Palliat Care; 2014; 4:2 167–174 Published Online First: 2014.
Mayland CR, Williams EMI, Ellershaw JE. Assessing quality of care for the dying: the development and initial validation of a postal self-completion questionnaire for bereaved relatives. Palliat Med. 2012;26(7):897–907.
Mayland CR, Williams EMI, Addington-Hall J, et al. Does the ‘Liverpool care pathway’ facilitate an improvement in quality of care for dying cancer patients? Br J Cancer. 2013;108(10):1942–8.
Mayland CR, Williams EMI, Addington-Hall J, et al. Assessing the quality of care for dying patients from the bereaved relatives’ perspective: the further validation of ‘evaluating care and health outcomes – for the dying’ (ECHO-D). J Pain Symp Manage. 2014;47(4):687–96.
Mayland CR, Mulholland H, Gambles M, Ellershaw JE. How well do we currently care for our dying patients in acute hospitals. The views of bereaved relatives? BMJ Supp Palliat Care BMJ Support Palliat Care. 2017 Jan 17. pii: bmjspcare-2014-000810. doi: https://doi.org/10.1136/bmjspcare-2014-000810. [Epub ahead of print].
http://www.icode7.org/icode7/homepage.html (last accessed 25th April 2018).
Rinck GC, van den Bos GA, Kleijnen J, de Haes HJ, Schade E, Veenhof CH. Methodologic issues in effectiveness research on palliative cancer care: a systematic review. J Clin Oncol. 1997;15(4):1697–707.
Westcombe AM, Gambles MA, Wilkinson SM, Barnes K, Fellows D, Maher EJ, Young T, Love SB, Lucy RA, Cubbin S, Ramirez AJ. Learning the hard way! Setting up an RCT of aromatherapy massage for patients with advanced cancer. Palliat Med. 2003;17(4):300–7.
Sleeman KE, Gomes B, Correspondence HIJ. Research into end-of-life cancer care—investment is needed. Lancet. 2012;379:519.
Jordhoy MS, Kaasa S, Fayers P, OVreness T, Underland G, Ahlner-Elmqvist M. Challenges in palliative care research; recruitment, attrition and compliance: experience from a randomized controlled trial. Palliative Med. 1999;13:299–310.
Addington-Hall J. Research sensitivities to palliative care patients. Eur J Cancer Care. 2002;11:220–4.
Berwick DM. A primer on leading the improvement of systems. BMJ. 1996;312:619–22.
Ellis J. Using benchmarking to improve practice. Nurs Stand. 1995;9(35):25–8.
Ellis J. Sharing the evidence: clinical practice benchmarking to improve continuously the quality of care. J Adv Nurs. 2000;32(1):215–25.
National end of life care intelligence network. Predicting death. Estimating the proportion of deaths that are ‘unexpected’. National end of life care intelligence network. 2011 http://www.endoflifecare-intelligence.org.uk/resources/publications/predicting_death (last accessed 25th April 2018).
Kvale S. InterViews: an introduction to qualitative research interviewing. London: Sage; 1996.
Polkinghorne D E. Narrative knowing and the human sciences. Albany, W. State: University of New York Press 1988.
Oliver DG, Serovich JM, Mason TL. Constraints and opportunities with interview transcription: towards reflection in qualitative research. Social Forces. 2005;84(2):1273–89.
Department of Health. The NHS Constitution. The NHS belongs to us all. Department of Health, 2013, London. http://www.nhs.uk/choiceintheNHS/Rightsandpledges/NHSConstitution/Documents/2013/the-nhs-constitution-for-england-2013.pdf (last accessed 25th April 2018).
Department of Health and Social Care (2017) The Government’s Mandate for NHS England for 2017–18. (https://www.gov.uk/government/publications/nhs-mandate-2017-to-2018 [last accessed 9th May 2018].
NHS England (2017) Next Steps On The Five Year Forward View https://www.england.nhs.uk/publication/next-steps-on-the-nhs-five-year-forward-view/ [last accessed: May 2018].
Kentish-Barners N, McAdam JL et al. Research participation for bereaved family members: experience and insights from a qualitative study. Crit Care Med 2015; 43 (9): 1839–45.
Germain A, Mayland CR, Jack BA. The potential therapeutic value for bereaved relatvies participating in research: an exploratory study. Palliat Support Care. 2016;14(5):479–87.
Robinson J, Gott M, Ingleton C. Patient and family experiences of palliative care in hospital: what do we know. An integrative review. Palliat Med. 2014;28(1):18–33.
Escobar PLC, Claus M, Zepf KI, et al. Symptom prevalence in the last days of life in Germany: the role of place of death. Am J Hosp Palliat Care. 2012;29:43107.
Gomes B, Calanzani N, Koffman J, et al. Is dying in hospital better than home in incurable cancer and what factors influence this? A population-based study. BMC Med. 2015;13:235.
del Rio MI, Shand B, Bonati P, Palma A, Maldonado A, Taboada P, et al. Hydration and nutrition at the end of life: a systematic review of emotional impact, perceptions, and decision-making among patients, family, and health care staff. Psycho-Oncology. 2012;913–21(8):21.
Davies A, Waghorn M, Boyle J, et al. Alternative forms of hydration in patients with cancer in the last days of life: study protocol for a randomised controlled trialTrials. 2015;16:464.
Gent MJ, Fradsham S, Whyte GM, Mayland CR. What influences attitudes towards clinically assisted hydration in the care of dying patients? A review of the literature. BMJ Support Palliat Care. 2015;5(3):223–31.
General Medical Council. Treatment and care towards the end of life. London, UK: General Medical Council; 2010.
We would like to express our sincere thanks to the individual relatives and friends who participated in this project for taking the time to complete the Care of the Dying Evaluation (CODE™) questionnaire and sharing their views on the care provided. We would also like to thank all the hospitals, hospices and community trusts that participated in this service evaluation project, with particular thanks to members of staff who submitted their data.
Availability of data and material
The datasets used and analysed during the current study are available from the corresponding author on reasonable request. Permissions would also need to be obtained from the Palliative Care Institute, University of Liverpool and Cheshire and Merseyside Strategic Clinical Network for Palliative and End-of-life Care.
Funding was provided by the Cheshire and Merseyside Strategic Clinical Network for Palliative and End-of-life Care. Local advice, where appropriate, was sought from the funding body as to the design of the study but they did not contribute to the collection, analysis and interpretation of the data nor in the writing of the manuscript.
Ethics approval and consent to participate
In keeping with Health Research Authority Guidance, the bereaved relatives’ survey was deemed to be Service Evaluation, and so formal ethical approval was not sought. Ethical approval was obtained from the University of Liverpool to undertake the interviews. All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and it later amendments or comparable ethical standards. The project was formally registered though the Royal Liverpool University Hospital Clinical Effectiveness department. For this type of study, formal consent is not required and is implied by those who completed and returned the CODE™ questionnaire. Interview participants provided written informed consent.
Consent for publication
The authors declare they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.