- Research article
- Open Access
- Open Peer Review
A `combined framework’ approach to developing a patient decision aid: the PANDAs model
BMC Health Services Researchvolume 14, Article number: 503 (2014)
There is a lack of practical research frameworks to guide the development of patient decision aids [PtDAs]. This paper described how a PtDA was developed using the International Patient Decision Aids (IPDAS) guideline and UK Medical Research Council (UKMRC) frameworks to support patients when making treatment decisions in type 2 diabetes mellitus.
This study used mixed methods to develop a PtDA for use in a UK general practice setting. A 10-member expert panel was convened to guide development and patients and clinicians were also interviewed individually using semi-structured interview guides to identify their decisional needs. Current literature was reviewed systematically to determine the best available evidence. The Ottawa Decision Support Framework was used to guide the presentation of the information and value clarification exercise. An iterative draft-review-revise process by the research team and review panel was conducted until the PtDA reached content and format `saturation’. The PtDA was then pilot-tested by users in actual consultations to assess its acceptability and feasibility. The IPDAS and UKMRC frameworks were used throughout to inform the development process.
The PANDAs PtDA was developed systematically and iteratively. Patients and clinicians highlighted the needs for information, decisional, emotional and social support, which were incorporated into the PtDA. The literature review identified gaps in high quality evidence and variations in patient outcome reporting. The PtDA comprised five components: background of the treatment options; pros and cons of each treatment option; value clarification exercise; support needs; and readiness to decide.
This study has demonstrated the feasibility of combining the IPDAS and the UKMRC frameworks for the development and evaluation of a PtDA. Future studies should test this model for developing PtDAs across different decisions and healthcare contexts.
Shared decision making is an important component of patient-centred care . It involves the exchange of information and negotiation between the patients and healthcare professionals to reach a consensus on a particular decision . The decision making process is complex and different decision support interventions have been developed to facilitate this process .
Patient decision aids (PtDAs) are `interventions designed to help people make specific and deliberative choices among options (including the status quo) by providing information on the options and outcomes relevant to a person’s health status and implicit methods to clarify values’ . They are different from patient health education materials which provide general health information about specific medical conditions including diagnosis, investigation and treatment. There are currently more than 500 PtDAs that have been developed worldwide, mainly in North America and Europe. [Decision Aids Library Inventory http://decisionaid.ohri.ca].
The effectiveness and utility of a PtDA is dependent on its quality. The International Patient Decision Aid Standards (IPDAS) collaboration has identified appropriate quality indicators using a Delphi consensus method and this provides guidance on the assessment of the content, format and evaluation of the PtDA (Table 1) . However, few PtDAs developers describe the development process per se and, of those which do, there is a wide variation in how PtDAs are actually developed. In addition, PtDAs are often developed without users’ involvement .
Although the IPDAS guideline provides a framework for the development of a PtDA, it does not provide guidance on which research methods to use; neither does it explicitly link the development of a PtDA to its evaluation and implementation. It is, therefore, necessary to combine these guidelines with other frameworks such as that produced by the UK Medical Research Council (UKMRC) framework which can link the development of the PtDA to its evaluation and implementation (Figure 1) ,. It is designed to guide the development and evaluation of complex interventions, such as PTDAs, and it stresses the important role of evidence, theories and modelling in the process of developing a complex intervention. Specific research methods are recommended to operationalise each step and it was for this reason that UKMRC Framework was used to complement the IPDAS guideline to develop and evaluate the PDA described in this study. In addition, the UKMRC framework highlights the importance of having a range of options before deciding which intervention to use and that it should be based on existing best available evidence. Before developing a decision support tool, it is important to reflect whether PtDA is the best tool to use to support decision making.
This paper described how the Patient and insulin Decision Aids (PANDAs) PtDA was developed for people with Type 2 Diabetes Mellitus [T2DM] based on the IPDAS criteria and UKMRC framework. The PANDAs study was conducted from 2007-2010 to develop the PtDA and to evaluate its effectiveness in the UK general practice .
We used a systematic and iterative approach to develop the PtDA by incorporating the IPDAS and UKMRC framework (Table 2). The UKMRC framework informed the methods used for the development of the PtDA, which is not stated in the IPDAS guideline. This section described in detail how the methods proposed by the UKMRC framework were used to operationalise each step: expert consensus (e.g. drafting of the PtDA), literature review (e.g. collating clinical evidence), individual interviews (e.g. needs assessment) and questionnaire surveys (e.g. acceptability and feasibility) (Table 2). This part of the PANDAs study was conducted in the general practice setting, Sheffield, England in 2007-2008. We obtained ethics approval from the National Health Service Research Ethics Committee (REC reference: 07/Q2308/53).
The members of the expert panel were selected based on their experience as patients or involvement in the care for people with type 2 diabetes in general practice (Table 2). The expert panel was responsible for reviewing the first and the subsequently revised drafts of the PtDA produced by the research team. This expert panel assessed the PtDA based on: (1) member’s experience as patients who were making or who had made the decision about starting insulin treatment; (2) healthcare professionals who had helped patients in making such decisions; and (3) key opinion leaders/policy makers who were involved in implementing health services for diabetes in General Practice. Members of the review panel comprised two patients, three healthcare professionals, three key opinion leaders and three representatives from the local Primary Care Trust and research network.
We conducted the literature review for two reasons; firstly, we aimed to identify the effective decision support interventions tools that were available; secondly, we wanted to search for latest clinical evidence on the pros and cons of the different treatment options to be incorporated into the PtDA. Therefore, two systematic review were conducted. As far as possible, we searched for systematic reviews and national or local clinical practice guidelines. In the event that they were not available, findings from individual studies were appraised, synthesised and summarised. The quality of the information was graded according to the "grading for evidence-based rheumatology" guidelines .
A qualitative methodology using individual in-depth interviews and focus group discussion was used for the needs assessment, acceptability and feasibility studies. A mixed methodology was used in this process to triangulate the data so that the PtDA could cater for the comprehensive needs of the users. Patients with type 2 diabetes who were at the point of deciding whether or not to start insulin therapy were recruited into the study. Healthcare professionals, including general practitioners, practice nurses and dieticians, who were involved in managing patients with type 2 diabetes, were also included in the study. For the needs assessment, the users were interviewed individually for their needs when making (or facilitating) a decision on insulin therapy. As for the feedback on the acceptability and feasibility of using the PtDA, both the patients and clinicians were interviewed after they had used the PtDA at the consultation.
One of the researchers (CJN) conducted all the interviews using a semi-structured interview guides, which were developed separately for patients and clinicians based on the literature review and expert opinion (Additional files 1 and 2). The interviews were audio-recorded, transcribed verbatim, checked and analysed using a thematic approach. NVivo 7 software was used to manage the qualitative data.
In addition, a bespoke questionnaire was used to capture quantitative feedback from the users on the acceptability and feasibility of using the PtDA. The users provided general and specific feedback on the content, layout and usability of the PtDA using a five-point Likert scale.
UKMRC and IPDAS frameworks
Table 3 demonstrated step-by-step how the findings from the needs assessment study, clinical evidence and the ODSF were incorporated into the development of the PtDA using the UKMRC framework. Both the UKMRC framework and IPDAS guideline guided the initial stages of the development of the PANDAs PtDA which included: convening an expert panel, comprising key stakeholders; conducting a needs assessment study; and searching for evidence for decision support interventions. The UKMRC framework highlights the importance of using theories to inform the development of complex interventions and is used to identify appropriate decision making theories. The drafting and piloting of the PtDA was also an important step in the UKMRC framework. The IPDAS framework guided the content and format development of the PtDA (Table 2).
Convening an expert panel
Initially, development and expert panels were convened to inform and advise on the development and evaluation of the PtDA. The development panel members were three healthcare professionals (2 GPs and a clinical nurse specialist in diabetes), one patient educator, three experts in decision science, two experts in evidence-based medicine and three experts in research methodology who had extensive experience in qualitative, quantitative and mixed methodologies. They were responsible for assessing the appropriateness of the research methodology used in the development and evaluation of the PtDA which informed the design and data analysis of the needs assessment acceptability and feasibility studies.
The needs assessment study identified four main needs common to both patients and clinicians: decisional, information, emotional and social support needs. For example, the patients wanted information on different treatment options available (besides insulin), the benefits and side effects of insulin therapy, and the impact of starting insulin on their lives. This information was incorporated into the PtDA. Although the PtDA did not address patients’ social and emotional needs directly, they were highlighted to the healthcare professionals who would address them during the consultation.
Identify a theoretical framework
Durand  identified a range of decision making theories that have been used to develop PtDAs, out of which, the Ottawa Decision Support Framework (ODSF) was the most commonly used and implemented. The ODSF is a conceptual framework which consists of a few theories such as expected utility theory, decisional conflict theory and social support theory . The PANDAs PtDA was developed based on the ODSF, which postulates that by identifying an individual patient’s decisional needs, a PtDA can provide personalised decision support to patients, and help patients make an informed and value-based decision about their health which in turn leads to a better health outcome ie. improved decisional quality  (Figure 2). The `decisional needs’ highlighted in the ODSF, such as decisional conflict, values, knowledge, expectations and support, were incorporated into the PANDAs PtDA.
Collate background information and clinical evidence
The background information and clinical evidence included in the PtDA was based on the needs of the patients and the healthcare professionals; availability and quality of the evidence; and the relevance to the local population. The evidence regarding the outcome probabilities for each of the treatment options was not easily available. A systematic review of the literature was, therefore, carried out to search, appraise and synthesise the information necessary to be incorporated into the PtDA.
We searched the literature systematically to determine the effectiveness of insulin-oral glucose-lowering drugs combination in reducing HbA1c, diabetic symptoms, diabetic complications and death compared to oral glucose-lowering drugs alone; its safety profile and the level of reduction in HbA1c. We included: systematic review, randomised and non-randomised trials; controlled and uncontrolled trials; cohort study. The inclusion criteria for the participants were: people with type 2 diabetes; blood sugar was not well controlled despite taking maximum oral glucose-lowering drugs; and insulin-naive. Two electronic databases, Cochrane Trials Register and Medline, were searched for eligible studies from 1950 to 2006. In addition, the reference lists and bibliographies of all relevant papers were searched for additional studies using the `snowballing’ method. This was performed on key articles till `reference saturation’. Publications by key authors were also searched and they were contacted for unpublished data. Only English-language publications were included in this review.
For the electronic database search, the following terms and strategy were used: diabetes mellitus, type 2, insulin, thirst, weight loss, weight gain, polyuria, nocturia, fatigue, infection, vision disorders, haemoglobin A, glycosylated, blood glucose, diabetes complications, mortality, death, mortality, hypoglycaemia, weight gain, lipodystrophy
CJN independently assessed the titles and abstracts of the identified studies. Where a clear decision could not be made on the basis of the title or the abstract, the study was considered relevant. Full text of all relevant studies was retrieved. The method sections of the retrieved articles were examined to assess whether they satisfied the inclusion criteria; uncertainty was resolved by asking a co-researcher for independent assessment.
Drafting of the PtDA
The initial drafts of the PtDA were developed by the research team based on the IPDAS guideline  and the ODSF . It went through a number of iterations before it was ready for alpha testing (Table 2).
In line with the IPDAS recommendations, the PtDA draft was reviewed by the review panel before being revised by the research team. This phase in the development of the PtDA was iterative and repeated until no new comments emerged, ie it had reached "thematic saturation" (Table 2).
The IPDAS guideline recommends that PtDAs should be `written at a level that can be understood by the majority of patients in the target group’ and it sets the readability threshold at grade 8 (English year 9) using readability test such as SMOG or Fry . The readability of this PtDA was measured using the Readability Calculations v. 7.0 software (Micro Power & Light Co. of Dallas, Texas 2005) and the results showed SMOG score at grade 7.
During the development of the PtDA, the PtDA drafts underwent three cycles of review by the users (nine patients and 14 healthcare professionals in total) and the expert panel as well as revisions by the research team. All members of the expert panel felt that the PtDA was acceptable in terms of content, format and readability prior to its’ use in clinical practice.
In the initial feasibility study, the healthcare professionals also provided feedback on how the PtDA could be delivered in usual general practice. Their major concerns were time constraints and a lack of familiarity with the use of the PtDA, which were addressed by conducting a training workshop for the healthcare professionals before they use it with their patients. This feedback was discussed during the meetings with the review panel and a concerted effort was made to incorporate these feedback into the final PtDA and its delivery.
Finalising the PTDA
The expert panel met four times during the review/revision process to discuss the feedback from the patients and the healthcare professionals based on the findings from the in-depth interview analysis and "acceptability" questionnaire surveys. The key findings were summarised and sent to the expert panel at least one week in advance. During the subsequent meetings, each member took turns to comment on each section of the PtDA as well as the findings from the in-depth interviews in order to achieve a consensus.
The PtDA was also revised in turn by the research team based on the analysis of the interviews and the consensus of the review panel meetings. This reviewing-revising iterative process was terminated when there were no further comments emerging from users’ interviews and review panel meetings.
The final draft was internally assessed using the IPDAS quality criteria checklist and proof read before sending for graphic design and printing. We found that the PANDAs PtDA satisfied all the criteria of the IPDAS checklist. This was the final step in the development of the PtDA before it was subjected to formal evaluation.
The development of the PANDAs PtDA demonstrates that it is feasible to use a combination of the IPDAS and the UKMRC frameworks to develop a PtDA based on users’ needs, evidence and theories (ODSF). The IPDAS recommendations provided evidence-based guidance on the development of the content and structure of the PtDA; the users’ healthcare decisional, social and emotional needs informed the selection of the content; and the ODSF provided a theoretical basis to link the development of the PtDA to the outcome measures for evaluation. Finally, the UKMRC framework for developing and evaluating complex interventions in Primary Care provided an overarching framework to guide the iterative process, inform the choice of research methods and ensure that the PtDA could be successfully developed, evaluated and implemented in practice.
The recent IPDAS collaboration evidence document reviewed the PtDAs assessed in the latest Cochrane Review  and found that only half of the PtDAs underwent field testing with patients and clinicians in the `real world’ and only 17% documented the method of reviewing and synthesising clinical evidence . It also highlighted the fact that few PtDAs provide sufficient details to assess whether or not they comply with the IPDAS criteria.
This study describes systematically how the IPDAS criteria guided the development of the PANDAs PtDA. The use of a theoretical framework to develop PtDAs was not part of the IPDAS standards . However in the recent update on the IPDAS evidence document, the use of a theoretical framework to develop PtDAs has been proposed . Similarly, the UKMRC guidance on how to develop complex interventions such as PtDAs also recommends the use of theories, which help to describe, explain and predict how the PtDA might work. With the growing number of clinical trials on PtDAs, a comparison between PtDAs which have or do not have a theoretical framework, is possible and the revised IPDAS standards on the evaluation of PtDA quality can be used to address this task .
The decision on `what’ and `how much’ to include in a PtDA is also a challenging one. Conventionally, PtDAs have focussed on delivering accurate and balanced information about the treatment options to patients ie emphasising the information needs . However, increasingly, there is growing evidence that people do not make decisions based only on the information they receive . Other considerations such as the availability of healthcare, emotional and social support may also affect how patients make decisions and it is, therefore, crucial that these needs of patients are attended to during the decision making process. In this study, the findings from the needs assessment reinforces this.
When identifying the best evidence to be included in the PtDA, we encountered a few difficulties. Firstly, there was a lack of systematic reviews or trials comparing insulin with `make no change’ or `lifestyle modification’. This is because it would be unethical and unacceptable to compare insulin therapy with no treatment in people with uncontrolled diabetes. There is also a lack of trials comparing insulin with lifestyle changes as most of these trials are funded by the pharmaceutical industry which have a vested interest in promoting drug usage .
In addition, there are also substantial variations in the reported outcomes of studies. For example, some studies report hypoglycaemic episodes as the number of episodes per 100 person year, whilst others report outcomes as "proportions of people experiencing hypoglycaemic episodes over a year". In addition, few clinical trials report on outcomes that are important to patients, such as `symptom relief’, which are relevant to patients when making any sort of medical decision .
In the PANDAs PtDA a list of diabetic symptoms was included and patients were asked to indicate whether or not they had experienced any of the symptoms. Although the evidence was, to some extent, lacking, "diabetic symptom relief" was included the in the PtDA as this is advice that is routinely given by healthcare professionals and it has a plausible scientific basis. Future clinical trials should routinely report outcomes that are clinically important to patients.
In the PANDAs PtDA, the risks and benefits were communicated to patients using the accepted principles of risk communication such as using textual, number and visual display to present risks; using natural frequencies rather than percentages; and emphasising the interaction between patients and healthcare professionals . There is an increasing recognition that people use both analytic and intuitive mechanisms to make decisions; so how people perceive risk may depend as much on logic and systematic analysis as well as emotions and heuristics .
Concerns were also raised about the purpose of the PtDA and whether it would be used to "convince" patients to start insulin treatment. Thompson PB has raised the same issue that risk communication might be used to encourage changes in peoples’ behaviour for the sake of public health gain . However, the aim of the PANDAs PtDA was to help patients make a decision which was informed and based on what was important to them and this was achieved by ensuring that the risk communication tool was balanced, accurate and up to date.
The purpose of value clarification in the process of shared decision making is to help patients recognise that their values play an important role in decision making. It also helps patients to determine which treatment option and its attributes are important to them and share their values with the healthcare professionals and their families .
In the PANDAs study, an explicit "balanced technique" was used to help patients compare and indicate the relative importance of the treatment option as well as the attributes of each option . However, patients found it difficult to answer the "negatively phrased" questions (e.g. `how important is it to avoid weight gain?’), especially when the response was also negative (eg `not important’). This difficulty was compounded when they were required to rate the importance (from `not important’ to `very important’). As a result, the questions asked in the value clarification section of the PtDA were modified and the response items were reduced to a yes/no option. It was clear that the accuracy of response to the questions in the PANDAs PtDA needed to be weighed against the ease of answering the questions.
The PtDA was delivered in a booklet based on feedback from the patients, healthcare professionals and expert panel during the needs assessment study. PtDAs can be developed in other formats including web-based compact discs or digital versatile disc; audio book, common decision board and patient focus groups. Increasingly web-based decision aids are preferred by developers. A paper-based PtDA was chosen because both healthcare professionals and patients during the feasibility study found the paper-based PtDA acceptable and the PtDA itself needed to be used by healthcare professionals and patients together in a consultation. In addition, a paper PtDA was portable and could be taken home as required by the patient for further consideration and it does not require any equipment. Most of the target population for the use of the PtDA were above 50 years of age and the assumption which was made for the study was that the majority of people in this age group prefer to use paper-based tools and are generally less familiar with using computers or the internet. However, this preference is changing . A survey conducted among orthopaedic surgeons in the UK found that more than half of the respondents preferred a booklet as a PtDA to other media such as web-based PtDA, CD/DVD and audiotape .
However, the disadvantages of using a paper-based PtDA are that the latter requires printing and mailing which may hinder wide dissemination and printing and reprinting of the PtDA was costly. By comparison, developing a web-based PtDA often needs only a single payment for computer programming and web design in the initial phase and maintenance and updating of a web-based PtDA requires less cost than reprinting of the paper-based PtDA.
Finally, web-based or computer-assisted PtDAs allow data to be collected and, if needed, summarized - so that it can be fed back to the patients and healthcare professionals, an advantage which paper-based PtDAs do not have. Nevertheless, a patient decision aid, regardless of the mode of delivery, only serves as a tool to facilitate discussion on the decision; it is not meant to replace a clinical consultation.
Strengths and limitations
Although the PANDAs PtDA was developed according to the two frameworks and, as far as possible, based on needs, evidence and theories, there were numerous challenges which we encountered during its development. There was some overlap in the roles of the members within the expert panels which had the potential of creating biases in the development process. However, both panels acknowledge the potential biases. On the other hand, it was found that there were strengths in dual roles which, for example, helped to facilitate communication among members of the panel who were from very diverse backgrounds.
Feldman-Stewart et al. (2007)  reported that patients are often not consulted about the information they would like to be included in the PtDA . The strength of this study is that it involved users (both patients and healthcare providers) throughout the development of the PtDA using individual in-depth interviews, questionnaire surveys and an expert consensus to assess users' needs; to draft and revise the PtDA; and to determine its acceptability and feasibility. The mixed methods approach was used to help `triangulate' the data and improve the credibility of the development process .
This study has demonstrated the feasibility of the IPDAS and the UKMRC frameworks for the development and evaluation of a PtDA. The IPDAS guideline was useful for informing the content, development and formatting of the PtDA, while the UKMRC framework helped to link the process of development with the evaluation and implementation of a complex intervention. Both frameworks are complementary and essential components to guide the development and evaluation of future PtDAs.
CJN conceptualised the study, designed the methodology, conducted the study, analysed the data and drafted the manuscript. NM conceptualised the study, designed the methodology, analysed the data and helped to draft the manuscript. AB conducted the study, analysed the data and helped to draft the manuscript. BC conducted the study, analysed the data and helped to draft the manuscript. All authors read and approved the final manuscript.
Lhussier M, Eaton S, Forster N, Thomas M, Roberts S, Carr SM: Care planning for long-term conditions - a concept mapping.Health Expect, in press..
Charles C, Gafni A, Whelan T: Shared decision-making in the medical encounter: what does it mean? (or it takes at least two to tango). Soc Sci Med. 1997, 44: 681-692. 10.1016/S0277-9536(96)00221-3.
Coulter A, Ellins J, Swain D, Clarke A, Heron P, Rasul F, Magee H, Sheldon H: Assessing the Quality of Information to Support People in Making Decisions about their Health and Healthcare. 2006, Picker Institute Europe, Oxford
Stacey D, Légaré F, Col NF, Bennett CL, Barry MJ, Eden KB, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Thomson R, Trevena L, Wu JHC. Decision aids for people facing health treatment or screening decisions.Cochrane Database Syst Rev 2014, Issue 1. Art. No.: CD001431. doi:10.1002/14651858.CD001431.pub4..
Elwyn G, O’Connor A, Stacey D, Volk R, Edwards A, Coulter A, Thomson R, Barratt A, Barry M, Bernstein S, Butow P, Clarke A, Entwistle V, Feldman-Stewart D, Holmes-Rovner M, Llewellyn-Thomas H, Moumjid N, Mulley A, Ruland C, Sepucha K, Sykes A, Whelan T: Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006, 333: 417-421. 10.1136/bmj.38926.629329.AE.
Flynn D, Ford GA, Stobbart L, Rodgers H, Murtagh MJ, Thomson RG: A review of decision support, risk communication and patient information tools for thrombolytic treatment in acute stroke: lessons for tool developers. BMC Health Serv Res. 2013, 13: 225-10.1186/1472-6963-13-225. doi:10.1186/1472-6963-13-225
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008, 337: a1655-10.1136/bmj.a1655.
Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.
Mathers N, Ng CJ, Campbell MJ, Colwell B, Brown I, Bradley A: Clinical effectiveness of a patient decision aid to improve decision quality and glycaemic control in people with diabetes making treatment choices: a cluster randomised controlled trial (PANDAs) in general practice. BMJ Open. 2012, 2: e001469-10.1136/bmjopen-2012-001469.
Coulter A, Ellins J: Patient-focused Interventions: A Review of the Evidence. 2006, The Health Foundation, London
Durand MA, Stiel M, Boivin J, Elwyn G: Where is the theory? Evaluating the theoretical frameworks described in decision support technologies. Patient Educ Couns. 2008, 71: 125-135. 10.1016/j.pec.2007.12.004.
Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33). UK Prospective Diabetes Study (UKPDS) Group. Lancet. 1998, 352: 837-853. 10.1016/S0140-6736(98)07019-6.
Tugwell P, Shea B, Boers M, Brooks P, Simon L, Strand V, Wells G: Evidence-based rheumatology. BMJ Books; 2005
Type 2 Diabetes: Newer Agents. 2009, NICE, London
Fishhoff B, Slovic P, Lichtenstein S: Knowing what you want: measuring labile values. Cognitive Processes in Choice and Decision Behavior. Edited by: Wallsten TS. 1980, Lawrence Erlbaum Associates, Hillsdale, New Jersey
O’connor AM, Tugwell P, Wells GA, Elmslie T, Jolly E, Hollingworth G, Mcpherson R, Bunn H, Graham I, Drake E: A decision aid for women considering hormone therapy after menopause: decision support framework and evaluation. Patient Educ Couns. 1998, 33: 267-279. 10.1016/S0738-3991(98)00026-3.
Legare F, O'Connor AM, Graham ID, Wells GA, Tremblay S: Impact of the Ottawa Decision Support Framework on the agreement and the difference between patients' and physicians' decisional conflict. Med Decis Making. 2006, 26: 373-390. 10.1177/0272989X06290492.
Coulter A, Stilwell D, Kryworuchko J, Mullen PD, Ng CJ, van der Weijden T: A systematic development process for patient decision aids. BMC Med Inform Decis Making. 2013, 13 (suppl.2): S2-10.1186/1472-6947-13-S2-S2.
Volk RJ, Llewellyn-Thomas H, Stacey D, Elwyn G: Ten years of the International Patient Decision Aid Standards Collaboration: evolution of the core dimensions for assessing the quality of patient decision aids. BMC Med Inform Decis Mak. 2013, 13 (Suppl 2): S1-10.1186/1472-6947-13-S2-S1. doi:10.1186/1472-6947-13-S2-S1
Elwyn G, O'Connor AM, Bennett C, Newcombe RG, Politi M, Durand MA, Drake E, Joseph-Williams N, Khangura S, Saarimaki A, Sivell S, Stiel M, Bernstein SJ, Col N, Coulter A, Eden K, Härter M, Rovner MH, Moumjid N, Stacey D, Thomson R, Whelan T, van der Weijden T, Edwards A: Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPTDASi). PLoS One. 2009, 4 (3): e4705-10.1371/journal.pone.0004705. doi:10.1371/journal.pone.0004705
Feldman-Stewart D, Brundage MD: Challenges for designing and implementing decision aids. Patient Educ Couns. 2004, 54: 265-273. 10.1016/j.pec.2003.09.007.
Bekker HL: Using decision-making theory to inform clinical practice. Shared Decision-Making in Health Care: Achieving Evidence-Based Patient Choice. Edited by: Edwards A, Elwyn G. 2009, Oxford University Press, Oxford, 45-51. 2
Privitera M: Large clinical trials in epilepsy: funding by the NIH versus pharmaceutical industry. Epilepsy Res. 2006, 68: 52-56. 10.1016/j.eplepsyres.2005.09.020.
Patient-reported Health Instruments Group: A structured review of patient-reported measures in relation to selected chronic conditions, perceptions of quality of care and carer impact. Oxford; 2006
Paling J: Strategies to help patients understand risks. BMJ. 2003, 327: 745-748. 10.1136/bmj.327.7417.745.
Slovic P, Finucane ML, Peters E, MacGregor DG: Risk as analysis and risk as feelings: some thoughts about affect, reason, risk, and rationality. Risk Anal. 2004, 24: 311-322. 10.1111/j.0272-4332.2004.00433.x.
Thompson PB: Ethics and risk communication. Sci Commun. 2012, 34: 618-641. 10.1177/1075547012459177.
Llewellyn-Thomas HA: Values clarification. Shared Decision Making in Health Care: Achieving Evidence Based Patient Choice. Edited by: Edwards A, Elwyn G. 2009, Oxford University Press, Oxford, 123-134. 2.
Marschollek M, Mix S, Wolf KH, Effertz B, Haux R, Steinhagen-Thiessen E: ICT-based health information services for elderly people: past experiences, current trends, and future strategies. Med Inform Internet Med. 2007, 32: 251-261. 10.1080/14639230701692736.
Adam JA, Khaw FM, Thomson RG, Gregg PJ, Llewellyn-Thomas HA: Patient decision aids in joint replacement surgery: a literature review and an opinion survey of consultant orthopaedic surgeons. Ann R Coll Surg Engl. 2008, 90: 198-207. 10.1308/003588408X285748.
Feldman-Stewart D, Brennenstuhl S, McIssac K, Austoker J, Charvet A, Hewitson P, Sepucha KR, Whelan T: A systematic review of information in decision aids. Health Expect. 2007, 10: 46-61. 10.1111/j.1369-7625.2006.00420.x.
Creswell JW, Fetters MD, Ivankova NV: Designing a mixed methods study in primary care. Ann Fam Med. 2004, 2: 7-12. 10.1370/afm.104.
We would like to thank Professor Annette O'Connor and Professor Dawn Stacey for helping to design the PtDA and the expert panel who provided invaluable feedback on the PtDA, particularly Professor Mike Campbell and Susan Beveridge. This study was funded by the National Institute for Health Research (NIHR) under its Research for Patient Benefit (RfPB) Programme (Grant Reference Number PB-PG-0906-11248) and the Sheffield Health and Social Care NHS Foundation Trust. The preparation of the manuscript was funded by the University of Malaya Research Grant (RP015B-13HTM).
The authors declare that they have no competing interests.