You are viewing the site in preview mode

Skip to main content

Advertisement

Table 2 Quality appraisal of included studies using the Effective Public Health Practice Project

From: A systematic review of the effects of advance care planning facilitators training programs

Component Description First author, year
Alexander, 2006 [17] Bristowe, 2014 [18] Detering, 2014 [19] Greenberg, 1993 [20] Jo, 2015 [21] Lum, 2018 [22] Murray, 2010 [23] Seal, 2007 [24] Smith, 2013 [25] Wilson, 2017 [26]
A R A R A R A R A R A R A R A R A R A R
A) Selection bias Q1) Are the individuals selected to participate in the study likely to be representative of the target population? (1: Very likely; 2: Somewhat likely; 3: Not likely; 4: Can’t tell) 2 2 (M) 2 2 (M) 2 2 (M) 2 2 (M) 2 2 (M) 2 2 (M) 2 2 (M) 1 3 (W) 2 2 (M) 2 2 (M)
Q2) What percentage of selected individuals agreed to participate? (1: 80–100% agreement; 2: 60–79% agreement; 3: Less than 60% agreement; 4: Not applicable; 5: Can’t tell) 1 1 1 1 1 1 2 3 2 5
B) Study Design Indicate the study design (1: RCT; 2: Controlled clinical trial; 3: Cohort analytic (two group pre + post); 4: Case-control; 5: Cohort (one group pre + post (before and after)); 6: Interrupted time series; 7: other specify; 8: Can’t tell) 2 1 (S) 5 2 (M) 5 2 (M) 1 1 (S) 3 2 (M) 6 2 (M) 1 1 (S) 3 2 (M) 5 2 (M) 5 2 (M)
Was the study described as randomized? If NO, go to Component C. N N N Y N N Y N N N
If Yes, was the method of randomization described?     N    Y    
If Yes, was the method appropriate?     N    Y    
C) Confounders Q1) Were there important differences between groups prior to the intervention? (1: Yes; 2: No; 3: Can’t tell) 2 1 (S) 3 3 (W) 1 3 (W) 2 1 (S) 2 1 (S) 2 1 (S) 2 1 (S) 3 3 (W) 2 1 (S) 3 3 (W)
Q2) If yes, indicate the percentage of relevant confounders that were controlled (either in the design (e.g. stratification, matching) or analysis)? (1:80–100% agreement; 2:60–79% agreement; 3: Less than 60% agreement; 4: Not applicable; 5: Can’t tell) 4 4 3 1 4 4 1 5 4 5
D) Binding Q1) Was (were) the outcome assessor (s) aware of the intervention or exposure status of participants? (1: Yes; 2: No, 3: Can’t tell) 2 2 (M) 3 3 (W) 3 3 (W) 1 3 (W) 1 3 (W) 1 3 (W) 2 2 (M) 1 3 (W) 1 3 (W) 1 3 (W)
Q2) Were the study participants aware of the research question? (1: Yes; 2: No; 3: Can’t tell) 3 3 3 3 1 1 3 1 1 1
E) Data Collection Method Q1) Were data collection tools shown to be valid? (1: Yes; 2: No; 3: Can’t tell) 1 2 (M) 3 3 (W) 3 3 (W) 3 3 (W) 1 1 (S) 3 3 (W) 1 1 (S) 3 3 (W) 1 2 (M) 1 2 (M)
Q2) Were data collection tools shown to be reliable? (1: Yes; 2: No; 3: Can’t tell) 3 3 3 3 1 3 1 3 3 3
F) Withdrawals and Dropouts Q1) Were withdrawals and drop-outs reported in terms of numbers and/or reasons per group? (1: Yes; 2: No; 3: Can’t tell; 4: Not applicable) 1 1 (S) 3 3 (W) 1 1 (S) 2 1 (S) 1 1 (S) 1 2 (M) 1 1 (S) 2 3 (W) 1 1 (S) 3 3 (W)
Q2) Indicate the percentage of participants completing the study. (If the percentage differs by groups, record the lowest). (1:80–100%; 2:60–79%; 3: Less than 60%; 4: Can’t tell; 5: Not applicable) 1 4 1 1 1 2 1 3 1 1
G) Intervention Integrity Q1) What percentage of participants received the allocated intervention or exposure of interest? (1:80–100%; 2:60–79%; 3: Less than 60%; 4: Can’t tell) 1   1   1   1   1   1   1   3   1   1  
Q2) Was the consistency of the intervention measured? (1: Yes; 2: No; 3: Can’t tell) 3 3 3 3 1 3 2 3 3 3
Q3) Is it likely that subjects received an unintended intervention (contamination or co-intervention) that may influence the results? (1: Yes; 2: No; 3: Can’t tell) 3 3 3 3 3 3 3 3 3 3
H) Analysis Q1) Indicate the unit of allocation (Community OR Organisation/institution OR Practice/office OR individual) Ind   Ind   Ind   Ind   H   Ins   Ind   Wa   Ind   Ind  
Q2) Indicate the unit of analysis (Community OR Organisation/institution OR Practice/office OR individual) Ind Ind Ind Ind Ind Ind Ind Ind Ind Ind
Q3) Are the statistical methods appropriate for the study design? (1: Yes; 2: No; 3: Can’t tell) 1 1 1 1 1 3 1 1 1 1
Q4) Is the analysis performed by intervention allocation status (i.e. intention to treat) rather than the actual intervention received? (1: Yes; 2: No; 3: Can’t tell) 2 1 1 2 2 2 2 2 2 3
Global rating 1 (S) 3 (W) 3 (W) 3 (W) 2 (M) 3 (W) 1 (S) 3 (W) 2 (M) 3 (W)  
  1. A answer, C community, H hospital, Ind individual, Ins institution, M moderate, N no, R rating, S strong, W weak, Wa ward, Y yes