- Research article
- Open Access
- Open Peer Review
The exit interview as a proxy measure of malaria case management practice: sensitivity and specificity relative to direct observation
© Pulford et al.; licensee BioMed Central Ltd. 2014
- Received: 31 July 2014
- Accepted: 24 November 2014
- Published: 3 December 2014
This paper aims to assess the sensitivity and specificity of exit interviews as a measure of malaria case management practice as compared to direct observation.
The malaria case management of 1654 febrile patients attending 110 health facilities from across Papua New Guinea was directly observed by a trained research officer as part of a repeat cross sectional survey. Patient recall of 5 forms of clinical advice and 5 forms of clinical action were then assessed at service exit and statistical analyses on matched observation/exit interview data conducted.
The sensitivity of exit interviews with respect to clinical advice ranged from 36.2% to 96.4% and specificity from 53.5% to 98.6%. With respect to clinical actions, sensitivity of the exit interviews ranged from 83.9% to 98.3% and specificity from 70.6% to 98.1%.
The exit interview appears to be a valid measure of objective malaria case management practices such as the completion of a diagnostic test or the provision of antimalarial medication, but may be a less valid measure of low frequency, subjective practices such as the provision of malaria prevention advice.
- Exit interview
- Direct observation
- Patient recall
Many countries have introduced revised malaria case management protocols over the past decade in light of increasing drug resistance to older anti-malarials and the emergence of affordable malaria rapid diagnostic tests (RDTs). Protocol revisions typically reflect current World Health Organisation guidelines recommending all fever or suspected malaria cases be tested for malaria infection by microscopy or RDT, with some form of artemisinin-combination therapy provided to all confirmed malaria cases . Monitoring health worker practice is an important means by which a national or regional program can determine the success (or otherwise) of implementing a revised malaria case management protocol. High rates of health worker adherence are required if the benefits of the new protocol are to be realised and the consequences of poor adherence, such as misdiagnosis, over- or under-treatment and the accelerated development of drug resistance, averted. As health worker practice is frequently inconsistent with malaria case management protocols -, interventions designed to improve health worker adherence are often necessary e.g. -. Assessing the impact of any such intervention further requires a means by which to monitor health worker practice.
While monitoring malaria case management practice is necessary in relevant program evaluation or intervention studies, there has been little consideration given to methods of assessment in the published literature. A number of methods have been used, including direct observation of clinical case management ,, exit interviews with febrile patients conducted immediately after service discharge ,, reviews of medical records  and health worker interviews . However, the authors are aware of no studies that have sought to examine the relative strengths and weaknesses of each assessment method or examined their relative validity in the context of malaria case management. Direct methods such as audio- or video-recording, observation by a trained observer or the use of a ‘standardised’ patient are considered gold standard measures of health worker practice , yet they may also be time consuming, labour intensive, intrusive and can promote social desirability bias (e.g. health workers modifying their usual practice when being observed or recorded). Accordingly, proxy measures of health worker practice, such as patient self-report (at service exit or sometime thereafter), health worker self-report or medical file review are often preferred. Proxy measures are less intrusive, less costly and may reduce social desirability bias, although the degree to which they accurately reflect health worker practice remains open to question. Several studies have reported divergent findings when comparing one form of proxy measurement with another - or when comparing a direct measurement with a proxy ,. A review paper designed to identify valid proxy measures of clinical behaviour concluded patient self-report demonstrated greater accuracy than either medical file review or clinician self-report when compared to a direct measure . However, the authors further concluded the evidence base for all three forms of proxy measure is very limited, due in large part to the use of inappropriate statistical methods, and that direct measures themselves may not be uniformly valid as a gold standard across all aspects of health worker practice.
Given the lack of investigation into valid measures of malaria case management practice specifically, and the dearth of statistically sound comparisons of direct versus proxy measures of clinical practice generally, this paper aims to compare a direct and a proxy measure of health worker practice in the context of malaria case management. Reported analyses draw on matched data obtained by direct observation of malaria case management and structured interviews (exit interview) conducted with the same patients or their caregivers immediately following service discharge from health facilities in Papua New Guinea (PNG). The analysis plan followed that recommended by Dickinson et al.  for comparing direct and proxy measures of clinical behavior (item by item comparisons), including a measure of sensitivity to answer the question: what proportion of actions that were actually performed and recorded by direct observation were identified by the proxy (exit interview)? And a measure of specificity to answer the question: what proportion of actions that were not performed or recorded by direct observation were equally not recorded as performed by the proxy? Factors potentially predictive of accurate patient/caregiver recall are also examined via logistic regression.
Data were collected during a repeat cross sectional survey of randomly selected health facilities from across PNG. This paper presents combined data from the first three of these surveys completed in the years’ 2010, 2011 and 2012 (the only surveys completed at the time of analysis). All three surveys were conducted as part of a five year evaluation of the PNG National Malaria Control Program. A full description of the evaluation program, including a detailed description of the health facility survey methodology, is presented elsewhere . The following description is a summarized version of this previously published account.
The study sample for each cross sectional survey consisted of two health centres and up to four aid posts selected from each of 20 PNG provinces, using a simple random sampling procedure repeated for each survey. The sampling frame in each was a list of all operational public-sector health centres nationwide as provided by the National Department of Health (N = 689). Aid posts were randomly selected on site at participating health centres. In this paper, study samples from the 2010, 2011 and 2012 surveys have been combined into a single dataset for analysis. Cases were included in the final dataset if matched direct observation and exit interview data were available. Health centres and aid posts are the main providers of primary care in PNG. The median number of health workers employed at health centres in PNG is eight and the median number at aid posts is one, almost all of whom are either nurses or community health workers .
Each survey was carried out from June to November and was conducted by trained survey teams working simultaneously at different sites. The training programme for survey staff spanned 10 days and included intensive instruction and practice on the methods of direct observation and exit interview. Members of each survey team spent between three to five days at each participating health centre and up to one day at each participating aid post. Oral informed consent was sought from the officer in charge at all participating health facilities and from all participating clinicians and patients prior to observation/interview. Patients were considered eligible for participation if they were presenting with febrile symptoms or reported a recent history of fever. Eligible patients were identified upon first contact with a health worker or, if circumstances allowed, by screening in the waiting area prior to first contact with a health worker. Consenting participants were observed/interviewed consecutively and were retained in the study sample irrespective of whether they were subsequently diagnosed with malaria or not. The study was approved and granted ethical clearance by the Medical Research Advisory Committee of PNG (MRAC No. 10.12; 26 Feb 2010).
The method of direct observation was undertaken by a trained research officer who passively observed the management of fever patients from the point of initial contact with a health professional until service exit or admission onto a treatment ward. During the course of this observation, the research officer recorded whether specified actions did or did not occur as well as the content of specific actions (e.g. whether an antimalarial was prescribed and, if yes, what type of antimalarial) on a structured checklist. The checklist was divided into discrete sections including diagnosis, prescription and treatment counselling and was informed by input from experienced medical- and medical research- professionals. The exit interview took the form of a structured questionnaire administered by a trained research officer to fever patients at the time of service discharge. The questionnaire included a range of open and closed questions pertaining to his or her recall of clinical information/clinical practice.
In this paper, the analysis is based on patient recall (as measured at exit interview) of ten clinical variables: five pertaining to clinical advice that the current PNG national malaria treatment protocol recommends all health workers provide to malaria patients  and five pertaining to clinical actions routinely associated with malaria case management. The five ‘advice’ variables include: 1) ‘dosage regimen’ , advice on when, how many and over how many days, prescribed antimalarial tablets should be consumed; 2) ‘dietary’ , advice to consume antimalarial tablets with food or with certain types of food; 3) ‘adverse effects’ , advice on potential side effects of prescribed antimalarial drugs; 4) ‘re-engagement’, advice on when, and under what circumstances, a patient should return to the health facility (e.g. if symptoms persist or worsen); and 5) ‘malaria prevention’ , advice on how to protect oneself and/or one’s family against malaria infection (e.g. sleep under a mosquito net every night). The five ‘action’ variables included: 1) ‘diagnosis’ , whether the health worker completed a malaria rapid diagnostic test or took a malaria blood slide; 2) ‘antimalarial prescription’ , whether the health worker prescribed an antimalarial drug; 3) ‘sulphadoxine-pyrimethamine (SP) prescription’ , whether the health worker prescribed SP (included as a proxy measure of patients’ ability to recall a specific drug as opposed to a class of drug. SP was selected as it was the most frequently prescribed antimalarial in the study sample); 4) ‘First dose ingested’ , whether the patient consumed the first dose of the prescribed antimalarial(s) at the health centre; and 5) ‘take away dose’ , whether the patient was provided with antimalarial medication to take home.
All data were double entered into DMSys version 5.1 (Sigma Soft International). Stata/SE version 12 was used for statistical analysis, including tests of sensitivity and specificity with 95% confidence intervals (CIs) calculated for all summary statistics. Sensitivity was defined as the number of cases in which the patient/caregiver correctly reported that a specified advice/action was provided divided by the total number of cases in which the specified advice/action was observed to have occurred. Specificity was defined as the number of exit interviews in which the patient/caregiver correctly reported that the specified advice/action was not provided divided by the total number of cases in which the specified advice/action was observed not to have occurred. The calculation of all CIs was adjusted for possible clustering at the health facility level by using the Stata ‘svy’ command in which health facilities were defined as the primary sampling unit. Factors potentially predictive of accurate recall (of both clinical-advice and -action) were examined by logistic regression. The outcome variable was whether a patient/caregiver accurately recalled whether the specified action/advice took place (yes/no). In each analysis, the sample was limited to the number of patients for whom the specified advice/action was observed to have occurred. Patient/caregiver recall was scored accurate (yes) if he/she stated the observed advice/action took place. Predictor variables included patient age (<5 years/5 + years), patient sex, interviewee status (patient/caregiver) and the consultation duration (<17 minutes/17+ minutes; 17 minutes being the mean consultation duration).
Selected characteristics of the study sample by survey year and overall
0 - 4 yrs
5 – 14 yrs
Sensitivity and specificity of exit interview measures
Sensitivity and specificity of exit interviews compared to direct observation
% (95% CI)
% (95% CI)
96.4 (93.6, 98.0)
53.5 (40.2, 66.2)
54.4 (41.9, 66.2)
94.1 (92.0, 95.6)
36.2 (16.8, 61.2)
98.6 (97.6, 99.2)
57.9 (49.4, 65.9)
75.2 (70.3, 79.5)
69.2 (60.5, 76.7)
96.9 (95.6, 97.7)
94.0 (88.8, 96.8)
98.1 (95.5, 99.1)
91.7 (87.8, 94.4)
97.9 (92.7, 99.4)
83.9 (79.0, 87.7)
70.6 (63.4, 83.3)
1st dose ingested
95.5 (93.0, 97.1)
95.0 (92.4, 96.8)
Take away dose
98.3 (97.1, 98.9)
88.2 (81.7, 92.6)
Factors associated with accurate patient recall
Factors associated with accurate recall of treatment advice
OR (95% CI)
OR (95% CI)
OR (95% CI)
OR (95% CI)
OR (95% CI)
1.1 (0.4, 3.0)
0.3 (0.1, 0.9)
0.1 (<0.1, 1.0)
0.9 (0.4, 1.9)
2.4 (0.9, 6.4)
0.7 (0.4, 1.2)
1.5 (0.6, 4.1)
0.1 (<0.1, 0.9)
0.8 (0.5, 1.2)
0.9 (0.5, 1.7)
< 5 yrs
5 yrs +
1.1 (0.6, 2.0)
1.0 (0.4, 2.5)
2.6 (0.3, 19.5)
1.0 (0.5, 1.8)
1.8 (0.8, 4.3)
17 mins +
1.2 (0.6, 2.1)
0.7 (0.2, 2.1)
0.1 (<0.1, 0.8)
1.5 (0.8, 2.8)
0.6 (0.3, 1.4)
Factors associated with accurate recall of treatment actions
AM prescription 1
SP prescription 2
1st dose ingested
Take away dose
OR (95% CI)
OR (95% CI)
OR (95% CI)
OR (95% CI)
OR (95% CI)
2.9 (1.0, 8.3)
1.3 (0.8, 2.2)
1.1 (0.7, 1.8)
2.0 (0.6, 6.6)
0.7 (0.1, 3.8)
1.5 (0.5, 4.4)
0.6 (0.5, 0.9)
1.1 (0.8, 1.7)
2.6 (1.0, 7.0)
2.2 (0.7, 7.1)
< 5 yrs
5 yrs +
1.7 (0.8, 3.9)
1.7 (1.0, 2.8)
1.1 (0.6, 1.7)
1.0 (0.3, 3.6)
1.3 (0.3, 6.1)
17 mins +
1.3 (0.6, 3.2)
1.3 (0.8, 2.0)
1.0 (0.7, 1.6)
1.1 (0.4, 2.6)
0.8 (0.3, 2.4)
The reported findings indicate that the exit interview was a poor proxy measure of malaria case management practice in regards to the provision of clinical advice. Sensitivity was as low as 36.2% on one ‘advice’ measure (adverse effects) and less than 60% on two others (diet and re-engagement), indicating patients’ frequently failed to recall the provision of clinical advice when such advice had been given. Specificity was higher than sensitivity on four out of five ‘advice’ measures and above 90% on three. While this indicates high concordance between the exit interview and direct observation in terms of detecting the non-provision of clinical advice, this finding is tempered by the fact that the forms of clinical advice measured were rarely provided at all. Thus, the number of ‘false positives’ detected by the exit interview may have been small relative to the number of correctly identified false cases (i.e. non-provision of clinical advice), but may still have exceeded or closely matched the number of correctly identified positive cases (i.e. provision of clinical advice). The ability of the exit interview to reliably detect the provision of clinical advice, therefore, is highly questionable if direct observation is taken as a reliable gold standard bench-mark.
Having said this, the exit interview proved to be a valid proxy measure of malaria case management practice in regards to the provision of clinical actions. Four out of the five ‘action’ measures had a sensitivity or specificity greater than 90% and in three out of the five measures both sensitivity and specificity was greater than 90%. The high frequency with which the specified actions occurred also indicates that there were few cases of false negatives or false positives relative to the number of actions correctly identified by exit interview (i.e. either having occurred or not occurred). Thus, in sum, the reported findings indicate that for frequently occurring, highly objective measures such as the prescription of an antimalarial or the use of a diagnostic test, the exit interview performs well as a proxy measure of malaria case management practice. However, for less frequent, more subjective measures such as the provision of malaria prevention advice or dietary information, the exit interview performs less well. The logistic regression analyses suggest recall accuracy is not consistently influenced by interviewee status, patient age or sex or consultation time. Where statistically significant associations were reported, the respective sample sizes were typically very low undermining confidence in the result.
These findings are somewhat consistent with the extant evidence-base. A number of studies have reported poor to moderate patient recall (as measured by exit interview) of the provision of health behaviour advice when compared to a direct measure of health worker practice ,,. In one study, patient recall on nine ‘advice’ domains (ranging from diet and exercise to seatbelt use and HIV prevention) exceeded 50% on only three domains and was as low as 11% for recall of substance use advice . In another, and converse to what was reported in this paper, parent recall of diet and physical activity advice provided to their child in the course of a paediatric consultation was found to have relatively high sensitivity (70-96%), but low specificity (43%-78%) . Other studies that have examined proxy measures of more objective clinical practices, such as measuring blood pressure or providing medication, have reported greater agreement with direct measurements ,. Nevertheless, the available literature is not neatly divided along these lines. High levels of agreement between proxy and direct measurements have been reported for the provision of health behaviour advice in some instances  and proxy measures of objective clinical practices such as components of a physical exam have not always uniformly produced high sensitivity or specificity . Drawing firm conclusions in regard to the validity of the exit interview as a proxy measure of clinical practice continues to be hampered by the dearth of statistically appropriate validation studies. This paper and others  published subsequent to the review paper which first highlighted this limitation  are improving the stock of available evidence, but further research is necessary. As the emerging evidence base is beginning to challenge the validity of the exit interview as a reliable measure of low frequency, subjective clinical practices then this should be considered an area of research priority. Until such time, researchers could consider employing multiple proxy measures of clinical practice (e.g. exit interview, file review, health worker interview) and triangulating the resulting data in order to improve confidence in the reported findings as has been previously advocated ,.
Future research in this area could further benefit by accounting for health literacy and other aspects of health communication when assessing the utility of proxy measures of clinical practice. A patient’s health literacy, defined as “The degree to which individuals can obtain, process, understand, and communicate about health-related information needed to make informed health decisions”  pg. 16, is an individual-level construct influenced by literacy and cognitive abilities . However, irrespective of one’s health literacy, comprehension of health information can be influenced by external factors such as the quality of clinician-patient communication and interventions can improve patient understanding and recall . Accordingly, clinical practices centred on verbal communication, such as advice pertaining to when, and under what circumstances one should seek further treatment, may be influenced by a greater range of factors as compared to recall of objective non-verbal actions such as the provision of a diagnostic test. The relative merit of using an exit interview as a proxy measure of clinical practice may, therefore, be dependent on the health literacy of the patient population and the perceived degree to which the quality of health communication may influence patient recall. In settings such as PNG where the patient population is likely to have relatively low health literacy and the health workforce is likely to have relatively undeveloped health communication skills, an exit interview may be a less accurate proxy measure of verbal, subjective clinical practices as compared to other forms of measurement or to the use of an exit interview in a higher income country (where the health literacy of the patient population and the communication skills of the health workforce are likely to be better developed).
The strengths of this study included the use of a statistical design appropriate to validation of a proxy measure of clinical practice, the use of matched data drawn from a nationally representative sample of health facilities and the inclusion of both advice- and action-centred clinical practices. Nevertheless, the reported study was not without limitation. The sample size for the ‘diet’ and ‘adverse effects’ advice measures was problematic due to the low frequency with which either form of advice was actually provided (n = 81 and 36, respectively). This limitation was especially problematic for the logistic regression analysis, the results of which should be considered highly tentative. All confidence intervals (CIs) were also adjusted for possible clustering at the health facility level rather than the health worker level, which would have been preferable. Unfortunately, it was not possible to adjust CIs at the health worker level in this study. Only a minority of health workers employed at any one health centre would have provided clinical treatment to febrile patients during the course of study participation. Finally, this paper only examined one form of proxy measurement (exit interview) and utilised only one form of direct measurement (observation). The reported findings would be usefully complemented by validation studies of other proxy measures (e.g. file review or health worker interview) against direct observation or the same proxy measure against an alternative form of direct measurement (e.g. video- or audio-taping).
The exit interview appears to be a valid measure of objective malaria case management practices such as the completion of a diagnostic test or the provision of antimalarial medication, but may be a less valid measure of low frequency, subjective practices such as the provision of malaria prevention advice. Further research is needed to establish the validity of the exit interview as a measure of health behaviour advice.
The authors gratefully acknowledge the many health workers and patients involved in this study. The generous support of the respective provincial and district health authorities and the PNG National Department of Health are also acknowledged as are the following individuals for assisting with data collection and processing: Mrs. Serah F Kurumop, Mr. Samuel Hurim, Mr. Brown Kaupa, Mr. Gaius Sabumai, Mr. Gibson Gideon, Ms. Elsie Bilam, Mrs. Aiyoh Gubag, Mr. Ismart Martin, Mr. George Dogoya, Mr. Loui Ipatu, Ms. Angeline Angwin, Mr. Iso Smith, Mr. Yangta Ura, Mr. Samson Pes, Ms. Tema Kay, Ms. Sherva Kevin, Mrs. Lillian Akunaii, Ms. Rose Kawage, Ms. Carolyn Kopan, Ms. Abanie Ginbol, Ms. Julianne Onga, Ms. Ceciliah Kamel, Mrs. Theresa Nime, Ms. Freda Opnal, Ms. Rose Charles, Ms. Winnifred Boina, Ms. Florence Lawrence and Ms. Regina Arre. This study was financially supported by a Global Fund to Fight AIDS, Tuberculosis and Malaria (GFATM) Round 8 grant.
- Guidelines for the Treatment of Malaria. 2010, WHO, Geneva, 2Google Scholar
- Pulford J, Kurumop S, Ura Y, Siba P, Mueller I, Hetzel MW: Malaria case management in Papua New Guinea following the introduction of a revised treatment protocol. Malar J. 2013, 12: 433-10.1186/1475-2875-12-433.View ArticlePubMedPubMed CentralGoogle Scholar
- Juma E, Zurovac D: Changes in health workers’ malaria diagnosis and treatment practices in Kenya. Malar J. 2011, 10: 1-10.1186/1475-2875-10-1.View ArticlePubMedPubMed CentralGoogle Scholar
- Abdelgader TM, Ibrahim AM, Elmardi KA, Githinji S, Zurovac D, Snow RW, Noor AM: Progress towards implementation of ACT malaria case-management in public health facilities in the Republic of Sudan: a cluster-sample survey. BMC Public Health. 2012, 12: 11-10.1186/1471-2458-12-11.View ArticlePubMedPubMed CentralGoogle Scholar
- Martins JS, Zwi AB, Hobday K, Bonaparte F, Kelly PM: The implementation of a new Malaria Treatment Protocol in Timor-Leste: challenges and constraints. Health Policy Plan. 2012, 27 (8): 677-686. 10.1093/heapol/czs019.View ArticlePubMedPubMed CentralGoogle Scholar
- Zurovac D, Sudoi RK, Akhwale WS, Ndiritu M, Hamer DH, Rowe AK, Snow RW: The effect of mobile phone text-message reminders on Kenyan health workers’ adherence to malaria treatment guidelines: a cluster randomised trial. Lancet. 2011, 378 (9793): 795-803. 10.1016/S0140-6736(11)60783-6.View ArticlePubMedPubMed CentralGoogle Scholar
- Wasunna B, Zurovac D, Bruce J, Jones C, Webster J, Snow RW: Health worker performance in the management of paediatric fevers following in-service training and exposure to job aids in Kenya. Malar J. 2010, 9: 261.PubMedPubMed CentralGoogle Scholar
- Namagembe A, Ssekabira U, Weaver MR, Blum N, Burnett S, Dorsey G, Sebuyira LM, Ojaku A, Schneider G, Willis K, Yeka A: Improved clinical and laboratory skills after team-based, malaria case management training of health care professionals in Uganda. Malar J. 2012, 11: 44-10.1186/1475-2875-11-44.View ArticlePubMedPubMed CentralGoogle Scholar
- Pulford J, Mueller I, Siba PM, Hetzel MW: Malaria case management in Papua New Guinea prior to the introduction of a revised treatment protocol. Malar J. 2012, 11: 157-10.1186/1475-2875-11-157.View ArticlePubMedPubMed CentralGoogle Scholar
- Lange S, Mwisongo A, Maestad O: Why don’t clinicians adhere more consistently to guidelines for the Integrated Management of Childhood Illness (IMCI)?. Soc Sci Med. 2014, 104: 56-63. 10.1016/j.socscimed.2013.12.020.View ArticlePubMedGoogle Scholar
- Masanja IM, Selemani M, Khatib RA, Amuri B, Kuepfer I, Kajungu D, de Savigny D, Kachur SP, Skarbinski J: Correct dosing of artemether-lumefantrine for management of uncomplicated malaria in rural Tanzania: do facility and patient characteristics matter?. Malar J. 2013, 12: 446-10.1186/1475-2875-12-446.View ArticlePubMedPubMed CentralGoogle Scholar
- Kyabayinze DJ, Asiimwe C, Nakanjako D, Nabakooza J, Counihan H, Tibenderana JK: Use of RDTs to improve malaria diagnosis and fever case management at primary health care facilities in Uganda. Malar J. 2010, 9: 200-10.1186/1475-2875-9-200.View ArticlePubMedPubMed CentralGoogle Scholar
- Onwujekwe O, Uzochukwu B, Dike N, Uguru N, Nwobi E, Shu E: Malaria treatment perceptions, practices and influences on provider behaviour: comparing hospitals and non-hospitals in south-east Nigeria. Malar J. 2009, 8: 246-10.1186/1475-2875-8-246.View ArticlePubMedPubMed CentralGoogle Scholar
- Hrisos S, Eccles MP, Francis JJ, Dickinson HO, Kaner EF, Beyer F, Johnston M: Are there valid proxy measures of clinical behaviour? A systematic review. Implementation Sci. 2009, 4: 37-10.1186/1748-5908-4-37.View ArticleGoogle Scholar
- Nicholson JM, Hennrikus DJ, Lando HA, McCarty MC, Vessey J: Patient recall versus physician documentation in report of smoking cessation counselling performed in the inpatient setting. Tob Control. 2000, 9 (4): 382-388. 10.1136/tc.9.4.382.View ArticlePubMedPubMed CentralGoogle Scholar
- Shaikh U, Nettiksimmons J, Bell RA, Tancredi D, Romano PS: Accuracy of parental report and electronic health record documentation as measures of diet and physical activity counseling. Acad Pediatr. 2012, 12 (2): 81-87. 10.1016/j.acap.2011.10.004.View ArticlePubMedGoogle Scholar
- Corser W, Sikorskii A, Olomu A, Stommel M, Proden C, Holmes-Rovner M: Concordance between comorbidity data from patient self-report interviews and medical record documentation. BMC Health Serv Res. 2008, 8: 85-10.1186/1472-6963-8-85.View ArticlePubMedPubMed CentralGoogle Scholar
- Flocke SA, Stange KC: Direct observation and patient recall of health behavior advice. Prev Med. 2004, 38 (3): 343-349. 10.1016/j.ypmed.2003.11.004.View ArticlePubMedGoogle Scholar
- Stange KC, Zyzanski SJ, Smith TF, Kelly R, Langa DM, Flocke SA, Jaen CR: How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison with direct observation of patients visits. Med Care. 1998, 36 (6): 851-867. 10.1097/00005650-199806000-00009.View ArticlePubMedGoogle Scholar
- Dickinson HO, Hrisos S, Eccles MP, Francis J, Johnston M: Statistical considerations in a systematic review of proxy measures of clinical behaviour. Implementation Sci. 2010, 5: 20-10.1186/1748-5908-5-20.View ArticleGoogle Scholar
- Hetzel MW, Pulford J, Maraga S, Barnedas C, Reimer L, Tavul L, Jamea-Maiasa S, Tandrapah A, Maalsen A, Makita L, Siba PM, Mueller I: Evaluation of the Global Fund-supported National Malaria Control Program in Papua New Guinea, 2009–2014. P N G Med J, in press..Google Scholar
- Kurumop SF, Pulford J, Mueller I, Siba P, Hetzel MW: Diagnostic capacity and anti-malarial availability in Papua New Guinea prior to the introduction of a revised national malaria treatment protocol. P N G Med J, in press..Google Scholar
- National Malaria Treatment Protocol. 2009, PNG NDoH, Port Moresby, 1Google Scholar
- Sciamanna CN, Goldstein MG, Marcus BH, Lawrence K, Pinto BM: Accuracy of recall of exercise counseling among primary care patients. Prev Med. 2004, 39 (6): 1063-1067. 10.1016/j.ypmed.2004.02.005.View ArticlePubMedGoogle Scholar
- Gerbert B, Stone G, Stulbarg M, Gullion DS, Greenfield S: Agreement among physician assessment methods. Searching for the truth among fallible methods. Med Care. 1988, 26 (6): 519-535. 10.1097/00005650-198806000-00001.View ArticlePubMedGoogle Scholar
- Wilson A, McDonald P: Comparison of patient questionnaire, medical record, and audio tape in assessment of health promotion in general practice consultations. BMJ. 1994, 309 (6967): 1483-1485. 10.1136/bmj.309.6967.1483.View ArticlePubMedPubMed CentralGoogle Scholar
- Pbert L, Adams A, Quirk M, Hebert JR, Ockene JK, Luippold RS: The patient exit interview as an assessment of physician-delivered smoking intervention: a validation study. Health Psychol. 1999, 18 (2): 183-188. 10.1037/0278-622.214.171.124.View ArticlePubMedGoogle Scholar
- Reif S, Horgan CM, Ritter GA: Treatment services: triangulation of methods when there is no gold standard. Subst Use Misuse. 2011, 46 (5): 620-632. 10.3109/10826084.2010.528119.View ArticlePubMedGoogle Scholar
- Tisnado DM, Adams JL, Liu H, Damberg CL, Chen WP, Hu FA, Carlisle DM, Mangione CM, Kahn KL: What is the concordance between the medical record and patient self-report as data sources for ambulatory care?. Med Care. 2006, 44 (2): 132-140. 10.1097/01.mlr.0000196952.15921.bf.View ArticlePubMedGoogle Scholar
- Berkman ND, Davis TC, McCormack L: Health literacy: what is it?. J Health Commun. 2010, 15 (Suppl 2): 9-19. 10.1080/10810730.2010.499985.View ArticlePubMedGoogle Scholar
- Wilson EA, Wolf MS, Curtis LM, Clayman ML, Cameron KA, Eigen KV, Makoul G: Literacy, cognitive ability, and the retention of health-related information about colorectal cancer screening. J Health Commun. 2010, 15 (Suppl 2): 116-125. 10.1080/10810730.2010.499984.View ArticlePubMedGoogle Scholar
- Sheridan SL, Halpern DJ, Viera AJ, Berkman ND, Donahue KE, Crotty K: Interventions for individuals with low health literacy: a systematic review. J Health Commun. 2011, 16 (Suppl 3): 30-54. 10.1080/10810730.2011.604391.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.