- Study protocol
- Open Access
- Open Peer Review
A cluster-randomized educational intervention to reduce inappropriate prescription patterns for elderly patients in general practice – The Prescription Peer Academic Detailing (Rx-PAD) study [NCT00281450]
BMC Health Services Researchvolume 6, Article number: 72 (2006)
Age-related alterations in metabolism and excretion of medications increase the risk of adverse drug events in the elderly. Inappropriate polypharmacy and prescription practice entails increased burdens of impaired quality of life and drug related morbidity and mortality. The main objective of this trial is to evaluate effects of a tailored educational intervention towards general practitioners (GPs) aimed at supporting the implementation of a safer drug prescribing practice for elderly patients ≥ 70 years.
Approximately 80 peer continuing medical education (CME) groups (about 600 GPs) in southern Norway will be recruited to a cluster randomized trial. Participating groups will be randomized either to an intervention- or a control group. The control group will not receive any intervention towards prescription patterns in elderly, but will be the target of an educational intervention for prescription of antibiotics for respiratory tract infections. A multifaceted intervention has been tailored, where key components are educational outreach visits to the CME-groups, work-shops, audit and feedback. Prescription Peer Academic Detailers (Rx-PADs), who are trained GPs, will conduct the educational outreach visits. During these visits, a set of quality indicators (QIs), i.e. explicit recommendations for safer prescribing for elderly patients, will be presented and discussed. Software will be handed out for installation in participants' practice computers to enable extraction of pre-defined prescription data. These data will subsequently be linked to corresponding data from the Norwegian Prescription Database (NorPD). Individual feedback reports will be sent all participating GPs during and one year after the intervention. Feedback reports will include QI-scores on individual- and group levels, before and after the intervention. The main outcome of this trial is the change in proportions of inappropriate prescriptions (QIs) for elderly patients ≥ 70 years following intervention, compared to baseline levels.
Improvement of prescription patterns in medical practice is a challenging task. Evidence suggests that a thorough evaluation of diagnostic indications for drug treatment in the elderly and/or a reduction of potentially inappropriate drugs may impose significant clinical benefits. Our hypothesis is that an educational intervention program will be effective in improving prescribing patterns for elderly patients in GP settings.
Although appropriate use of drugs may indeed be of vital importance to elderly patients, drugs represent a double-edged sword due to their potential adverse effects. Age-related changes in drug metabolism and sensitivity put frail elderly patients at particular risk for adverse drug events (ADEs) [1, 2]. The Word Health Organization (WHO) defines an ADE as a detrimental response to medication that is undesired and unintended, excluding therapeutic failure, poisoning, and intentional overdose . In the elderly, between 10 and 20% of all hospital admissions are drug-related [4–8] and also associated with a higher mortality than other reasons for hospitalization . In a comprehensive study from a large internal medical department in Norway, more than one out of six deaths were judged to be caused by the drug treatment used rather than the underlying illness . According to the WHO, rational use of drugs implicates "each patient receiving medication appropriate for his/her clinical needs, in doses meeting the related requirements, for an adequate period of time and at the lowest cost to them and to community" .
Inappropriate us of drugs commonly occur in the elderly and may imply impaired quality of life and drug related morbidity and morbidity [4, 11–15]. Problems related to GPs' lack of updated medication lists for their patients , the common practice of prescribing for patients without seeing them [17, 18], inadequate communication between physicians and community nurses regarding treatment for shared care patients , and patients' noncompliance, as well as physicians' lacking ability to understand, detect, and improve compliance, also increase the risk of medical errors and ADEs .
In the Norwegian general practice Møre & Romsdal Prescription study, Straand and Rokstad  considered 13.5% of 16774 prescriptions for elderly patients to be inappropriate. Corresponding figures have been reported by Stuck et al. , who found that 14% of 414 patients older than 75 years used at least one inappropriate drug. Willcox et al.  found that potentially inappropriate drugs were prescribed for 23.5% of 6 171 patients 65 years and older. However, the different studies apply different criteria for inappropriateness. Based on Beers criteria , Aparasu and Mort  reviewed eight studies on prescription patterns in elderly, and found that the rate of inappropriate drug use varied from 14% in community-dwelling elderly to 40.3% in nursing home residents.
Prescribing indicators for general practice have been used for more than two decades . Previous research has highlighted the importance of a critical approach to prescribing practice [23, 24], the defining and assessment of the appropriateness of prescribing [25, 26], the exploration of variations in prescribing across general practices , and the physicians' adherence to various standards . However, few validated quality indicators exist for prescribing in general practice , and published standards tend to be consensus-based rather than evidence-based.
Quality indicators (QIs) are explicitly defined and measurable items which may serve as building blocks in the assessment of care . As statements about structure, process, or outcomes they may be used to generate criteria and standards to measure specific aspects of clinical practice . Indicators differ from guidelines, review criteria, and standards and may be regarded as a kind of rules of the thumb. Primary care rarely meets absolute standards , and the development of indicators must be realistic and set according to context and patient circumstances . Indicators can measure the frequency with which an event occurs, such as prescriptions of a particular drug. However, indicators do not provide definite answers, they rather indicate potential problems. Quality measures are now increasingly being developed for primary care quality assessments and research . This development has probably been encouraged by the increased access to large health care databases, made up by automated electronic records of e.g. filled prescriptions, professional services, and hospitalizations . Linking prescription databases with various electronic patient record (EPR) systems comprising detailed information of patients' symptoms, findings and diagnoses enables a "reality-based" pharmaco-epidemiologic research, which may be useful for highlighting areas in need of quality improvements.
The identification of suboptimal practice is, however, only the first step for quality improvements. Several educational strategies have been used to improve doctors' clinical practice, but substantial effects are only rarely reported [35, 36]. Rokstad et al.  performed a controlled educational intervention towards GPs aimed at improving their prescriptions for acute cystitis and insomnia. The intervention included mailed prescription feedback along with printed therapeutic recommendations, and resulted in statistical significant (although clinically moderate) improvements in prescription patterns in the intervention group (GPs in one district), compared to the control group (GPs in another district) . Davies et al.  reviewed 777 continuous medical education (CME) studies and found evidence that educational intervention consisting of passive dissemination of clinical practice guidelines had little or no effect on practice. This corresponds with later reports by Oxman et al.  and Freemantle et al. . More active strategies, like educational outreach visits [40, 41] and multifaceted interventions , are more effective, but require more resources . In an extensive review, Jamtvedt et al.  concluded that audit and feedback may be effective in improving professional medical practice, although the effects are generally moderate, and that absolute effects of audit and feedback are more likely to be larger when baseline adherence to recommended practice is low.
Underlying reasons for deviations between clinical practice and clinical guidelines vary from one problem to another and from one physician to another . Therefore, it is recommended to address potential barriers to change when tailoring an intervention targeting change in medical performance. Because non-equivalent comparison groups may distort the results of evaluations, cluster-randomized trials (in which healthcare professionals or groups of professionals, rather than patients are randomized) are more likely to provide valid results than other research designs, such as controlled before-after or time-series studies .
We have developed an intervention aimed at improving GPs' prescribing practice for elderly (≥ 70 years) out-patients, and planned a cluster randomized controlled trial to assess the effectiveness of this intervention.
Our hypothesis is that an educational intervention program carried out during a 6-month period will be effective in improving prescribing patterns by reducing the occurrence of potentially targeted harmful drugs and drug-drug interactions in elderly patients.
Our main hypothesis will be tested using a cluster-randomized controlled trial comparing outcomes between the intervention and control groups at follow-up. Peer continuing medial education (CME) groups of GPs will be randomized to receive a tailored intervention to support a safer prescription practice for the elderly or to a control group. The control group will be assigned to another trial, namely an educational intervention for better prescription of antibiotics for respiratory tract infections . As such, the control group may also be susceptible to changes in their general prescription patterns, i.e. a possible Hawthorne effect. To control for this, we will be able to analyze prescription patterns for all Norwegian GPs not included in the current trial, using data from the Norwegian Prescription Database (NorPD), a national registry including data for all prescription drugs issued at Norwegian pharmacies, established in 2004 .
Prescription data will be collected for all eligible patients from intervention- and control group GPs at baseline and one year after the initiation of the trial. Changes in prescribing patterns will be tracked by a set of explicit recommendations (quality indicators) developed by the authors (Table 1), which will be used to analyze changes in baseline and post-intervention prescribing patterns. Degree of improvements will be measured by recording prescriptions of the particular drugs and the concurrent use of listed drug combinations that the GPs have been recommended to avoid.
In Norway, specialists in general practice have to renew their clinical specialty every five years. In this renewal process, participation in a number of peer CME group meetings is compulsory, in order to stimulate continuously medical education and reflection. All GPs participating in such peer groups, on average consisting of six to eight peers, located in southern Norway, will be invited to participate in this trial. GPs using one of the four major EPRs (Infodoc®, WinMed®, ProfDoc Vision® or System X®) are eligible for the trial. More than nine out of ten Norwegian GPs use one of these systems routinely during consultations with patients .
The intervention has been developed through a process of identifying potential harmful prescriptions to elderly; either as specific drugs and combinations of particular drugs to be avoided due to clinically relevant interactions, or the concurrent use of three or more psychotropic drugs. The identification of suboptimal pharmacological treatments to be targeted in this study, was based on previous research and active reflection and discussions based on own clinical experience from general practice. This process led to the development of a set of prescription QIs (Table 1).
In order to implement rational prescribing patterns, 13 GPs will be recruited as tutors, each with responsibility for the intervention in about three peer groups. Each tutor, named Prescription Peer Academic Detailer (Rx-PAD), will receive a four days' pre-study training program, focusing on safety issues in relation to pharmacological treatment in the elderly, pedagogical intervention techniques, and how to use the data-software for extracting data files from the EPRs. When recruiting the Rx-PADs, emphasis will be laid on economic independence from pharmaceutical manufacturers.
The tailored intervention towards the GPs in the peer CME groups will include two educational outreach visits by one Rx-PAD, discussions within the peer CME group, extraction of prescription data, audit and individual feedback reports, as well as a one day work-shop with all participants, in order to facilitate reflections on personal prescription patterns. Elements in the tailored intervention are summarized in Figure 1.
In the first outreach visit, the main elements of the intervention will be presented, with special emphasis on safer prescription strategies for elderly (≥ 70 years) out-patients, choice of first-line drugs, possible harmful effects of particular drugs, and specific drug combinations to be avoided. During the visit, a software package will be delivered to the participating GPs for installation in own practice computers. This enables data extraction from the preceding 12-month period, which will comprise baseline data used in the study. Prescription data will be collected on diskettes and analyzed by research staff, followed by an individual prescription report which will be mailed to each participant.
The second outreach visit, which will take place within two months after the first one, will focus on the disclosed individual prescription patterns in relation to the explicit recommendations provided during the first meeting. The Rx-PADs will facilitate the discussion within their peer groups, based on the individual feedback reports, enabling participants to compare own prescription patterns with overall averages. This will probably trigger discussion within the peer group, aimed at critical reflection towards own prescription strategies for elderly patients and facilitating disclosure of areas where individual improvements may be desirable.
About three months after the second outreach visit, all participants will be gathered in regional work-shops where rational pharmacological treatment for elderly out-patients ≥ 70 years will be outlined in more depth, on the basis of the baseline prescription data.
Twelve months after the first data extraction, a second data extraction addressing the preceding 12-months prescription patterns, will be made. Each GP will then get a new feedback report revealing before- and after-intervention-data in relation to the QIs and compared with average figures for the total sample. Application will be sent to The Norwegian Medical Association (NMA) to have this educational intervention approved as a so called "clinical theme-course", which will give the participants important CME credit.
Quality indicators (QIs)
In this study we have developed 14 explicit QIs regarding possible inappropriate prescription patterns to elderly out-patients ≥ 70 years, based on current knowledge and pervious research [15, 47–52] (Table 1). The face validity of the QIs will be assessed using a modified three postal round Delphi consensus technique [47, 53, 54]. The Delphi technique is a structured interactive method involving repetitive administration of anonymous questionnaires, usually across two or three postal rounds . There is limited evidence of the content validity of quality measures derived using the Delphi technique [53, 55]. Still, the Delphi procedure has been used for validating the relevance of prescribing indicators , i.e. concerning GP's prescribing of non-steroidal anti-inflammatory drugs , as well as indicators for patient and general practitioner perspectives of chronic illness , and indicators for cardiovascular disease . We will recruit a panel of health professionals (GPs, clinical pharmacologists and geriatricians; about 20 in each group) to rate the face validity of our proposed QIs. Also, the participating GPs will be invited to assess their interpretation of the QIs used in this study by the end of the six-month educational intervention. This will be made by filling in a questionnaire where the relevance of each QI may be scored on a visual-analogue scale.
Software aimed at extracting predefined data sets will be developed for this trial. The software will be compatible with the four electronic patient record (EPR) systems (Infodoc®, WinMed®, ProfDoc Vision® or System X®) used by the waste majority of Norwegian GPs. In addition we will provide technical telephone support during the whole data collection period. The participants will get a deadline for sending their data sets, before they are able to receive an individual feedback report, and the Rx-PAD will remind their group to send data sets before the second peer group meeting.
Data extraction will provide information on contacts with patients and prescriptions issued. Prescription data will be described in terms of The Anatomical, Therapeutic, Chemical (ATC) classification system with Defined Daily Doses (DDDs), in short: the ATC/DDD system .
In order to merge prescription data provided by NorPD with data from the EPR systems, the Civil Personal Registration (CPR) number for each patient will be extracted from the EPR. These are the unique identification numbers for Norwegian citizens, and will be deleted from the research database after the record linkage has been performed. The dataset from NorPD will provide data on drugs actually dispensed.
Extracted data from the EPR will be encrypted, stored on a diskette and mailed to the principal researcher. A flow-chart of the data collection is summarized in Figure 2.
Primary outcome measures will be changes in prescription patterns after the tailored educational intervention regarding the listed QIs (Table 1). Post-intervention prescription data will be collected one year after the collection of the baseline prescription data. Prescription patterns in the intervention group will be compared with the non-intervention control group, and with corresponding data (from NorPD) based on a random sample of Norwegian GPs not included in the current trial.
In addition to investigating changes in each QI, we will summarize changes for all QIs (Table 1), in order to give a total sum score for improvement potentials. The difference in total QI sum score between the intervention group and the control group will be a main outcome measure. The QI regarding regular use of the EPR function showing patient's total regular medications will not be included in this sum score. Outcome measures are summarized in Table 2.
It would also be interesting to investigate if this intervention may influence all-over mortality patterns for elderly patients targeted during this intervention as compared to corresponding elderly patients in the control group . By 2006, death data are not yet included in the NorPD, but efforts are currently undertaken to include such data in the NorPD on a regular basis. A possible mortality study has not yet been elaborated in details, but this will be considered.
Recruitment and randomization
Block-randomization of peer groups will be done within geographical strata, each comprised of one or more counties. The size of the blocks will vary according to the number of recruited groups within each stratum. An independent researcher not involved in the study will be responsible for the randomization. Based on this randomization, peer CME groups will be assigned to either the intervention group or the control group.
With the exception of the one-day CME-course, the intervention will be piloted in one CME group before the main trial.
Ethics and data security
Physicians participating in the peer CME groups will be given information about the objectives of the study and the practical implications this may have on their practice. They will be told that each peer CME group will be randomized to one out of two interventions (improved prescription patterns towards elderly ≥ 70 years, or improved antibiotic prescriptions for respiratory tract infections), and that they will serve as control-group for the intervention they do not take part in. Participation and data extraction are based on written, informed consent from all physicians. The aim of this study is improved quality according to well established principles for good clinical practice and should therefore not imply risks for the patients involved, and we find it unlikely that the current intervention might worsen the quality of care. The project has been presented for The Regional Committee for Research Ethics and approval from The Norwegian Social Science Data Services (NSD) has been obtained, implicating acceptance to extract prescription data. We have assessed the risk for misusing the collected data, and found this unlikely due the fact that the data are linked to de-identified ID numbers. In order to use patient identification data in the record linkage of the NorPD and EPR databases, The Norwegian Directorate for Health and Social Affairs have approved a dispensation from the Health-Professional Secrecy regulations.
Sample size and statistics
In a pilot study (including 13 physicians) for the present study, the mean number of positive hits on our listed QIs (Table 1) made up 25 hits per 100 elderly patients during the preceding 12 months period. In accordance with this finding, we anticipate an occurrence of inappropriate prescription of about 25 hits per 100 elderly patients in the present study.
Proving a clinical relevant reduction from 25 to 17 hits or less per 100 patients (32% relative reduction), assuming that the prevalence of inappropriate prescriptions in the control group remains constant, will imply a need for 74 peer groups in total (power of 80%; statistical significance level of 5%). This estimation takes into account the need to adjust for intra-cluster correlation, since data within the peer CME groups cannot be assumed to be independent. Furthermore, we assume the average number of GPs per peer CME group to be 7 (allowing for some withdrawals) and that the average number of patients ≥ 70 years per participating GP during the study period will be 165. Based on previous studies [46, 58], the intracluster correlation coefficient is assumed to be 0.085, resulting in a variance inflation factor of 99 .
We will carry out post-test comparisons between the intervention and control group using cluster-adjusted chi-square and t-tests. Analysis of covariance may be used to adjust for imbalance of baseline levels between the intervention- and control-groups . The data set will primarily be analyzed according to the cluster randomization, however, analyzes at physician- and sub-groups of physicians as well as compared to NorPD-data for GPs not participating in the study, will also be performed.
Fried L, Walston J: Frailty and failure to thrive. Principles of Geriatric Medicine and Gerontology. Edited by: Hazzard WH, Blass JP, Ettinger WH, Halter JB and Ouslander JG. 1999, New York, McGraw-Hill, 1387-1402. 4th
Turnheim K: Drug dosage in the elderly. Is it rational?. Drugs Aging. 1998, 13: 357-379. 10.2165/00002512-199813050-00003.
WHO: The role of the hospital. 1969, , Tec Rep Ser, 425:5-24.
Atkin PA, Veitch PC, Veitch EM, Ogle SJ: The epidemiology of serious adverse drug reactions among the elderly. Drugs Aging. 1999, 14: 141-152. 10.2165/00002512-199914020-00005.
Beard K: Adverse reactions as a cause of hospital admission in the aged. Drugs Aging. 1992, 2: 356-367.
Sarlov C, Andersen-Karlsson E, von Bahr C: [Adverse effects of drugs in patients with heart disease lead to hospital care]. Lakartidningen. 2001, 98: 5349-5353.
Beijer HJ, de Blaey CJ: Hospitalisations caused by adverse drug reactions (ADR): a meta-analysis of observational studies. Pharm World Sci. 2002, 24: 46-54. 10.1023/A:1015570104121.
Mjorndal T, Boman MD, Hagg S, Backstrom M, Wiholm BE, Wahlin A, Dahlqvist R: Adverse drug reactions as a cause for admissions to a department of internal medicine. Pharmacoepidemiol Drug Saf. 2002, 11: 65-72. 10.1002/pds.667.
Ebbesen J, Buajordet I, Erikssen J, Brors O, Hilberg T, Svaar H, Sandvik L: Drug-related deaths in a department of internal medicine. Arch Intern Med. 2001, 161: 2317-2323. 10.1001/archinte.161.19.2317.
WHO: The problems of drug therapy in the elderly, http://www.euro.who.int/docoment/WT166B.pdf. 2004
Lazarou J, Pomeranz BH, Corey PN: Incidence of adverse drug reactions in hospitalized patients: a meta-analysis of prospective studies. Jama. 1998, 279: 1200-1205. 10.1001/jama.279.15.1200.
Hanlon JT, Schmader KE, Ruby CM, Weinberger M: Suboptimal prescribing in older inpatients and outpatients. J Am Geriatr Soc. 2001, 49: 200-209. 10.1046/j.1532-5415.2001.49042.x.
Lacoste-Roussillon C, Pouyanne P, Haramburu F, Miremont G, Begaud B: Incidence of serious adverse drug reactions in general practice: a prospective study. Clin Pharmacol Ther. 2001, 69: 458-462. 10.1067/mcp.2001.116145.
Ruths S, Straand J, Nygaard HA: Psychotropic drug use in nursing homes--diagnostic indications and variations between institutions. Eur J Clin Pharmacol. 2001, 57: 523-528. 10.1007/s002280100348.
Straand J, Rokstad KS: Elderly patients in general practice: diagnoses, drugs and inappropriate prescriptions. A report from the More & Romsdal Prescription Study. Fam Pract. 1999, 16: 380-388. 10.1093/fampra/16.4.380.
Rognstad S, Straand J: [Do general practitioners know what medication community nurses give their shared patients?]. Tidsskr Nor Laegeforen. 2004, 124: 810-812.
Willcox SM, Himmelstein DU, Woolhandler S: Inappropriate drug prescribing for the community-dwelling elderly. Jama. 1994, 272: 292-296. 10.1001/jama.272.4.292.
Straand J, Rokstad K: General practitioners' prescribing patterns of benzodiazepine hypnotics: are elderly patients at particular risk for overprescribing? A report from the More & Romsdal Prescription Study. Scand J Prim Health Care. 1997, 15: 16-21.
Eraker SA, Kirscht JP, Becker MH: Understanding and improving patient compliance. Ann Intern Med. 1984, 100: 258-268.
Stuck AE, Beers MH, Steiner A, Aronow HU, Rubenstein LZ, Beck JC: Inappropriate medication use in community-residing older persons. Arch Intern Med. 1994, 154: 2195-2200. 10.1001/archinte.154.19.2195.
Aparasu RR, Mort JR: Inappropriate prescribing for the elderly: beers criteria-based review. Ann Pharmacother. 2000, 34: 338-346. 10.1345/aph.19006.
Prescribing Support Unit PSU: Prescribing measures and application. An explanation. 1998, Leeds.
Roland M, Holden J, Campbell S: Quality assessment for general practice: supporting clinical governance in primary care groups. 1998, Manchester, National Primary Care Research and Development Centre
Campbell SM, Roland MO, Quayle JA, Buetow SA, Shekelle PG: Quality indicators for general practice: which ones can general practitioners and health authority managers agree are important and how useful are they?. J Public Health Med. 1998, 20: 414-421.
Buetow SA, Sibbald B, Cantrill JA, Halliwell S: Appropriateness in health care: application to prescribing. Soc Sci Med. 1997, 45: 261-271. 10.1016/S0277-9536(96)00342-5.
Cantrill JA, Sibbald B, Buetow S: Indicators of the appropriateness of long-term prescribing in general practice in the United Kingdom: consensus development, face and content validity, feasibility, and reliability. Qual Health Care. 1998, 7: 130-135.
Avery AJ, Heron T, Lloyd D, Harris CM, Roberts D: Investigating relationships between a range of potential indicators of general practice prescribing: an observational study. J Clin Pharm Ther. 1998, 23: 441-450. 10.1046/j.1365-2710.1998.00187.x.
Bateman DN, Eccles M, Campbell M, Soutter J, Roberts SJ, Smith JM: Setting standards of prescribing performance in primary care: use of a consensus group of general practitioners and application of standards to practices in the north of England. Br J Gen Pract. 1996, 46: 20-25.
Campbell SM, Cantrill JA, Roberts D: Prescribing indicators for UK general practice: Delphi consultation study. Bmj. 2000, 321: 425-428. 10.1136/bmj.321.7258.425.
Campbell SM, Braspenning J, Hutchinson A, Marshall M: Research methods used in developing and applying quality indicators in primary care. Qual Saf Health Care. 2002, 11: 358-364. 10.1136/qhc.11.4.358.
McGlynn EA, Asch SM: Developing a clinical performance measure. Am J Prev Med. 1998, 14: 14-21. 10.1016/S0749-3797(97)00032-9.
Seddon ME, Marshall MN, Campbell SM, Roland MO: Systematic review of studies of quality of clinical care in general practice in the UK, Australia and New Zealand. Qual Health Care. 2001, 10: 152-158. 10.1136/qhc.0100152...
Marshall M, Campbell SM: Introduction to quality assessment in general practice. Quality indicators for general practice: a practical guide for health professionals and managers. Edited by: Marshall M, Campbell SM, Hacker J and Roland MO. 2002, London, Royal Society of Medicine, 1-6.
Arana A, Rivero E, Egberts TCG: What do we show and who does so? An analysis of the abstracts presented at the 19th ICPE. Pharmacoepidemiol Drug Saf. 2004, S330-331.
Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, Grilli R, Harvey E, Oxman A, O'Brien MA: Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001, 39: II2-45. 10.1097/00005650-200108002-00002.
Oxman AD, Thomson MA, Davis DA, Haynes RB: No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. Cmaj. 1995, 153: 1423-1431.
Rokstad K, Straand J, Fugelli P: Can drug treatment be improved by feedback on prescribing profiles combined with therapeutic recommendations? A prospective, controlled trial in general practice. J Clin Epidemiol. 1995, 48: 1061-1068. 10.1016/0895-4356(94)00238-L.
Davis DA, Thomson MA, Oxman AD, Haynes RB: Evidence for the effectiveness of CME. A review of 50 randomized controlled trials. Jama. 1992, 268: 1111-1117. 10.1001/jama.268.9.1111.
Freemantle N, Harvey EL, Wolf F, Grimshaw JM, Grilli R, Bero LA: Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2000, CD000172.
Thomson O'Brien MA, Oxman AD, Davis DA, Haynes RB: Educational outreach visits: effects on professional practice and health care. Cochrane Library. 2001, Oxford, Update Software, 4.
Jamtvedt G, Young JM, Kristoffersen DT, Thomson O'Brien MA, Oxman AD: Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2003, CD000259.
Oxman AD, Flottorp S: An overview of strategies to promote implementation of evidence based health care. Evidence Based Practice. Edited by: Silagy C and Haines A. 2001, London, BMJ Books, 101-109. 2nd
Campbell MK, Steen N, Grimshaw JM, Eccles M, Mollison J, Lombard C: Design and statistical issues in implementation research. Changing Professional Practice. Edited by: Thorsen T and Mäkelä M. 1999, Chopenhagen, Danish Institute for Health Services Research and Development
Gjelstad S, Fetveit A, Straand J, Dalen I, Rognstad S, Lindbaek M: Study Protocol: Can antibiotic prescriptions in respiratory tract infections be improved? A cluster randomized educational intervention in general practice - The Prescription Peer Academic Detailing (Rx-PAD) Study [NCT00272155]. Submitted. 2006
NorPD: . 2005, Oslo, Norway, Norwegian Prescription Database, Norwegian Institute of Public Health, www.fhi.no
Fretheim A, Oxman AD, Treweek S, Bjorndal A: Rational Prescribing in Primary Care (RaPP-trial). A randomised trial of a tailored intervention to improve prescribing of antihypertensive and cholesterol-lowering drugs in general practice [ISRCTN48751230]. BMC Health Serv Res. 2003, 3: 5-10.1186/1472-6963-3-5.
Rasmussen HM, Sondergaard J, Kampmann JP, Andersen M: General practitioners prefer prescribing indicators based on detailed information on individual patients: a Delphi study. Eur J Clin Pharmacol. 2005, 61: 237-241. 10.1007/s00228-004-0870-9.
Ruths S, Straand J, Nygaard HA: Multidisciplinary medication review in nursing home residents: what are the most significant drug-related problems? The Bergen District Nursing Home (BEDNURS) study. Qual Saf Health Care. 2003, 12: 176-180. 10.1136/qhc.12.3.176.
Beers MH: Explicit criteria for determining potentially inappropriate medication use by the elderly. An update. Arch Intern Med. 1997, 157: 1531-1536. 10.1001/archinte.157.14.1531.
McLeod PJ, Huang AR, Tamblyn RM, Gayton DC: Defining inappropriate practices in prescribing for elderly people: a national consensus panel. Cmaj. 1997, 156: 385-391.
Fick DM, Cooper JW, Wade WE, Waller JL, Maclean JR, Beers MH: Updating the Beers criteria for potentially inappropriate medication use in older adults: results of a US consensus panel of experts. Arch Intern Med. 2003, 163: 2716-2724. 10.1001/archinte.163.22.2716.
Sosialstyrelsen: [Uppfõljning av ãldres lãkemedelsãnvendning]. 2004, , Svenska Socialstyrelsen
Hasson F, Keeney S, McKenna H: Research guidelines for the Delphi survey technique. J Adv Nurs. 2000, 32: 1008-1015. 10.1046/j.1365-2648.2000.01567.x.
Fink A, Kosecoff J, Chassin M, Brook RH: Consensus methods: characteristics and guidelines for use. Am J Public Health. 1984, 74: 979-983.
Campbell SM, Cantrill JA: Consensus methods in prescribing research. J Clin Pharm Ther. 2001, 26: 5-14. 10.1046/j.1365-2710.2001.00331.x.
Normand SL, McNeil BJ, Peterson LE, Palmer RH: Eliciting expert opinion using the Delphi technique: identifying performance indicators for cardiovascular disease. Int J Qual Health Care. 1998, 10: 247-260. 10.1093/intqhc/10.3.247.
WHO: The ATC/DDD system. 2005, , WHO Collaborating Centre for Drug Statistics Methodology
Flottorp S, Oxman AD, Havelsrud K, Treweek S, Herrin J: Cluster randomised controlled trial of tailored interventions to improve the management of urinary tract infections in women and sore throat. Bmj. 2002, 325: 367-10.1136/bmj.325.7360.367.
Donner A, Birkett N, Buck C: Randomization by cluster. Sample size requirements and analysis. Am J Epidemiol. 1981, 114: 906-914.
Vickers AJ, Altman DG: Statistics notes: Analysing controlled trials with baseline and follow up measurements. Bmj. 2001, 323: 1123-1124. 10.1136/bmj.323.7321.1123.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/6/72/prepub
Atle Fretheim and Signe Flottorp from the Norwegian Knowledge Centre for the Health Services, Hanne Strøm and Kari Furu from the NorPD and Trine Bjørner from the Department of General Practice and Community Medicine provided important input during the planning of the study.
SG has interests in Mediata Ltd, which has developed the software for the project. The other authors declare that they have no competing interests.
JS had the original idea for the study and made the first draft of the study protocol (in Norwegian). AF prepared the current manuscript in cooperation with the authors. All authors have participated in the planning of the study and have approved the final version of this manuscript.