- Study protocol
- Open Open Peer Review
Preventing hospital admissions by reviewing medication (PHARM) in primary care: design of the cluster randomised, controlled, multi-centre PHARM-study
BMC Health Services Researchvolume 11, Article number: 4 (2011)
Medication can be effective but can also be harmful and even cause hospital admissions. Medication review or pharmacotherapy review has often been proposed as a solution to prevent these admissions and to improve the effectiveness and safety of pharmacotherapy. However, most published randomised controlled trials on pharmacotherapy reviews showed no or little effect on morbidity and mortality. Therefore we designed the PHARM (Preventing Hospital Admissions by Reviewing Medication)-study with the objective to study the effect of the total pharmaceutical care process on medication related hospital admissions and on adverse drug events, survival and quality of life.
The PHARM-study is designed as a cluster randomised, controlled, multi-centre study in an integrated primary care setting. Patients with a high risk of a medication related hospital admission are included in the study with randomisation at GP (general practitioner) level. We aim to include 14200 patients, 7100 in each arm, from at least 142 pharmacy practices.
The intervention consists of a patient-centred, structured, pharmaceutical care process. This process consists of several steps, is continuous and occurrs over multiple encounters of patients and clinicians. The steps of this pharmaceutical care process are a pharmaceutical anamnesis, a review of the patient's pharmacotherapy, the formulation and execution of a pharmaceutical care plan combined with the monitoring and follow up evaluation of the care plan and pharmacotherapy. The patient's own pharmacist and GP carry out the intervention. The control group receives usual care.
The primary outcome of the study is the frequency of hospital admissions related to medication within the study period of 12 months of each patient. The secondary outcomes are survival, quality of life, adverse drug events and severe adverse drug events. The outcomes will be analysed by using mixed-effects Cox models.
The PHARM-study is one of the largest controlled trials to study the effectiveness of the total pharmaceutical care process. The study should therefore provide evidence as to whether such a pharmaceutical care process should be implemented in the primary care setting.
Trial number: NTR 2647
Drug regulatory authorities give a medicine marketing authorisation if the balance between efficacy and safety is considered positive, based on the available evidence in the studied population. On the level of the individual patient treated with one or more drugs in daily clinical practice, it is, however, hard to predict whether the positive effects outweigh the negative effects. Individual (patho)physiological and psychological characteristics of the patient, concomitantly used medication as well as the treatment setting, can largely modulate pharmacokinetics, pharmacodynamics and behaviour of the patient and thereby treatment outcomes. Unfortunately for some patients the net effect of pharmacotherapy is not positive but harmful. For example, several studies have shown that 3-5% of all hospital admissions is medication related.
The Dutch multi-centre HARM-study on medication-related hospital admissions, showed that almost half (46%) of these admissions were considered as potentially preventable admissions. Patients who were especially at risk of medication-related admissions were elderly patients with multiple drug use, who are cognitively impaired or who are non-adherent to their pharmacotherapy[1–5].
Medication review or pharmacotherapy review has often been proposed as a solution to improve the effectiveness and safety of pharmacotherapy. However, most published randomised controlled trials on pharmacotherapy reviews showed no or little effect on morbidity and mortality[6, 7]. These studies differed largely with respect to the nature and extensiveness of the review techniques, the outcomes studied, setting and follow-up time and results are therefore difficult to compare. One study reported an increase in emergency readmissions, while in the other studies there is no suggestion that patients were harmed by the interventions[9, 10], and even some consistency in suggesting that falls and hospital admissions[12, 13] might be reduced. Potentially relevant elements in these studies were a review of a fully available medical and drug history, structured pharmaceutical care plan approach, combined effort of pharmacist and GP and involvement and commitment of the patient.
Hence there is still a need for large studies to evaluate the effectiveness of a so called patient centred pharmaceutical care process, including reviewing pharmacotherapy, formulating a pharmaceutical care plan and monitoring and follow up evaluating of pharmacotherapy, in daily practice of an integrated primary care setting. Therefore we designed the PHARM-study with the objective to study the effect of the total pharmaceutical care process on medication related hospital admissions and on adverse drug events, survival and quality of life in patients with a high risk of medication related hospital admissions. This study is a practice based, cluster randomised controlled intervention study in an integrated primary care setting in the Netherlands. The study design with its explanation and definition of the different steps in of the pharmaceutical care process will be described in this paper. The results of the study will be presented in a separate paper.
Only patients at high risk for a medication-related hospital admission are included in the study. To identify these patients we used risk factors from the HARM study as inclusion criteria. This resulted in four criteria regarding age, polypharmacy, type of drug class used and non-adherence. (See table 1 for detailed information on inclusion criteria) Patients could be included if they met all four of these criteria
The number of included patients is limited to the capacity of the GP and the pharmacist. If too many patients are eligible for inclusion, random selection by computer based on patient serial number, is used within the eligible group of one GP and pharmacist, to comply with the limit. The pharmacist and GP both can include patients in 2008 and 2009, with a follow-up period of 12 months.
Patients are excluded if they are resident in a nursing home, if their life expectancy is less than three months or if they will not give informed consent. Patients have to be withdrawn from the study when they are no longer a patient of the participating GP or pharmacist. This is possible when a patient moves to another area or to a nursing home or when a patient withdraws his/her informed consent.
The study is conducted in agreement with the principles of the Declaration of Helsinki (Edinburgh 2000) and was approved by the medical ethical review board of METOPP (Medisch-Ethische Toetsing Onderzoek Patiënten en Proefpersonen). The patient's pharmacist explains the procedure, possible benefit and burden of participation in the study to each patient and provides an informed consent form approved by METOPP. The patient is asked to sign the form prior to inclusion into the study. Patient data from this study are coded by the patient's own pharmacist. Analysing and publication of the results of this study will be performed anonymously.
The study is carried out from 2008 to 2010 in an integrated primary care setting, by the patient's own GP, pharmacist and practice nurse if available. All Dutch GPs, practice nurses and pharmacists working in primary care will be informed about the study and invited to participate by mail, by websites, by several articles in pharmacy and GP journals and by several presentations at regional meetings or at national symposia. They are asked to cooperate as a group of at least one pharmacist and at least two GPs. This cooperation includes sharing data from electronic medical records required for the study. The GPs are allocated as an intervention GP or a control GP, by random selection.
Before and during the intervention period the GP and the pharmacist are offered support by training, education and a web based community of practice with a helpdesk on pharmacotherapy. The web-based community of practice offers a place of sharing information and experiences within the group of participants, provides all materials for the study and establishes for the researchers a place to encourage and support the participants and monitor the progress of the study. The pharmacist receives training on communication skills focussing on the pharmaceutical anamnesis, motivation of patients and communicating with the GP. The GP and the pharmacist participate together in at least three workshops on the study protocol, assessment of pharmacotherapy and the assessment of adverse drug events. The helpdesk is managed by a clinical pharmacist with support of experts on pharmacotherapy, medication safety and care of the elderly.
The GP from the control patients does not received any additional training or support, other than generally in usual care.
The intervention consists of a patient-centred, structured, pharmaceutical care process. This process consists of several steps, is continuous and occurs over multiple encounters of patients and clinicians. The steps of this pharmaceutical care process are a pharmaceutical anamnesis, a review of the patient's pharmacotherapy, the formulation and execution of a pharmaceutical care plan to combine with the monitoring and follow up evaluation of the care plan and pharmacotherapy (see figure 1).
The purpose of the pharmaceutical anamnesis is to gather information from the patient and its drug therapy. The anamnesis is performed by the pharmacist who meets the patient at home or in a private consultation room at the pharmacy or at the GP practice. During the pharmaceutical anamnesis the patient's medication use and experiences therewith are discussed, including the patient's current pharmacotherapy, drug history, drug use, possible allergies or intolerabilities and concomitant use of OTC drugs or other health products, but also the patient's beliefs, perceptions, understandings, attitudes, and concerns of the pharmacotherapy.
The purpose of the pharmacotherapy review is to identify potential drug therapy related problems, and pharmaceutical care issues. A pharmaceutical care issue is defined as an element of a patient's drug related need, which can lead to a drug therapy related problem. We define a drug therapy related problem as any undesirable event or risk thereof, experienced by the patient that involves or is suspected to involve pharmacotherapy and that actually or potentially interferes with the desired patient outcome[15, 16]. The pharmacist identifies these possible drug therapy related problems (DTPs) by combining sociological, pathophysiological and pharmacological knowledge of the patient in a systematic way. This structure is derived from the classification by Strand et al. as defined and described in table 2 and in table 3. The pharmaceutical care issues are described in table 4.
Pharmaceutical care plan
The purpose of the pharmaceutical care plan is to organize all of the pharmaceutical care agreed upon by the pharmacist, the GP, the practice nurse and the patient to achieve the goals of pharmacotherapy by addressing, resolving and preventing drug therapy problems. Together they formulate a care plan and the pharmacist specifically is responsible for the monitoring and the follow-up evaluation of the care plan and pharmacotherapy.
After establishing the drug therapy problems they are categorized based on a medical condition and on the drug therapy. When multiple drug therapy problems are present, they are prioritized based on the patient's perspective, focussing on those that causes the most concern and which one the patient is willing to address. The next step is to set the goals of the drug therapy and to agree on the interventions to achieve these goals. The interventions include start, stop or switch drug therapy, adjusting the dosage regimens or formulation, monitoring of drug therapy, referral to other clinician and individualized patient counselling and education. All these interventions are documented in the pharmaceutical care plan with detailed information on who is responsible for a certain action (GP, pharmacist or practice nurse), when the action will be taken and when it will be evaluated.
Monitoring and follow-up evaluation of care plan and pharmacotherapy
The focus of the monitoring and follow-up evaluation of pharmacotherapy is on the implementation of the pharmaceutical care plan. The pharmacist, the GP and if needed the patient, verify if all planned interventions are completed and they examine the outcomes of the documented drug therapy problems. They also assess if the goals of drug therapy are achieved. At this evaluation moment it is possible to plan new interventions to achieve previously documented goals of therapy or to solve previously identified drug therapy problems. The pharmacist documents the outcomes and possible new interventions in the care plan.
Patients in the control group receive usual care from their GP, pharmacist, practice nurse and other primary health care staff. This care consists of repeat prescriptions and medication surveillance according to the current clinical guidelines.
The primary outcome of the study is the frequency of hospital admissions related to medication within the study period of 12 months of each patient. Two independent clinical pharmacists assess all admissions for a causal relationship between the reason for admission and the medication use, prior to the admission. This is done by reviewing the, blinded, discharge letter combined with the medical and medication data from an electronic Case Report Form (CRF), according to the adjusted Kramer algorithm.
The secondary outcomes are survival, quality of life, adverse drug events and severe adverse drug events. The quality of life is measured by the EuroQol EQ5D combined with the VAS (visual analogue scale) questionnaire at the start of the inclusion period and at the end of the inclusion period, after 12 months. The pharmacist and the GP ask the patient at the end of the study period about symptoms of the past 3 months. They report and assess the adverse drug events according to the adjusted Kramer algorithm combined with National Coordinating Council for Medication Error Reporting and Prevention (NCC MERP) scheme for categorisation of the severity of the events.
Other outcomes are the frequency and type of drug therapy problems (table 2) as documented in the pharmaceutical care plans over the intervention period. Two independent pharmacists code from the care plans, all the drug therapy problems, the proposed and executed intervention combined with the drug therapy. They meet to reach consensus when needed.
We expect to achieve an effect of 50% reduction of medication-related hospital admissions[2, 20]. It seems possible to include 50 intervention patients from one intervention GP and 50 control patients from one control GP in one pharmacy practice, in a period of 12 months with a follow-up period of 12 months. To show a statistically significant difference between the intervention and the control arm with an expected prevalence of 0.01 (1%), we plan to include 14200 patients, 7100 in each arm, from at least 142 pharmacy practices and at least 284 GP practices to participate in the PHARM-study[21, 22]. This is based on an alpha of 0.05 and a power (1-beta) of 0.8. It should be noted that the prevalence of HARM is expected to be higher in the group eligible for inclusion in the study.
Distribution of inclusion criteria
To determine the size of the population at risk and therefore eligible for inclusion, we searched the 'Kring-kubus-database'. This database contains anonymous drug dispensing data from 100 (5.5%) community pharmacies, spread throughout the Netherlands, belonging to the franchise organization 'Kring-apotheek' (n = 330). In the Dutch community pharmacies, the drug history of individual patients can be considered as nearly complete because most patients visit only one single pharmacy. This database includes drug-dispensing data from 719,022 patients with patient related information (age, sex, unique anonymous identifier), information on the dispensed drug (chemical substance coded according to the Anatomical Therapeutic Chemical (ATC) system and dispensed product), date of dispensing, amount dispensed and prescribed dosage regimen. Patients who complied with the defined risk factors and therefore with the inclusion criteria as well (table 1), were selected from the database by using Microsoft Access. The use of the drug-dispensing data was performed in compliance with the Dutch privacy regulations.
We found that in an average pharmacy practice 6.4% (range: 1.5 - 15.0%) of the patients had a high risk of being admitted to hospital with a medication-related cause, according to the HARM-risk model. In an average Dutch pharmacy practice the size of this high-risk population was around 450 patients, enough eligible patients for participating in the PHARM-study. The type of drug (ATC class A; alimentary tract and metabolism or ATC class B; blood and blood forming organs) risk factor was the most common risk factor in the population of a pharmacy: 37.2% (range: 23.8 - 48.8%), while non-adherence was the smallest risk factor in the population of a pharmacy: 22.4% (range: 15.6 - 37.7%). The relative numbers of high risk patients per risk factor in the Dutch pharmacies and the distribution of these risk factors are presented in the box plots in figure 2. The numbers of high-risk patients per risk factor and the overlap between the risk factors are presented in the Venn diagram in figure 3.
Cluster randomisation takes place after informed consent of the participating GPs and pharmacists on a GP level and before the selection of patients. For every pharmacist a random selection of the intervention GP is made. The other participating GP becomes the GP who will include control patients.
From each included patient data are collected in an electronic CRF containing: patient data, medical history and complaints, clinical data, quality of life and visual analogue scale, drug history with drug-allergies and drug-intolerabilities and a part with information on hospital admissions and adverse drug events. Detailed information on the data collected in the CRF can be found in table 5. The pharmacist and the GP complete the CRF with data from the pharmacy database, the GP database and from the interview with the patient. The collected data are based on literature and present guidelines[26–28].
For the intervention patients the CRF also contains a separate part for documenting the pharmacotherapy review, the pharmaceutical care plan and monitoring and follow up evaluation of pharmacotherapy. In this plan information is organised according to drug therapy related problems with the Subjective-Objective-Assessment-Plan (SOAP) notes method. The assessment and evaluation of the different drug therapy problems are subsequently documented and prioritised and the subsequent interventions are documented with specific information on who of the clinicians is taking the action, when the action is taken and when the action is evaluated.
Data from the digital Excel CRF and from a Microsoft Access database are combined and further analysed by using R, version 2.6.2. In R mixed-effects Cox models are designed to study the effect of the intervention on hospital admissions related to medication and the effect on survival, quality of life and adverse drug events. All available patient data are included. The pharmacist and the GP are integrated as random effects in the models. P-values < 0.05 are regarded as statistically significant. The two-sided 95% bootstrap percentile confidence intervals are computed using 1000 replications. Bootstrap samples are obtained by random sampling GP's or patients with replacement from the population. To assess the model's goodness of fit we create plots of outcome versus follow-up time, versus number of diseases and examined residuals. The influence of the baseline characteristics such as age, gender, number of physicians, number of diseases, number of drug prescribed, refill rate and follow-up time are also analysed using linear mixed-effects models or generalized linear mixed-effects models.
The PHARM-study looks into the effect of the complex pharmaceutical care process on medication related hospital admissions. This patient centred pharmaceutical care process is highly patient individualized, includes several steps (figure 1) and is conducted in a primary care setting. This care process can only be partly structured in a study protocol because it is dependent on patients' autonomy, the performance of the clinicians and on the cooperation between them. These issues cannot be completely restrained to a protocol and will be a reflection of real clinical practice. In the PHARM-study the effectiveness of the pharmaceutical care process will be studied in daily clinical practice and due to this the study is a pragmatic trial. Such a trial is suitable to evaluate effectiveness rather than to measure efficacy.
A key methodological issue in pragmatic trials is balancing internal and external validity. This issue is addressed for the PHARM-study in the study design and evaluation protocol. External validity, or generalizability, is achieved by allowing the GPs and the pharmacists to implement the intervention in their own manner within their daily practice. External validity is also addressed by having very few exclusion criteria and general inclusion criteria. The included high-risk patients are a heterogeneous group, with multiple and varying morbidities and medication usage. Internal validity is maintained by selecting intervention patients from another general practitioner than the control patients, to reduce contamination bias by ensuring that GPs do not apply strategies and knowledge used in the intervention patients to control patients.
We expect this study to have several other strengths besides internal and external validity. First, we have gained experience during several previous pilot projects and because of this we were able to optimize the intervention by providing a structure for the pharmacotherapy review. We have also optimized the CRF for documentation of the pharmaceutical care and the planned intervention in drug therapy to guarantee the continuity of care. Since pharmacotherapy and medical services become more complex, creating a comprehensive documentation is required to facilitate collaboration between members of the health care team and ensure continuity of care. Second, the pharmacist and the GP are offered a training regarding the study protocol, the documentation and how to perform a structured pharmacotherapy review. A third strength is the large group of patients, which makes it possible to measure a possible effect on medication related hospitalisations. A fourth strength is the extensive intervention during a period of 12 months in an interdisciplinary setting in cooperation between the patient and the own GP and pharmacist, which makes it more likely to solve all major drug therapy problems.
This study also has some limitations. First, selection bias may occur by just including patients who are willing to cooperate in the intervention. However, the same selection will take place in the control group because they also have to cooperate in completing the questionnaires. Second the selection of the participating pharmacist and GPs is based on voluntary participation. Only motivated couples of GPs and a pharmacist who established a good cooperation will participate in the study, which hampers the generalizability. But in case the intervention shows an effect, these participating GPs and pharmacists can be a role model for their colleagues in the region. A third limitation is the extensive and therefore demanding intervention. It is thinkable that it will not be implemented as described in the protocol because this is not possible or feasible in daily practice. A fourth limitation is the selection of intervention and control patients on a general practice level but from the same pharmacy which implies that control patients are cared for by the same pharmacist as the intervention patient. This possibly leads to contamination bias, but we do not expect that the pharmacist will provide other care than usual care to the control patients. A fifth limitation is the assessment of the ADEs which will be done by the patient's own pharmacist and GP who are not blinded to the assignment to intervention or control group. Knowing to which group the patient is assigned, may possibly affect their judgement of ADEs, which can potentially lead to the detection of more ADEs in the control group. On the other hand an advantage may be that they know their patients so they can make a better judgement if the symptoms are related to the medication or to a disease.
The PHARM-study is one of the largest controlled trials to study the effect of the total pharmaceutical care process, including a pharmaceutical anamnesis, followed by a pharmacotherapy review, a pharmaceutical care plan, monitoring and follow up evaluation of pharmacotherapy, in an ordinary integrated primary care setting on medication related hospital admissions. Few controlled trials in this area have been performed and none have investigated the extensive intervention of the total pharmaceutical care process, performed in cooperation of the patient, the pharmacist, the GP and the practice nurse, in this group of high risk patients, at the scale of this study either in terms of the number of practices or the number of patients. The PHARM-study should provide evidence as to whether such a pharmaceutical care process should be implemented in a primary care setting in the Netherlands.
Leendertse AJ, Visser D, Egberts ACG, van den Bemt PMLA: The relationship between study characteristics and the prevalence of medication-related hospitalizations: a literature review and novel analysis. Drug Saf. 2010, 33: 233-44. 10.2165/11319030-000000000-00000.
Leendertse AJ, Egberts ACG, Stoker LJ, van den Bemt PMLA, HARM Study Group: Frequency of and risk factors for preventable medication-related hospital admissions in the Netherlands. Arch Intern Med. 2008, 168: 1890-6. 10.1001/archinternmed.2008.3.
Aparasu RR, Fliginger SE: Inappropriate medication prescribing for the elderly by office-based physicians. Ann Pharmacother. 1997, 31: 823-829.
Walker J, Wynne H: Review: the frequency and severity of adverse drug reactions in elderly people. Age Ageing. 1994, 23: 255-9. 10.1093/ageing/23.3.255.
Horne R, Weinman J, Barber N, et al: Concordance, adherence and compliance in medicine taking: report for the National Co-ordinating Centre for NHS Service Delivery and Organisation R&D. 2005, London: NCCSDO
Holland R, Desborough J, Goodyer L, Hall S, Wright D, Loke YK: Does pharmacist-led medication review help to reduce hospital admissions and deaths in older people? A systematic review and meta-analysis. Br J Clin Pharmacol. 2008, 65: 303-16. 10.1111/j.1365-2125.2007.03071.x.
Zermansky AG, Silcock J: Is medication review by primary-care pharmacists for older people cost effective?: a narrative review of the literature, focusing on costs and benefits. Pharmacoeconomics. 2009, 27: 11-24. 10.2165/00019053-200927010-00003.
Holland R, Lenaghan E, Harvey I, Smith R, Shepstone L, Lipp A, Christou M, Evans D, Hand C: Does home based medication review keep older people out of hospital? The HOMER randomised controlled trial. BMJ. 2005, 330: 293-7. 10.1136/bmj.38338.674583.AE.
Richmond S, Morton V, Cross B, Chi Kei Wong I, Russell I, Philips Z, Miles J, Hilton A, Hill G, Farrin A, Coulton S, Chrystyn H, Campion P, RESPECT trial team: Effectiveness of shared pharmaceutical care for older patients: RESPECT trial findings. Br J Gen Pract. 2010, 59: 14-20.
Krska J, Cromarty JA, Arris F, Jamieson D, Hansford D, Duffus PR, Downie G, Seymour DG: Pharmacist-led medication review in patients over 65: a randomized, controlled trial in primary care. Age Ageing. 2001, 30: 205-11. 10.1093/ageing/30.3.205.
Zermansky AG, Alldred DP, Petty DR, Raynor DK, Freemantle N, Eastaugh J, Bowie P: Clinical medication review by a pharmacist of elderly people living in care homes: randomised controlled trial. Age Ageing. 2006, 35: 586-91. 10.1093/ageing/afl075.
Schnipper JL, Kirwin JL, Cotugno MC, Wahlstrom SA, Brown BA, Tarvin E, Kachalia A, Horng M, Roy CL, McKean SC, Bates DW: Role of pharmacist counseling in preventing adverse drug events after hospitalization. Arch Intern Med. 2006, 166: 565-71. 10.1001/archinte.166.5.565.
Stewart S, Pearson S, Luke CG, Horowitz JD: Effects of home-based intervention on unplanned readmissions and out-of-hospital deaths. J Am Geriatr Soc. 1998, 46: 174-80.
Steiner JF, Prochazka AV: The assessment of refill compliance using pharmacy records: methods, validity, and applications. J Clin Epidemiol. 1997, 50: 105-16. 10.1016/S0895-4356(96)00268-5.
Strand LM, Morley PC, Cipolle RJ, Ramsey R, Lamsam GD: Drug-related problems: their structure and function. DICP. 1990, 24: 1093-7.
Cipolle RJ, Strand LM, Morley PC: Pharmaceutical care practice: the clinician's guide. 2004, New York: McGraw-Hill, 2
Kramer MS, Leventhal JM, Hutchinson TA, Feinstein AR: An algorithm for the operational assessment of adverse drug reactions, I: background, description, and instructions for use. JAMA. 1979, 242: 623-31. 10.1001/jama.242.7.623.
The EuroQol Group: EuroQol-a new facility for the measurement of health-related quality of life. Health Policy. 1990, 16: 199-208. 10.1016/0168-8510(90)90421-9.
National Coordinating Council for Medication Error Reporting and Prevention (NCC_MERP): NCC MERP Index for categorizing medication errors. 2010, [http://www.nccmerp.org/]
Stichting Farmaceutische Kengetallen: Polyfarmacie. Pharm Weekbl. 2005, 32: 968.
Campbell MK, Thomson S, Ramsay CR, MacLennan GS, Grimshaw JM: Sample size calculator for cluster randomized trials. Comput Biol Med. 2004, 34: 113-25. 10.1016/S0010-4825(03)00039-8.
Brown H, Prescott R: Multi-Centre Trials and Meta-Analyses. Applied Mixed Models in Medicine. 2006, West Sussex: JohnWiley & Sons Ltd, 2
Geerts AF, De Koning FH, De Smet PA, Van Solinge WW, Egberts TC: Laboratory tests in the clinical risk management of potential drug-drug interactions: a cross-sectional study using drug-dispensing data from 100 Dutch community pharmacies. Drug Saf. 2009, 32: 1189-97. 10.2165/11316700-000000000-00000.
Buurma H, Bouvy ML, De Smet PA, Floor-Schreudering A, Leufkens HG, Egberts AC: Prevalence and determinants of pharmacy shopping behaviour. J Clin Pharm Ther. 2008, 33: 17-23. 10.1111/j.1365-2710.2008.00878.x.
WHO Collaborating Centre for Drug Statistics Methodology: Complete ATC index. 2009, [http://www.whocc.no/atcddd/]
Floor-Schreudering , De Smet AP, Buurma H, Egberts CA, Bouvy LM: Documentation Quality in Community Pharmacy: Completeness of Electronic Patient Records After Patients' First Visits. Ann. Pharmacother. 2009, 43: 1787-94. 10.1345/aph.1M242.
(KNMP) Royal Dutch Association for the Advancement of Pharmacy: Dutch Pharmacy Standard (NAN). 2006, The Hague, Netherlands
Koda-Kimble MA, Young LL, Kradjan WA, Guglielmo BJ: Applied therapeutics. The clinical use of drugs. 2008, Philadelphia: Lippincott Williams & Wilkins, 9
Weed LL: The problem oriented record as a basic tool in medical education, patient care and clinical research. Ann Clin Res. 1971, 3: 131-4.
Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, Lam M, Seguin R: Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol. 2003, 3: 28-10.1186/1471-2288-3-28.
Lamberts H, Wood M: International Classification of Primary Care. 1988, Oxford: Oxford University Press
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/11/4/prepub
The authors would like to thank Svetlana V. Belitser, MSc for providing statistical support, Marjolein M.M. Geleedst-de Vooght, PharmD, Matthijs M. Engering, PharmD and Frank A. van Wees, PharmD for participating in the pilot study of the PHARM-study.
The PHARM-study is part of a larger study program, entitled "Implementation of interventions for preventing adverse drug events in high risk populations in primary care and care institutions, by a team of doctors and hospital pharmacists". This study program was financially supported by a non-conditional grant of the Patient Safety Program of the Netherlands Organisation for Health Research and Development (ZonMw) (file number 8140.0001). ZonMw has no role in the study design, collection, analysis and interpretation of data, in writing the manuscript and in the decision to submit the manuscript for publication.
The authors declare that they have no competing interests.
All authors are responsible for interpretation of the data and are involved with drafting and critically reviewing the manuscript. AL, FK, AG, AJ, AG, TE and PB are responsible for study design and study implementation. AL and SB (see acknowledgements) are responsible for analysis of the population at risk. All authors have read and approved the final manuscript.