An intervention modelling experiment to change GPs' intentions to implement evidence-based practice: using theory-based interventions to promote GP management of upper respiratory tract infection without prescribing antibiotics #2
© Hrisos et al; licensee BioMed Central Ltd. 2008
Received: 13 July 2007
Accepted: 14 January 2008
Published: 14 January 2008
Psychological theories of behaviour may provide a framework to guide the design of interventions to change professional behaviour. Behaviour change interventions, designed using psychological theory and targeting important motivational beliefs, were experimentally evaluated for effects on the behavioural intention and simulated behaviour of GPs in the management of uncomplicated upper respiratory tract infection (URTI).
The design was a 2 × 2 factorial randomised controlled trial. A postal questionnaire was developed based on three theories of human behaviour: Theory of Planned Behaviour; Social Cognitive Theory and Operant Learning Theory. The beliefs and attitudes of GPs regarding the management of URTI without antibiotics and rates of prescribing on eight patient scenarios were measured at baseline and post-intervention. Two theory-based interventions, a "graded task" with "action planning" and a "persuasive communication", were incorporated into the post-intervention questionnaire. Trial groups were compared using co-variate analyses.
Post-intervention questionnaires were returned for 340/397 (86%) GPs who responded to the baseline survey. Each intervention had a significant effect on its targeted behavioural belief: compared to those not receiving the intervention GPs completing Intervention 1 reported stronger self-efficacy scores (Beta = 1.41, 95% CI: 0.64 to 2.25) and GPs completing Intervention 2 had more positive anticipated consequences scores (Beta = 0.98, 95% CI = 0.46 to 1.98). Intervention 2 had a significant effect on intention (Beta = 0.90, 95% CI = 0.41 to 1.38) and simulated behaviour (Beta = 0.47, 95% CI = 0.19 to 0.74).
GPs' intended management of URTI was significantly influenced by their confidence in their ability to manage URTI without antibiotics and the consequences they anticipated as a result of doing so. Two targeted behaviour change interventions differentially affected these beliefs. One intervention also significantly enhanced GPs' intentions not to prescribe antibiotics for URTI and resulted in lower rates of prescribing on patient scenarios compared to a control group. The theoretical frameworks utilised provide a scientific rationale for understanding how and why the interventions had these effects, improving the reproducibility and generalisability of these findings and offering a sound basis for an intervention in a "real world" trial.
The consultation for upper respiratory tract infection (URTI) is one of the commonest in general practice . Systematic reviews have shown that antibiotics are of limited effectiveness in the treatment of URTI [2, 3]. Growing public health concerns about the implications of overprescribing of antibiotics for antimicrobial resistance in general have brought doctors under pressure to reduce inappropriate prescribing of these drugs [4–6]. Major public health campaigns have also targeted patients to deter consultation for URTI. Encouragingly, recent years have seen both a decline in the number of patients consulting for URTI [7, 8] and the prescribing of antibiotics for URTI in UK general practice . Between 1993 and 2001, prescribing reduced nationally by 30% for coughs and colds and by 47% for sore throat. However there remained substantial regional variation in practice and general practitioners (GPs) continued to prescribe for up to 42% patients presenting with uncomplicated URTI.
Such varied uptake of research evidence into routine practice may be due to the currently imperfect evidence-base to guide the choice and design of effective interventions to change professional behaviour . Few implementation studies provide an underlying theoretical basis to explain how or why successful interventions work or have been preceded by exploratory studies to test the feasibility of or to refine an intervention. We aimed to address this gap in the current implementation evidence-base through the application of a systematic, theory-based intervention modelling process (IMP) for the development and evaluation of interventions to change clinical practice . The process involves stages of development – currently lacking in implementation research – that closely correspond to the theoretical, modelling and experimental phases of the MRC Framework for the evaluation of complex interventions .
Using theory to develop and evaluate implementation interventions
We used the IMP in the design of the content of two theory-based interventions to change the behaviour of GPs with respect to their management of URTI. Detailed description of the interventions and their systematic development is provided in our partner paper . As part of this initial stage of the IMP, three psychological theories of behaviour change were selected as the framework to inform the content of the interventions: the Theory of Planned Behaviour (TPB) ; Social Cognitive Theory (SCT)  and Operant Learning Theory (OLT) . These theories all explain behaviour in terms of factors that are amenable to change. They each provided theoretical constructs (e.g. beliefs, attitiudes) that were found to be the antecedents of both GPs' intended and actual behaviour in relation to their management of URTI. The interventions were designed to differentially target these important constructs by incorporating relevant and evidence-based behaviour change techniques.
In addition to guiding the design of implementation interventions, the selected theories also provide a means to experimentally evaluate and refine implementation interventions. As these theories identify the proximal predictors of behaviour they provide measurable interim endpoints that represent actual behaviour (usually intention). They also identify beliefs that can mediate the effect of an intervention on this proxy measure of behaviour. The potential effect of an intervention on actual behaviour and the underlying behavioural process that drives it can thus be examined by conducting an intervention modelling experiment (IME). IMEs have been used successfully in the evaluation of interventions targeting health behaviours in patient populations, with effects replicated in "real world" studies [17–19]. We have further demonstrated the utility of this method in relation to clinicians' behaviour [20, 21].
This paper reports the experimental evaluation of the two theory-based interventions using this method, and which forms an additional stage of the IMP. The evaluation was designed to answer the following research questions:
Do the theory-based interventions influence GPs' behavioural intention and/or their simulated behaviour in the management of URTI without prescribing antibiotics?
Do the theory-based interventions influence the targeted theoretical constructs?
Design and participants
The design was a randomised 2 × 2 factorial randomised controlled trial with baseline and post-intervention assessment. The theoretical frameworks used for this evaluation were the same as those used in the development of the theory-based interventions . Measures were delivered in two postal questionnaire surveys, with the interventions incorporated at the start of the second questionnaire booklet (Additional file 1). Participants responding to the first survey were included in the second. Randomisation was at the level of general practice to ensure that participants within each practice received the same intervention and was stratified by the number of baseline respondents per practice to ensure equivalence of groups. Practices were randomised twice to receive, or not, each of two study interventions, producing four comparison groups: no intervention; Intervention1, Intervention 2; both intervention 1 & 2. The study participants were all of the general practitioners (GPs) serving 13 Primary Care Trusts in the North East region of the UK.
This was measured using the standard methods used in investigations based on the Theory of Planned Behaviour i.e. using rating scales of likelihood, frequency or agreement with statements or questions about behavioural intention [14, 22]. Four items assessed behavioural intention to manage a patient with an URTI without prescribing an antibiotic: When a patient presents with an URTI, I have in mind to manage them without prescribing an antibiotic; I intend to manage patients who present with an URTI without prescribing an antibiotic; I aim to manage patients who present with an URTI without prescribing an antibiotic (all scored on a scale 1 "Strongly Disagree" to 7 "Strongly Agree"); Given 10 patients presenting for the first time with the an URTI, how many patients would you intend to manage without prescribing an antibiotic? (scored on the scale 0 to 10) [Additional file 1; section 1]. The behavioural intention score was the sum of the 4 variables (as the scales differed, behavioural intention scores were converted to z-scores and summed). Higher behavioural intention scores reflected a stronger behavioural intention to manage URTI without prescribing an antibiotic.
Two sets of eight patient scenarios were developed, one set for each postal survey. Each required the respondent to simulate the behaviour they would enact in the real clinical situation. The scenarios reflected the range of patients and clinical features that present in general practice informed by qualitative work conducted in a previous study . Features identified in this study as influencing GPs' choice of management strategy were systematically allocated between the two sets of scenarios. The presentation format of the scenarios was designed to replicate the presentation of patient information as seen by a GP on the surgery computer screen [Additional file 1; section 2]. The format also included a simulated prescription pad, free text sections to note the diagnosis and management. The behavioural simulation score was the total number out of eight scenarios for which antibiotics were not prescribed.
Process (explanatory) measures
Summary of the theoretical constructs used as predictive measures
Variables (number of questions)
Theory of Planned Behaviour (TPB) (Ajzen, 1991)
Behavioural intention (3 & 4). Two summary scores: sum of three and four items
I intend to manage patients with URTIs without prescribing an antibiotic (scored 1 to 7)
Given 10 patients presenting for the first time with an URTI, how many patients would you intend to manage without prescribing an antibiotic? (Scored 1 to 10)
Attitude: Direct (3);
Indirect (8 behavioural beliefs (bb) multiplied by 8 outcome evaluations (oe).
The score was the mean of the summed multiplicatives.)
Direct: In general: The benefits of managing patients with URTI without prescribing antibiotics outweighs the harms;
Indirect: In general, managing a patient with an URTI without prescribing an antibiotic would reassure them (bb) × reassuring the patient is (oe: un/important)
Subjective Norm: I (5 normative beliefs (nb) multiplied by 5 motivation to comply (mtc) items. The score was the mean of the summed multiplicatives).
I feel under pressure to manage patients with an URTI without prescribing an antibiotic: from published literature (nb) × How motivated are you to do what the published literature states that you should (mtc: very much/not at all)
Perceived Behavioural Control: Direct (4)
Direct: Whether I manage patients with an URTI without prescribing an antibiotic is entirely up to me
Indirect: I find it difficult to manage patients presenting with an URTI without prescribing an antibiotic who: Expect me to prescribe an antibiotic
Social Cognitive Theory (SCT) (Bandura,1997)
Risk Perception (3)
It is highly likely that patients with an URTI will be worse off if I manage them without prescribing an antibiotic.
Outcome Expectancies: Behaviour (8 × 8)
The score was the mean of the summed multiplicatives.
Behaviour: See Attitude (Theory of Planned Behaviour)
Self Efficacy: Specific (6)
Specific: Without an antibiotic: How confident are you in your ability to manage patients with URTIs who have tried to self-medicate
Operant Learning Theory (OLT)
Anticipated consequences (3)
If I routinely manage patients with URTIs without prescribing an antibiotic then, on balance, my life as a GP will be easier in the long run
Evidence of habit (2)
When I see patients with URTIs, I automatically consider managing them without prescribing an antibiotic
Implementation Intention (Gollwitzer, 1993)
Prior planning (1)
Currently, my standard method of managing patients with an URTI involves managing them without prescribing an antibiotic
Action planning (3)
I have a clear plan of how to manage patients with an URTI without prescribing an antibiotic
I have a clear plan of when to manage patients with an URTI without prescribing an antibiotic
I have a clear plan of under what circumstances to manage patients with an URTI without prescribing an antibiotic
gender, years qualified, trainer status, single or multi-practitioner practice
Three additional measures were included in the questionnaire: the extent of "prior planning" and "action planning" from the Implementation Intention model (II)  and "evidence of habit" from OLT. These constructs have been found to be significant predictors of GP behaviour in relation to the management of URTI . In the II model "prior planning" and "action planning" represent the extent to which an individual has developed an explicit plan, or an "implementation intention, about when and where an intended action or "goal behaviour" will be achieved. An implementation intention is therefore a "post-intentional" variable. As one of the interventions includes an element of "making a plan", the extent of GPs' prior planning was assessed by a single item (Additional file 1, Section 1, Item 18) and "action planning" by three items (Additional file 1, Section 1, Items 19a, b & c).
OLT proposes that repeated behaviours may become "habitual". Habitual behaviour is a strong predictor of behaviour but could be described more accurately as an attribute of behaviour rather than a causal determinant. Change in habit, or the formation of new habits, is influenced indirectly by targeting factors that are causally related to the behaviour. As a general aim of both study interventions was to promote the habit of managing patients with URTI without an antibiotic, a measure of "evidence of habitual behaviour" was included in the questionnaire. Two items assessed evidence of habitual behaviour (Additional file 1, Section 1, Items 7a & b).
Two paper-based, behaviour change interventions were evaluated. The interventions are named according to the principle behaviour change technique used in their development .
This intervention targeted the theoretical construct of self-efficacy (SCT) using the behaviour change techniques of graded task; rehearsal; and action planning. The aim of this intervention was to increase the individual's belief in his/her capabilities to manage uncomplicated URTI without prescribing antibiotics. (Additional file 2).
This intervention targeted the theoretical constructs of anticipated consequences (OLT) and risk perception (SCT). [As these constructs overlap considerably in their description and their operationalisation, this intervention is referred to from here on as targeting "anticipated consequences". The distinction between the two constructs is maintained when discussing them in relation to their source theories]. The aim of this intervention was to influence the individual's beliefs about the positive consequences of managing URTI without prescribing antibiotics (Additional file 3).
Participant engagement with the interventions was measured as the degree of completeness of the written tasks presented by each intervention. We considered that GPs who had completed at least one of the 3 parts of the Graded Task intervention had engaged interactively with this intervention. We also looked to see if the pattern of actual responses to part A ("Yes", "Maybe" and "No") followed the pattern we anticipated.
For the persuasive communication intervention, interactive engagement was assumed if the GP had completed one or both of the rating scales on this intervention.
Delivering the modelling experiment
The first postal questionnaire survey ran from 1st September to mid-October 2005 and the second survey ran from mid-October to the end of November 2005. For the first survey all GPs received a letter of invitation, and the survey booklet (Additional file 1). The booklet included a set of instructions, questions addressing the process measures (behavioural antecedents and beliefs) and outcome measures (behavioural intention and behavioural simulation) and a set of eight patient scenarios. GPs were instructed to complete the different sections of the booklet in the order that they were presented. By responding to the first survey GPs consented to participate in the second survey. To increase response rates, a £20 incentive was offered to each participant who returned the first questionnaire [25, 26].
Two months after the first mailing, respondents were randomised at the practice level to one of the four study groups and then mailed the second survey. For those GPs allocated to an intervention group, the survey booklet now also contained the appropriate interventions, in addition to the process and outcome measures. The interventions were always the first section of the survey booklet, and GPs were again instructed to complete each section in the order of presentation. On both occasions two reminders were mailed to non-responding clinicians.
Sample size and Analysis
The experiment was powered to detect a difference between each of the active intervention groups and the control group. Using standard methods for a continuous outcome, 50 participants were required per group to have 80% power of detecting an effect size of 0.8 using a significance level of 2.5%, giving a total sample size of 200 for the experiment. We over-sampled to ensure achieving this final sample size, using an initial sample of 1225.
Data were analysed using SPSSPC . For composite variables, where contributing items were missing these were replaced with the individual respondent's mean score of the remaining items in the composite set, providing that 50% of the measure was complete. Missing data for single item measures were not replaced. Internal consistency of multi-item measures was assessed using Cronbach's alpha (for measures with >2 items) using an acceptability criterion of α > 0.6, and Pearson's correlation coefficient (for 2 item measures) using an acceptability criterion of r > 0.25.
Relationships between explanatory (process) and outcome variables were examined using Pearson correlations and stepwise regression analyses. The trial groups were compared using methods appropriate for comparing independent samples (t-tests to compare two groups, analysis of variance to compare multiple groups and analysis of covariance to compare two or more groups adjusting for differences in baseline performance). When undertaking analysis of variance and analysis of covariance the first step was to fit a full factorial model. If the interaction between the two interventions was not significant it was removed from the model and the estimate of the effect of each intervention was based on a main effects model. The extent to which the antecedent beliefs mediated effects on the outcomes was tested using the Baron and Kenny methodology , and the Sobel test .
The study was approved by the Northern and Yorkshire Multi-Centre Research Ethics committee.
Response rates and non-response analyses
The response rate to the first mailing was fairly consistent across the 13 PCTs (average PCT response rate (SD) = 39% (7.6)). The final sample of 340 GPs did not differ significantly from the original sampling frame of 1225 GPs on gender (chi-square = 2.916, df = 1, p = 0.09, excludes 78 where gender was not confirmed for non-respondents) or multi-practitioner practice status (chi-square = 0.001, df = 1, p = 0.971).
Equivalence of intervention groups
The randomised groups did not differ significantly on any demographic variables (Gender: chi-square = 3.105, df = 3, p = 0.376; GP trainer: chi-square = 2.563, df = 3, p = 0.439; years qualified: F = 0.904, df = 3, p = 0.439) or on their pre-intervention behavioural intention and behavioural simulation scores (Intention: F = 0.839, df = 3, p = 0.473; Behavioural simulation: F = 0.252, df = 3, p = 0.860).
Graded Task intervention
Description of situation
% GPs rating "Yes" (N = 163)
% GPs using situation as basis for their management "plan" (N = 158)
Could you confidently end a consultation for a patient with an URTI without prescribing an antibiotic?
Could you confidently manage patients with URTIs without an antibiotic, who have already tried to self-medicate?
Could you confidently manage patients with URTIs without an antibiotic, who expect you to prescribe an antibiotic?
Could you confidently manage patients with URTIs without an antibiotic, whose symptoms are distressing them
Could you confidently manage patients with URTIs without an antibiotic, who have a past history of COPD 1 ?
Where another doctor had already prescribed antibiotics for the same episode
Description of rating
Proportion of GPs rating themselves as 0–100% like Dr B 2 (N = 161)
Mean Difference (t-test)
Rating 1 (Intended behaviour)
% GP "tries to be like Dr B2"
10.8 (t = 8.326, p < 0.001)
Rating 2 (Actual behaviour)
% GP is "actually like Dr B"
Post-intervention descriptive statistics, correlations of process variables with intention and behavioural simulation & regression analyses by theory.
Process (explanatory) variables
Model summary R2(adj)
Model summary R2(adj)
Risk Perception (same as anticipated consequences)
Outcome Expectancies (same as attitude indirect)
Evidence of habit
Cross-theory analysis (variables retained in regression models)
Risk Perception/Anticipated consequences
Evidence of habit
Relationships between explanatory and outcome measures
Table 3 presents the post-intervention correlation and regression coefficients for relationships between process and outcome variables by theoretical framework and overall, for all respondents. With the exception of PBC direct, all TPB variables were significantly correlated with scores on the behavioural intention outcome measure. Attitude indirect and subjective norm did not correlate with behavioural simulation. All SCT and OLT variables were significantly correlated with both outcome measures. Past behaviour was significantly associated with both behavioural intention and behavioural simulation, while both post-intentional variables, prior planning and action planning, significantly correlated with behavioural simulation.
The TPB explained 33% of the variance in behavioural intention, SCT 32% and OLT 60%. For behavioural simulation, the TPB explained 14% of the variance, SCT 17% and OLT 10%. All constructs from each model were entered simultaneously into regressions on behavioural intention and behavioural simulation, and allowed to compete. Attitude direct, subjective norm, anticipated consequences, habitual behaviour and past behaviour significantly predicted behavioural intention. Together these variables explained 63% of the variance in behavioural intention. The strongest predictor in this cross-theory model was "evidence of habit" (Beta = 0.605, p < 0.001). Self-efficacy and prior planning were the only significant predictors of behavioural simulation, together explaining 18% variance (Table 3).
Did the theory-based interventions influence GPs' behavioural intention and/or their simulated behaviour in the management of URTI without prescribing antibiotics?
Trial analysis: Effect size and 95% Confidence Intervals
Covariate analysis: Estimates of Effect Size
Attitude (Indirect)/Outcome expectancies
Anticipated Consequences/Risk perception
Graded Task intervention
There was no significant effect of this intervention on either behavioural intention not to prescribe an antibiotic or on GPs' simulated behaviour.
Persuasive communication intervention
There was a significant effect of this intervention on behavioural intention and behavioural simulation. GPs receiving this intervention had, on average, intention scores that were 0.9 units higher than those who did not receive it, indicating that their intentions were stronger (Table 4). They also prescribed on 0.47 fewer patient scenarios.
Did the theory-based interventions influence their targeted theoretical constructs?
The Graded Task intervention had a significant main effect on the theoretical construct targeted by this intervention (self-efficacy) and also on the TPB construct of PBC (indirect) (Table 4). GPs who experienced this intervention had stronger beliefs in their capabilities to manage patients with URTI without antibiotics and a stronger sense of perceived behavioural control compared to GPs who did not experience this intervention. The persuasive communication had a significant main effect on the construct targeted by this intervention (anticipated consequences). A significant effect was observed on a number of constructs not specifically targeted by this intervention (Table 4).
Further investigation examined whether the effect of the Persuasive Communication on behavioural intention and behavioural simulation was mediated through anticipated consequences, or any of the non-targeted constructs. Mediational analyses showed that the effect of this intervention on behavioural intention was partially mediated through its targeted construct (anticipated consequences: Sobel test statistic = -3.59, p < 0.001). In addition, the effect of this intervention was also partially mediated through both measures of TPB attitude (Attitude direct: Sobel test statistic = -2.49, p = 0.01; Attitude indirect: Sobel test statistic = 3.17, p = 0.001), the TPB measure of subjective norm (Sobel test statistic = -2.36, p = 0.018) and the SCT measure of self-efficacy (Sobel test statistic = -1.98, p = 0.048).
The effect of the persuasive communication on behavioural simulation was again partially mediated through the targeted construct of anticipated consequences (Sobel test statistic = -2.53, p = 0.012). Mediation also occurred through TPB Attitude direct (Sobel test statistic = -2.20, p = 0.028) and the SCT measure of self-efficacy (Sobel test statistic = -1.97, p = 0.049)
The objective of the present study was to experimentally evaluate the effect of two theory-based interventions on the behavioural intention and simulated behaviour of GPs in relation to the management of uncomplicated URTI. We did this using a randomised controlled trial design, within the context of an Intervention Modelling Process (IMP). The interventions were designed to change beliefs previously identified as important predictors of antibiotic prescribing by GPs for upper respiratory tract infection. Two behavioural antecedents were differentially targeted: self-efficacy from SCT and anticipated consequences from OLT (also represented in SCT as "risk perception").
Our theoretical framework included the constructs from three psychological models of behaviour that have been well validated in non-health professional populations: TPB , SCT , OLT  and the post-intention conceptual model of Implementation Intentions . Like Eccles et al , we found that each of these models were predictive of GP intention to manage URTI without prescribing antibiotics and their simulated behaviour, although such relationships are not inherent in OLT and for II, the proposal is that II follow from BI. The variance explained by each model and overall was very similar to that observed in the previous predictive study , adding further support for the utility of these models in this approach. We found that each intervention had a significant effect on its targeted theoretical construct and that one intervention also improved the behavioural intention and simulated behaviour of GPs in relation to managing URTI without antibiotics.
GPs receiving the Graded Task intervention reported greater confidence in their ability to manage uncomplicated URTI without prescribing antibiotics than those who did not receive this intervention. This intervention also showed a significant effect on one of the TPB perceived behavioural control constructs (PBC Indirect). In a similar way to the self-efficacy construct, PBC describes the extent to which the individual feels they have personal control over a given behaviour. It is encouraging that this intervention changed only those constructs relating to control and suggests that this intervention is having its effect as we would predict based on the underlying rationale for its development. This intervention did not, however, have a measurable impact on either behavioural intention or behavioural simulation. Self-efficacy was selected as a target construct as it was found by Eccles et al. to be a significant predictor of behavioural intention, behavioural simulation and actual behaviour. As intention is not a feature of SCT there is no theoretical basis to expect self-efficacy to have a direct effect on intention. It is still theoretically possible, however, that the intervention targeting self-efficacy might affect actual behaviour as both the TPB and SCT propose that control cognitions (PBC and self-efficacy) have a direct effect on behaviour, not mediated by behavioural intention.
GPs receiving the Persuasive Communication intervention had stronger intentions to manage URTI without prescribing antibiotics and were less likely to prescribe antibiotics than those who did not. They also reported greater anticipation of positive consequences for themselves and their patients in managing URTI without prescribing antibiotics than those receiving no intervention and those receiving the Graded Task intervention. This is an interesting finding in that it suggests that previous communications relating to the prescribing of antibiotics for the management of URTI (eg clinical guidelines) have not persuaded some GPs of the potential positive consequences of managing URTI symptomatically.
We further found that the effect of this intervention on both outcome measures was mediated through the targeted construct (anticipated consequences) and through a number of none targeted constructs: TPB attitude and subjective norm (latter mediated the effect on intention only) and SCT self-efficacy. This analysis suggests that the constructs provided by the theoretical frameworks we employed were behaving as proposed by their respective theories, supporting the value of these theories to guide the design and evaluation of interventions to change professional practice. The Persuasive Communication also showed a significant effect on two additional theoretical constructs not directly targeted by this intervention. Scores on the measure of habit (OLT) and one of the implementation intention (II) items (prior planning) were significantly enhanced even though they were not directly targeted by this intervention. The effect of the intervention on either behavioural intention or behavioural simulation was not mediated through either of these constructs. This possibly reflects the fact that the GPs taking part in the evaluation already had a strong habit to manage patients with URTI symptomatically and also had well developed plans of what they would do to achieve this.
Strength and limitations
A significant strength of this study is the experimental design. Experimental modelling and manipulation of key theoretical constructs provided insight into the potential influence of these variables on clinical behaviour, using a method that is both robust and replicable. The response rates achieved are both a strength and a limitation of this study. A limitation is the quite low response rate for the initial survey (just over 32%). However, the recruited and randomised sample represented GP responses from 66% of the primary care practices we sampled, was of equal proportions across 13 PCTs and did not differ from the wider sampling frame on any of the demographic variables measured. In addition, the post-intervention retention rate was high (around 86%). The validity of the study findings is further strengthened by a high level of participant engagement with the study interventions
One aim of this research approach is to develop a replicable methodology for the design, evaluation and refinement of interventions before conducting a costly service level assessment – an intervention modelling process. In this study, the theoretical interim endpoints of behavioural intention and behavioural simulation were used as proxy measures for clinicians' actual behaviour. For this method to be reliable, such proxy measures of behaviour must be predictive of actual behaviour. While there is evidence to suggest that behavioural intention is a reliable proxy for actual clinical behaviour, the validity of other frequently used proxy measures of behaviour – like patient vignettes – is less well established. The measure of simulated behaviour was self-reported but the variance explained in the present study (10% and 14%) is closer to that reported in studies examining the relationship between behavioural intention and observed behaviour. In designing the format of the scenario presentation, we tried to replicate the real world setting as near as possible. The scenario presentation style was designed to replicate element s of routine consultations – for example we adopted the layout of the computer screen commonly seen by GPs in the surgery and used pictures of an actual prescription pad. Previous studies have presented patient scenarios as a block of descriptive text. It is possible that the introduction of visual elements increased saliency. We also asked GPs to note their diagnosis and management of each fictional patient rather than give a simple "Yes/No" response to indicate their decision to prescribe or not. Again this may have further increased their engagement with the task and encouraged them to respond in a way more closely representative of their actual behaviour.
Understanding why and how interventions have their effect will allow implementation researchers to choose and develop more targeted behaviour change strategies, and have greater confidence in their effectiveness when applied at the service-level. The systematic approach used in this and our partner paper for the development and evaluation of interventions to change professional behaviour describes an intervention modelling process that corresponds closely to the theoretical and modelling phases recommended by the MRC Framework. We have shown the feasibility and value of this process in the development and evaluation of two behaviour change interventions. The theoretical framework provides an understanding of how and why these interventions differentially impacted on behaviour, offering the basis for the development of a taxonomy of intervention components. The approach presented in these partner papers promotes the development of professional behaviour change interventions that are replicable, are underpinned by a robust explanatory scientific rationale and that use generalisable elements of behaviour.
This study is funded by the European Commission Research Directorate as part of a multi-partner program: Research Based Education and Quality Improvement (ReBEQI): A Framework and tools to develop effective quality improvement programs in European healthcare. (Proposal No: QLRT-2001-00657). Jeremy Grimshaw holds a Canada Research Chair in Health Knowledge Transfer and Uptake. Jill Francis is a member of the Aberdeen Health Psychology Group, funded by the Institute of Applied Health Sciences, and of the Health Services Research Unit, funded by the Chief Scientist Office of the Scottish Executive Department of Health. The views expressed are not necessarily those of the funding bodies.
- Butler CC, Hood K, Kinnersley P, Robling M, Prout H, Houston H: Predicting the clinical course of suspected acute viral upper respiratory tract infection in children. Fam Pract. 2005, 22 (1): 92-95. 10.1093/fampra/cmh713.View ArticlePubMedGoogle Scholar
- Del Mar CB, Glasziou PP, Spinks AB: Antiobiotics for sore throat. Cochrane Database Syst Rev. 2004, CD000023-2Google Scholar
- Arroll B: Antibiotics for upper respiratory tract infections: an overview of Cochrane reviews. Respir Med. 2005, 99 (3): 255-261. 10.1016/j.rmed.2004.11.004.View ArticlePubMedGoogle Scholar
- Department of Health: UK antimicrobial resistance strategy and action plan. 2000, London , Department of HealthGoogle Scholar
- Standing Medical Advisory Committee.Subgroup on Antimicrobial Resistance: The path of least resistance. 1998, London , Department of HealthGoogle Scholar
- House of Lords Select Committee on Science and Technology: Resistance to antibiotics and other antimicrobial agents. 1998, London , House of Lords Select Committee on Science and Technology, 1-108.Google Scholar
- Ashworth M, Charlton J, Ballard K, Latinovic R, Guilliford M: Variations in antibiotic prescribing and consultation rates for acute respiratory infection in UK general practices 1995 - 2000. Br J Gen Pract. 2005, 55: 603-608.PubMedPubMed CentralGoogle Scholar
- Ashworth M, Latinovic R, Charlton J, Cox K, Rowlands G, Gulliford M: Why has antibiotic prescribing for respiratory illness declined in primary care? A longitudinal study using the General Practice Research Database. Journal of Public Health. 2004, 26: 268-274. 10.1093/pubmed/fdh160.View ArticlePubMedGoogle Scholar
- Smith S, Smith GE, Heatlie H, Bashford JN, Ashcroft DM, Verlander NQ, al. : Reducing variation in antibacterial prescribing rates for 'cough/cold' and sore throat between 1993 and 2001: regional analyses using the General Practice Database. Public Health. 2006, 120 (8): 752-759. 10.1016/j.puhe.2006.02.007.View ArticlePubMedGoogle Scholar
- Grimshaw JM, Eccles M, Tetroe J: Implementing clinical guidelines: current evidence and future implications. J Contin Educ Health Prof. 2004, 24 (Suppl 1): S31-7. 10.1002/chp.1340240506.View ArticlePubMedGoogle Scholar
- Eccles MP, Johnston M, Hrisos S, Francis J, Grimshaw J, Steen IN, Kaner EF: Translating clinicians' beliefs into implementation interventions (TRACII): a protocol for an intervention modelling experiment to change clinicians' intentions to implement evidence-based practice. Implementation Science. 2007, 2 (27).Google Scholar
- Medical Research Council: A framework for development and evaluation of RCTs for complex interventions to improve health. 2000Google Scholar
- Hrisos S, Eccles MP, Johnston M, Francis J, Kaner EFS, Steen IN, Grimshaw J: Developing the content of two behavioural interventions: Using theory-based interventions to promote GP management of upper respiratory tract infection without prescribing antibiotics #1. BMC Health Services Research. 2008, 8 (11).Google Scholar
- Ajzen I: The theory of planned behaviour. Organizational Behaviour and Human Decision Processes. 1991, 50: 179-211. 10.1016/0749-5978(91)90020-T.View ArticleGoogle Scholar
- Bandura A: Self-efficacy: the exercise of control. 1997, New York , FreemanGoogle Scholar
- Blackman D: Operant conditioning: an experimental analysis of behaviour. Edited by: Blackman D. 1974, London , MethuenGoogle Scholar
- Paul GL: Insights vs. desensitisation in psychotherapy. 1966, Stamford , Stamford University PressGoogle Scholar
- Bandura A: Principles of behaviour modification. 1969, Norwich , Holt, Rinehart and WilsonGoogle Scholar
- Mathews AM: Agoraphobia: nature and treatment. 1981, London , TavistockGoogle Scholar
- Bonetti D, Johnston M, Pitts N, Deery C, Ricketts I, Bahrami M, Ramsay C, Johnston J: Can psychological models bridge the gap between clinical guidelines and clinicians' behaviour? A randomised controlled trial of an intervention to influence dentists' intention to implement evidence-based practice. British Journal of Dentistry. 2003, 195: 602-606.Google Scholar
- Bonetti D, Eccles M, Johnston M, Steen IN, Grimshaw J, Baker R, Walker A, Pitts N: Guiding the design and selection of interventions to influence the implementation of evidence-based practice: an experimental simulation of a complex intervention trial. Soc Sci Med. 2005, 60: 2135-2147. 10.1016/j.socscimed.2004.08.072.View ArticlePubMedGoogle Scholar
- Francis J, Eccles MP, Johnston M, Walker AE, Grimshaw JM, Foy R, Kaner EFS, Smith L, Bonetti D: Constructing questionnaires based on the theory of planned behaviour. A manual for health services researchers. 2004, Newcastle upon Tyne , Centre of Health Services Research, University of Newcastle upon TyneGoogle Scholar
- Eccles MP, Grimshaw JM, Johnston M, Steen N, Pitts NB, Thomas R, Glidewell E, Maclennan G, Bonetti D, Walker A: Applying psychological theories to evidence-based clinical practice: identifying factors predictive of managing upper respiratory tract infections without antibiotics. Implementation Science. 2007, 2 (August): 26-10.1186/1748-5908-2-26.View ArticlePubMedPubMed CentralGoogle Scholar
- Gollwitzer PM: Implementation intentions: strong effects of simple plans. Am Psychol. 1999, 54 (7): 493-503. 10.1037/0003-066X.54.7.493.View ArticleGoogle Scholar
- McColl EM, Jacoby A, Thomas L, Soutter J, Bamford C, Steen IN, Thomas R, Harvey E, Garrett A, Bond J: Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. Health Technol Assess. 2001, 5(31).Google Scholar
- Halpern SD, Ubel PA, Berlin JA, Asch DA: Randomized trial of $5 versus $10 monetary incentives, envelope size, and candy to increase physician response rates to mailed questionnaires. Med Care. 2002, 40: 834-839. 10.1097/00005650-200209000-00012.View ArticlePubMedGoogle Scholar
- Norusis MJ: SPSS for Windows. Base system user's guide. 2002, Chicago , SPSS Inc. Marketing DepartmentGoogle Scholar
- Baron RM, Kenny DA: The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J Pers Soc Psychol. 1986, 51 (6): 1173-1182. 10.1037/0022-35184.108.40.2063.View ArticlePubMedGoogle Scholar
- Sobel T: [cited 2007 12th July]. 2007, [http://www.psych.ku.edu/preacher/sobel/sobel.htm]Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/8/10/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.