We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
The OPTIMISE project: protocol for a mixed methods, pragmatic, quasi-experimental trial to improve primary care delivery to refugees in Australia
BMC Health Services Researchvolume 19, Article number: 396 (2019)
Australia is one of many nations struggling with the challenges of delivering quality primary health care (PHC) to increasing numbers of refugees. The OPTIMISE project represents a collaboration between 12 organisations to generate a model of integrated refugee PHC suitable for uptake throughout Australia. This paper describes the methodology of one component; an outreach practice facilitation intervention, directed towards improving the quality of PHC received by refugees in Australian general practices.
Our mixed methods study will use a cluster stepped wedge randomised controlled trial design set in 3 urban regions of high refugee resettlement in Australia.
The intervention was build upon regional partnerships of policy advisors, clinicians, academics and health service managers. Following a regional needs assessment, the partnerships reached consensus on four core areas for intervention in general practice (GP): recording of refugee status; using interpreters; conducting comprehensive health assessments; and referring to refugee specialised services.
Refugee health staff trained in outreach practice facilitation techniques will work with GP clinics to modify practice routines relating to the four core areas.
36 general practice clinics with no prior involvement in a refugee health focused practice facilitation will be randomly allocated into early and late intervention groups.
The primary outcome will be changes in number of claims for Medical Benefit Service reimbursed comprehensive health assessments among patients identified as being from a refugee background. Changes in practice performance for this and 3 secondary outcomes will be evaluated using multilevel mixed effects models.
Baseline data collection will comprise (i) pre-intervention provider survey; (ii) two surveys documenting each practices’ structure and approaches to delivery of care to refugees. De-identified medical record data will be collected at baseline, at the end of the intervention and 6 and 12 months following completion.
OPTIMISE will test whether a regionally oriented practice facilitation initiative can improve the quality of PHC delivered to refugees. Findings have the potential to influence policy and practice in broader primary care settings.
Australian New Zealand Clinical Trials Registry, ACTRN12618001970235, 05/12/2018, Retrospectively registered.
Protocol Version 1, 21/08/2017.
Australia is a major site for the resettlement of refugees. Over 78,000 permanent resident visas were granted to refugees and asylum seekers between 2011 and 2016 [1, 2]. The nation’s refugee and humanitarian program intake has recently increased (in 2018/19) to 18,750 per annum , the majority of whom will settle in the states of New South Wales and Victoria [3, 4].
The vulnerability of Australians of a refugee background follows from the physical and psychological sequelae of torture, trauma and multiple deprivations in countries of origin and transit . Compared to the wider population, refugees are at greater risk of mental health conditions , infectious disease , nutritional deficiencies , obstetric complications , poor dental health  and disability . Complex physical and psychological problems are often addressed only for the first time in Australia .
Australian states and territories have introduced different approaches to aid transition to life in a new country [3, 4]. Pathways vary across regions within different states/territories, and, as to whether refugees arrive through a sponsored or non-sponsored pathway. However, in general, resettled refugees are initially put in contact with Commonwealth funded Humanitarian Settlement Program service providers, which provide practical assistance for settling in the community. In many jurisdictions, new arrivals may be directed to Refugee Focused Health Services and/or a mainstream General Practice for initial health assessment . Subsequently, all but the most complex clients are managed within mainstream primary care.
The health and wellbeing of people of refugee background is intimately linked with their ability to access high quality, coordinated primary health care . Many struggle to access general practitioners, specialists, community health services and hospitals – problems related to socio-economic factors, language and cultural differences and the complexity of the Australian healthcare system [3, 4]. Provision of quality care to refugee background patients in mainstream primary care has been found to be inconsistent, with many providers having incomplete knowledge of refugee health requirements. Interpreters are underutilised, , coordination between sectors problematic, and, at times, in some jurisdictions, Refugee Focused Health Services have found it difficult to provide timely care [13, 14].
Outreach practice facilitation has become a promising intervention to support quality improvement in primary care . Practice facilitation has been shown to improve chronic disease management, increase prevention, and facilitate system-level change and quality improvement . Emerging evidence has shown that the principles of outreach practice facilitation could assist in the care of vulnerable populations, including refugees [17, 18]. This protocol outlines a project designed to investigate the effectiveness of outreach practice facilitation in supporting primary care practice-wide quality improvement within the context of refugee health.
Our overall objective is to conduct a mixed methods evaluation of a practice facilitation intervention designed to improve the primary care management of refugees in 36 general practice clinics across 3 regions: South East Melbourne (SEM), North West Melbourne (NWM) and South West Sydney (SWS).
We asked whether a facilitation-based intervention directed at improving the quality of general practice-based primary care delivered to patients with a refugee background could increase:
The conduct and documentation of comprehensive physical and mental health assessments among patients identified as being from a refugee background (primary outcome)
Refugee status determination and recording
The use of credentialed interpreters among patients identified as being from a refugee-like background
Practice staff knowledge and use of referral pathways to refugee specific health and social welfare services
This quality improvement programme has a mixed methods approach incorporating a cluster randomised controlled trial (cRCT) design with blind allocation to early and late intervention groups . Quantitative measures collected cross-sectionally at multiple timepoints will be assessed using the recommended statistical approach for step-wedged cRCT designs . An embedded qualitative component will explore the acceptability, usefulness and sustainability of the intervention(s).
The study will be informed by the literature on organisational change that identifies the factors influencing the diffusion and institutionalisation of organisational innovations, and where organisations are considered as a whole rather than as a set of independent attributes [21,22,23]. Two principles underpin the study design: a) Participatory research: where community based research partnerships built upon on-going knowledge exchange are considered an essential component of sustainable innovations and, community impact [24, 25]; and b) Implementation science: incorporating contemporary approaches to quality improvement, and, in particular Normalization Process Theory’s principles for understanding the process of embedding change in a practice by examining what people actually do and how they work .
The study will be conducted in general practice clinics in two regions of metropolitan Melbourne and one region in metropolitan Sydney, each with high rates of refugee resettlement. The study regions correspond to the Commonwealth Government Primary Health Networks (PHN) regions of South East Melbourne, North West Melbourne and South West Sydney .
Trial eligibility is at three levels. Participating general practice clinics will be located in one of the three PHN regions, provide general primary care services and plan to be in operation for the next two years without substantial change to governance or management. Each will have needed to be in operation for 12 months and use electronic medical records and billing software compatible with the study’s data extraction tool (PENCS CAT4™). Practices will not have participated in refugee health related capacity building activities in the 12 months immediately preceding the study.
At least 50% of GPs in a practice must consent for practice participation to be confirmed. As the intervention is designed around a whole-of-practice approach, the research team will ensure there is a process by which staff within the practice can confidentially object to the practice’s participation in the study, via call or email. If this occurs, the practice will be withdrawn from the study.
Development of the intervention
The oversight of the study’s activities in each region is the responsibility of regional partnership teams (RPTs) comprising decision makers, clinicians, academics, health service managers and community members (Table 1).
Each RPT worked to characterise each region’s policy, program and service context with particular reference to the care of refugee populations. We focused specifically on barriers and enablers affecting access, transition and quality of primary care within the region. To further understand regional partnership needs, each RPT performed a focused scientific and grey literature review, analysed secondary data extracted from the Australian Bureau of Statistics Census, Department of Home Affairs Settlement Reporting Facility, settlement agencies, public health services and local councils, and conducted a series of key informant interviews with health service managers, policy advisors and clinicians. The three RPTs then met in a deliberative forum  to determine priority interventions, from which four core areas of activity were chosen;
Physical and mental health assessments: GPs and practice nurses will have relevant skills and knowledge to conduct comprehensive refugee physical and mental health assessments.
Refugee identification: general practice clinics will have accurate and accessible mechanisms in place to record and retrieve refugee identification, status, country of birth or ethnicity, year of arrival, and need for interpreter.
Use of interpreters: practices will have a practice protocol for using interpreters, and ensure that staff have appropriate knowledge and skills in their role of supporting use of interpreters.
Referral pathways: practice staff will gain an understanding of refugee health referral pathways in the region (including available services, eligibility requirements and referral procedures).
These areas of focus helped the study objectives (see above). All practices recruited will be asked to work on these four core areas as a minimum, with the option to choose an additional 1–2 activities from a list of optional tasks depending on interest and capacity (Table 2).
Practice Facilitators will deliver the intervention to general practice clinics using a plan/do/study/act (PDSA) approach oriented to the four core goals . Practice Facilitators will make a minimum of three, 60–90 min, in-person contacts with each participating practice during the six-month intervention period. Practices will receive one telephone contact following each visit.
Prior to the intervention commencing, each practice will identify a team comprising the practice lead and key practice participants, including at least one GP and (if applicable) one practice nurse. The team will complete a survey designed to ascertain current practice performance and needs in key areas of refugee health. This information will be used to help the Practice Facilitator lead a discussion during their first visit to the practice where the practice team will identify and discuss potential needs and areas for action, and develop an action plan (following a pre-designed template) for each of the four core priority areas. The action plans were adapted from the Victorian Refugee Health Network’s Engaging and supporting General Practice in refugee health program  and an example can be found in Additional file 1.
The subsequent two practice facilitation visits and phone calls will act to support and monitor action plan development and implementation. The Practice Facilitator will continue to assist with challenges faced by the practice and identify any other resources, strategies, tools or training available to aid in the action plan’s implementation.
Practices will also be provided with additional resources relating to the four core priority areas, including a soft and hard copy of a “General Practice Resource Book”. This book was created by the research team to provide a directory of verified resources organised to complement the four goals targeted by the project. A two-page electronic ‘summary sheet’ of key resources, with links embedded to be easily accessed on electronic devices, will also be provided.
Practice Facilitators will be existing refugee health staff in each region and will be refugee health clinical fellows,Footnote 1 refugee health nursesFootnote 2 or project officers currently employed by Refugee Focused Health Services. Each will need to have experience in refugee and asylum seeker health care delivery and an understanding of the principles of engaging general practice clinics in quality improvement activities. This knowledge as well as the tasks and timelines of the role will be reinforced by a one-day training program and on-going facilitator support meetings. The content of the training was based on findings from the North-West Melbourne Primary Health Network’s in-house GP support program, the Settlement Coordinators’ program, and the Victorian Refugee Health Network’s Engaging and supporting General Practice in refugee health program. Additional material was sourced from the Agency for Healthcare Research and Quality training program for outreach practice facilitation  and the researchers’ prior work in other facilitation initiatives [31,32,33].
The primary outcomes will be changes in number of claims for the delivery of Medicare Benefits Schedule (MBS) reimbursed comprehensive health assessments among patients identified as being from a refugee background. We will calculate the change in proportion of eligible (within 12 months of arrival in Australia) refugee background patients with medical records where there is evidence of billing for a comprehensive health assessment (MBS items 701, 703, 705 and 707). Secondary outcome measures will be:
The change in the proportion of patients with records with recorded refugee identification (country of birth, ethnicity, year of arrival).
The change in proportion of refugee patient consultations with documented use of credentialed interpreter, where one was required.
The change in practice staff knowledge, attitudes and behaviours towards referring refugee background patients to external health and welfare services for which their refugee patients are eligible.
We will also measure changes in general practitioners’ confidence to undertake health assessments, catch-up immunisation and infectious diseases screening, and changes in practice routines relating to health assessments.
A timeline of the intervention proposal is shown in Table 3.
Given that our primary outcome measure is a proportion i.e. the proportion of refugee patients’ records that show a refugee health assessment was billed when it was indicated, then to detect a post-intervention increase in percentage by 25–30% (a medium-large effect) we need approximately 12 clinics per region. In each of the 12 clinics we require cross-sectional data from 30 refugee background patients at each timepoint. Sample size calculations were done using Stata statistical software stepped-wedge for clusters defined at the level of the practice, intra-class correlation coefficient of 0.05, 80% power, an alpha of 0.05 and data collected at two time points .
The project will be promoted to general practice clinics through the partner organisations, including practice visits, newsletters and promotion through each region’s PHN website. Practices will be invited to express interest through contacting the research team. Practices will be recruited by personal contact from the study’s research officers during an on-site visit to practices that express interest. The visit will allow an opportunity to further explain the project and to obtain written informed consent. Once the practice gives informed consent, clinical staff will be approached directly (generally through a practice meeting) and asked to provide written informed consent for the practice to participate in the intervention.
Practices will be offered a $2000 honoraria in recognition of the time required by staff to participate in the study. Participating general practitioners, practice nurses and practice managers will be eligible for continuing professional development points through their respective peak and professional bodies.
Assignment of interventions
Following recruitment into the study, practices will undergo blinded, stratified random allocation into either an early or late intervention group using a minimization procedure. Early group practices will start receiving the intervention immediately after recruitment. Late group practices will start the intervention 6-months after the date of completing the initial baseline data collection to act as control for the group receiving the intervention first. To ensure that early and late study groups are similar, practices will be stratified based on region and practice size as determined by the number of full time equivalent (FTE) general practitioners (≤ 5 FTEs, > 5 FTEs). The randomization codes were generated using Minim randomization software . Wherever possible, batches of two or more practices will randomised at the same time.
A statistician external to the project will perform the randomisation but will be blinded to the name or location of the practice. Practices will be informed of their allocation as blinding of practices to early or late intervention will not be possible.
Data collection methods
Evaluation of the impact of the intervention will be assessed at the level of the practice. The researchers will collect data from early intervention practices at three-time points: at baseline (prior to the start of the intervention), at 6-months (immediately after completion of the intervention), and at 12 months (6-months after the intervention has been completed). Data collection in the late intervention practices will follow the same schedule, however they will have an additional point of data collection immediately prior to the start of the intervention. Table 4 provides an overview of the data collection methods used at each time point.
A qualitative study is embedded within the quasi-experimental randomised controlled trial. We will use qualitative methods to generate an in-depth understanding of practice facilitation as the mechanism of change, and the key contextual determinants of change. Qualitative data will illuminate our understanding of variations in quantitative practice performance data in relation to refugee identification, interpreter use, conduct of comprehensive health assessments and referral, in response to the intervention.
The following instruments will be used to collect data:
De-identified data extraction: The PENCS CAT4™ tool, is widely used by practices and Primary Health Networks to monitor practice performance and inform routine quality improvement interventions. The research team designed an add-on software report within the CAT4™ tool to allow measurement of general practice performance in key refugee health quality domains including refugee identification, interpreter use and health/mental health assessments. Searches of each participating practice’s electronic clinical and practice management software will first filter all patient records where identifiers of country of birth, ethnicity or language spoken that are relevant to refugee populations have been recorded in a coded field or as free text in the patient record. All identifiable information including patient name, address, contact details will be automatically removed prior to the output being made available to the researchers. This output will be a de-identified line listed excel spreadsheet that includes (where available) residential postcode, age, gender, country of birth, ethnicity, language spoken, year of arrival, interpreter needed, list of diagnoses, date of first visit, dates of visits in the last 12 months, dates of visits where an interpreter was used, date of last health assessment and date of last mental health care plan. This data extract will be carried out at baseline and repeated at the end of the intervention period as well as at 6-months post intervention completion. Analysis will allow us to identify track changes in practice performance as a result of the quality improvement intervention.
A Practice Description survey (Additional file 2) will be administered to the practice team at baseline and will contain questions regarding a practice’s staffing, patient load and demographics, organisational structure/governance, appointment setting systems, clinical record management systems, payment systems and processes for client transition including transfer of information. Survey items were primarily derived from the Preventive Evidence into Practice study (PEP)  and the Canadian Community-Based Primary Health Care Common Indicator Project .
A Practitioner survey (Additional file 3) will be administered to each consenting general practitioner. This will contain questions ascertaining practice staff’s background, experience and interest in refugee health care delivery, and experience of and attitude towards using interpreters in clinical care. Survey items were derived from the Comparison of Models of Primary Care in Ontario study ; PEP ; the Community-Based Primary Health Care Common Indicator Project ; and the Patient-Centered Medical Home Scale . The survey will be repeated at the end of the intervention period.
A Refugee healthcare survey (Additional file 4) will be administered to each practice and their staff participating in the project by the Research Officer during the first facilitation visit to document whole-of-practice approaches to refugee care. The survey items were designed specifically for this project, informed by the areas of focus emerging from the deliberative forum. The data generated by using this tool will also inform tailoring of the practice facilitation intervention. The survey will be repeated at the end of the intervention period.
Semi-structured interviews: Following the intervention period, we will interview Practice Facilitators (n = 3), research officers (n = 3) and practice staff who played a key role in intervention from two practices in each round within each region (n = 12 practices) to explore their experiences of being involved in the intervention. The aims of the interviews are to identify key factors affecting the fidelity, effectiveness and sustainability of the intervention.
Facilitator diary: Practice Facilitators will maintain a reflective diary of their contacts with practices to document activities undertaken, resources provided, challenges encountered and how these were overcome.
Action plans: As part of the intervention, Practice Facilitators will work alongside key practice personnel to document practice goals and relevant activities relating to refugee identification, interpreter use, conduct of comprehensive health assessments and referral. Action plans will be used to monitor progress towards practice goals and (where applicable) the documentary evidence of achieving these goals.
Facilitator meeting minutes: The research team will maintain detailed minutes from the research officers’ meeting and the Practice Facilitator meetings.
Reports of regional needs assessments: Will provide additional information on the region, including refugee population demographics, distribution general practice clinics and refugee health services within the catchment and socio-political factors affecting service provision.
Survey data will be collected using electronic or paper based forms. All survey data will be entered into Qualtrics then checked for accuracy and completeness prior to de-identification. Patient data will be extracted from practice records using PENCS CAT4 in de-identified format. Trained researchers will clean quantitative data using a protocol created in collaboration with the project biostatistician. Quantitative data will be exported to SPSS or Stata for analysis.
Audio files of interviews with practice staff will be de-identified and transcribed verbatim. Interview transcripts, facilitator diaries and other documents will be exported to NVivo for analysis.
Changes in practice performance relating to the primary outcome measure will be assessed between early and late intervention practice groups using multilevel mixed effects models to account for clustering as recommended for stepped-wedge cRCT designs [19, 20]. All quantitative outcome measures will be assessed for clustering, and if not significant may be further explored through uni-level multivariate methods (e.g. logistic regression to investigate factors affecting the proportion of consultations with interpreter use). However, if practice-level clustering is indicated, then the mixed models will include a cluster-specific random effect to deal with clustering at the practice level. In the main analysis the independent variables defined as fixed effects will be group allocation (1 = early, 0 = late), intervention status (0 = pre-intervention, 1 = post-intervention) and timepoint (0 = baseline for all practices, 1 = post intervention for early practices, pre-intervention for late start practices, 2 = 6 months post intervention for early practices, post intervention for late start practices, 3 = 6 months post intervention for late practices). Timepoint will be included as a categorical variable. In subsequent analyses, provider and practice level covariates thought to influence outcomes will be included to adjust for baseline differences between the two groups.
A Research Fellow with qualitative methods expertise will read de-identified interview transcripts, facilitator diaries, and other documents. We will begin by developing a preliminary coding template, based on the initial reading and familiarisation with the raw data, as well as a priori broad theoretical concepts from Stange and Glasgow’s Context Tool  and May’s Normalisation Process Theory [26, 40]. We will refine and expand on the preliminary coding template following the standard qualitative techniques of immersion, crystallisation and constant comparison which involves repeated cycles of detailed examination of data, followed by reflection, identification, and articulation of themes and concepts and purposive refinement of existing theories. Interpretive insights are recorded to generate a ‘thick’ description of the findings and their context and include extracts from raw data and discussed with the team. Individual member of the research team will independently code a number of sources to test for reliability and the appropriateness of the final coding template.
We will use matrices to help organize and analyse the data and generate case descriptions . We will evaluate the impact of the practice facilitation approach by exploring mechanisms for changes in practice routines across the four foci of the intervention, and then further considered against:
Practice outer context: refugee background population in the area, links with external environment.
Practice inner context: practice size, practice staff, time required to recruit the practice, proportion of refugee patients, staff/patient language concordance.
Intervention: practice’s level of engagement with the intervention.
Facilitator and research officers: the time research officers spend engaging the practices and troubleshoot issues arising with implementation.
Reliability will be informed by parallel collection of the same categories of data by multiple researchers, inter-rater comparisons of data coding decisions and clearly defined measurement procedures. Accuracy of the findings is achieved through the use of multiple data sources, and the triangulation of qualitative data with surveys and de-identified aggregate clinical data .
Minimal risks were evaluated with this study and hence a data monitoring committee was not needed.
Harms within the study are not anticipated, however in the event that they do arise, practices will inform the research officer and the practice may have to be withdrawn from the study. Ethics procedures are in place such that if a participating provider becomes distressed at interview they will be referred for psychological support.
No plans for auditing have been made for this study.
Research ethics approval
The project was approved by the Monash University Human Research Ethics Committee (Ref:10086), Monash Health Human Research Ethics Committee (Ref: 17-487L), South West Sydney Local Hospital District Human Research Ethics Committee (Ref: LNR/17/Lpool/391) and La Trobe University Human Research Ethics Committee (Ref: S17–138). Original protocol approvals were granted in September 2017 before project commencement. All protocol amendments require agreement by all authors, and will be submitted to and approved by the respective Human Research Ethics Committee using the appropriate ethics amendment forms. As a practice-based intervention designed to achieve organisational change, there was no direct contact with refugee clients, hence ethical concerns that may arise about conducting research about this vulnerable group were not applicable.
Consent or assent
Written informed consent will be obtained from participants.
Data will be stored on password protected secure drives on Monash University servers, and/or in secure filing cabinets for the duration of the study. Data will be cleaned and de-identified by each site prior to secure transfer to the biostatistician.
Access to data
Investigators are data custodians during and after the project. Custodians need to be informed about any data management/analyses.
Ancillary and post-trial care
As there are low risks of harm with this study, ancillary and post-trial care has not been organised.
The results of this study will be disseminated via publication in a peer reviewed journal and presented at a relevant conference. The investigators have adopted an authorship protocol based on the International Committee of Medical Journal Editors recommendations . Final decisions in case of disputes regarding authorship rest with the study’s principal investigator. Partner agencies will be acknowledged in all publications. Professional writers will not be used. Findings will be shared with each Regional Partnership Team, and summaries of key findings will be shared with participating practices and other interested stakeholders. Public access will be provided for individual participant data that underlie the results reported in study publications, after de-identification (text, tables, figures, and appendices). We will also make available the statistical analysis plan and relevant statistical code. Availability will begin 6 months after and end 36 months following article publication and will be for proposals that have been approved by an independent review committee. Qualitative data will not be made publicly available.
A co-designed, practice facilitation intervention is an innovative approach to improve key refugee background patient outcomes in 36 practices in regions with the highest refugee settlement in Australia.
The findings of the research described in this paper will generate evidence for the effectiveness and limitations of a practice facilitation approach to quality improvement in general practice. This will add to the evolving body of knowledge around the implementation of practice facilitation, particularly whole-of-practice changes that impact on access to quality primary health care for vulnerable populations. It will also generate evidence about the approach to facilitate improvements in the delivery of primary care to people of refugee background.
Data on the intervention will generate valuable knowledge concerning the effectiveness of outreach practice facilitation in optimising the primary care of people of refugee background in Australia. If successful, it will deliver quality, accessible and coordinated PHC care to refugees. Primary care clinicians, especially those working within general practice clinics will benefit from insights for improving refugee identification, health assessment, interpreter use and referral. Potential solutions can be adapted to local contexts to address a local health system’s priority gaps and will ultimately assist the Australian health system to integrate care and reduce the burden on refugee focused health services to meet the needs of this vulnerable population. Additional benefits are likely to flow from inter-sectoral partnerships between academics, Refugee Focused Health Services, mainstream general practice clinics, settlement services, state governments and primary health care organisations.
Availability of data and materials
Refugee health fellows are medical practitioners funded by the Victorian Department ofHealth and Human services to build capacity in refugee and asylum seeker health. Moreinformation on refugee health fellows can be found at: http://refugeehealthnetwork.org.au/engage/refugee-health-fellows/
Refugee health nurses
in Victoria are located in community health centres in areas of high refugee settlement. In New South Wales, they are affiliated with the NSW Refugee Health Service. Both programs are funded by the state Departments of Health and Human Services.
cluster Randomised Controlled Trial
Full Time Equivalent
Medicare Benefits Schedule
North West Melbourne
Primary Health Care
Primary Health Network
Regional Partnership Team
South East Melbourne
South West Sydney
Karlsen E. Refugee resettlement to Australia: what are the facts? . Research Paper Series, 2016–17; 2016.
Parliament of Australia. Migration and humanitarian programs Canberra 2015 [.
Department of Health and Human Services. The Victorian refugee and asylum seeker health action plan 2014–2018. Melbourne: Victorian Department of Health and Human Services; 2014.
Primary Health and Community Partnerships. Department of Health NSW. Refugee Health Plan 2011-2016. North Sydney: Department of Health, NSW; 2011. Available from: https://www1.health.nsw.gov.au/pds/ActivePDSDocuments/PD2011_014.pdf.
Foundation House. Promoting refugee health: a guide for doctors and other health care providers caring for people from refugee backgrounds. Brunswick: Foundation house; 2007.
Harris M, Telfer BL. The health needs of asylum seekers living in the community. Med J Aust. 2001;175(11/12):589–92.
Harris MF, Zwar N. Refugee health. Aust Fam Physician. 2005;34(10):825–9.
Bowers EJ, I-H C. Meeting the primary health care needs of refugees and asylum seekers. Res Roundup. 2010;16:2.
Davidson N, Skull S, Calache H, Chesters D, Chalmers J. Holes a plenty: oral health status a major issue for newly arrived refugees in Australia. Aust Dent J. 2006;51(4):306–11.
Correa-Velez I, Johnston V, Kirk J, Ferdinand A. Community-based asylum seekers' use of primary health care services in Melbourne. Med J Aust. 2008;188(6):344–8.
Davidson M, Smith BD, Frydenberg A, Isaacs D, Buttery JP, et al. Comprehensive health assessment for newly arrived refugee children in Australia. J Paediatr Child Health. 2004;40(9/10):562–8.
Russell G, Harris M, Cheng I, Kay M, Vasi S, Joshi C, Chan B, Lo W, Wahidi S, Advocat J, Pottie K, Smith M, Furler J. Coordinated primary health care for refugees: a best practice framework for Australia. Report to the Australian Primary Health Care Research Institute; 2013.
Murray SB, Skull SA. Hurdles to health: immigrant and refugee health care in Australia. Aust Health Rev. 2005;29(1):25–9.
Lamb CF, S M. Problems refugees face when accessing health services. N S W Public Health Bull. 2002;13:161–3.
Agency for Healthcare Research and Quality. Developing and running a practice facilitation program for primary care transformation: a how-to guide. Rockville: US Department of Health and Human Services; 2011.
Nagykaldi Z, Mold JW, Aspy CB. Practice facilitators: a review of the literature. Fam Med. 2005;37(8):581–8.
Kay M, Jackson C, Nicholson C. Refugee health: a new model for delivering primary health care. Aust J Prim Health. 2010;16(2):98–103.
Furneaux S, Duell-Piening S, Christensen S, Jaraba S, Loupetis M, Varenica R. Engaging and supporting general practice in refugee health Melbourne, Australia: the Victorian Foundation for survivors of torture (foundation house); 2017 [Available from: http://refugeehealthnetwork.org.au/wp-content/uploads/Report_2016_August_Primary-Care-Report_FINAL-REPORT-WEB2.pdf.
Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28:182–91.
Hemming K, Taljaard M, Frobes A. Analysis of cluster randomised stepped wedge trials with repeated cross-sectional samples. Trials. 2017;18(1):101.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.
Fiss PC. A set-theoretic approach to organizational configurations. Acad Manag J. 2007;32(4):1180–98.
Levesque JF, Pineault R, Provost S, Tousignant P, Couture A, Da Silva RB, et al. Assessing the evolution of primary healthcare organizations and their performance (2005-2010) in two regions of Quebec province: Montreal and Monteregie. BMC Fam Pract. 2010;11:95.
Crosby LE, Parr W, Smith T, Mitchell MJ. The community leaders institute: an innovative program to train community leaders in health research. Acad Med. 2013;88(3):335–42.
de Gruy F 3rd. Depression research in primary care: pushing the field forward. Ann Fam Med. 2005;3(1):3–6.
May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: normalization process theory. Implement Sci. 2009;4:29.
Australian government department of health. Primary health network map locator 2019 [cited 2019 03/01/2019]. Available from: https://www.health.gov.au/internet/main/publishing.nsf/Content/PHN-Locator.
MacNeil C. Evaluator as steward of citizen deliberation. Am J Eval. 2002;23(1):45–54.
Deming WE. Out of the crisis. Massachusetts: Massachusettes institute of technology; 1986.
Liddy C, Laferriere D, Baskerville B, Dahrouge S, Knox L, Hogg W. An overview of practice facilitation programs in Canada: current perspectives and future directions. Healthc Policy. 2013;8(3):58–67.
Liddy C, Hogg W, Russell G, Wells G, Armstrong CD, Akbari A, et al. Improved delivery of cardiovascular care (IDOCC) through outreach facilitation: study protocol and implementation details of a cluster randomized controlled trial in primary care. Implement Sci. 2011;6:110.
Hogg W, Lemelin J, Moroz I, Soto E, Russell G. Improving prevention in primary care: evaluating the sustainability of outreach facilitation. Can Fam Physician. 2008;54(5):712–20.
Harris MF, Lloyd J, Litt J, van Driel M, Mazza D, Russell G, et al. Preventive evidence into practice (PEP) study: implementation of guidelines to prevent primary vascular disease in general practice protocol for a cluster randomised controlled trial. Implement Sci. 2013;8(1):8.
Hemming K, Girling A. A menu-driven facility for power and detectable-difference calculations in stepped-wedge cluster-randomized trials. Stata J. 2014;14:363–80.
Evans S, Royston P, Day S. Minim: allocation by minimisation in clinical trials. University of York; 2017. https://www-users.york.ac.uk/~mb55/guide/minim.htm.
Canadian Institutes of Health Research. Community-Based Primary Health Care (CBPHC) Common Indicator Project 2015 [updated 15 September 2015. Available from: http://www.cihr-irsc.gc.ca/e/47012.html.
Rowan MS, Hogg W, Labrecque L, Kristjansson EA, Dahrouge S. A theory-based evaluation framework for primary care: setting the stage to evaluate the "comparison of models of primary health Care in Ontario" project. Can J Program Eval. 2008;23(1):113–40.
Lewis SE, Nocon RS, Tang H, Park SY, Vable AM, Casalino LP, et al. Patient-centered medical home characteristics and staff morale in safety net clinics. Arch Intern Med. 2012;172(1):23–31.
Stange KC, Glasgow RE. Considering and Reporting Important Contextual Factors in Research on the Patient-Centered Medical Home. Rockville: Agency for Healthcare Research and Quality; 2013.
May CR, Finch T, Ballini L, MacFarlane A, Mair F, Murray E, et al. Evaluating complex interventions and health technologies using normalization process theory: development of a simplified approach and web-enabled toolkit. BMC Health Serv Res. 2011;11:245.
Miles MB, Huberman AM, Saldana J. Qualitative data analysis : a methods sourcebook. 3rd ed. Thousand Oaks: SAGE Publications, Inc.; 2014.
Cohen DJ, Crabtree BF. Evaluative criteria for qualitative research in health care: controversies and recommendations. Ann Fam Med. 2008;6(4):331–9.
International Committee of Medical Journal Editors. Recommendations for the conduct, reporting, editing, and publication of scholarly work in medical journals. International Committee of Medical Journal Editors, ; 2018. Contract No.: 11/04/2019.
The authors acknowledge the commitment and professionalism of those working within the eleven partner organisations who have worked together over a number of years to bring this project to fruition. We thank Ms. Anne Peek and other members of the leadership team of the former South-Eastern Melbourne Medicare Local for providing support and inspiration for the work supporting the development of the study. Finally we acknowledge the assistance of Mr. Bill Chow and Dr. Katrina Long for their work in preparing this manuscript for publication.
This project is co-funded by the National Health and Medical Research Council (NHMRC) Partnerships for Better Health Scheme (Round 2, 2015, APP1106372) and the following partner agencies: Monash Health, coHealth, enliven, Victorian Department of Health and Human Services, Victorian Refugee Health Network, NSW Refugee Health Service, South Eastern Health Providers Association, North Western Melbourne Primary Health Network; South Western Sydney Primary Health Network, AMES, Settlement Services International and the Royal Australian College of General Practitioners. Partner agencies have contributed to the study design and dissemination through involvement in a National Project Advisory Group. Study recruitment, management, analysis and publication are entirely independent of the funding agencies.
Ethics approval and consent to participate
The project was approved by the Monash University Human Research Ethics Committee (Ref:10086), Monash Health Human Research Ethics Committee (Ref: 17-487L), South West Sydney Local Hospital District Human Research Ethics Committee (Ref: LNR/17/Lpool/391) and La Trobe University Human Research Ethics Committee (Ref: S17–138). Original protocol approvals were granted in September 2017 before project commencement. All protocol amendments were submitted to and approved by the respective HREC using the appropriate ethics amendment forms. Written informed consent will be obtained from participants.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.