- Research article
- Open Access
- Open Peer Review
Can a continuous quality improvement program create culturally safe emergency departments for Aboriginal people in Australia? A multiple baseline study
BMC Health Services Researchvolume 19, Article number: 222 (2019)
Providing culturally safe health care can contribute to improved health among Aboriginal people. However, little is known about how to make hospitals culturally safe for Aboriginal people. This study assessed the impact of an emergency department (ED)-based continuous quality improvement program on: the accuracy of recording of Aboriginal status in ED information systems; incomplete ED visits among Aboriginal patients; and the cultural appropriateness of ED systems and environments.
Between 2012 and 2014, the Aboriginal Identification in Hospitals Quality Improvement Program (AIHQIP) was implemented in eight EDs in NSW, Australia. A multiple baseline design and analysis of linked administrative data were used to assess program impact on the proportion of Aboriginal patients correctly identified as Aboriginal in ED information systems and incomplete ED visits in Aboriginal patients. Key informant interviews and document review were used to explore organisational changes.
In all EDs combined, the AIHQIP was not associated with a reduction in incomplete ED visits in Aboriginal people, nor did it influence the proportion of ED visits made by Aboriginal people that had an accurate recording of Aboriginal status. However, in two EDs it was associated with an increase in the trend of accurate recording of Aboriginality from baseline to the intervention period (odds ratio (OR) 1.31, p < 0.001 in ED 4 and OR 1.15, p = 0.020 in ED 5). In other words, the accuracy of recording of Aboriginality increased from 61.4 to 70% in ED 4 and from 72.6 to 73.9% in ED 5. If the program were not implemented, only a marginal increase would have occurred in ED 4 (from 61.4 to 64%) and, in ED 5, the accuracy of reporting would have decreased (from 72.6 to 71.1%). Organisational changes were achieved across EDs, including modifications to waiting areas and improved processes for identifying Aboriginal patients and managing incomplete visits.
The AIHQIP did not have an overall effect on the accuracy of recording of Aboriginal status or on levels of incomplete ED visits in Aboriginal patients. However, important organisational changes were achieved. Further research investigating the effectiveness of interventions to improve Aboriginal cultural safety is warranted.
In Australia, Aboriginal peopleFootnote 1 have poorer health than non-Aboriginal people . Although improvements have been made in recent decades, Aboriginal people continue to experience higher rates of infant mortality, injury, non-communicable diseases, preventable illnesses and nutritional disorders than other Australians [2, 3]. Several social factors contribute to the gap in health outcomes between Aboriginal and non-Aboriginal people, such as higher levels of unemployment, social exclusion and experiences of racism and suboptimal use of health care among Aboriginal people [3,4,5]. Aboriginal people are more likely than non-Aboriginal people to delay seeking care until their illness is advanced and/or comorbid .
Aboriginal peoples’ engagement with health care is influenced by the physical accessibility, affordability and cultural safety of health service provision . Culturally safe care is characterised by a genuine partnership between patient and health care provider in which: power is shared; the life experiences, views and beliefs – especially cultural beliefs – of the patient are respected; and Aboriginal histories and associated social impacts are acknowledged [8,9,10,11]. Some Aboriginal people feel culturally unsafe when using mainstream health services in Australia and are therefore reluctant to seek care in these settings . Some factors that undermine the cultural safety of Aboriginal patients include: culturally insensitive health staff; institutionalised racism; a shortage of Aboriginal health workers; distrust of the health system among some Aboriginal patients; and unwelcoming waiting areas in key settings like hospital emergency departments (ED) [13, 14].
Aboriginal people are overrepresented among ED patients, relative to population size . Additionally, EDs are the first point of contact with the health system for many Aboriginal people. EDs are therefore uniquely positioned to improve the health of this group . However, EDs can feel unwelcoming and culturally unsafe for some Aboriginal people [13, 14]. Common aspects of the ED visit experience, like variable and sometimes long wait times and a lack of information about ED processes, contribute to a perceived sense of powerlessness or lack of control among some Aboriginal people . Further, rates of incomplete ED visits (where the patient either left the ED before receiving a medical assessment or left the ED after a medical assessment but before completion of care) are elevated among Aboriginal people compared to non-Aboriginal people (9.7% vs. 7.1%), providing indirect evidence of higher levels of dissatisfaction with ED care in Aboriginal people than in other Australians [17,18,19].
Improving the cultural safety of health services can contribute to improved health among Aboriginal people and is a health priority in Australia [20, 21]. However, little is known about how to effectively intervene, including in ED settings. Recent reviews have found a predominance of descriptive studies, a lack of high quality intervention studies and a need for more rigorous innovation testing and translational research [10, 22, 23]. Continuous quality improvement (CQI) seeks to improve service quality through on-going cycles of reflection and refinement. Existing organisational processes are examined and modifications are developed, tested and, if effective, adopted . CQI approaches have shown initial promise in improving the cultural safety of Aboriginal people in some primary care settings – especially in Aboriginal community-controlled health services – and warrant further investigation in secondary and tertiary care settings [10, 24].
We evaluated the Aboriginal Identification in Hospitals Quality Improvement Program (AIHQIP), a CQI initiative aiming to improve the cultural safety of Aboriginal patients in eight EDs in New South Wales (NSW), Australia. The study aimed to investigate whether the program: increased the proportion of Aboriginal patients correctly identified as Aboriginal in ED information systems; reduced the proportion of Aboriginal patients who had an incomplete ED visit; and improved the cultural appropriateness of ED systems and environments.
Each participating ED implemented a CQI project with a focus on working with Aboriginal people to improve the cultural safety of ED services for Aboriginal patients. Each ED employed a project officer and established a working group to lead and guide project implementation. Working group membership typically included key hospital staff, staff of Aboriginal community-controlled organisations and local Aboriginal community members.
The research team supported EDs to implement their CQI projects in the following ways:
Provision of a nine-step “Plan, Do, Study, Act” CQI framework with a unique emphasis on genuine partnership with Aboriginal communities. The framework included an implementation toolkit with supportive resources, such as an action plan template and examples of activities to aid each framework step. The nine steps of the framework are shown in Fig. 1, with further details available elsewhere .
Provision of a 1.5 day face-to-face training session for project officers and other interested working group members on how to implement the nine-step CQI framework and use the implementation toolkit. Key topics covered included: problem identification and solution generation; data collection and synthesis; action planning; guiding principles for collaborating with Aboriginal organisations; examples of best practice in the application of CQI; and the Aboriginal health policy context in NSW.
Provision of between four and six site visits during which project officers were provided with tailored CQI and cultural competency advice, mentoring and resources, with additional support provided via email and telephone.
Establishment of a network of project officers and other working group members from participating EDs to: share and discuss their CQI experiences; identify key facilitators and barriers to effective implementation; and share CQI resources. Two face-to-face meetings of the network were facilitated by the research team.
Each ED selected objectives for their CQI project from a predetermined list of objectives aligning with the overarching aims of the AIHQIP. Common project objectives included to: encourage Aboriginal patients to identify as Aboriginal in the ED; improve the Aboriginal cultural competence of ED staff and other hospital staff; improve collaboration between the ED and Aboriginal community-controlled organisations; and reduce incomplete ED visits among Aboriginal patients. Tailored strategies were developed, implemented and refined to meet these objectives.
The AIHQIP was implemented in eight public EDs in NSW, one of eight States and Territories in Australia. About 7.5 million people live in NSW, of whom about 3% (n~ 216,000 persons) are Aboriginal people . There are about 2.7 million visits to NSW EDs annually, with about 6% (n~ 462,000) of visits made by Aboriginal people .
In NSW, public EDs are operated by autonomous, geography-based health corporations called Local Health Districts, while the NSW Ministry of Health monitors and manages ED performance – for example, levels of re-presentation to the same ED within 48 h among Aboriginal patients. Several policies and procedures are in place to improve Aboriginal peoples’ experiences of emergency care in NSW, including mandatory Aboriginal cultural competency training for all hospital staff, mandatory recording of the Aboriginal status of hospital patients in information systems and a strategy for increasing and building the capacity of the Aboriginal health workforce in public hospitals, including EDs. Additionally, some EDs employ Aboriginal Liaison Officers (ALO) to provide emotional, social and cultural support to Aboriginal patients and their families when in hospital.
Site selection was non-random. EDs were chosen to include a mix of rural and metropolitan EDs across multiple Local Health Districts. Additionally, executive support for implementing the AIHQIP and employment of an ALO were essential criterion for study participation, as these characteristics were considered fundamental to implementing the program as intended. The characteristics of participating EDs are included in Table 1.
A multiple baseline design, qualitative interviews with program stakeholders and document review were used to evaluate the AIHQIP.
Multiple baseline design
A multiple baseline design  and secondary analysis of linked administrative health data were used to assess quantitative outcomes of the AIHQIP.
Data were obtained from the NSW Admitted Patient, Emergency Department Attendance and Deaths Register (APEDDR). The APEDDR is a statutory public health and disease register established under the NSW Public Health Act 2010 to support, among other things, evaluations of public health interventions. It includes linked records of the following datasets:
NSW Admitted Patient Data Collection includes records of all separations in NSW private and public hospitals.
NSW Register of Births, Deaths and Marriages includes records of all births, deaths and marriages registered in NSW.
Cause of Death Unit Record File provides cause(s) of death for all deaths registered in NSW.
NSW Emergency Department Data Collection includes records of all visits to public EDs in NSW. Data are obtained from patient information systems in local EDs.
These data sources were linked by the Centre for Health Record Linkage using probabilistic record linkage methods.
The study population included Aboriginal people who attended one of the eight participating EDs between 1st January 2010 and 31st March 2015.
The two outcomes investigated were the proportion of Aboriginal patients correctly identified as Aboriginal in ED information systems and rates of incomplete ED visits. Both are considered indirect indicators of the cultural safety of ED service provision .
In NSW, staff in public EDs are required to ask every ED patient if they are AboriginalFootnote 2 although adherence to this requirement is variable within and across EDs. Health staff are more likely to ask this question of patients if they are culturally competent and work in an environment in which Aboriginal cultural competency standards are integrated into policies and procedures . An Aboriginal person may choose not to identify as Aboriginal if they feel culturally unsafe in the ED, especially if they think that identifying as Aboriginal will negatively influence the quality of care they receive [29, 30].
The proportion of Aboriginal patients correctly identified as Aboriginal in ED information systems was assessed using the Enhanced Reporting of Aboriginality (ERA) variable in the APEDDR. The different datasets in the APEDDR and records of the NSW Perinatal Data CollectionFootnote 3 (all of which hold information on the Aboriginal status of the patient/person) were linked and an algorithm applied to identify ED records for which the patient could reasonably be considered an Aboriginal person for analysis purposes. The algorithm was as follows: if the person had three or more independent units of information (for example, a birth record, a hospital separation record and an ED separation record) and at least two of these indicated that the person was Aboriginal, then the person was considered Aboriginal; or if the person had one or two independent units of information and at least one of these indicated that the person was Aboriginal, then the person was considered Aboriginal. More on the ERA variable can be found elsewhere . The accuracy of recording of Aboriginality was calculated as the observed number of ED visits for which the patient was recorded as Aboriginal in the ED information system divided by the “expected” number of ED visits by Aboriginal people, as determined by the ERA calculation.
Incomplete ED visits included visits for which the patient either left the ED before receiving a medical assessment or left the ED after a medical assessment but before completion of care or ED discharge. Feeling culturally unsafe is a main reason why Aboriginal people leave the ED early [14, 32]. Incomplete ED visits provide indirect evidence of patient dissatisfaction with the ED experience . Rates of incomplete ED visits among Aboriginal people were calculated by dividing the number of incomplete visits by the total number of ED visits, using the Indigenous status variable in the NSW Emergency Department Data Collection.
The eight EDs were allocated to three clusters. The clustering of EDs was non-random and informed by practical considerations, such as readiness to start implementing the AIHQIP. Clusters were then randomly assigned an implementation order of first, second or third. It was intended that program implementation in each cluster would be separated by three months. However, some EDs experienced delays in implementing the AIHQIP such that the period separating program commencement in EDs ranged from one month to four months. The first cluster of EDs started implementation in August 2012, with the implementation period at each site ranging in duration from 10 months to 15 months (Table 1).
Monthly data on the two outcomes were obtained for each ED and partitioned temporally into: before the intervention was implemented (control period: January 1st 2010 until the first site visit by the research teamdFootnote 4) and during and immediately after program implementation (intervention period: from the date of the first site visit until March 31st 2015). Each ED had at least 17 control period time points and 19 intervention period time points.
The multiple baseline design acknowledges that EDs differ by catchment population, staffing arrangements, administrative procedures and other characteristics. This variation, combined with the random staggering of intervention commencement across participating EDs (described above), increases the likelihood that any detected improvement in outcomes is due to the intervention, rather than external factors .
In determining program effectiveness, the main consideration was whether the trend in each outcome changed significantly, and in the desired direction, following program implementation. Change in intercept (that is, immediate change in the outcome at the start of the intervention period) was considered less relevant given the organisational changes the AIHQIP aimed to achieve can take a long time to establish.
Data were aggregated by month of ED presentation, hospital and patient sex, age group and Aboriginal status. Baseline patient characteristics were calculated for each site. Two modelling phases were undertaken for each outcome. First, preliminary logistic regression models were prepared for each study ED to investigate facility-level intervention effects. Following this, generalised linear mixed models were prepared to investigate the average intervention effect among all study EDs. Preliminary analyses identified a need to adjust for varying intercepts, trends and intervention effects between study sites. In all models, the key parameter of interest was the change in the linear trend from the control period to the intervention period. Parameter estimates were calculated, along with odds ratios, 95% confidence intervals and corresponding p-values. Data management and aggregations were performed in SAS version 9.3. Modelling was conducted in R version 3.2.1. An additional file provides a complete description of the statistical analysis [see Additional file 1].
Qualitative interviews with program stakeholders and document review
Following implementation of the AIHQIP, qualitative interviews of 15–60 min duration were conducted with participating ED staff and other hospital staff (n = 23) exploring factors influencing project implementation and perceived achievements. Interviewees were AIHQIP project officers (n = 8), hospital managerial staff (n = 8), a hospital executive, an LHD Deputy Director of Aboriginal Health, and ALOs (n = 5). Six of the 23 interviewees were Aboriginal people.
Interviews were conducted in a quiet room in participating EDs (three were done by phone) by a non-Aboriginal researcher with experience conducting qualitative interviews with Aboriginal people. Detailed notes were taken during the interviews and circulated to interviewees for comment and verification. The notes were analysed using qualitative thematic analysis and a data mining approach. Responses were grouped under the questions that were asked during interviews. Following this, responses were repeatedly read to identify common themes and key achievements, both within individual EDs and across all sites.
Documents relating to the AIHQIP (n = 50) were also reviewed to describe changes to participating ED systems and environments relating to the cultural safety of Aboriginal patients. The main documents reviewed were site visit reports. Following each site visit, the research team and local working groups compiled a report using a standardised template. Reports described: the hospital context; the CQI support provided; implementation progress and challenges; and organisational changes perceived to be related to the AIHQIP. Documents were analysed using qualitative thematic analysis and a data mining approach (as described above), and findings triangulated with key informant interview findings. Several other methods were used as part of a comprehensive process evaluation of the AIHQIP. However, these are not the focus of this paper.
Ethics approval was obtained from the NSW Population and Health Services Research Ethics Committee (Reference no. HREC/12/CIPHS/64) and the Aboriginal Health and Medical Research Council of NSW Ethics Committee (Reference no. 856/12).
During the control period, the average number of ED visits per month in the eight study EDs combined was 27,096 (Table 2). The average age of the presenting population was 28.3 years. However, average age varied among participating EDs (ranging from 25.2 years to 40.4 years). About half (51.3%) of the visits were made by females, although this also varied among participating EDs (ranging from 34.2 to 55.8%). Similarly, the proportion of ED presenters who were recorded as Aboriginal people in ED information systems differed between study sites, ranging from 1.7 to 22.3% (avg. 5.1%) (Table 2).
During the control period, the proportion of ED visits made by Aboriginal people that had an accurate recording of Aboriginal status varied among participating EDs (ranging from 45.5 to 87.2%; avg. 76%). The proportion of ED visits made by Aboriginal people that were incomplete also differed between study sites (ranging from 6.5 to 24.9%; avg. 11.5%) (Table 2).
Recording of Aboriginal status in ED information systems
During the control period, the proportion of ED visits made by Aboriginal people that had an accurate recording of Aboriginal status was significantly increasing over time in six of the eight participating EDs, while the accuracy of recording was decreasing significantly in one ED. A non-significant increase was observed in one ED (Fig. 2 and Table 3).
In two EDs, the AIHQIP was associated with a statistically significant increase in the trend of accurate recording of Aboriginality from the control period to the intervention period (Table 3) (the key parameter to consider in the table is the change in slope).
In ED 4, during the control period the odds of an ED visit made by an Aboriginal person having an accurate recording of Aboriginal status were increasing by a factor of 1.12 per year. During the intervention period, the odds were increasing by a factor of 1.47 per year (p < 0.001). In other words, if the AIHQIP was not implemented the accuracy of recording would have increased from 61.4% in the control period to 64% 12 months after the program was first implemented. However, program implementation was associated with a larger increase in the accuracy of recording during this period – from 61.4 to 70%.
In ED 5, during the control period the odds of an ED visit made by an Aboriginal person having an accurate recording of Aboriginal status were decreasing by a factor of 0.93 per year. During the intervention period, the odds were increasing by a factor of 1.07 per year (p = 0.020) (Table 3). In other words, if the AIHQIP was not implemented the accuracy of recording would have decreased from 72.6% in the control period to 71.1% 12 months after the program was first implemented. However, program implementation was associated with an increase in the accuracy of recording during this period – from 72.6 to 73.9%.
In all EDs combined, the AIHQIP was not associated with a change in the trend of accurate recording of Aboriginality from the control period to the intervention period (Table 4).
Incomplete ED visits
During the control period, the proportion of ED visits made by Aboriginal people that were incomplete remained steady over time in seven of the eight participating EDs and decreased significantly in one ED (Fig. 3 and Table 5).
The AIHQIP was not associated with a decrease in the trend of incomplete ED visits among Aboriginal people from the control period to the intervention period in any of the eight study EDs (Table 5), nor was an overall program effect detected (Table 6). Although decreases in the trend were observed in some sites, these were not statistically significant (Table 5).
Table 7 provides an overview of CQI project objectives and examples of organisational changes achieved by study EDs. Some examples of organisational changes which key informants attributed to the AIHQIP include:
the establishment of mandatory Aboriginal cultural competence training, including an Aboriginal patient identification training program, for ED staff and other hospital staff;
the strengthening of existing referral mechanisms between the ED and local Aboriginal community-controlled health services;
the establishment of a critical incident response procedure for all incomplete ED visits among Aboriginal patients, which aimed to learn from the incident, prevent similar incidents in the future and ensure follow up and care of the affected patient; and
the establishment of a performance indicator dashboard on the ED care of Aboriginal patients, which aimed to monitor and guide ED and hospital practice.
Key informant interviewees identified several factors that they felt enabled program implementation, such as supportive hospital executive staff and a high level of engagement of local Aboriginal community-controlled health services and ALOs in project design and implementation. A more complete description of the factors influencing implementation is included in Additional file 2.
To our knowledge, this is the first study to comprehensively investigate the effectiveness of a CQI program in making EDs more culturally safe for Aboriginal people in Australia. Our complementary use of a quasi-experimental design investigating primary outcomes and qualitative methods exploring organisational changes and program implementation is particularly novel in this area. In all study EDs combined, the AIHQIP was not associated with a reduction in incomplete ED visits in Aboriginal people, nor did it influence the proportion of ED visits made by Aboriginal people that had an accurate recording of Aboriginal status. However, in two EDs the AIHQIP was associated with an increase in the trend of accurate recording of Aboriginality from the control period to the intervention period.
There are four main factors that might explain this limited evidence of an intervention effect. First, the intervention may have lacked the intensity to influence the primary outcomes investigated. Second, in some participating EDs recording of Aboriginal patients’ Aboriginality was fairly accurate and trending up at baseline. As such, improvements in this outcome may not have been detected, or indeed possible, in these EDs. The same issue applied to the incomplete ED visits outcome. Third, it is possible that the outcomes of interest were assessed prematurely, as the system changes that the AIHQIP sought to achieve can take considerable time to institutionalise . Premature outcome assessment can occur in programs for Aboriginal people, especially if implementation is in complex systems where cause and effect and action and outcome relationships are poorly understood . A longer intervention period may have increased the statistical power to detect intervention effects and provided more time for the program to produce change in the primary outcomes. This was not possible, however, due to constraints of time and resources. Similar multiple baseline studies might employ a longer intervention period. Lastly, we did not conduct power calculations prior to study implementation. Consequently, our study may have been under-powered to detect subtle changes associated with the intervention. That said, we analysed all ED records that were reasonably available to us during the five year study period.
The linked administrative health data used in this study have several strengths. They provide population-level insights, they are easy and inexpensive to obtain relative to primary data collection methods, and they draw on multiple health datasets and the ERA algorithm to provide as accurate a description of the study population as possible. However, the two outcomes used – Aboriginal patients correctly identified as Aboriginal in patient information systems and incomplete ED visits in Aboriginal people – may not be the most sensitive measures of culturally safe care. Complementary use of other quantitative methods, such as patient satisfaction surveys, may have provided a more sensitive and comprehensive way of measuring the impacts of the AIHQIP [34, 35]. As part of a comprehensive program of surveys, the Bureau of Health Information implements regular surveys of patients’ experiences of public hospital and emergency care in NSW, with some surveys oversampling Aboriginal patients . These surveys provide a powerful tool for monitoring and evaluating the extent to which health services are meeting the needs of Aboriginal patients.
Our finding that the AIHQIP reoriented ED environments and systems towards the provision of culturally safe care for Aboriginal patients is encouraging. Organisations with cultural competency standards integrated into policies and practices have been found to foster culturally competent behaviours among health professionals . It is therefore likely that the organisational changes achieved in this study, if sustained, will reinforce culturally safe care in participating EDs in the future.
A strength of our study was that the AIHQIP aligned with the available evidence on building cultural competency in health organisations. Although few studies have rigorously examined the effectiveness of cultural competency interventions, there is growing recognition of the need for sustained, multifaceted organisational-level approaches [10, 38]. Interventions that combine organisational change strategies with efforts to develop individual competency are more likely to be effective than stand-alone low intensity interventions [39, 40]. Similarly, the strong engagement of Aboriginal communities and staff in our study reflect best practice principles for working with Aboriginal people to improve health outcomes . Our study reinforces the utility of CQI approaches as a tool for engaging Aboriginal communities in system change interventions. CQI should therefore form the basis of policy responses in this area.
There are three main limitations of our study. First, two participating EDs were delayed in commencing their CQI projects and therefore had condensed implementation periods, which may have reduced the likelihood of achieving program objectives and influencing the study outcomes. Second, the routinely collected data used in the multiple baseline design have some limitations relating to quality and completeness. In public EDs in NSW, practices relating to the entry of patient information in ED information systems, such as timeliness and quality checking, may vary among staff within EDs as well as between EDs, which introduces the potential of information bias in the findings. Third, the researcher who conducted the key informant interviews also conducted site visits in some participating EDs. This may have influenced some interviewees’ willingness to provide honest and fulsome responses during interviews.
The AIHQIP did not have an overall effect on the accuracy of recording of Aboriginality in ED information systems or on levels of incomplete ED visits in Aboriginal patients. Still, key organisational changes were achieved, which over time may lead to more welcoming and culturally safe ED environments for Aboriginal patients. Further research investigating the effectiveness of interventions to improve Aboriginal cultural safety is warranted.
In this paper, Aboriginal and Torres Strait Islander people are referred to as Aboriginal people in recognition that Aboriginal people are the original inhabitants of the Australian state of NSW, where this study was conducted.
NSW Health clinical staff are required to ask the following question of all patients: “Are you (is the person) of Aboriginal or Torres Strait Islander origin?”
The NSW Perinatal Data Collection holds records of all births in NSW, regardless of the birth setting.
Due to data quality problems, the control period for ED 8 was from April 1st 2012 until the first site visit by the research team (September 1st 2013).
Aboriginal Identification in Hospitals Quality Improvement Program
Aboriginal Liaison Officer
Admitted Patient, Emergency Department Attendance and Deaths Register
Continuous Quality Improvement
Enhanced Reporting of Aboriginality
New South Wales
Australian Institute of Health and Welfare. Australia's Health 2016. Austalia's health series no. 15. Cat. no. AUS 199. Canberra: AIHW; 2016a.
Australian Institute of Health and Welfare. Mortality and life expectancy of Indigenous Australians: 2008 to 2012. Cat. no. IHW 140. Canberra: AIHW; 2014.
Australian Institute of Health and Welfare. The health and welfare of Australia’s Aboriginal and Torres Strait Islander peoples 2015. Cat. no. IHW 147. Canberra: AIHW; 2015.
Durey A, McEvoy S, Swift-Otero V, Taylor K, Katzenellenbogen J, Bessarab D. Improving healthcare for Aboriginal Australians through effective engagement between community and health services. BMC Health Serv Res. 2016;16:224.
Markwick A, Ansari Z, Clinch D, McNeil J. Perceived racism may partially explain the gap in health between Aboriginal and non-Aboriginal Victorians: a cross-sectional population based study. SSM - Population Health. 2019;7:010.
Gibberd A, Supramaniam R, Dillon A, Armstrong BK, O'Connell DL. Are Aboriginal people more likely to be diagnosed with more advanced cancer? Med J Aust. 2015;202(4):195–9.
Ware VA. Improving the accessibility of health services in urban and regional settings for indigenous people. Resource sheet no. 27. Produced for the closing the gap clearinghouse. Canberra: Australian Institute of Health and Welfare & Melbourne: Australian Institute of Family Studies; 2013.
Garneau AB, Pepin J. Cultural competence: a constructivist definition. J Transcult Nurs. 2015;26(1):9–15.
Brascoupé S, Waters C. Cultural safety: Exploring the applicability of the concept of cultural safety to Aboriginal health and community wellness. J Aborig Health. 2009;5(2):6–41.
Bainbridge R, Mccalman J, Clifford A, Tsey K. Cultural competency in the delivery of health services for indigenous people. Issues paper no. 13. Produced for the closing the gap clearinghouse. Canberra: Australian Institute of Health and Welfare & Melbourne: Australian Institute of Family Studies; 2015.
Nguyen HT. Patient centred care - cultural safety in indigenous health. Aust Fam Physician. 2008;37(12):990–4.
Mbuzi V, Fulbrook P, Jessup M. Indigenous peoples' experiences and perceptions of hospitalisation for acute care: a metasynthesis of qualitative studies. Int J Nurs Stud. 2017;71:39–49.
Chapman R, Smith T, Martin C. Qualitative exploration of the perceived barriers and enablers to Aboriginal and Torres Strait islander people accessing healthcare through one Victorian emergency department. Contemp Nurse. 2014;48(1):48–58.
Wright L. “They just don’t like to wait”—a comparative study of Aboriginal and non-Aboriginal people who did not wait for treatment, or discharged themselves against medical advice from rural emergency departments: part 2. Australas Emerg Nurs J. 2009;12(3):93–103.
Australian Institute of Health and Welfare. Emergency department care 2015–16: Australian hospital statistics. Health services series no. 72. Cat. no. HSE 182. Canberra: AIHW; 2016b.
Thomas DP, Anderson IP. Use of emergency departments by Aboriginal and Torres Strait islander people. Emerg Med Australas. 2006;18(1):68–76.
Centre for Epidemiology and Evidence. The health of Aboriginal people of NSW: report of the chief health officer 2012. Sydney: NSW Ministry of Health; 2012.
NSW Emergency Department Data Collection and Admitted Patient Emergency Department Attendance and Deaths Register. Quality of reporting of Aboriginality in Emergency Department data. [http://www.healthstats.nsw.gov.au/Indicator/dqi_era_eddc/dqi_era_eddc?&topic=Aboriginal%20health&topic1=topic_aboriginal_health&code=atsi%20dqi%20hlp].
Thomas DP, Anderson IP, Kelaher MA. Accessibility and quality of care received in emergency departments by Aboriginal and Torres Strait islander people. Aust Health Rev. 2008;32(4):648–54.
National Aboriginal and Torres Strait Islander Health Standing Committee. Cultural Respect Framework for Aboriginal and Torres Strait Health 2016 - 2026; A National Approach to building a culturally respectful health system. Australian health ministers' Advisory Council 2016.
Truong M, Paradies Y, Priest N. Interventions to improve cultural competency in healthcare: a systematic review of reviews. BMC Health Serv Res. 2014;14:99.
Clifford A, McCalman J, Bainbridge R, Tsey K. Interventions to improve cultural competency in health care for indigenous peoples of Australia, New Zealand, Canada and the USA: a systematic review. Int J Qual Health Care. 2015;27(2):89–98.
Shaw C. An evidence-based approach to reducing discharge against medical advice amongst Aboriginal and Torres Strait islander patients. Issues Brief Deeble Institute. 2016.
Wise M, Angus S, Harris E, Parker S. National Appraisal of continuous quality improvement initiatives in Aboriginal and Torres Strait islander primary health care. Melbourne: The Lowitja Institute; 2013.
Renhard R, Chong A, Willis J, Wilson G, Clarke A. Aboriginal and Torres Strait islander quality improvement framework and toolkit for hospital staff (AQIFTHS). Melbourne: St Vincent‟s Hospital Melbourne; 2014.
Australian Bureau of Statistics. 2016 Census QuickStats - NSW [http://www.censusdata.abs.gov.au/census_services/getproduct/census/2016/quickstat/1?opendocument]. Accessed 4 May 2017.
Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford R. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ. 2015;350:h391.
Kelaher M, Parry A, Day S, Paradies Y, Lawlor J, Solomon L. Improving the identification of Aboriginal and Torres Strait islander people in mainstream general practice. Melbourne: The Lowitja Institute; 2010.
NSW Aboriginal Affairs. Aboriginal identification: the way forward. Sydney: An Aboriginal peoples’ perspective; 2015.
Hayman NE, White NE, Spurling GK. Improving indigenous patients' access to mainstream health services: the Inala experience. MJA. 2009;190(10):604–6.
Population and Public Health Division. Improved reporting of Aboriginal and Torres Strait islander peoples on population datasets in New South Wales using record linkage – a feasibility study. Sydney: NSW Ministry of Health; 2012.
Einsiedel LJ, van Iersel E, Macnamara R, Spelman T, Heffernan M, Bray L, et al. Self-discharge by adult Aboriginal patients at Alice Springs hospital, Central Australia: insights from a prospective cohort study. Aust Health Rev. 2013;37(2):239–45.
Muir S, Dean A. Evaluating the outcomes of programs for indigenous families and communities. Melbourne: Australian Institute of Family Studies, Australian Government; 2017.
Siegel C, Haugland G, Chambers ED. Performance measures and their benchmarks for assessing organizational cultural competency in behavioral health care service delivery. Adm Policy Ment Health Ment Health Serv Res. 2003;31(2):141–70.
Weech-Maldonado R, Elliot M, Pradhan R, Schiller C, Hall A, Hays RD. Can hospital cultural competency reduce disparities in patient experiences with care? Med Care. 2012;50(Suppl):S48–55.
Bureau of Health Information. Patient perspectives: hospital care for Aboriginal people. Sydney: BHI; 2016.
Paez KA, Allen JK, Carson KA, Cooper LA. Provider and clinic cultural competence in a primary care setting. Soc Sci Med. 2008;66(5):1204–16.
McCalman J, Jongen C, Bainbridge R. Organisational systems' approaches to improving cultural competence in healthcare: a systematic scoping review of the literature. Int J Equity Health. 2017;16(1):78.
Weech-Maldonado R, Dreachslin JL, Epane JP, Gail J, Gupta S, Wainio JA. Hospital cultural competency as a systematic organizational intervention: key findings from the national center for healthcare leadership diversity demonstration project. Health Care Manag Rev. 2018;43(1):30–41.
Liaw S, Hasan I, Wade V, Canalese R, Kelaher M, Lau P, et al. Improving cultural respect to improve Aboriginal health in general practice: a multi-methods and multi-perspective pragmatic study. Aust Fam Physician. 2015;44(6):387–92.
Implementation of the AIHQIP was led by St Vincent’s Hospital Melbourne, in a coproduction model with NSW Health. We would like to acknowledge the NSW Health staff and local Aboriginal communities and organisations that supported the implementation and evaluation of the AIHQIP. We would also like to thank the AIHQIP Evaluation Advisory Committee members for their advice and guidance throughout the study design and implementation.
This study was funded by NSW Health. NSW Health staff provided input into study scope and design, and conducted analyses of administrative health data for the multiple baseline design. Interpretation of study findings and manuscript preparation were conducted jointly by staff of NSW
Availability of data and materials
The administrative data used in this study (APEDDR) are available from NSW Health but restrictions apply to the availability of these data and so are not publicly available. Access to the data is available by application to the data custodian, NSW Health.
TG contributed to this project while he was employed as a trainee on the NSW Public Health Officer Training Program funded by the NSW Ministry of Health. He contributed to this work whilst based at the Centre for Epidemiology and Evidence, NSW Ministry of Health.
Ethics approval and consent to participate
Ethics approval was obtained from the NSW Population and Health Services Research Ethics Committee (Reference no. HREC/12/CIPHS/64) and the Aboriginal Health and Medical Research Council of NSW Ethics Committee (Reference no. 856/12). Informed written consent was obtained from all interviewees. The multiple baseline design involved secondary analysis of de-identified epidemiological data obtained from a large linked dataset. Informed consent was waived for this component of the study.
Consent for publication
TG, JT, A Cashmore, EP, HG and AM acknowledge a competing interest in that they are employed by NSW Health, which is the funding body for this study.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Statistical analysis. A complete description of the statistical analysis used for the multiple baseline design. (DOCX 18 kb)
Factors influencing implementation. Description of data: A detailed description of the factors influencing implementation, as reported by key informant interviewees. (DOCX 19 kb)