This article has Open Peer Review reports available.
Assessing health centre systems for guiding improvement in diabetes care
© Si et al; licensee BioMed Central Ltd. 2005
Received: 03 May 2005
Accepted: 24 August 2005
Published: 24 August 2005
Aboriginal people in Australia experience the highest prevalence of diabetes in the country, an excess of preventable complications and early death. There is increasing evidence demonstrating the importance of healthcare systems for improvement of chronic illness care. The aims of this study were to assess the status of systems for chronic illness care in Aboriginal community health centres, and to explore whether more developed systems were associated with better quality of diabetes care.
This cross-sectional study was conducted in 12 Aboriginal community health centres in the Northern Territory of Australia. Assessment of Chronic Illness Care scale was adapted to measure system development in health centres, and administered by interview with health centre staff and managers. Based on a random sample of 295 clinical records from attending clients with diagnosed type 2 diabetes, processes of diabetes care were measured by rating of health service delivery against best-practice guidelines. Intermediate outcomes included the control of HbA1c, blood pressure, and total cholesterol.
Health centre systems were in the low to mid-range of development and had distinct areas of strength and weakness. Four of the six system components were independently associated with quality of diabetes care: an increase of 1 unit of score for organisational influence, community linkages, and clinical information systems, respectively, was associated with 4.3%, 3.8%, and 4.5% improvement in adherence to process standards; likewise, organisational influence, delivery system design and clinical information systems were related to control of HbA1c, blood pressure, and total cholesterol.
The state of development of health centre systems is reflected in quality of care outcome measures for patients. The health centre systems assessment tool should be useful in assessing and guiding development of systems for improvement of diabetes care in similar settings in Australia and internationally.
Indigenous Australians experience the highest prevalence of diabetes in the country, an excess of preventable complications and early death . Published studies have demonstrated that effective diabetes management in Indigenous primary care can improve the process and outcomes of care [2–4]. Reported approaches to improving quality of care include use of recall and reminder systems, audit and feedback of clinical performance, structured clinical care, and specialist involvement in primary care. This evidence on the effectiveness of approaches to care in the Indigenous Australian population is consistent with the approach reflected in the Chronic Care Model developed in the USA [5, 6]. The Chronic Care Model is comprised of six major components that have been shown to be important internationally to chronic illness care: 1) health care organisation, 2) community linkages, 3) self-management support, 4) decision support, 5) delivery system design, and 6) clinical information systems. This model has been extensively implemented in community health centres and hospitals in the USA to assess system support for chronic care and to identify areas for further improvement .
In the context of Australia's Northern Territory (NT) health service providers' collaborative efforts to improve prevention and management of chronic disease in primary health care , the Audit and Best practice for Chronic Disease (ABCD) project was implemented on the expectation that community health centre staff and managers would benefit from an improved understanding of the status of health centre systems in order to appropriately plan for improvement. A central component of the ABCD project was therefore an assessment of health centre systems as outlined in the Chronic Care Model. This paper reports on the association of the systems assessment with the quality of diabetes care for ABCD participating centres at baseline.
Study design, setting and selection of participating health centres
Community members who met all of the following criteria were included in the study: 1) a definite diagnosis of type 2 diabetes according to health centre records; 2) identified as Aboriginal; 3) aged 16 years or older; and 4) lived in the community for 6 months or more during the previous 12 months. A random sample of 30 records was drawn from four of the twelve community health centres where more than 30 eligible people were identified. In the other eight centres the records of all eligible people were included.
Measurement and data collection
The Assessment of Chronic Illness Care (ACIC, Version 3.5) scale , a practical tool based on the Chronic Care Model , was used to evaluate the status of health centre systems to support chronic illness care. A minor adaptation was made to facilitate its use in the local setting. The adapted scale consists of 34 items covering the six components of the Chronic Care Model and an additional domain which denotes the level of integration of the six components: health care organisation (3 items), community linkages (4 items), self-management (4 items), clinical decision support (3 items), clinical delivery system (9 items), clinical information system (6 items), and integration (5 items). Compared with the original ACIC scale, this adapted version included three additional items (cultural competence, pathology management, and pharmacy management) in the clinical delivery system domain, to reflect specific features of interest in NT centres.
A group of health centre staff (manager, doctor, nurse, and/or Aboriginal Health Worker when available) was guided by researchers on how to complete the scale. The answer to each item in the adapted scale requires recording of a score in the range of 0–11. The scale includes a set of prompts (see Additional file 1) to increase standardisation and reproducibility in scoring and staff are requested to provide a qualitative justification for their score in relation to these prompts (see example in Additional file 2). The scores are categorised as: 0–2 (limited support); 3–5 (basic support); 6–8 (good support); and 9–11 (fully developed support). The score and justification for each item were obtained by arriving at a consensus among participating staff members. The mean was calculated from individual item scores to create a component score, and the mean of 6 component and integration scores formed the overall system score for the community health centre. The average time to complete the scale was 2 hours.
Quality of diabetes care
Adherence to delivery of scheduled services for study participants (N = 295)
Scheduled interval (months)
% of patients receiving services
Fundi (dilated pupils)
BSL (finger prick or venous)
Urine – Dipstix
Intermediate outcomes of diabetes care include three measures: the values of the most recent HbA1c, blood pressure, and total cholesterol within 12 months prior to the audit. Control of these 3 measures is essential in preventing or delaying the onset of macro- and micro-vascular complications .
Means and proportions were used to summarise normally distributed continuous and binomial data respectively, and 95% confidence intervals were calculated after adjustment for clustering by heath centre. As the ACIC result represented a score ranking from 0 to 11, nonparametric measures were used to describe ACIC results in terms of median, interquartile range, and range.
Multiple linear regression analysis was used to determine the independent association of each health system component with the overall adherence to delivery of scheduled services, with patient level variables (age and sex) treated as covariates.
The associations between system components and intermediate outcomes of diabetes care were assessed using multivariate probit regression . This statistical procedure allows three dependent variables Y1(HbA1c control), Y2 (blood pressure control) and Y3 (total cholesterol control) to be jointly regressed on the same independent variables (6 system components and participants' age and sex) in one model. The dependent variables are dichotomous and defined as follows: Y1 = 1 if HbA1c level < 8.0%, and Y1 = 0 if HbA1c = 8.0% or no HbA1c tested within the past 12 months; Y2 = 1 if blood pressure < 140/90 mmHg, and Y2 = 0 if blood pressure ≥ 140/90 mmHg or no blood pressure checked within the past 12 months; Y3 = 1 if total cholesterol < 5.5 mmol/L, and Y3 = 0 if total cholesterol ≥ 5.5 mmol/L or no total cholesterol tested within the past 12 months. The associations with a single intermediate outcome, and the three as a group, were separately tested. All analyses were performed using Stata version 8.2 .
Ethics approval for the study was obtained from the Top End Health Research Ethics Committee, including the Indigenous sub-committee.
The records of 295 people with diabetes (116 males and 179 females) were included in the study. The average age of participants was 49 years (range 16–87). Diabetes duration averaged 6.5 years. Seventy-seven percent (95%CI: 71%–81%) of participants had attended their community health centres within the previous 3 months.
ACIC scores for community health centre systems
five of twelve health centres included chronic disease care goals in their business plan and had one or more chronic disease coordinators in place. One health centre had an established continuous improvement program. Public health nurse positions, recently developed by the Department of Health and Community Services, were perceived by health service staff as an improvement strategy for chronic illness care. Six health centres reported use of Enhanced Primary Care Medicare claims as incentives for chronic care planning.
All participating health centres reported going out into the community to 'collect' people for specialist visits as a common activity. Some health centres worked together with other organisations and ran community-based programs such as 'school nutrition programs', 'healthy lifestyle promotional days' at the local store, 'healthy kids week', or 'tobacco prevention week'. However, all health service staff reported that acute care demands often prevented the development of community relationships that may have improved chronic care.
There was limited uptake and documentation of self-management activities in health centres, such as goal setting with clients and patient education. One-to-one education was the most commonly mentioned approach for the delivery of patient education. Peer or group education was seldom used.
Clinical decision support
Clinical guidelines (e.g. CARPA standard treatment manual)  were universally distributed to centres to facilitate clinical decision-making, and most health centres reported integration of these guidelines into routine care. Involvement of specialists in primary care was mainly through conventional referrals, and visiting specialist services to health centres were perceived generally as not frequent enough to meet needs.
Clinical delivery system
Most health centres suffered from a shortage of staff, and only six communities had a resident doctor. Few centres adopted planned visits for delivering multiple services to clients. All centres reported that systems for collecting and reporting of pathology specimens and for dispensing medication were in place. Most respondents perceived their centres to be delivering culturally safe and appropriate services.
Clinical information systems
Computerised information systems were installed in 11 health centres, with four different clinical information software systems. The remaining centre used a paper-based information system only. Recall systems were operational for eight health centres (6 computerised, 1 paper-based, and 1 with both). Most centres had organised and easily accessible patient records. Most information systems lacked the capacity (or were not used) to supply staff with population-based information on quality of chronic illness care.
Integration of system components
The integration of system components was the least developed area. For example, the existing information system was not integrated with patient self-management in terms of documenting goals and activities; and there was limited sharing of information between out-of-clinic community programs and clinical services.
Quality of diabetes care
Adherence to delivery of scheduled services varied across different categories of services (Table 1). Adherence was relatively higher for immunisation and laboratory investigations, followed by eye checks and basic measurement. Least attention was paid to feet checks and counselling services. The overall adherence to delivery of scheduled services for individuals averaged 31% (range 0–93%).
Intermediate outcomes of diabetes care for study participants (N = 295)
Proportion ‡(95% CI)
HbA1c level (%)
HbA1c < 8%
Systolic blood pressure (mmHg)
Diastolic blood pressure (mmHg)
Blood pressure <140/90 mmHg
Total cholesterol level (mmol/L)
Total cholesterol <5.5 mmol/L
Associations between system ACIC scores and quality of diabetes care
Association of health centre system components with overall adherence to delivery of scheduled services§
Individual level variables
Association between scores for health centre system components and measures of intermediate outcomes of diabetes care
HbA1c control (Y1)
Blood pressure control (Y2)
Total Cholesterol control (Y3)
Effect of independent variables on joint intermediate outcomes P value ‡
Adjusted Odds Ratios (95%CI) *
Individual level variables
This study shows that participating Aboriginal community health centres in Australia had implemented basic systems to support chronic illness care, but there was considerable room for improvement in all system components. Stronger organisational influence and information system components were associated both with better performance in process of diabetes care and in intermediate outcomes. Additionally, community linkages were specifically related to better performance in process of care, and delivery system design was associated with better intermediate outcomes.
When compared with data from the USA , health centres had similar ACIC scores for community linkages, decision support, delivery system, and clinical information system, but lower scores for organisational influence and self-management support. In many respects the quality of diabetes care in participating health centres is also comparable with national and international data [17–19] For example, 70% of patients in our study had HbA1c tested in the past year and 26% had values less than 8% – almost identical to experience reported from the USA .
To our knowledge, this is the first study to demonstrate quantitative evidence regarding the importance of organisational influence (including goals for chronic care, improvement strategies, and incentives for care) on diabetes care. Wagner and colleagues reported their experience in the chronic condition Breakthrough Series, suggesting the removal of disincentives in practice encourages providers' in delivery of effective chronic illness care . Financial incentives for diabetes care have been introduced to Australian general practice through Enhanced Primary Care (EPC) and Practice Incentive Program (PIP) [20, 21]. However, only half of participating centres reported claiming for Medicare rebate using EPC items.
Our study shows better implementation of clinical information systems to be associated with both increased adherence to guideline-recommended processes of diabetes care and improved intermediate outcomes. An ideal information system has three important roles: 1) as a registry for a target population; 2) to provide reminders to primary care teams to comply with guidelines for care; and 3) to provide feedback measures relevant to quality of care . Our data show the third role to be the least-developed area for current information systems in this study setting, and support the appropriateness of external clinical audit as a useful approach to address such system deficiencies [23, 24]
The positive relation between delivery system design and intermediate outcomes of diabetes care is consistent with several previous studies [25, 26] It is likely that health centres characterised by availability of resident doctors, active specialist outreach, and appropriate client follow-up offer more opportunity for intensive management that might contribute to better diabetes control. Given that many remote community health centres are staffed primarily by nurses and Aboriginal Health Workers (AHWs) and supported by visiting doctors , a feasible approach to improve delivery system design is to assign and strengthen nurses' and AHWs' roles in delivering routine care, and to ensure referral to medical practitioners for consultation and medication adjustment where appropriate . Features of delivery system design may also be amenable to improving the relative under-utilisation of primary care services by Aboriginal men – a widely recognised phenomenon that is reflected in the study sample.
The apparent poor integration of system components in participating health centres also needs to be addressed in future system development, as isolated upgrading in one component without integrating with another may lead to an increase in costs but not in effectiveness. For example, computerised information systems can generate "pop-up" reminders for healthcare providers, but poor delivery system design characterised by unclear roles among health staff may result in no appropriate action being taken.
The cross-sectional study design limits the confidence with which the observed associations between health centre systems and processes and outcomes of diabetes care can be defined as causal. However, the findings suggest that the Chronic Care Model and the associated ACIC scale will be valuable in assessing and guiding the development of health centre systems in Aboriginal community settings. More research is needed to formally examine the reproducibility of the methods of assessing systems development, and to define the cause-effect relationship between healthcare systems and quality of diabetes care using longitudinal study designs. Such studies may also help clarify resource and management requirements for sustaining improvements in chronic illness care.
The state of development of health centre systems is reflected in quality of care outcome measures for patients. The health centre systems assessment tool proves to be useful in describing the quality of clinical systems for the prevention and management of diabetes in Australian Aboriginal communities, and providing a guide for development of systems for improving diabetes care.
This project would not have been possible without the support of staff and management of the participating community health centres. We also gratefully acknowledge the advice of members of the project reference group and management committee. This project was supported by a grant from the Australian Health Minister's Advisory Council (AHMAC) through the States and Commonwealth Research Issues Forum (SCRIF), Grant number AHMAC PDR 2001/06, and by a grant from the CRC for Aboriginal Health.
- National Centre for Monitoring Diabetes: Diabetes: Australian Facts. 2002, Canberra: AIHWGoogle Scholar
- McDermott R, Tulip F, Schmidt B, Sinha A: Sustaining better diabetes care in remote indigenous Australian communities. BMJ. 2003, 327: 428-430. 10.1136/bmj.327.7412.428.View ArticlePubMedPubMed CentralGoogle Scholar
- Simmons D: Impact of an integrated approach to diabetes care at the Rumbalara Aboriginal Health Service. Intern Med J. 2003, 33: 581-585. 10.1111/j.1445-5994.2003.00491.x.View ArticlePubMedGoogle Scholar
- Bailie RS, Si D, Robinson GW, Togni SJ, D'Abbs PH: A multifaceted health-service intervention in remote Aboriginal communities: 3-year follow-up of the impact on diabetes care. Med J Aust. 2004, 181: 195-200.PubMedGoogle Scholar
- Wagner EH: Chronic disease management: what will it take to improve care for chronic illness?. Eff Clin Pract. 1998, 1: 2-4.PubMedGoogle Scholar
- Bodenheimer T: Interventions to improve chronic illness care: evaluating their effectiveness. Dis Manag. 2003, 6: 63-71. 10.1089/109350703321908441.View ArticlePubMedGoogle Scholar
- Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A: Improving chronic illness care: translating evidence into action. Health Aff (Millwood). 2001, 20: 64-78. 10.1377/hlthaff.20.6.64.View ArticleGoogle Scholar
- Weeramanthri T, Hendy S, Connors C, Ashbridge D, Rae C, Dunn M, Fittock M, Cleary J, O'Donohoe L, Morton S, Swanson N: The Northern Territory preventable chronic disease strategy – promoting an integrated and life course approach to chronic disease in Australia. Aust Health Rev. 2003, 26: 31-42.View ArticlePubMedGoogle Scholar
- Hoffmann B, Bailie R: Health-related housing and infrastructure in the Northern Territory Aboriginal Communities: 2001 data. 2003, Darwin: Cooperative Research Centre for Aboriginal and Tropical HealthGoogle Scholar
- Improving Chronic Illness Care: Assessment of Chronic Illness Care (version 3.5). [http://www.improvingchroniccare.org/ACIC%20docs/ACIC_V3.5.pdf]
- Bonomi AE, Wagner EH, Glasgow RE, VonKorff M: Assessment of chronic illness care (ACIC): a practical tool to measure quality improvement. Health Serv Res. 2002, 37: 791-820. 10.1111/1475-6773.00049.View ArticlePubMedPubMed CentralGoogle Scholar
- Central Australian Rural Practitioner Association: CARPA standard treatment manual: a clinic manual for primary health care practitioners in remote and rural communities in Central and Northern Australia. 2003, Alice Springs: Central Australian Rural Practitioner Association, 4Google Scholar
- Williams R, Herman W, Kinmonth AL, Wareham NJ: The evidence base for diabetes care. 2002, Chichester: John Wiley & Sons, LtdView ArticleGoogle Scholar
- Cappellari L, Jenkins S: Multivariate probit regression using simulated maximum likelihood. Stata Journal. 2003, 3: 278-294.Google Scholar
- StataCorp: Stata Statistical Software: release 8.2. 2003, College Station, TX: Stata CorporationGoogle Scholar
- Wagner EH, Glasgow RE, Davis C, Bonomi AE, Provost L, McCulloch D, Carver P, Sixta C: Quality improvement in chronic illness care: a collaborative approach. Jt Comm J Qual Improv. 2001, 27: 63-80.PubMedGoogle Scholar
- Georgiou A, Burns J, Wan Q, Flack J, Penn D, Powell DG: Analysis of Division-based diabetes register data (2000–2002). 2005, Sydney: National Divisions Diabetes Program, University of New South Wales, [http://www.commed.unsw.edu.au/cgpis/public/diab/Analysis%20of%20Div%20Based%20Diab%20Reg%20Data.pdf]Google Scholar
- Tapp RJ, Zimmet PZ, Harper CA, de Court, Balkau B, McCarty DJ, Taylor HR, Welborn TA, Shaw JE: Diabetes care in an Australian population: frequency of screening examinations for eye and foot complications of diabetes. Diabetes Care. 2004, 27: 688-693.View ArticlePubMedGoogle Scholar
- Chin MH, Auerbach SB, Cook S, Harrison JF, Koppert J, Jin L, Thiel F, Karrison TG, Harrand AG, Schaefer CT, Takashima HT, Egbert N, Chiu SC, McNabb WL: Quality of diabetes care in community health centers. Am J Public Health. 2000, 90: 431-434.View ArticlePubMedPubMed CentralGoogle Scholar
- Parsons J: Diabetes. Can systems change improve outcomes?. Aust Fam Physician. 2001, 30: 1116.PubMedGoogle Scholar
- Harris M, Blakeman T: Enhanced Primary Care items. Their use in diabetes management. Aust Fam Physician. 2001, 30: 1134-1140.PubMedGoogle Scholar
- Bodenheimer T, Wagner EH, Grumbach K: Improving primary care for patients with chronic illness. JAMA. 2002, 288: 1775-1779. 10.1001/jama.288.14.1775.View ArticlePubMedGoogle Scholar
- Chaves N, Weeramanthri T, Mak D, Bunn L, Lines D, Morgan S, Girrabul J, Allen O: Diabetes audit can aid practice development in a range of Indigenous health care settings. Aust J Rural Health. 2001, 9: 251-253. 10.1046/j.1440-1584.2001.00397.x.View ArticlePubMedGoogle Scholar
- Fitzsimons B, Wilton L, Lamont T, McCulloch L, Boyce J: The Audit Commission review of diabetes services in England and Wales, 1998–2001. Diabet Med. 2002, 19 (Suppl 4): 73-78. 10.1046/j.1464-5491.19.s4.13.x.View ArticlePubMedGoogle Scholar
- Feifer C, Ornstein SM, Nietert PJ, Jenkins RG: System supports for chronic illness care and their relationship to clinical outcomes. Top Health Inf Manage. 2001, 22: 65-72.PubMedGoogle Scholar
- Sperl-Hillen JM, Solberg LI, Hroscikoski MC, Crain AL, Engebretson KI, O'Connor PJ: Do all components of the chronic care model contribute equally to quality improvement?. Jt Comm J Qual Saf. 2004, 30: 303-309.PubMedGoogle Scholar
- Elliott R: Regional statistics, Northern Territory 2004. 2004, Canberra: ABSGoogle Scholar
- McDermott RA, Schmidt BA, Sinha A, Mills P: Improving diabetes care in the primary healthcare setting: a randomised cluster trial in remote Indigenous communities. Med J Aust. 2001, 174: 497-502.PubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/5/56/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.