- Research article
- Open Open Peer Review
Desired Chinese medicine practitioner capabilities and professional development needs: a survey of registered practitioners in Victoria, Australia
BMC Health Services Researchvolume 8, Article number: 27 (2008)
The State of Victoria in Australia introduced Chinese medicine practitioner registration in 2000 and issued its education guidelines in late 2002 for introduction in 2005. This study obtained practitioners' views on desired capabilities for competent Chinese medicine practice and to identify professional development needs.
A questionnaire, consisting of 28 predefined capabilities in four categories with a rating scale of importance from one to five, was developed and sent to all registered Chinese medicine practitioners in the State of Victoria, Australia in October, 2005.
Two hundreds and twenty eight completed questionnaires were returned which represented a response rate of 32.5%. Of the four categories of capabilities, technical capabilities were considered to be the most important for clinical practice. Specifically, the ability to perform acupuncture treatment and/or dispense an herbal prescription was ranked the highest. In contrast, research and information management capabilities were considered the least important. The educational background of practitioners appeared to be an important factor influencing their rating of capabilities. Significantly, nearly double the number of practitioners with Australian qualifications than practitioners trained overseas valued communication as an important capability. For continuing professional education, clinical skills courses were considered as a priority while research degree studies were not.
Registered Chinese medicine practitioners viewed skills training as important but did not support the need for research and information management training. This represents a significant hurdle to developing Chinese medicine as a form of evidence-based healthcare.
Chinese medicine (CM) is a unique medical system that has been taught and practised in China for more than 2000 years. Over the last several decades, CM has been increasingly used in the Western world, including Australia . In parallel, CM education has been introduced in public and private institutions in a number of Western countries. In Australia, currently more than 20 institutions provide degree or diploma level education in CM . Of these, four publicly funded Australian universities offer degree programs in acupuncture and/or Chinese herbal medicine. While the expansion of education programs in CM in the West has been welcomed, the consistency of educational quality has been an ongoing concern.
As a worldwide trend in medical education, there has been a growing emphasis on the learning process and learning outcomes, shifting from the traditional focus on course content and hours of tuition . The required capabilities of practitioners have been used to guide curriculum design in most health practitioner education programs . It is expected that by the time students graduate, they will have developed defined capabilities which meet the expectations of the public for safe and effective clinical practice.
Some medical schools in Australia have also introduced such capabilities into their curriculum. For example, the University of New South Wales has developed a new curriculum in which the capabilities of medical graduates are central to its design . At RMIT University, all undergraduate and postgraduate programs are required to apply a capability-based curriculum approach. This approach was adopted in the design of the recently introduced postgraduate Chinese herbal medicine program in the School of Health Sciences .
Victoria is the only state in Australia, and also the first jurisdiction outside China, to have established and enforced standards of education and practice in CM. The Chinese Medicine Registration Board of Victoria (CMRBVic) has also published course approval guidelines for CM educational programs . These guidelines use a traditional approach by describing the general outcomes of knowledge, skills and attributes of graduates of the approved courses, but they fail to define clearly demonstrable CM practitioner capabilities. Therefore, program approval is still largely based on general principles, rather than on more objective and measurable criteria. In addition, over nine hundreds of Chinese medicine practitioners were registered under much more flexible requirements between 1 January 2002 and 31 December 2004, known as the grand-parenting or transitional arrangement.
In developing the postgraduate Chinese herbal medicine program mentioned above, RMIT classified the Registration Board's guidelines  into four broad categories of desired capabilities: technical; communication; sustainability; and, research. A total of 28 capabilities were included under the four categories in a desired capability chart which was used to guide the development of the new masters program. Details of the process have been described elsewhere . This capability chart was used as the basis for a bilingual (English/Chinese) questionnaire developed to seek practitioner views of the capabilities desired for Chinese medicine practice.
Variable qualifications and backgrounds are anecdotally presented among the current registered practitioners, while the CMRBVic education standards are based on what the profession has defined. This survey was to gather existing practitioners' views on desired capabilities of Chinese medicine practice against the CMRBVic requirements for new graduates to determine the knowledge and skills gaps between the two categories of practitioners. Consequently, professional development needs and strategies could be developed by the CMRBVic and/or the profession to narrowing down these gaps to ensure consistency of standards of practice.
Human Research Ethics approval was obtained from the RMIT University's Human Research Ethics Committee prior to the commencement of the survey.
A CM practitioner capabilities chart was generated, based on the Chinese Medicine Registration Board's course approval guidelines in conjunction with a systematic review of Chinese medicine educational standards . To ensure that the full breadth of CM capabilities was included, inputs from CM educators and regulators in Victoria were also sought through structured face-to-face interviews. A revised version of 28 capabilities was used in the development of the survey questionnaire. It comprised four categories of capabilities required for competent CM practice, namely, technical capability (TC), communication capability (CC), responsible and sustainable practice capability (RSC) and research and information management capability (RIMC). The questionnaire was translated into Chinese by academic staff at RMIT University who were native Chinese speakers.
In October 2005, the bilingual questionnaire, with a plain language statement was sent to all registered CM practitioners in Victoria (n = 714). The plain language statement explained the purpose of the study, invited participation, and indicated that responses were confidential and that the data would be analysed and presented anonymously. A reminder letter was sent to all practitioners three weeks later to encourage participation. No further attempt was made to collect information from non-respondents.
Survey participants were asked to rate each of the 28 predefined capabilities in the questionnaire, using a five-point scale (i.e., 1 = not important, 2 = a little important, 3 = moderately important, 4 = important, 5 = very important). Additional capabilities or further comments could be added at the end of each of the four capability categories. Socio-demographic data on gender, age, educational background, and experience of practice were also collected.
Data were entered into a Microsoft Excel spreadsheet and then analysed using the Statistical Package for Social Sciences (SPSS) for Windows, version 15.0. Chi-square analyses were used to compare participant responses across each capability. The significance level for multiple comparisons was adjusted by the Holmes-Bonferroni procedure .
Demographic characteristics of survey participants
Two hundred and twenty-eight (228) completed questionnaires were returned, representing a response rate of 32.5%. Table 1 summarises the characteristics of survey participants. Nearly two-thirds (61.4%) were aged 35 – 54 years and just over half (55.8%) were males. Nearly one in five (19.2%) participants had received CM training in both Australia and overseas. In all, over two-thirds (70.1%) of participants had trained in Australia. Of these, almost three-quarter (71.3%) had been awarded at least a bachelor degree in CM. Among those who received CM training overseas (50.5%), approximately two-thirds (66.3%) had a bachelor degree or above. In addition, 41% of the participants had overseas practice experience. All except two participants (99.1%) had practiced in Australia. Of these, approximately two in five had practised for more than 10 years.
Data provided from the Chinese Medicine Registration Board of Victoria suggested that the basic demographic information of the survey participants did not differ appreciably from the overall profile of CM registrants. Specifically, males comprised 55.8% of the participants in the survey compared to 54.5% of CM practitioners registered by the Board (p > 0.05). In addition, the age profile of participants in the survey was almost identical to that of all CM registrants, there being, 24.7% and 23.6% aged 18 – 34, 61.4% and 60.3% aged 35 – 64, and 13.9% and 16.1% aged over 64, survey participants and all registered practitioners, respectively (p > 0.05).
Participant responses to the 28 practitioner capabilities
Table 2 presents the mean score and standard deviation of participant responses to each of the 28 capabilities. Overall, 19 capabilities were rated 4.0 or higher (indicating the capability was considered to be important or very important). The mean scores for all technical capabilities (12 in total) were higher than four. Of these, the ability to perform acupuncture treatment and/or prescribe a Chinese herbal prescription were the highest (mean = 4.8). In contrast, all of the six capabilities under research and information management were rated lower than four, with the ability to develop a research protocol rated the lowest (mean = 3.1).
Items ranked the highest of importance
Table 3 summarises the 10 capabilities of the total of 28 with the highest scores on importance. These are broken down according to practitioners' demographic characteristics. Of these, seven were technical capabilities (TC) and three were responsible and sustainable practice capabilities (RSC). Among these highest-ranked capabilities, a higher proportion of female than male respondents considered TC5, TC8, TC10, RSC2 and RSC5 as "very important or important" (hereafter, important) (p < 0.05). On the other hand, a significantly lower proportion (75.4%) of participants aged 35 – 54 considered the skill to diagnose and differentiate diseases according to both western and CM principles and techniques (TC5) to be important, compared with younger participants (aged 18 – 34, 92%, p < 0.05) and older participants (55+, 90%, p < 0.05).
Participants with at least one Australian CM qualification were more likely to value lifelong learning (RSC5). The majority of people with an Australian CM qualification (91.0% of those with a bachelor degree or above and 93.3% of those with less than a bachelor degree) considered lifelong learning to be important. This proportion was significantly lower among those without any Australian CM qualifications (70.1%, p < 0.001, Table 3). Supporting this finding, over nine-tenths (91.8%) of respondents without an overseas qualification but with an Australian qualification, considered lifelong learning to be important, in comparison to those respondents holding an overseas qualification (81.6% among people with less than a bachelor degree or 77.3% among those with a bachelor degree or higher, p < 0.05). Similarly, significantly lower proportions of respondents without an Australian qualification appreciated the importance of learning through experience (RSC6) and the ability to review and monitor a patient's health and modify treatment accordingly (TC8, Table 3).
CM practice experience in Australia and/or overseas appears to have influenced practitioner attitudes regarding the importance of each capability. Compared to those with overseas CM experience, participants who had never practised overseas gave significantly higher ratings to four capabilities (TC8, RSC2, RSC5 and RSC6). For example, TC8, the capability to review and monitor a patient's health and modify treatment accordingly, was considered important by 96.6% of practitioners without overseas experience, compared with only 78.9% of practitioners who had less than 10 years overseas experience and 71.9% of practitioners who had 10 years or more overseas experience (p <0.001, Table 3).
Items ranked lowest on importance
The ten capabilities that were rated lowest on importance comprised all six items in the research and information management category (RIMC), three out of the four communication capabilities (CC1, CC3 and CC4) and one of the responsible and sustainable capabilities (RSC4, Table 4). None of the technical capabilities was in the list of "lowest-ranked" capabilities.
In relation to socio-demographic data, the only gender difference in responses to the ten "lowest-ranked" capabilities was for CC3 (refer patients to medical and other allied health professionals) where over one-third (34.7%) of male respondents considered this capability as not important/less important or moderately important (hereafter, "less important"), whereas only one in five (19.2%) of female respondents considered it to be less important (p < 0.05).
In relation to age, younger participants (aged 18 – 34), those with Australian qualifications, without overseas qualifications and with less than 10 years clinical experience in either Australia or overseas, were less likely to consider RSC4, an ability to identify key business issues and draw on appropriate professional resources, to be less important. Specifically, a lower proportion (18.5%) of those aged 18 – 34 considered RSC4 to be less important, compared with those aged 35 – 54 (48.4%) and those aged 55 or older (44.5%, p < 0.005, Table 4).
In relation to practice experience, significant variations were observed in the perceived importance of communication capabilities. The capabilities to appropriately apply Chinese and Western medical terminologies (CC1), to refer patients to other health professionals (CC3) and, to communicate effectively with fellow workers (CC4), were more likely to be considered as less important by participants who had overseas experience (ranging from 35.3% – 58.8%), while a significantly lower proportion of respondents who had no overseas experience fell in the same category (ranging from 15.4% – 24.4%, p < 0.005, Table 4). In addition, over half (53.7% – 59.7%) of respondents without Australian CM qualifications considered these capabilities (CC3 and CC4) to be less important, while these proportions decreased to some 14% – 17% among respondents with at least an Australian CM qualification (p < 0.001, Table 4).
As noted above, research and information management capabilities overall, were considered less important compared to the other three domains of capabilities, across participants with different demographic characteristics. The only exception was found for RIMC3, a capability to review critically research publications relevant to CM. Specifically, nearly two-thirds (62.1%) of respondents without an Australian CM qualification considered RIMC3 to be less important, whereas approximately half (51.1%) of respondents with less than an Australian bachelor degree and just over one-third (38.4%) of respondents with an Australian bachelor degree or higher, responded in the same way (p < 0.05).
Professional development needs
Practitioners were asked about their plans and need for professional development in the next five years. Nearly two-thirds (61.9%) of participants indicated a need for a short course in CM to update their clinical knowledge and skills. About half (44.6%) indicated that they would like to undertake research studies to specialise in one or more areas to enhance practice. More than one-third (37.4%) considered undertaking postgraduate studies to gain future qualifications. Undertaking short courses in Western medical sciences were also considered by nearly one-quarter of the participants (23.4%).
The number of years of overseas practice experience and having an Australian qualification were significant factors that contributed to participants' intention to pursue professional development. Those who had never practised overseas were more likely to want to pursue postgraduate studies to gain further qualifications (45.8%) than those with less than 10 years overseas experience (31.6%, p < 0.05) and those that had more than 10 years overseas experience (15.2%, p < 0.05). However, compared with the latter groups, participants without overseas experience were less likely to want to undertake postgraduate research studies (30.5%, 66.7% and 63.6%, respectively, p < 0.05). Similarly, those who had at least one Australian CM qualification were more likely to undertake postgraduate studies (43.5%) than those without Australian qualification (23.4%, p < 0.05), but less likely to pursue research studies (36.4% vs. 65.6%, p < 0.05). Further, over half (56.4%) of participants aged 18 – 34 would like to engage in postgraduate studies, while fewer than one-third (32.8%) of those aged 35 – 54 and less than one-quarter (23.3%) of those aged 55 or older, responded similarly (p < 0.01).
There is no existing literature on practitioners' view of the importance of desired CM professional capabilities. The current study surveyed all registered CM practitioners in the State of Victoria, Australia to obtain existing practitioner views regarding desired capabilities and to identify their continuing educational needs. The findings of this study may inform the development of CM educational programs, and are of relevance to regulators who are increasingly concerned about continuing mandating professional development (such as the Victorian Health Professions Registration Act 2005)  and ensuring that health professional education reflects contemporary requirements of a changing health industry . These findings may also be relevant to a broad range of health professionals as well, beyond CM practitioners.
The response rate of this study was 32.5%. The mailing list used in the current survey was provided by the Chinese Medicine Registration Board of Victoria and hence. Hence, the sampling frame was the totality of eligible population. Perhaps, the most noteworthy shortcoming of the current survey is that two-thirds of the targeted population did not respond. This may have introduced a non-response bias towards the rating of capability items. Despite the fact that the study sample was comparable to the target population on important characteristics (see Methods), interpretation of the findings from this study needs caution and a follow-up study is required with an effort to increase the response rate. The other issue is to clarify the meaning of postgraduate studies as it appeared to be understood differently by participants
It is understood that effective clinical practice is dependent on graduates' ability to integrate and consistently apply a number of capabilities beyond profession-specific skills and knowledge . Thus, it is not surprising that technical capabilities (specifically, the ability to perform acupuncture treatment and/or dispense an herbal prescription) were considered to be the most important aspects of clinical practice, followed by responsible and sustainable practice capabilities. As a clinically oriented workforce, practitioners seek to learn their trade. In contrast, most participants considered the ability to develop a research protocol, an element of the research and information management capabilities, to be only moderately important. Such views reflect the theoretic underpinning of Chinese medicine held by members of the profession, something that needs to be addressed through continuing professional education and incorporation of the importance of this activity into CM practitioner education. Nevertheless, in recent years, there has been an increasing body of scientific evidence of CM treatment from rigorously designed clinical research which may serve as the base of integrative health care.
The country where practitioners' obtained their CM education appears to be an important factor influencing their rating of the importance of a number of capabilities, in particular, communication capabilities. A much lower proportion of those without Australian qualifications considered communication capabilities to be important. This may be related to socialisation during the course of education, which in turn reflect differences in the value orientation in health professional education generally or in specific curriculum design . At the same time, it might also reflect self-selection, that is, Australian trained CM practitioners choose to enter the profession because they consider it to offer a holistic approach to health-care in contrast to conventional health-care professions. These findings are consistent with a previous study comparing CM tertiary education in Australia and China. They suggest that, CM education in Australia shares a number of common features with that in China, but the location of education has an impact on its curriculum design as well . This is a matter that warrants additional exploration.
In relation to the "less important" capabilities, over one-third of male participants considered patient referral capability to be less important. This is a finding that will be of concern to health policy-makers, in the context of ensuring continuity of care and the most appropriate care. New graduates rated higher identifying key business issues than did elderly practitioners. This may reflect their educational background and the early stage of their practice development. However, it is clear that participants without overseas experience would like to gain further qualifications, but were less willing to engage in research studies. In addition, participants with Australian qualifications would like to pursue postgraduate study, but not research. The motivation underlying selection of a particular course for professional development warrants further study.
Much educational research has been done for the western medicine profession, however, in the USA, the concept of embedding desired essential capabilities into curriculum design is a recent development . These essential capabilities are broadly similar to the capabilities included in the current study. For example, clinical (technical) skills, communication skills, information management and critical thinking and research have all been addressed. It has been stated that such core capabilities  would help to determine what teachers are supposed to teach, what students are expected to learn, and what educational experiences all physicians must have.
It is challenging to identify a range of capabilities that truly cover the roles of CM practitioners in the Australian health-care setting. Unlike the situation in Asian countries and a limited number of Western countries, CM practitioners in Australia are mainly self-employed. Compared with the traditional approach to curriculum design, the capability-based approach of professional education potentially leads to individualised flexible learning, transparent standards, and increased public accountability . Other studies have demonstrated that medical residents who had attended courses based on competencies perform better and are safer practitioners . In Australia, criterion-referenced approaches to set standards have been used to define and measure competencies for graduate entry medical programs . A sophisticated model of professional education is required that recognises both basic standards and continuing professional development  and thus, to enable Australian CM practitioners to provide a safe and effective health service.
This study provides an in-depth perspective of the professional capabilities of CM practitioners – a profession with increasing numbers of practitioners in Western countries, including Australia. The views on capabilities reported by current practitioners can inform educational curriculum design. However, the lack of recognition of the importance of research capability will continue to hinder the development of CM as an evidence-based healthcare profession.
Xue CCL, Zhang AL, Lin V, Da Costa C, Story DF: Complementary and alternative medicine use in Australia: Results of a national population based survey in 2005. J Altern Complement Med. 2007, 13 (6): 643-650. 10.1089/acm.2006.6355.
National Academic Standards Committee for Traditional Chinese Medicine [NASC]: Australian Guideline for Traditional Chinese Medicine Education. 2001, Brisbance , Desert Oak Publishing Services
Baum KD, Axtell S: Trends in North American medical education. Keio J Med. 2005, 54 (1): 22-28. 10.2302/kjm.54.22.
Smith SR, Dollase RH, Boss JA: Assessing students' performances in a competency-based curriculum. Acad Med. 2003, 78 (1): 97-107.
Toohey S, Ham J, Hughes C, Harris P, McNeil P: Expectations for Level of Achievement of the Graduate Capabilities in Each Phase of the Curriculum. 2005, Sydney, Australia , Faculty of Medicine, UNSW
O'Brien KA, Lines R, Xue CL: Approaches in developing an integrative and evidence-based curriculum in Chinese herbal medicine. Annals of Traditional Chinese Medicine. 2005, 1: 211-234.
CMRBVic: Guidelines for the Approval of Courses of Study in Chinese Medicine as a Qualification for Registration. 2002, Melbourne , Chinese Medicine Registration Board of Victoria., 1-93.
Jaccard J, Guilamo-Ramos V: Analysis of variance frameworks in clinical child and adolescent psychology: issues and recommendations. J Clin Child Adolesc Psychol. 2002, 31 (1): 130-146.
Victorian Government: Health Professions Registration Act 2005. 2005, Act No. 97/2005, Melbourne.
Australian Government Productivity Commission: Australia's Health Workforce, Research Report. 2006, Canberra
Rochester S, Kilstoff K, Scott G: Learning from success: improving undergraduate education through understanding the capabilities of successful nurse graduates. Nurse Educ Today. 2005, 25 (3): 181-188. 10.1016/j.nedt.2004.12.002.
Xue CC, Wu Q, Zhou WY, Yang WH, Story DF: Comparison of Chinese medicine education and training in China and Australia. Ann Acad Med Singapore. 2006, 35 (11): 775-779.
Core Committee; Institute for International Medical Education: Global minimum essential requirements in medical education. Med Teach. 2002, 24 (2): 130-135. 10.1080/01421590220120731.
Schwarz MR, Wojtczak A: Global minimum essential requirements: a road towards competence-oriented medical education. Med Teach. 2002, 24 (2): 125-129. 10.1080/01421590220120740.
Leung WC: Competency based medical training: review. Bmj. 2002, 325 (7366): 693-696. 10.1136/bmj.325.7366.693.
Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C: Shifting paradigms: from Flexner to competencies. Acad Med. 2002, 77 (5): 361-367. 10.1097/00001888-200205000-00003.
Searle J: Defining competency - the role of standard setting. Med Educ. 2000, 34 (5): 363-366. 10.1046/j.1365-2923.2000.00690.x.
Diwakar V: Commentary: The baby is thrown out with the bathwater. BMJ. 2002, 325 (7366): 695-696.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/8/27/prepub
We would like to acknowledge the Chinese Medicine Registration Board of Victoria for providing mailing addresses of registered Chinese medicine practitioners resided in the state of Victoria, Australia.
The author(s) declare that they have no competing interests.
The following authors contributed to the conceptualisation of the project: CX, WZ, AZ and AR. The following authors contributed to the data collection, analysis and interpretation: CX, WZ, AZ and CD. The following authors contributed to the draft of the manuscript: CX, WZ and AZ. The following authors contributed to the review and commentary on the manuscript: KG, VL, AR and DS. All authors read and approved the final manuscript.
Charlie C Xue, Wenyu Zhou, Anthony L Zhang, Kenneth Greenwood, Cliff Da Costa, Alex Radloff, Vivian Lin and David F Story contributed equally to this work.