- Research article
- Open Open Peer Review
Current level and determinants of inappropriate admissions to township hospitals under the new rural cooperative medical system in China: a cross-sectional study
BMC Health Services Researchvolume 14, Article number: 649 (2014)
The increased funding and reimbursement for the New Rural Cooperative Medical System (NRCMS) have provided residents in rural China with better access to inpatient services. This research aims to examine the level of inappropriate admissions to township hospitals under NRCMS, and the determinants that influence inappropriate admissions.
A total of 2,044 medical records in 10 township hospitals were collected from five counties in Midwestern China by stratified cluster sampling and evaluated using the Appropriateness Evaluation Protocol (AEP), which was developed by a Delphi expert consultation of 32 experts. A two-level logistic regression model by MLwiN 2.30 was used to examine the determinants of inappropriate admissions.
Township hospitals had an average inappropriate admission rate of 26.5%. The highest rate of inappropriate admission was among patients aged more than 59 years old (30.1%). Inappropriate admissions mostly occurred for respiratory and circulatory diseases. Township hospital similarity and clustering were observed. Two-level logistic regression analysis showed that age, treating department, and disease were determinants of inappropriate admission.
Township hospitals have a high rate of inappropriate admissions. Explicit diagnostic criteria and a standardized supervision system should be developed to reduce this.
Excess hospitalization demand means that patients receive unnecessary hospital services or those that are beyond their capacity to pay . It can occur on three occasions: inappropriate admission, where patients receive unnecessary inpatient services rather than outpatient ones, or services that are beyond their capacity to pay; inappropriate inpatient services, in which patients receive inappropriate services during necessary hospitalization; and inappropriate level of care, in which patients are admitted to a higher-level hospital than necessary. This phenomenon increases the average medical expenditure per capita. This research focuses particularly on inappropriate admissions.
In 2003, the Chinese government launched the New Rural Cooperative Medical System (NRCMS), which had been implemented in all counties by 2005. The target population for the NRCMS was rural residents, who account for more than 60% of the population of China . Rural residents voluntarily enrolled as families. The scheme’s sources of revenue included government subsidies and individual premiums. The population covered increased from 80.79 million in 2004 to 831.63 million in 2011, or 95.3% of the rural population of China .
Rural residents’ access to healthcare rapidly improved under the NRCMS. From 2003 to 2011, rural hospital admissions increased by 2.5 times from 3.4% to 8.4% (compared with the 0.3% increase from 1993 to 2003), the outpatient rate increased from 13.9% to 15.3%, and hospital delivery rates averaged from 68.9% to 95.9%. Simultaneously, the rate of unmet outpatient care declined from 48.9% to 5.4%, and the rate of unmet inpatient care declined from 29.6% to 17.3% . At the same time, the caesarean section rate sharply increased from 19.2% to 36.3% . Some studies have reported that inappropriate admissions have significantly contributed to this increase ,. Many hospitals may admit patients who could have been treated as outpatients to increase the reimbursement from NRCMS, and patients often prefer to receive services as inpatients .
The consumer healthcare utilization model provides four steps for an inpatient procedure: assessing whether the patient needs healthcare; selecting a hospital; receiving the doctor’s proposal for diagnosis and treatment; and providing the care . Although patients have absolute choice in the treatment process, they always take account of doctors’ proposals. Inappropriate admission therefore results from the joint decision of patients and healthcare providers . In China, doctors have two possible reasons for causing inappropriate admission. The first is to avoid potential medical risks of outpatient care, because hospitalization allows for more examination and treatment to control the disease . The second is to generate more personal revenue, because most doctors generate revenue based on the volume of medical care they have supplied . Patients prefer hospitalization to outpatient care for three reasons: (1) cost saving—because hospital reimbursement comes from a pooled social fund, patients only pay a minimal amount personally; (2) to receive a more comprehensive and safe diagnosis and treatment than they would as outpatients ; and (3) convenience—repeated outpatient attendances, particularly for older people who live alone, are inconvenient in rural areas . At present, both patients and doctors can benefit from inappropriate admission, so a preference by either side will usually lead to inappropriate admission for example, a doctor may choose to satisfy a patient’s inappropriate request ,.
There are many studies about the determinants of inappropriate admissions. Mozes et al.  found that inappropriate admissions were much higher in groups requiring an operation and in children than other groups. De Marco et al.  also demonstrated that inappropriate admissions were seen more often in children, especially if they had an influenza-like illness. Barker Bausell  found that older people also had a high inappropriate admissions rate. Pileggi et al.  demonstrated that emergency patients were at high risk of inappropriate admissions. Brown  found that the insurance reimbursement ratio and day limits on insurance payouts also had a significant influence on the admission appropriateness.
Two methods are internationally accepted in evaluating admission rationality, explicit diagnosis-specific criteria (EDC)  and implicit criteria ,. The classification of disease diagnosis is not included in EDC. Instead, this provides reviewers with common criteria for all types of diagnosis, including the severity of the disease, the strength of services, and the patient’s need for hospitalization . The alternative, implicit criteria, requires senior clinical doctors to review medical records and determine whether hospitalization was appropriate. Researchers need not supply any information; the reviewer’s judgment will depend entirely on their knowledge, experience, and skills . EDC is often used by managers and other specialists in non-clinical medicine, and implicit criteria are employed by clinical medical experts. The results of the latter method are more reliable. However, insurance companies have limited funding and time, authoritative clinical medical experts are lacking, and doctors’ judgments on records vary, even for the same doctor at different times . Using EDC is therefore more practical.
In many countries, an Appropriateness Evaluation Protocol (AEP), a form of EDC, is commonly used to assess the appropriateness of admission and hospitalization. By reviewing the patient's medical records according to explicit criteria, the AEP enables evaluation of the rationality of the care. This is based on medical and technical standards and is independent of disease category. An AEP review focuses on specific services or patients, instead of a specific diagnosis, so evaluation can be performed by non-doctors, and even used for undefined or incorrect diagnosis. This method is commonly used by insurance agencies for supervising hospitalization services.
In 1967, the United States implemented AEP admission and hospital standards . In 1993, Austria, France, Italy, Portugal, Spain, Sweden, and the UK established a unified AEP standard for EU countries ,. In 1994, a panel of subsidiary hospitals of Maastricht University in the Netherlands launched the US-AEP for medical insurance payments for hospital services .
Inappropriate admissions considerably increase hospitalization expenses  and account for 20% to 40% of operation days . Ignoring inappropriate admission would hinder government inputs in public health as well as individual well-being .
The existing studies on excess demand for hospital services are more concerned with inappropriate services than hospitalization in China. NRCMS management agencies have formulated several policies to address inappropriate admissions, such as the creation of clinical pathways . Nevertheless, standardized clinical pathways cannot be implemented easily in township hospitals because of the considerable variation in the service capacities of rural institutions. Some NRCMS management agencies consider an admission inappropriate if the duration of stay is less than 3 days, or the total cost of non-surgical hospitalization is less than 200 RMB. However, such rigid judgment criteria are likely to cause mistakes. Other NRCMS management agencies have formed panels to assess such matter, which means higher costs. There is no tool like AEP in China.
We aim to make clear the level and determinants of inappropriate admissions in Chinese township hospitals by establishing AEP criteria. This study will also help policy makers and health planners predict and plan for future needs.
We used a Delphi expert consultation to build AEP criteria for township hospitals in rural China. All current judgments on clinical indicators were screened based on current AEP criteria in the US , the seven aforementioned EU countries , the Netherlands, and other countries , and China's current clinical pathway and literature studies. We then consolidated and classified the systems to develop a preliminary evaluation of AEP entries. A total of 32 experts were chosen to conduct three rounds of consultation and adjustment. Of the 32, 11 were from top-class national hospitals, 15 from county hospitals, four from township hospitals, and two from NRCMS management agencies. The experts’ deep understanding of China’s existing services in rural areas enabled them to assess the suitability and other indicators of systemic AEP standards, and so build the AEP criteria for inappropriate admissions to township hospitals.
The experts reviewed 400 randomly selected medical records from a township hospital to formulate two standards, a final AEP standard and implicit diagnostic criteria for clinical experts. Both were tested with a kappa test.
The study protocol conformed to the ethical guidelines of the 1975 Declaration of Helsinki as reflected in a priori approval by the Ethics Committee of Tongji Medical College of Huazhong University of Science and Technology. Written informed consent was obtained from each participant. Patient information was anonymized and de-identified prior to analysis.
We applied stratified cluster sampling. Counties and county-level cities in China’s central (e.g., Jingshan, Songzi, and Dangyang in Hubei Province) and western (e.g., Danjiangkou and Meixian in Shaanxi Province) regions were designated as sample areas.
The sample size was calculated using the inappropriate admission rate in township hospitals. From existing research, the estimated inappropriate admission rate P is 16%, and the expected error d = 0.1 P = 1.6%, and α = 0.05. So,
An additional 10% was added to the final sample, giving a total of 2220 medical records.
Township hospitals were ranked by size and those in the 4th and 10th places were chosen for the study. In each hospital, 250 non-delivery medical records from 2012 were randomly selected. A total of 2,100 records were collected (fewer than 250 records were available from Songzi and Dangyang). After screening, 2,044 records were found acceptable. All the sampling patients were covered by NRCMS, and had received reimbursement. Sociological characteristics such as gender, age, complications, admission information including hospital department, admitted severity, length of stay, disease category, and other data like the treatment capacity of the township hospital and the payment were collected to build a database using Epidata 3.2. Diseases were categorized using the International Classification of Diseases 10th revision (ICD-10). Additionally, NRCMS management personnel and doctors from the subject township hospitals were interviewed.
From previous research, we identified possible determinants including gender, age, department, admitted severity, length of stay, disease category, complications and the payment method ,-. The treatment capacity of a medical institution is an important factor in inappropriate admission. The data we obtained indicate a hierarchical structure. The 2,044 records were aggregated by township hospital. The determinants for inappropriate admission to hospitals were examined using MLwiN 2.30, which was developed by the University of Bristol, UK, for multilevel binomial logistic regression analysis ,.
After three rounds of Delphi evaluation and adjustment, the AEP criteria were identified (Table 1). The criteria comprise nine requirements for services, such as surgery needs, and 20 indicators of disease severity, such as persistent fever over 38°C for 5 days. Patients were considered to be inappropriately admitted if their records did not fit any AEP criteria.
The Cronbach coefficients for the three rounds of expert consultation were 0.676, 0.942, and 0.729. The applicability of the new AEP criteria was investigated by 32 experts, 28 of whom (87.5%) claimed the criteria could be used for more than 80% of the township hospital inpatients. Both the AEP criteria and clinical experts’ implicit diagnostic criteria were applied to judging 400 medical records (see Table 2). The judgments were consistent, and the kappa coefficient of the result was 0.686 (u = 10.34, P < 0.01).
Basic condition of NRCMS in counties
Table 3 shows how the patients from the five counties benefited from the reimbursement policies of NRCMS. These counties shared the same financing policies in 2012, in which an individual who pays 60 RMB receives a government subsidy of 240 RMB. Reimbursement takes two forms, namely, outpatient and inpatient reimbursement and the different payment schemes lead to a sizeable difference in hospitalization benefits.
Characteristics of patients inappropriately admitted to township hospitals
Table 4 shows the characteristics and inpatient admissions data for the subject patients. A total of 26.5% of the records indicated inappropriate admissions. The incidence rate varied in different regions (P < 0.001), which ranged from 10% to 40%. More than half of the cases, 57.5%, were women, but appropriate admissions were only 51.7% (P = 0.021). The average age of the 2,044 hospitalized patients was 54.7 years, whereas the mean age of inappropriate admissions was 57.8 years (P < 0.001). Elderly patients (52.1%) were more likely to be inappropriately admitted (P < 0 .001). Patients in internal medicine departments were more likely to have been inappropriately admitted than other departments (P < 0.001). Inappropriate admission also occurred mostly in non-urgent patients (P < 0.001). Respiratory, circulatory, and skeletal muscle diseases were more likely in those inappropriately admitted (P < 0.001). No statistical difference between the two groups was found in terms of length of stay (LOS) and whether the patients had complications.
Determinants of inappropriate admissions to township hospitals
The two-level logistic regression used was by MLwiN 2.30, the medical records were level 1, and the township hospitals level 2. The level 2 variance of the zero model was statistically significant (χ2 = 4.917, P = 0.027), with aggregation of information at the township level.
The specific results of the introduction of the explanatory variables to fit two variance components models are shown in Table 5. The major determinants of inappropriate admissions to township hospitals were age, hospital department, severity of illness on admission, and disease category. If other factors remain constant, inappropriate admission was higher among groups aged 20 and above. The accidental estimation of the group aged 20 and above was about 2.6, which is considerably higher than younger groups. No difference existed between pediatrics and internal medicine, and inappropriate admissions for surgical and other departments were far below those for internal medicine. More severe conditions had lower rates of inappropriate admission. Meanwhile, digestive, symptomatic, and respiratory diseases had the same rate of inappropriate admission. The rates for circulatory and skeletal muscle diseases were higher than respiratory diseases (P < 0.001), whereas the rates for urinary tract diseases, trauma, and poisoning were much lower (P < 0.001).
Based on the existing management capacity and supervision scope of NRCMS, AEP is the most effective regulatory tool. The AEP developed in this study is based on the service capacity and need for hospitalization in rural China. The standard applies to common diseases, and mainly covers surgery, gynecology, and pediatrics. A few specialist diseases are exceptions. A kappa coefficient of 0.686 for AEP and clinical experts’ implicit diagnostic criteria indicates high consistency. The former could reflect the results of the latter at 0.686, which is higher than other evaluated tools in previous studies . From the studies published in the past 20 years, no approach could guarantee total reliability in evaluating inappropriate admission . The present AEP criteria, which were developed based on the physical condition and medical needs of the general public, could be implemented in large rural areas in China.
Otherwise, it is worth noting that the standard of whether hospitalization was appropriate is based on disease development and treatment demands, but social factors were not taken into account. These might include older people living alone, the need for multiple outpatient visits, or distance from medical facilities and difficulties traveling. Although such hospitalizations are clinically unreasonable, their rationality is worth discussing from the point of view of humanization and social care.
Reasons for aggregation of inappropriate admissions at township hospital level
The two-level logistic regression shows an evident hierarchy among the inpatient data (township hospitals–patients). Patients hospitalized at the township level are clustered. The township hospitals of different counties differ in NRCMS reimbursement, payment policies, service concept, and medical capability, which affect the incidence of inappropriate admission. Because of limited information, the results which these factors affect inpatient service reflected from a qualitative point of view.
First, the design of outpatient and inpatient NRCMS reimbursement influences the rate of inappropriate admission. International experience indicates that decreasing the out-of-pocket (OOP) share of inpatients in hospital fees induces excess hospitalization demand and increases costs . If the difference between inpatient and outpatient reimbursement is not large, patients prefer inpatient treatment. For example, those paying through a family account or via individual reimbursement could afford only a few visits to the clinic, because they would have to fund any more themselves. The reimbursement for outpatients is lower and there is a limit per day, whereas the corresponding inpatient reimbursement is higher, as much as 70%. As a result, patients exaggerate their outpatient needs to enjoy a more economical inpatient service. Dangyang County uses a fund-pooling system for outpatient service, with reimbursement of up to 40% and a limit of 100 RMB per capita. The incidence of inappropriate admission reaches 39.9% because the 100 RMB only pays for a few outpatient visits, compared with inpatient reimbursement, through which all expenses exceeding 100 RMB will be reimbursed. Thus, for patients with chronic diseases, who need more frequent clinic visits, the tendency for inappropriate admission increases, up to 39.9%. Jingshan reimburses 6 RMB per outpatient, with the balance to be paid by the patient. Those suffering from chronic diseases or requiring multiple visits tend to choose hospitalization after paying 100 RMB, because 90% of inpatient costs can be reimbursed. Meixian County has no reimbursement limitations for outpatients and has a lower reimbursement for inpatient services than other counties, so residents have to pay more to be admitted. It therefore has a lower hospitalization rate than other counties, and the inappropriate admission rate is only 10.3%.
The payment modes of NRCMS determine the way in which township hospitals operate, affecting the incidence of inappropriate admission. For example, payment for single disease leads to inappropriate admissions. Township hospitals sometimes need to accept patients with minor illnesses as inpatients, to lower the average cost of hospitalization, and to get more reimbursement. Counties that pay different rates for different conditions, such as Dangyang, Jingshan and Danjiangkou, have higher rates of inappropriate admissions. Some common conditions, some regular diseases such as respiratory and circulatory problems, have higher inappropriate admission rates than others in payment for single disease.
Geographical environment correlates with inappropriate hospitalization. Meixian and Songzi County are both plains, and their rate is about 10%. Dangyang and Jingshan are hilly, and Danjiangkou is mountainous; they have higher rates, suggesting that convenience of travel to receive treatment also influences hospitalization.
The management of township hospitals also influences the appropriateness of hospitalization. Meixian County is a pilot project of the World Bank Loan/British Government Grants China Rural Health Development Project. Its township hospitals have undergone more comprehensive and standard reforms and have strong administration, translating to fewer inappropriate admissions. Danjiangkou uses a system of exclusions to control inappropriate admission, which defines 14 kinds of medical problems, 13 kinds of surgical problems, and nine other diseases that do not require hospitalization. These include where Hb > 6 g/L in iron deficiency anemia, and a liver cyst of less than 2 cm. The remaining inpatient services are reimbursed. This policy has, to some extent, caused inappropriate admissions for other diseases to rise, and it now has a higher inappropriate admission rate than any other county.
Individual characteristics of patients who were hospitalized inappropriately
Table 4 shows that neither a patient’s experience of medical complications nor length of stay have any significant effect on inappropriate admissions, which are affected by age, treating department, admitted severity, and disease category, as shown in Table 5. The largest proportion of inappropriate admissions (52.1%) occurred among older people, which is consistent with other research , and children had the lowest incidence. Inappropriate admission among older people may be for two reasons. First, a high demand for health care and an inadequate outpatient account could eventually lead to hospitalization. Second, traveling can be difficult for older people, and since most of them no longer need to go to work, hospitalization is more convenient.
Medical wards tend to have distinctly more inappropriate admissions (30.7%) than surgical wards and pediatrics. Surgical cases require hospitalization, so it is easy to distinguish whether hospitalization is needed, while medical wards have less control over hospitalization standards. The lower rate of inappropriate admissions in pediatric departments (18.75%) conflicts with previous studies, where the global inappropriate admission rate among children reached 20% to 40% . The disparity may be associated with parental choice. Parents may be more inclined to choose county hospitals for children, and the small number of cases, just 32, may not be representative. Inappropriate admission generally occurs among patients with minor diseases. Severely afflicted patients more often require hospitalization, and the rate is therefore more rational.
Respiratory, circulatory, digestive, and endocrine conditions have a higher incidence of inappropriate admission, while urinary and other conditions have a lower incidence , perhaps because of the differing treatment capabilities and control levels of outpatient departments. Urinary diseases are poorly controlled in clinics, so admissions are more appropriate. The conditions with more inappropriate admissions are those where it is not easy to differentiate whether outpatient or inpatient care is necessary. Children and older people with low immunity and resistance to disease are more vulnerable to respiratory diseases, such as influenza, bronchial pneumonia in children, and chronic bronchitis in older people. These diseases have higher occurrences and longer durations. Their symptoms usually last 5–7 days, and while medication and rest are critical to recovery, many patients find no improvement in village clinics or outpatient treatments after brief periods and request hospitalization. These diseases do not meet the admission standards, either on severity or intensity, so such admissions are considered inappropriate.
Inappropriate admission to township hospitals in Chinese rural areas is high, according to the AEP. The reimbursement design and methods of NRCMS often promote inappropriate admission. Payment without checking for appropriateness, fee for service, and little difference between inpatient and outpatient reimbursement were also causes. Individual requirements, coupled with the interests of medical institutions, seem to cause inappropriate admissions. The Chinese government could control rural area admissions in two ways. First, this study suggests that improving the out-of-pocket payments would reduce inappropriate admissions . In particular, it would help to differentiate NRCMS inpatient and outpatient reimbursement and reduce the economic considerations that drive patients to choose hospitalization, to make them select their treatment more rationally. Second, it would help to strengthen the admission supervision system in medical institutions. This would include clear identification standards for admission, emphasis on severity, and more focus on respiratory diseases.
New Rural Cooperative Medical System
Appropriateness evaluation protocol
Length of stay
Gertman PM, Restuccia JD: The appropriateness evaluation protocol: a technique for assessing unnecessary days of hospital care. Med Care. 1981, 19: 855-871. 10.1097/00005650-198108000-00005.
Lei X, Lin W: The New Cooperative Medical Scheme in rural China: does more coverage mean more service and better health?. Health Econ. 2009, 18 (Suppl 2): S25-46. 10.1002/hec.1501.
NHFPC NHaFPCoC: 2013 China Statistics Yearbook of Health and Family Planning. Beijing: Peking Union Medical College Press. 2013.
Meng Q, Xu L, Zhang Y, Qian J, Cai M, Xin Y, Gao J, Xu K, Boerma JT, Barber SL: Trends in access to health services and financial protection in China between 2003 and 2011: a cross-sectional study. Lancet. 2012, 379: 805-814. 10.1016/S0140-6736(12)60278-5.
Long Q, Klemetti R, Wang Y, Tao F, Yan H, Hemminki E: High Caesarean section rate in rural China: is it related to health insurance (New Co-operative Medical Scheme)?. Soc Sci Med. 2012, 75: 733-737. 10.1016/j.socscimed.2012.03.054.
Han B YZ, Liao X, Shen F, Hao X, Han B, Yuan ZK, Liao XB, Shen FM, Hao X, Xiao YC, Hong Y: Investigation on the medical service demand and utilization of farmers under NRCMS, Jiangxi: Four years tracking study. Chi j Health Manag 2009, 24:483-485..
Lei JQH: Research on the Inpatient utilization and its influencing factors under NRCMS in HaiRMB, Ningxia. J Ningxi Med Univ. 2011, 33: 345-348.
Cheng Xiaoming LW: Chapter 2: Health service demand inn: Health Economics. 2 Edition. Bejing: People's Medical Publish House. 2008
Alarcon RD, Walter-Ryan WG, Shaw L: Inappropriate admissions to psychiatric wards. South Med J. 1985, 78: 827-832. 10.1097/00007611-198507000-00014.
Yip WCM, Hsiao W, Meng QY, Chen W, Sun XM: Realignment of incentives for health-care providers in China. Lancet. 2010, 375: 1120-1130. 10.1016/S0140-6736(10)60063-3.
Jing W, Otten H, Sullivan L, Lovell-Simons L, Granek-Catarivas M, Fritzsche K: Improving the Doctor-Patient Relationship In China: The Role Of Balint Groups. Int J Psychiatry In Med. 2013, 46: 417-427. 10.2190/PM.46.4.g.
Martineau T, Gong YL, Tang SL: Changing medical doctor productivity and its affecting factors in rural China. Int J Health Plann Manage. 2004, 19: 101-111. 10.1002/hpm.748.
Chen W, Tang SL, Sun J, Ross-Degnan D, Wagner AK: Availability and use of essential medicines in China: manufacturing, supply, and prescribing in Shandong and Gansu provinces. Bmc Health Services Research 2010, 10:211..
Dunn RG: Scheduling elective admissions. Health Serv Res. 1967, 2: 181-215.
Mozes B, Schiff E, Modan B: Factors affecting inappropriate hospital stay. Qual Assur Health Care. 1991, 3: 211-217. 10.1093/intqhc/3.3.211.
De Marco G, Mangani S, Correra A, Di Caro S, Tarallo L, De Franciscis A, Jefferson T, Guarino A: Reduction of inappropriate hospital admissions of children with influenza-like illness through the implementation of specific guidelines: a case-controlled study. Pediatrics. 2005, 116: e506-511. 10.1542/peds.2005-0053.
Ingold BB, Yersin B, Wietlisbach V, Burckhardt P, Bumand B, Bula CJ: Characteristics associated with inappropriate hospital use in elderly patients admitted to a general internal medicine service. Aging (Milano). 2000, 12: 430-438.
Coast J, Peters TJ, Inglis A: Factors associated with inappropriate emergency hospital admission in the UK. Int J Qual Health Care. 1996, 8: 31-39.
Brown PH, Theoharides C: Health-seeking behavior and hospital choice in China's New Cooperative Medical System. Health Econ. 2009, 18 (Suppl 2): S47-64. 10.1002/hec.1508.
Payne SM: Identifying and managing inappropriate hospital utilization: a policy synthesis. Health Serv Res. 1987, 22: 709-769.
McClain JO, Riedel DC: Screening for utilization review: on the use of explicit criteria and non-physicians in case selection. Am J Public Health. 1973, 63: 247-251. 10.2105/AJPH.63.3.247.
Restuccia JD: The evolution of hospital utilization review methods in the United States. Int J Qual Health Care. 1995, 7: 253-260.
Payne BC: Use of the criteria approach to measurement of effectiveness of hospital utilization. Jama. 1966, 196: 1066-1068. 10.1001/jama.1966.03100250076027.
Morehead MA: The medical audit as an operational tool. Am J Public Health Nations Health. 1967, 57: 1643-1656. 10.2105/AJPH.57.9.1643.
Strumwasser I, Paranjpe NV, Ronis DL, Share D, Sell LJ: Reliability and validity of utilization review criteria. Appropriateness Evaluation Protocol, Standardized Medreview Instrument, and Intensity-Severity-Discharge criteria. Med Care. 1990, 28: 95-111. 10.1097/00005650-199002000-00001.
Liberati A, Apolone G, Lang T, Lorenzo S: A European project assessing the appropriateness of hospital utilization: background, objectives and preliminary results. The Project Steering Group and the Coordinating Center. Int J Qual Health Care. 1995, 7: 187-199.
Lang T, Liberati A, Tampieri A, Fellin G, Gonsalves Mda L, Lorenzo S, Pearson M, Beech R, Santos-Eggimann B: A European version of the Appropriateness Evaluation Protocol. Goals and presentation. The BIOMED I Group on Appropriateness of Hospital Use. Int J Technol Assess Health Care. 1999, 15: 185-197. 10.1017/S0266462399152784.
Lavis JN, Anderson GM: Appropriateness in health care delivery: definitions, measurement and policy implications. CMAJ. 1996, 154: 321-328.
Kaplan RS, Lave LB: Patient incentives and hospital insurance. Health Serv Res. 1971, 6: 288-300.
Davis JE: Day surgery: a viable alternative. Aorn j. 1974, 19: 641-647. 10.1016/S0001-2092(07)60398-6.
Emil S, Taylor M, Ndiforchu F, Nguyen N: What are the true advantages of a pediatric appendicitis clinical pathway?. Am Surg. 2006, 72: 885-889.
Panis LJ, Verheggen FW, Pop P: To stay or not to stay. The assessment of appropriate hospital stay: a Dutch report. Int J Qual Health Care. 2002, 14: 55-67. 10.1093/intqhc/14.1.55.
H G: Mutillevel statistical models. 3rd ed. 2003.
GHR J: Improved approximations for multilevel models with binary responses. J Royal Stat Soc. 1996, 159: 505-513. 10.2307/2983328.
Xu LWX, Liu D, Sun Q: Study on the measurements of unnecessary health services. Chi J Hosp Adm. 2001, 19: 150-152.
Purdy S, Griffin T: Reducing hospital admissions. BMJ. 2008, 336: 4-5. 10.1136/bmj.39394.402465.BE.
Rodriguez-Vera J, de la Llave EP: Inappropriate admissions. J R Soc Med. 2002, 95: 111-10.1258/jrsm.95.2.111.
San Romain C, Guil M, Fernández S: Inappropriate admissions and stays in internal medicine. Med Clin (Barc). 2002, 118:157..
This research is supported by the National Natural Science Foundation of China (71073061) and the China Medical Board (11-069). The authors would like to thank the National Natural Science Foundation of China for funding this research, and acknowledge the outstanding contributions from Zhaoqun Chu to this article. We also want to thank the associate editor and reviewers for careful review and insightful comments, which have led to a significant improvement of the manuscript.
The authors have declared that no competing interests exist.
YZ and Y-CC participated in conception and design, and the analyses, and wrote the manuscript. XZ and YZ participated in data collection and performed the statistical analysis. LZ helped to draft the manuscript, reviewed the manuscript and made final changes. YZ participated in data collection. All authors have given their final approval of the version to be published.