This article has Open Peer Review reports available.
Measuring costs of data collection at village clinics by village doctors for a syndromic surveillance system-a cross sectional survey from China
- Yan Ding†1,
- Yang Fei1,
- Biao Xu2,
- Jun Yang3,
- Weirong Yan4, 5,
- Vinod K. Diwan5,
- Rainer Sauerborn1 and
- Hengjin Dong†1, 6Email author
Received: 20 January 2014
Accepted: 16 July 2015
Published: 25 July 2015
Abstract
Background
Studies into the costs of syndromic surveillance systems are rare, especially for estimating the direct costs involved in implementing and maintaining these systems. An Integrated Surveillance System in rural China (ISSC project), with the aim of providing an early warning system for outbreaks, was implemented; village clinics were the main surveillance units. Village doctors expressed their willingness to join in the surveillance if a proper subsidy was provided. This study aims to measure the costs of data collection by village clinics to provide a reference regarding the subsidy level required for village clinics to participate in data collection.
Methods
We conducted a cross-sectional survey with a village clinic questionnaire and a staff questionnaire using a purposive sampling strategy. We tracked reported events using the ISSC internal database. Cost data included staff time, and the annual depreciation and opportunity costs of computers. We measured the village doctors’ time costs for data collection by multiplying the number of full time employment equivalents devoted to the surveillance by the village doctors’ annual salaries and benefits, which equaled their net incomes. We estimated the depreciation and opportunity costs of computers by calculating the equivalent annual computer cost and then allocating this to the surveillance based on the percentage usage.
Results
The estimated total annual cost of collecting data was 1,423 Chinese Renminbi (RMB) in 2012 (P25 = 857, P75 = 3284), including 1,250 RMB (P25 = 656, P75 = 3000) staff time costs and 134 RMB (P25 = 101, P75 = 335) depreciation and opportunity costs of computers.
Conclusions
The total costs of collecting data from the village clinics for the syndromic surveillance system was calculated to be low compared with the individual net income in County A.
Keywords
Background
Studies of the costs of syndromic surveillance systems are rare, especially for estimating the direct costs involved in implementing and maintaining these systems. There was only one study before 2014 [1] elucidating the direct costs of implementing and maintaining such a system. This study [1] excluded the costs incurred during the process of data collection at hospitals because those hospitals routinely collected the data elements in their electronic information system; however, some other syndromic surveillance systems may require substantial resources to be devoted to data collection. In these cases, the costs of data collection should be explored in order to arrive at comprehensive costs for implementing and maintaining these surveillance systems.
An Integrated Surveillance System in rural China (ISSC project), which integrated the functions of a syndromic surveillance system into the existing infectious disease surveillance system in China, was established and implemented from April 2012 to March 2014 with village clinics as the major surveillance units [2]. The aim of this project was to improve early warning for infectious disease outbreaks in rural China and it required additional effort in data collection at village clinics. Data for the surveillance at those clinics was collected from outpatients regarding 10 non-specific symptoms, and those symptoms were fever, cough, sore throat, nausea/vomiting, diarrhea, rash, muco-cutaneous hemorrhage, headache, convulsion and disturbance of consciousness [2]. The village clinics did not have electronic medical records that could be sorted and analyzed for surveillance purposes. Instead the village doctors entered data daily specifically for the syndromic surveillance to the ISSC platform. Our hypothesis was that this surveillance was labor intensive and that the costs of data collection for the implementation of the surveillance would not be negligible for those village clinics.
In a previous study, we found that the village doctors would be willing to provide public health services, including syndromic surveillance services, if they received an appropriate subsidy [3]. The purpose of this paper is to measure the costs of data collection by village clinics for the syndromic surveillance system in the ISSC project, and to provide a reference regarding the subsidy level required for village clinics to participate in data collection. The costs reported here included the time costs of data collection, and the depreciation and opportunity costs of the village clinic computers.
Definitions
According to the CDC’s evaluation framework, syndromic surveillance for early outbreak detection is defined as “an investigational approach, where health department staff, assisted by automated data acquisition and generation of statistical signals, monitor disease indicators continually (real-time) or at least daily (near real-time) to detect outbreaks of diseases earlier and more completely than might otherwise be possible with traditional public health methods” [4]. In the ISSC project, the syndromic surveillance system was an investigational approach, where staff from the County CDC, as well as researchers in this project, assisted by automated data acquisition and generation of statistical signals, monitored syndromes daily based on the 10-symptom data reported by the village clinics to detect outbreaks of diseases earlier and more comprehensively than might otherwise be possible with the existing infectious disease surveillance system in China. The existing system in China is a notifiable case report system based on confirmed infectious diseases [5]. Diseases of concern in this syndromic surveillance system were acute respiratory infectious diseases (e.g., influenza, epidemic cerebrospinal meningitis, measles, chicken pox, mumps), as well as gastrointestinal infectious diseases (e.g., bacillary dysentery, enteritis, viral hepatitis, polio) [6]. The syndromic surveillance system also detected outbreaks based on absenteeism data from primary schools and sales of medicines from pharmacies, which is beyond the scope of this survey. More information can be found in other studies [2, 7].
Any report concerning an outpatient with at least one of the ten symptoms became a reported event to the syndromic surveillance system. Syndromes defined within this system included acute respiratory infection (patients with fever and either cough or sore throat), influenza-like illness (patients with temperature ≥38 °C and with either cough or sore throat), fever gastro syndrome (patients with fever and with either diarrhea or nausea/vomiting), and fever and rash (patients with both fever and rash) [8].
Methods
This cost analysis was performed from the program managers’ point of view. The time horizon of this study was 15 months, covering the formal implementation period of ISSC in County A from April 1, 2012, to June 30, 2013. All cost data were reported in Chinese currency (Renminbi; RMB), and costs were not discounted or adjusted for inflation due to the short time horizon.
Study sites and setting
Basic characteristics of county A in 2011
Variables | Units |
|---|---|
Area | 2035 km2 |
Population | 386,000 |
Annual income per capita of rural residents | 7400 RMBa |
No. of towns | 21 |
No. of villages | 182 |
No. of village clinics | 206 |
No. of village doctors | 579 |
Incidence of infectious diseaseb | 668/105/year |
ISSC implementation in county A
Phrase 1_Pilot study | Phrase 2_Formal study | |
|---|---|---|
Time period | August 1, 2011 - March 31,2012 | April 1, 2012 - March 31, 2014 |
Sampling strategy | Purposive cluster sampling with town as the basic sample unit | Purposive cluster sampling with town as the basic sample unit |
Towns involved | 2 | 9 (including the 2 pilot towns) |
Village clinics involved | 19 | 75 |
Data collection
We designed a questionnaire for the village clinics and a questionnaire for the village doctors in order to measure and value costs. The village clinic questionnaires collected information on the population served, outpatient volume, staff, computers, clinic incomes and expenditures, and the way in which the syndromic surveillance system had been implemented. Staff questionnaires collected individual information on the daily working time, and the time spent on the surveillance both before and after becoming familiar with the tasks involved in the surveillance.
This survey was part of a before-after study of an economic evaluation. It was performed using a non-randomized cluster sampling strategy following the ISSC project; the sampling units were towns. We approached 56 village clinics with the clinic questionnaire and one village doctor for each of the 56 village clinics with the staff questionnaire. The number of valid clinic and staff questionnaires received were, respectively, 51 and 53.
We also collected data on reported events by village clinics logged in an internal database of the ISSC project. Our hypothesis was that to report more events consumes more time in general. It was, therefore, considered meaningful to explore the daily time spent on the surveillance if the time was connected with the number of reported events on outpatients.
Data analysis
Costs of time
Data from village clinics and staff questionnaires were first entered into Epidata 3.02 (the EpiData Association, Odense, Denmark), and then exported to Stata (StataCorp LP, Texas, USA) for descriptive analysis.
Where R: number of reported events during a certain time period; D: number of days covered by the same time period; P: population covered.
Where t: daily staff time from a village clinic devoted to SSS for every 1000 of the population; T: total daily duty time of a reporter from a village clinic devoted to all services; I: net income of a village clinic for every 1000 of the population.
Depreciation and opportunity costs of computers
Computer usage life in China is 6 years according to the WHO-CHOICE project [13]. We chose to use 5 % as the discount rate for the depreciation and opportunity costs of computers, as suggested, in order to be comparable with other studies on costs [14]. Consequently, the annuity factor for computers was 5.0757 [14].
We needed to allocate the annual depreciation and opportunity costs of computers to the syndromic surveillance project, since the computers were not solely used for the surveillance. The allocation basis was the usage percentage of the computers in each village clinic devoted to the surveillance.
Ethical approval for this study was obtained from Heidelberg University in Germany and Fudan University in People’s Republic of China.
Results
Characteristics of the investigated village clinics and village doctors
Characteristics of the investigated village clinics and village doctors in 2012
Population of a village | No. of clinics at a village | No. of village doctors at a clinic | Age of village doctors | |
|---|---|---|---|---|
P25 | 1437 | 1 | 1 | 34 |
Median | 1980 | 1 | 1 | 38 |
P75 | 2173 | 1 | 2 | 42 |
Reported events and daily time on data collection from village clinics
Number of outpatient visits and reported events to the ISSC from a village clinic from April 1 2012 to June 30 2013
Total reported events per 1000 people | Total outpatient visits per 1000 people | Reported events/ outpatient visits (%) | Daily reported events per 1000 people | Daily outpatient visits per 1000 people | |
|---|---|---|---|---|---|
P25 | 931 | 2185 | 29.4 | 2 | 5 |
Median | 1267 | 3375 | 42.3 | 3 | 7 |
P75 | 1932 | 4150 | 60.1 | 4 | 9 |
According to the village doctors, targeted syndromes were present in 42.3 % (P25 = 29.4, P75 = 60.1) of all out-patient visits and reported to the ISSC.
Costs of time of daily data collection and reporting for ISSC in 2012
Reporting time in minutes per 1000 population (A) | Total time in minutes for all duties per 1000 population (B) | Percent of time in reporting per 1000 population (C) | Net income of a village clinic in 2012 in RMB (D) | Net income serving for 1000 population in RMB (E) | Costs of time in reporting for 1000 population in RMB (F) | Adjusted costs of time in reporting for 1,000 population in RMB (G) | |
|---|---|---|---|---|---|---|---|
P25 | 7 | 480 | 2.1 | 36,000 | 23,000 | 567 | 656 |
Median | 12 | 600 | 4.2 | 52,500 | 27,579 | 1029 | 1250 |
P75 | 27 | 720 | 6.3 | 90,000 | 45,455 | 2000 | 3000 |
Initial training was provided for the village doctors who were to collect the data. The time for the village doctors to attend initial training ranged from one day plus one hour to one and a half days. Other time consumed by the village doctors for the surveillance was the time they spent assisting staff from the County CDC in verifying signals. The time needed for signal verification by the village doctors was negligible, as shown in the following section.
Warning signals detected based on reported events from village clinics
Eight signals were detected during the 15 months’ implementation period from the 56 village clinics. The number of signals per surveillance unit per day was close to zero. Five out of the eight signals were ruled out by the county CDC staff through telephone investigations, and the other three led to fieldwork investigation. Those investigation were performed by staff from the county CDC and assisted by village doctors from the three respective village clinics. Among those three, one signal was judged by the staff from the County CDC as not relevant to an outbreak, and the other two were suspected to be warnings of outbreaks. One of the two was confirmed as a new influenza A (H1NI) virus infection with laboratory tests. It was under control as the County CDC together with related health facilities and primary schools started to take coping measures as they began the investigation. The other signal was not confirmed with laboratory tests. The staff of the County CDC closely followed up the signal and no outbreaks occurred.
Net incomes of village clinics and their village doctors
According to our survey, township hospitals or villages were the registered owners of village clinics in County A, whereas village doctors in County A enjoyed the benefits of ownership of those village clinics that they worked at. This means that the village doctors generated the raw incomes of the village clinics either by direct charges for medical treatments or medicines or by receiving payments from the government for providing certain services (e.g. performing the ten public health services included in the essential package in rural China). It also means that the village doctors needed to take care of the expenditures incurred in their clinics, which included the costs of medicines and medical supplies, the rents and maintenance of clinic buildings and their operation, and the transportation for medical or public health services. The net incomes of the village doctors came from the raw incomes of their clinics deducted by the expenditures incurred by their clinics.
Table 5 shows the distribution of net income per 1000 of the population of each village clinic. For every 1000 of the population, the median net income of a village clinic was 27,579 RMB (P25 = 23,000, P75 = 45,455).
Costs of data collection by village doctors at village clinics for the ISSC
The surveillance itself was not supposed to be an after duty time job; however, the majority of village clinics reported data after routine working time, as reported in the former section. Working time after duty time should be valued more given that, according to the Labor Law of the People’s Republic of China [15], employers should pay their employees at least 150 % of salaries for after duty time work. We therefore adjusted the costs by multiplying them by 150 %, and presented the time costs of data collection both before and after the adjustment in Table 5. The adjusted median cost of staff time in 2012 was 1250 RMB (P25 = 656, P75 = 3000). As we reported in the former section, to perform the surveillance, village doctors also spent time on initial training and assistance in signal verification besides collecting data. This survey only focused on the costs of data collection.
The purchasing cost of a computer for the syndromic surveillance in county A in 2012 was 3400 RMB. Annual depreciation and opportunity cost of a computer in 2012 was therefore 670 RMB according to formula (5). We calculated the annual depreciation and opportunity costs of computers for the ISSC to be 134 RMB (P25 = 101, P75 = 335), with the median percentage of usage of computers for the ISSC 20 % (P25 = 8, P75 = 49).
The adjusted total cost of data collection at the village clinics for the surveillance, which included staff time costs, and the depreciation and opportunity costs of computers, was 1423 RMB (P25 = 857, P75 = 3284).
Discussion
This survey represents a first step in exploring the operating cost of a syndromic surveillance system. It demonstrated a detailed process in calculating the costs of data collection at village clinics, including the cost of staff time, and the depreciation and opportunity cost of computers.
The average net income of a village resident in county A in 2012 was 8737 RMB [16]. Therefore, for village doctors or village clinics, the cost of collecting data for the syndromic surveillance system in County A for a population of 1000 in 2012 is 16 % (P25 = 10, P75 = 38) of the average net income of a resident in County A. It is 14 % (P25 = 8, P75 = 34) if we compared the cost of staff time in data collection with the net income of a resident in County A in 2012. According to these percentages, we consider the cost of data collection to be low. This conclusion is different from a study which found that implementing new data collection processes involved prohibitive costs [17].
We believe that the adjusted total costs of data collection at the village clinics for the syndromic surveillance were an appropriate proxy of the costs of the village clinics for participating in the syndromic surveillance services. Our reason was that the other costs incurred at the village clinics associated with participation in the syndromic surveillance included the time costs of the initial training and of the signal verification and investigations, and that these costs were negligible to the clinics because they were covered by the County CDC and researchers. Detailed reasons were: 1) the time for the initial training was minimal (1 day plus 1 h to half a day) considering that this surveillance was implemented as a daily routine; 2) the number of signals per surveillance unit per day was close to zero and fieldwork investigations were mainly performed by staff from the county CDC, although the village doctors whose reported events triggered the signals may assist the investigation.
The percentage of reported events among the total outpatient visits from other studies was 26.7 % [18] or 75 % [19] which spans the median percent found in this study. Further studies may need to explore this uncertainty regarding the percentages of reported events among total outpatient visits. Our reason was that these percentages relate to the workload in data collection for surveillance, even if their influence on the effectiveness of the surveillance is not yet known.
Understaffing was viewed as a challenge for public health surveillance [20]. Health care workers have repeatedly shown poor compliance with additional administrative tasks, such as data collection for surveillance [20]. In addition to studying the cost of data collection, information concerning the willingness and motivation of staff to undertake a syndromic surveillance system would be helpful for the policy makers.
The limitations of this study include: 1) it may under-estimate net incomes of village clinics and village doctors since income is a sensitive topic, accurate income data may be difficult to obtain [21]; consequently, this survey may over- or under-value village doctors’ time; 2) it is based on data from only one study site, and therefore caution must be given if generalizing for the rest of rural China.
Conclusions
The total costs of collecting data by village doctors from village clinics in County A for the syndromic surveillance system were calculated to be low as compared with the average net income of a village resident in County A. The estimated cost of data collection was 1423 RMB in 2012 (P25 = 857, P75 = 3284), and this may provide a reference value for policy makers regarding a possible subsidy for village clinics to participate in similar syndromic surveillance systems.
Notes
Declarations
Acknowledgements
We are grateful to the study participants. Data collection could not have been carried out without the aid of Qi Zhao and staff from the county CDC and Jiangxi province CDC. We appreciate the help from a writing workshop lectured by Petra Eggensperger and organized by Manuela De Allegri, and we also thank peers in this workshop. We are grateful to Andreas Ruppel, Salvador Shabbir and Cate Livingstone for helpful criticism and substantial language editing. The views expressed in this paper are those of the authors and not of their home institutions. This work was supported by grant number 241900 from the European Union Framework Programme 7.
Authors’ Affiliations
References
- Kirkwood A, Guenther E, Fleischauer AT, Gunn J, Hutwagner L, Barry MA. Direct cost associated with the development and implementation of a local syndromic surveillance system. J Public Health Manag Pract. 2004;13:194–9.View ArticleGoogle Scholar
- Yan W et al. Establishing a web-based integrated surveillance system for early detection of infectious disease epidemic in rural China: a field experimental study. BMC Med Inform Decis Mak. 2012;12:4.View ArticlePubMedPubMed CentralGoogle Scholar
- Ding Y et al. Factors influencing the provision of public health services by village doctors in Hubei and Jiangxi provinces, China. Bull World Health Organ. 2013;91:64–9.View ArticlePubMedGoogle Scholar
- CDC. Framework for evaluating public health surveillance systems for early detection of outbreaks. Morb Mortal Wkly Rep. 2004;53(RR05):1–11.Google Scholar
- Chinese CDC. The China information system for disease control and prevention. 2007. Available at: http://www.chinacdc.cn/ztxm/ggwsjc/jcxt/200702/t20070215_41341.htm [Accessed 2013 08 10].Google Scholar
- ISSC. ISSC Annex I-“Description of Work” for Project “An integrated surveillance system for infectious disease in rural China: generating evidence for early detection of disease epidemics in resource-poor settings”, with “ISSC” as Project acronym. 2009. Internal material.Google Scholar
- Yan W, Palm L, Lu X, Nie S, Xu B, Zhao Q, et al. ISS-an electronic syndromic surveillance system for infectious disease in rural China. PLoS One. 2013;8(4):e62749.Google Scholar
- The research team for the ISSC at Fudan University School of Public Health. Presentation: progress of WP4 in Jiangxi sites. Stockholm: Oral presentation at 2013 ISSC annual meeting; 2013.Google Scholar
- Stommel M, Given C, Given B. The cost of cancer home care to families. Cancer. 1993;71(5):1867–74.View ArticlePubMedGoogle Scholar
- Wganer TH, Chadwick G, Cruz AM. The cost of operating institutional review boards (IRBs) in the VA. Available at: http://www.herc.research.va.gov/files/RPRT_255.pdf [Accessed 2013 08 10].
- Ruger JP, Emmons KM, Kearney MH, Weinstein MC. Measuring the costs of outreach motivational for smoking cessation and relapse prevention among low-income pregnant women. BMC Pregnancy Childbirth. 2009;9:46.Google Scholar
- Somda ZC, Meltzer MI, Perry HN, Messonnier NE, Abdulmumini U, Mebrahtu G, et al. Cost analysis of an integrated disease surveillance and response system: case of Burkina Faso, Eritrea, and Mali. Cost Eff Resour Alloc. 2009;7:1.Google Scholar
- CHOosing Interventions that are Cost Effective (WHO-CHOICE). Prices and useful lives of tradable capital goods. Unknown year. Available at: [http://www.who.int/choice/cost-effectiveness/inputs/capital_goods/en/ [Accessed 2013 08 12].
- Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL. Methods for the economic evaluation of health care programmes. 3rd ed. New York: Oxford University Press; 2005.Google Scholar
- Standing Committee of the National People’s Congress. Labor Law of the People’s Republic of China [Revised] 1995. Available at: http://www.gov.cn/banshi/2005-05/25/content_905.htm (in Chinese) [Accessed 2013 10 10].
- Bureau of Statistics, Yongxiu. Report on the social economic development of Yongxiu in 2012. 2012. Available at: http://218.87.20.15/yxx/bmgkxx/tjj/gzdt/tjsj/201309/t20130925_89073.htm (in Chinese) [2013 11 10].
- Mandl KD, Overhage JM, Wagner MM, Lober WB, Sebastiani P, Mostashari F, et al. Implementing syndromic surveillance: a practical guide. Informed by the early experience. J Am Med Inform Assoc. 2004;11(2):141–50.Google Scholar
- Ackelsberg J, Balter S, Bornschelgel K, Carubis E, Cherry B, Das D, et al. Syndromic surveillance for bioterrorism following the attacks on the World Trade Center---New York City, 2001. Morb Mortal Wkly Rep. 2002;51(Special Issue):13–5.Google Scholar
- Heffernan R, Mostashari F, Das D, Karpati A, Kulldorff M, Weiss D. Syndromic surveillance in public health practice, New York City. Emerg Infect Dis. 2004;10(5):858–64.Google Scholar
- May L, Chretien JP, Pavlin JA. Beyond traditional surveillance: applying syndromic surveillance to developing settings -opportunities and challenges. BMC Public Health. 2009;9:242.Google Scholar
- Davern M, Rodin H, Beebe TJ, Call KT. The effect of income question design in health surveys on family income, poverty and eligibility estimates. Health Service Res. 2005;40(5):1534–52.Google Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
