This article has Open Peer Review reports available.
Using diffusion of innovation theory to understand the factors impacting patient acceptance and use of consumer e-health innovations: a case study in a primary care clinic
© Zhang et al.; licensee BioMed Central. 2015
Received: 27 May 2014
Accepted: 4 February 2015
Published: 21 February 2015
Consumer e-Health is a potential solution to the problems of accessibility, quality and costs of delivering public healthcare services to patients. Although consumer e-Health has proliferated in recent years, it remains unclear if patients are willing and able to accept and use this new and rapidly developing technology. Therefore, the aim of this research is to study the factors influencing patients’ acceptance and usage of consumer e-health innovations.
A simple but typical consumer e-health innovation – an e-appointment scheduling service – was developed and implemented in a primary health care clinic in a regional town in Australia. A longitudinal case study was undertaken for 29 months after system implementation. The major factors influencing patients’ acceptance and use of the e-appointment service were examined through the theoretical lens of Rogers’ innovation diffusion theory. Data were collected from the computer log records of 25,616 patients who visited the medical centre in the entire study period, and from in-depth interviews with 125 patients.
The study results show that the overall adoption rate of the e-appointment service increased slowly from 1.5% at 3 months after implementation, to 4% at 29 months, which means only the ‘innovators’ had used this new service. The majority of patients did not adopt this innovation. The factors contributing to the low the adoption rate were: (1) insufficient communication about the e-appointment service to the patients, (2) lack of value of the e-appointment service for the majority of patients who could easily make phone call-based appointment, and limitation of the functionality of the e-appointment service, (3) incompatibility of the new service with the patients’ preference for oral communication with receptionists, and (4) the limitation of the characteristics of the patients, including their low level of Internet literacy, lack of access to a computer or the Internet at home, and a lack of experience with online health services. All of which are closely associated with the low socio-economic status of the study population.
The findings point to a need for health care providers to consider and address the identified factors before implementing more complicated consumer e-health innovations.
Healthcare providers in Australia are currently facing a number of challenges, including the increasing size of the aging population, a shortage of healthcare workers, patient demands for increased access to health information and participation in healthcare decision making, and rising healthcare costs .
As a response to these challenges, there is a trend for healthcare organizations to provide consumer e-health services which allow patients electronic access to their medical information [2-4]. Consumer e-health has emerged with the rapid development of interactive consumer health informatics (CHI) and the increasing prevalence of the Internet . It is described as “the use of modern computer technology and telecommunications to support consumers in obtaining information, analyzing their unique health care needs and helping them make decisions about their own health” and the “study, development, and implementation of computer and telecommunications and interfaces designed to be used by health consumers” [2,5]. Examples of consumer e-health include personal health records, smart cards, online health services, or engaging consumers in shared decision-making processes [2,6,7]. Currently, a substantial amount of e-health initiatives are in either the development or implementation phase [8,9], such as the Patient-Centered Access to Secure Systems Online (PCASSO) in the United States , or “Personally Controlled Electronic Health Record” (PCEHR), which is being implemented by the National E-Health transaction Authority (NETHA) in Australia . According to the Australia National E-Health strategy, over the next 10 years, the electronic communication of health information will cover 90% of consumers or their care providers, and over 50% of them will be able to actively access and use electronic health records to manage their health and interact with health systems .
Although consumer e-health has the potential to facilitate patients’ access to healthcare services, there still remain some questions about whether patients are willing and able to accept and use them. A number of factors have been suggested as the determinants to predict patient acceptance of or resistance to consumer e-health services, including socio-demographic variables, device usability, awareness of the e-health innovations, and the user’s computer skills [11-19]. A systematic review of studies on patient acceptance of consumer-centered health information technologies (CHIT) reveals that major variables (67 of the 94 variables) associated with consumers’ acceptance of CHIT were patient factors . These include socio-demographic factors, education level, prior experience of using computers, and health- and treatment- related variables . In addition, human-technology interaction, prior experience of using computer/health information technologies and environmental factors appear to be significantly associated with patient acceptance of CHIT .
A meta-analysis by Dohan and Tan  of 15 articles recognizes that perceived usefulness is positively associated with a consumer’s intention to use web-based tools for health related purposes . Another study on the impact of low literacy on the use of the internet for searching health information noted that, persons with low literacy made more mistakes during web-based searches and exhibited greater reluctance to access online health services .
Physical limitations for older adults to use e-Health services were also studied [18,19]. Choi reported that in the US, the rate of use the Internet for health related purposes by old adults is ranging from 32.2% in the 65–74 years old to 14.5% in the 75–84 years old .
According to Karahanna et al. , adoption and continued use of an IT innovation represent different behavioral intention . IT adoption is the initial usage (new behavior) of an IT innovation at the individual level, whereas IT usage is the subsequent continued usage of an IT innovation after adoption at the individual level . Consequently, factors determining user acceptance of an IT innovation differ from those affecting users’ attitudes toward continued usage of the IT innovation . Therefore, it is important to distinguish these two concepts and investigate factors impacting on each of them.
Although many studies relating to patient acceptance of e-Health services have been conducted, to date, no attempt has been made to interpret and synthesize the evidence about factors influencing patient acceptance and use of consumer e-health applications in a primary health care context. In addition, there are significant concerns with a mismatch between what is supplied and what is demanded, which might hinder patient acceptance and use of e-health services, and lead to a loss of return on investment for healthcare organizations [21,22]. To that end, studies that examine the factors impacting on patient acceptance and use of consumer e-health applications are needed.
To bridge this knowledge gap, the current study focuses on investigating the factors influencing patients’ acceptance or ongoing use or dis-continuation of use of an exemplar consumer e-health service – a patient e-appointment scheduling service – through a longitudinal case study in a primary health care clinic. This study was a continuation of previous qualitative interview study . A new data set extracted from computer log records adds a longitudinal view to this study. To increase the scientific value and generalizability, Rogers’ innovation diffusion theory was used as a theoretical lens to analyze the impact of factors on the patient attitudes toward the acceptance or rejection of the e-appointment service.
E-appointment scheduling service as an IT innovation
One of the primary health care processes that is affected by increasing numbers of patients is the appointment scheduling process [24-26]. The traditional telephone-based appointment scheduling service is a time- and resource- consuming process – staff spend too much time on answering phone calls and managing appointments, which is inefficient [25,27]. In addition, telephone-based appointment scheduling requires patients to call the medical clinics during office hours, which can be inconvenient for patients who work full-time . Therefore, it often results in congestion on the telephone lines and restricts the efficiency of the care providers’ work [26,27].
Another problem faced by clinics is that patients sometimes do not show up for their appointments. Missed appointments represent close to 10% of all appointments and this can lead to lower productivity for healthcare professionals and increased overall waiting-time for patients, which can decrease patient satisfaction and increase their health risks .
As a response to this challenge, more recently, some primary health care clinics have started to provide patients with e-appointment scheduling (EAS) services that enable a patient to conveniently and securely make appointments with healthcare providers through the Internet . According to the classification of Antonia et al. , the EAS is a typical consumer e-health application: the use of the Internet for online health services.
In the healthcare context, patients can access EAS service through a web portal 24 hours a day and 7 days a week . Once a patient’s preferred date and time are selected, the system will automatically confirm the patient’s appointment request and record the information in the database instantly without the involvement of care providers. In comparison with telephone-based appointment services, EAS enables patients to easily schedule their appointments. At the same time, by using this online scheduling tool, medical staff can identify new patients, allocate an appropriate time slot for each patient and easily manage patients’ appointments. Recently, Horvath et al.  reported a reduction of 2% in missed appointments for patients using an e-appointment system over two years 
With the prevalence of EAS in the health care sector, studies on patient acceptance and usage of EAS services have been conducted [31,32]. Cao et al.  conducted a qualitative study to examine patient usage of a web-based appointment system implemented in a Chinese public tertiary hospital . Their study found that although many patients were not aware of the existence of the online appointment system, the use of the Internet for appointment making could significantly reduce the total waiting-time and improve patients’ satisfactions with outpatient services . In addition, being ignorant of online registration, not trusting the Internet, and lacking the ability to use a computer were three main reasons given for not using the online appointment system . Zhang et al.  also reported that, despite the benefits of using the e-appointment service, most patients in a tertiary hospital in Shanghai still registered via the traditional method of queuing, suggesting that health service providers should use a more effective method to promote and encourage patients to use the online system and improve their satisfaction with this service .
It is expected that through the study of the adoption and usage of this system, we can improve understanding of patient behavior in adopting and using consumer e-health applications and the factors that either influence acceptance or usage behavior.
Rogers’ Innovation Diffusion Theory is one of the most popular theories for studying adoption of information technologies (IT) and understanding how IT innovations spread within and between communities [33,34]. According to this theory, innovation is an idea, process, or a technology that is perceived as new or unfamiliar to individuals within a particular area or social system. Diffusion is the process by which the information about the innovation flows from one person to another over time within the social system.
There are four main determinants of success of an IT innovation: communication channels, the attributes of the innovation, the characteristics of the adopters, and the social system . The communication channels refer to the medium through which people obtain the information about the innovation and perceive its usefulness. It involves both mass media and interpersonal communication.
The attributes of an innovation include five user-perceived qualities: relative advantage, compatibility, complexity, trialability and observability . Relative advantage is the degree to which the user perceives benefits or improvements upon the existing technology by adopting an innovation . Compatibility captures the extent to which an innovation is consistent with the existing technical and social environment . The more an innovation can integrate or coexist with existing values, past experience and the needs of potential adopters, the greater its prospects for diffusion and adoption [35,36]. Complexity measures the degree to which an innovation is perceived to be difficult to understand, implemented or used . An innovation that is less complex is more likely to be rapidly accepted by end users [35,36]. Trialability is the ability of an innovation to be put on trial without total commitment and with minimal investment . An innovation with higher trialability is more likely to be adopted by individuals . Finally, observability is the extent to which the benefits of an innovation are visible to potential adopters . Only when the results are perceived as beneficial, will an innovation be adopted .
Rogers has also characterized the individuals of a social system into five groups based on their attitudes toward an innovation: innovators, early adopters, earlier majority, later majority and laggards . Innovators, representing 2.5% of the population in a social system, are the first group to adopt an innovation. According to Rogers, innovators have the ability to understand and apply complex technical knowledge essential for bringing in the innovation from outside the social system. The next group is the early adopters who are a more integrated part of the social system than the innovators. They tend to be well informed about the innovation, well connected with the new technologies and more economically successful . The first two groups of adopters comprise 16% of the population in a social system. The next two groups, which account for 68% of the population of the social system, are earlier and later majority adopters. The last 16% of the individuals in the social system are called laggards . They are the strongest resisters to the adoption of an innovation and most likely they tend to become non-adopters because of their limited resources and lack of awareness or knowledge of the innovation .
In Rogers’ theory (2003), a social system is “a set of interrelated units engaged in joint problem solving to accomplish a common goal” . It constitutes a boundary within which the diffusion of innovations takes place . Rogers suggests that the structure of a social system affects the individuals’ attitude toward the innovation, and consequently, the rate of adoption of innovations .
In recent years, diffusion of innovation theory has been used to study individuals’ adoption of new healthcare information technologies [37-43]. To name a few, Helitzer et al. applied the diffusion of innovation theory to assess and predict the adoption of a telehealth program in rural areas of New Mexico . Chew et al. used innovation diffusion theory to study use of Internet healthcare services by family physicians ; and Lee conducted a qualitative study using Rogers’ theory to investigate the adoption of a computerized nursing care plan (CNCP) by nurses in Taiwan .
These studies demonstrated that Rogers’ innovation theory is useful for conceptualization of technology adoption in the context of e-heath. Therefore, this theory was used in the study as the theoretical framework to examine and explain the impact of factors, in particular, the characteristics of innovations and innovation decision-making processes, on patient acceptance and ongoing usage of an EAS service.
The case study was conducted in a primary health care centre, Centre Health Complex (CHC), located in Shellharbour, a suburban town on the South Coast of New South Wales (NSW), 100 kilometers south of Sydney. The medical centre provides family medical practices, specialist medical services, allied health services and wellness services to the local community. The staff included 19 physicians (17 GPs and 2 nurse practitioners), 7 allied health professionals, 10 specialists and 7 clerical front office staff.
According to the Australia Bureau of Statistics (ABS) 2011 census data, 63,605 people resided in the town where the study was conducted . Of these, 49% (N = 31,158) were male and 51% (N = 32,447) were female . The average age of the population at the study site was 37 years . People aged between 18 and 64 years made up 71.9% (N = 45762) of the population and people aged 65 years and over comprised 19.7% (N = 12576) of the population .
In addition, the ABS census data also suggested that 57.1% of the population at the study site reported working full-time, lower than the average of 60.2% in New South Wales (NSW) and 59.3% in Australia . On the other hand, the unemployment rate was 13.2%, which was higher than the average level in NSW (11.6%) and the whole country (11.5%) . The average weekly personal income of the study site was $479, lower than the average level of NSW ($561) and whole country ($577) . Therefore, the study site had a relatively low socioeconomic status in NSW and in Australia.
Design and implementation of the patient e-appointment scheduling service
In CHC, the current phone-call based appointment system was often congested and could not provide prompt services to patients. A patient e-appointment scheduling service was identified by the CEO of CHC as urgently needed in order to relieve the congestion of the phone-call based appointment system and provide patients with the opportunity for ‘self-service’ 24 hours a day and 7 days a week.
Information about the e-appointment service was disseminated to patients through the following channels: (1) fliers left at the reception desk; (2) posters placed in prominent locations in the medical centre; (3) an advertisement on the CHC web site, and (4) a voice message played during the phone call waiting periods was implemented 6 months after online system implementation. The information disseminated included the web link of the e-appointment service and the steps to follow to make an appointment using it.
At the time of the field study, the CHC provided a patient with three options for appointment making, include phone-call, online self-service and walk-in.
Methods for data collection and analysis
Methods for data collection
This study used both qualitative and quantitative research methods. To obtain detailed, in-depth qualitative data, a semi-structured interview was conducted. Six major issues were captured in each interview: (1) the patient’s basic demographic information, including age, education level and employment status, (2) the variation of continued usage of the online appointment service over the whole study period, (3) their awareness of the e-appointment service and the communication channels through which the information was received, (4) their perceptions of the e-appointment service compared with phone-call based appointment making, (5) prior experience of using online healthcare services, and (6) their intention to use the e-appointment service in the near future.
This study was sponsored by the University Research Committee (URC) Internal Industry Linkage Grant Scheme. The survey was approved by the University of Wollongong/South Eastern Sydney & Illawarra area Health Service Human Research Ethics Committee. The semi-structured interview guide was reviewed by the owner of the medical centre, the practice manager and a general practitioner (GP). It was then trialed on three patients to ensure they understood all the questions and could provide relevant answers to these questions. Afterwards, the interviews were conducted in the medical centre from April 2011 to May 2013.
The first survey was conducted three months after the system was implemented, from April to June 2011. The time of the survey was decided based on the research group’s experience with other e-Health system implementation studies, which was also confirmed by Munyisia et al. . In order to understand whether a patient’s perception of the system would change with time, the survey was repeated three times, from June to August 2011, from October to November 2012 and again from April to May 2013.
In each interview, the first author approached patients who were sitting in the waiting area, appearing not to be engaged in any activities. The researcher explained the purpose and procedure of the interview, then gave an information sheet with written explanation to the patient. Only after oral consent was given by the patient, would an interview start. Each interview lasted about 10 to 15 minutes and was audio-recorded with the interviewee’s permission. The interview stopped when theoretical saturation was reached .
For the protection of the patient privacy, each interviewee was given a unique number with the form of ‘PID_’, followed by three digital numbers. For example, ‘PID_001’ represents the first patient who participated in the interview.
The procedure for computer log data collection
The computer log data provides a complete and accurate longitudinal data set about patients’ ongoing or dis-continued use of the e-appointment service. Therefore, in addition to the interview, appointment log data was collected from the online appointment database. The online appointment database was built based on Microsoft SQL Server 2008. It stores each patient’s online appointment information, including date, time and the name of the GP to be visited. A set of data searching/results export SQL programs were developed and used to extract the online appointment information from different data tables. The search results were automatically exported to the Microsoft Excel worksheet, which was further used for data analysis.
Computer log data collection was conducted from January 2011 to May 2013. Twenty nine months of appointment log records were captured and analysed to ascertain the patients’ usage of the EAS.
Interview data analysis
Following the qualitative data analysis technique suggested by Miles and Humberman , each interview was transcribed from verbatim into a word processing document . The transcribed data was then carefully read and divided into meaningful analytical units that were relevant to the research aims . By using the method proposed by Zhang et al. , the analytical unit was identified and a code was assigned to signify this particular unit [47,48]. Each meaningful unit was coded into different sub-categories and then grouped into the categories that were framed based on Rogers’ innovation diffusion model. For example, for the question “which method do you prefer to use to make an appointment”, one interviewee responded that “I would prefer to use the phone because I prefer to speak to someone and confirm”. This statement was coded as “prefer phone-call for oral communication and confirmation”. Another interviewee answered “I will probably use the phone. I found it is easier to use the phone” was coded as “prefer phone-call because of its ease of use”. Both units were placed in the category of “preference for phone-call”, but with different sub-categories “prefer for oral communication” and “phone-call is easier than e-appointment service”. This process was applied repetitively to all of the transcribed data until the overall coding was completed [47,48].
Each interview was double-checked in order to prevent a patient from being repeatedly interviewed in different survey periods. Therefore, although the interview data was collected in four stages, the qualitative interview study was not treated as longitudinal study.
Statistical analysis was conducted in SPSS20 in order to assess the influence of demographic factors on perceptions. Spearman’s correlation test and a Chi-square test were conducted to measure associations and differences in proportions between groups. Statistical significance was set at P-value < 0.05.
Computer log data analysis
In order to investigate patients’ continued usage of the EAS, qualitative thematic analysis with coding via Microsoft Excel was used to analysis the computer log data. The analysis results were categorized and coded based on Roger’s innovation-decision model and the topic guide. For example, one patient registered as an online appointment user but never used this service during the whole study period, this patient was coded as ‘logged into the web site but never used’. Where a patient used the electronic, as well as the phone-call/walk-in appointment service, more than once, this patient was coded as ‘used both online and phone-call services’. In total, the online appointment users were categorized into four groups, including (1) logged into the web site but never used, (2) tried once but never used again, (3) used both online and phone-call services, and (4) only used online appointment system.
Demographics of the participants and their use of the e-appointment service
Fifty-one patients were interviewed in the first survey. In the three follow-up surveys, 20, 32 and 22 patients were interviewed, respectively. This gave a total number of 125 interviewees, providing sufficient variation in age, gender and social status of the study population.
Basic demographic profiles of interviewees and patients recorded in appointment database, and their use of phone-call or online system to make appointment
Usage of each type of appointment method by % (No.)of Interviewees
Usage of each type of appointment method by % (No.) of Patients recorded in the database
Using phone-call/walk-in only
Using online appointment service
Using phone-call/walk-in only
Using online appointment service
Eleven percent of the interviewees (6 males and 8 females) used the e-appointment service in all four survey periods. This was much higher than the real number of online appointment users suggested by the computer log records stored in the database of the medical centre (see Table 1). There was no significant gender difference in terms of preferred method for appointment making by either interviewees or computer log data. Six interviewees who used the e-appointment service at least once were in the age group of 30 to 41 years, representing 19% of the population in this age group. Five interviewees were between18 to 29 years of age and 3 users between 42 to 53 years of age. None of the online appointment users was above 54 years of age.
According to the computer log records, from January 2011 to May 2013, 25,616 patients visited the medical centre through phone-call, walk-in or online appointment making services. Only 6% of them (N = 1554, 557 males and 997 females) had continuously used the e-appointment service to make appointments to see their doctors over the whole study period.
Of the interview participants, 29% of the 17 interviewees (N = 5) with a university degree used the e-appointment service at least once. Of the remaining 108 interviewees (86.4% of the total respondents) who reported having a primary, secondary or certified technical education degree from the Technical and Further Education (TAFE) system in Australia, only 8% (N = 9) used this online service at least once.
The relationship between educational level and online service usage was assessed by Spearman’s correlation analysis. The result suggests that usage of the EAS by male interviewees had a weak, yet significant positive correlation with their educational level (rs (59) = 0.3, P = 0.031). However, no such correlation was found for the female interviewees (rs (62) = 0.17, P = 0.064).
The interview data shows that 52% of the interviewees (N = 65) reported working full-time, which was found to be similar to the ABS census data presented above. 21% (N = 26) worked part-time, and the remaining 27% of interviewees (N = 34) were unemployed, which was found to be higher than that reported in the census data (13.2%).
The results also show that 17% of the interviewees (N = 11) who worked full-time had experience of using the e-appointment service. No part-time workers reported using the system. The other 3 online system users came from the unemployed group, accounting for 9% of this population. A strong, positive correlation between employment status and usage of e-appointment service was found for male interviewees (rs (59) = 0.44, P = 0.012). However, no such association was found for female interviewees (rs (62) = 0.12, P = 0.234).
Variations in patients’ continuous usage of the EAS over two and a half years
Categories of online system users recorded in the computer log records at each data point (from January 2011 to May 2013)
% (No.)registered patients at each data point in computer records
Usages of online appointment system by registered users
January to December 2011%(N)
January to December 2012%(N)
January to May 2013%(N)
1. Logged into web site but never used
2. Tried once and never used again
3. Used both online and phone-call services
4. Only used online system
At the second data point (from January to December 2012), 5642 patients logged into the online appointment web site (see Table 2). In comparison with the first data point, the number of patients who preferred to use the online service (in category ONL3 and ONL4) had significantly increased to 1322, accounting for 23% of the total online users. The number of patients in each category remained similar at the third data point (from January to May 2013).
Patient awareness of the EAS and effectiveness of communication channels for disseminating the information
Percentage of interviewees who were aware of and used the e-appointment service at each data point
% (No.)of interviewees
Aware of the online system/total Interviewees
Used the online service/total interviewees
April 2011 – June 2011
July 2011– August 2011
October 2012–November 2012
April 2013 – May 2013
Those interviewees who were aware of the EAS reported receiving the information about the availability of this service through visiting the medical centre web site or through the voice message heard when making an appointment via phone. No interviewees appeared to notice the posters or fliers placed at the locations that were assumed to be prominent in the medical centre.
Interviewees’ perceptions of e-appointment service
Perceived advantages of the EAS
Twelve out of fourteen interviewees (86%) who used the EAS at least once stated that the service was easy to use. In comparison with the phone-call based system, the e-appointment service provided certain advantages such as after-hour access to the medical appointment service and less waiting time.
Less waiting time
“The online system gives your available time slots, or just straightway what’s available and what’s not.” [Patient 15]
Providing after-hour service
Perceived disadvantages of the EAS
The interview data suggests that inflexible time slot allocation and an insufficient number of appointment selection options were the main disadvantages of the EAS as perceived by the interviewees.
Inflexible time slot allocation
“The appointment times are very limited. It seems there is only one appointment time for the online customer which is always 12 minutes past the hour. A few more choices would be helpful.” [Patient 43]
“Very good that you don’t have to ring up, but we should be able to see what doctors are available at the time you pick instead of having to go back if it’s not the right time for you.” [Patient 27]
Insufficient options provided by e-appointment service for appointment making
“[The online service] doesn’t allow you to cancel the appointment. It would be helpful as I cannot always get to the phone easily.” [Patient 65]
“[To add] the ability to manage your booking would be nice, just in case you need to cancel an appointment or change the time.” [Patient 19]
Patients’ prior experience of using online healthcare services
Percentage of interviewees who reported to have or not to have had prior experience with online healthcare services
% (No.)of interviewees
Searched online health information
Using e-appointment service at least once
The interview data suggests that 76% (n = 41) of these online healthcare service users searched for general health-related information, such as information about the common flu, vaccinations, side effects of new medications and suggestions for healthy food. The remaining 24% (N = 13) had searched for diseases information of concern to them, such as information about kidney-stents, cancer, symptoms of heart disease or mental health problems.
Although 43% of interviewees had prior experience of using the Internet for health-related purposes, more than 50% of the interviewees reported their preference for obtaining information from their doctors rather than from searching the Internet. They believed doctors could provide more accurate and credible information than the Internet.
Patients’ intention to use the e-appointment service in the near future
Percentage of interviewees who intended to use the e-appointment service
Would like to use the online system in the near future % (N)
18 - 29
30 - 41
42 – 53
54 – 65
Patients who did not have a computer or Internet access at home
About 30% of the interviewees (N = 28) who preferred to use the phone-call appointment service reported that they did not have a computer or Internet connection at home, therefore making an appointment by phone or walking-in was their only choice. Of these patients, 64.3% (N = 18) were unemployed and 21.4% (N = 6) worked full-time, respectively. The remaining 14.3% (N = 4) worked part-time. The relationship between work status and computer/Internet connection at home was examined by Chi-square test. A significant association was found between employment status and Internet access at home (P < 0.001). It implies that patients who were not in the labour force were less likely to have an Internet connection at home than those who worked full-time or part-time.
The computer log records show that the monthly adoption rate of the EAS increased slowly from 1.5% (76/4941 patients/month) at three-months after system implementation, to 4% (287/7189 patients/month) at twenty-nine months. The monthly number of patients using the EAS was steady, compared to the increasing number of patients who used phone-call/walk-in appointment services at the end of study period (see Figure 4). Computer log records also show that, although more than 300 patients visited online appointment web site each month, most of them were still not ready to accept this e-health innovation. In total, only 6% (1554/25,616) of patients continuously used the e-appointment service to see the doctors in the clinic during the whole period of the study. The overall adoption rate of the EAS was still lower than the ‘take-off’ point – 13% of the overall population according to Rogers’ innovation diffusion theory . Therefore, at the end of the study, only the ‘innovators’ had adopted the online service.
As suggested by Rogers , the communication channels, the attributes of the e-appointment service, the characteristics of the patients who were the consumers of the online system, and the social system, had all contributed to the low adoption rate of the online service.
Influence of communication channels on patient adoption of the e-appointment service
In this study, the information about the availability of the e-appointment service was carefully planned and disseminated to patients through mass media channels, include posters, fliers and web advertisement. However, twenty-nine months after system implementation, only 5% of appointments were made through the EAS. The majority of patients were not aware of the existence of the online service and consequently, could not use it for appointment making.
In response, a new communication channel – a voice message played during the phone call waiting periods was implemented 6 months after implementation. This appeared to be an effective channel that helped to increase patient awareness of the online appointment service to a certain extent, as suggested by the 55% of the interviewees who reported that they were aware of the existence of the online appointment system at the second data point (see Table 3). However, twenty-nine months after system implementation, despite the introduction of the voice message, only 23% of the interviewees reported being aware of the availability of the online system. It appears that the majority of patients did not pay attention to the voice-message, which can be seen as an example of mass media in Rogers’ terms .
It implies that the use of mass media was not effective in attracting patients’ attention to the availability of the e-appointment service. Obviously, lack of awareness of the existence, features and benefits of the e-appointment service had a negative impact on patient adoption of the new e-health system, as validated by the result of the correlation between the interviewees’ awareness and usage of the e-appointment service. This fact confirms the view of Cao et al.  that effective dissemination of information about any new online technology could improve the usage of the innovation. This lesson is useful to learn for other consumer e-health initiatives, so that more effective and personalized communication strategies can be developed and used to increase patient awareness of a new e-health service.
Influence of the perceived attributes of the EAS on its adoption and use
According to Rogers (2003), there are four perceived attributes of the EAS which might influence patient adoption and use of the service. They are relative advantages, compatibility, complexity and trialability.
The interview results show that the extended after-hour service and less waiting time appeared to be the main attributes attracting patients to adopt the e-appointment service.
However, more than 88% (N = 111) of the interviewees expressed their preference for using the phone call appointment service (see Table 1). From their perspective, the e-appointment service was inferior to making an appointment by phone. This was because the phone-call service provided them with an immediate, fast and convenient way to access the appointment service compared with the EAS. Besides, the phone-call service provided an opportunity for patients to chat with a person – the receptionist, who could make a more flexible decision on the spot. They saw no personal advantages in making appointments online. Lee et al. also suggested that patients’ need for human interaction may hinder their adoption of online self-service .
Furthermore, the e-appointment service did not provide patients with any other value-adding services, such as access to patients’ electronic healthcare records. Therefore, there was little or no value for patients to switch to the e-appointment service.
A major reason for patients to continue with making appointment by phone was its compatibility with their preference of having a conversation with a person, the opportunity to discuss the options for more complex situations and to receive reliable information from their doctors. Tradition and habit also appeared to play an important role in hindering adoption of the EAS. It is the first time that this factor has been reported in the studies on the adoption of consumer e-health innovations . It might help to increase the probability of patient adoption of the EAS if the system can integrate a voice message similar to the receptionist talking to patients addressing their real-time concerns.
Although the e-appointment service was perceived as easy to use for those patients who had continued to use this service, a large number of patients in this study had never accessed the Internet at home. Some did not even have a computer or Internet access at home. Only a small portion had prior experience of using the Internet for health-related purposes. As a result, more than 74% of the interviewees (N = 93) did not feel confident about their ability to use the Internet or the e-appointment service.
In this study, the computer log records showed that 45% of the registered users stopped using the system after a trial use. There might be several explanations for this: (1) the patient did not need to see the doctor again after the appointment; or (2) they directly made the follow-up appointment after seeing a GP in the clinic and thus had no further needs to make appointments online; or (3) they preferred to make appointments by phone or in person rather than using the e-appointment service. Karahanna et al.  also indicate that trialability appears to be a less important factor in determining an individual’s decision to continuously use an IT innovation after individuals adopt the innovation .
In general, the interview results suggest that a high level of relative advantages and low level of complexity are the factors which will encourage patients to adopt this e-appointment innovation. However, the computer log data shows that the e-appointment service is still in the initial knowledge stage of the innovation-decision process, and only the ‘innovators’ in the patient population adopt and continuously used this innovation by the end of the field study.
Influence of the patients’ characteristics on their adoption of the EAS
In this study, the patients’ social and demographic characteristics, including age, education level and work status, appeared to have influenced their choice of use or non-use of the e-appointment service. Computer log records showed that 72% of the ‘innovators’ (N = 1116) were in the age group of 18 to 41 years.
The reason why the patient group who worked full-time were more likely to use the e-appointment service might be that this group had difficulty making phone calls during office hours, and could only do so after-hours. In this case, the online service might be helpful. Thirty six percent of the online appointment users (N = 5) had a university degree, suggesting that that the younger patients with a higher educational level and better job prospects are more likely to adopt consumer e-health services than older, less educated patients with fewer job opportunities.
In addition to the social and demographics factors, as shown in Table 1, all of the patients who reported using the e-appointment service had prior experience using the Internet for health-related purposes. LaRose and Eastin found that users’ Internet self-efficacy is positively affected by their prior Internet experience, positive outcome, and Internet usage . Macpherson et al.  also reported that lack of access to the computer or Internet, or low computer/Internet skills could have a negative impact on the acceptance and use of e-Health services by older adults . Therefore, having prior experience of in using online health care services also appears to be positively associated with patient acceptance of the e-appointment service.
Influence of the nature of the social system on the adoption of consumer e-health
According to the Australia Bureau of Statistics’ 2011 census data, the population of the study site had a lower income and higher un-employment profile in comparison with the national demographic data . The interview results suggest that this population group is yet to develop the capacity and interest in using the Internet for health-related purposes. As explained by Rogers’ Innovation Diffusion Theory, the probability of patients adopting the e-appointment service was negatively influenced by their lower socio-economic profile.
Limitations of the study
The research was conducted in a regional area in Australia, therefore the findings may only be comparable to a similar population group. Qualitative studies in other suburban areas would enrich the results of the study and provide a better understanding of patients’ adoption of consumer e-health innovations.
Another limitation in sampling is that the patients who were sitting in the waiting area and appeared to be willing to communicate with researchers were more likely to be invited to participate in the interview. This trend was revealed by a much higher adoption rate of 13% from interview results than the 6% of population consistently suggested by the computer log records. The bias in the interview results was effectively rectified by the computer log records. In addition, this study was conducted based on a particular form of consumer e-health application – the online appointment service. Therefore caution is needed in generalizing the relevance of the findings from this study to other types of consumer e-health applications in similar or other healthcare settings. Further substantial studies are needed to understand patient behavior in adopting more complicated consumer e-health innovations.
This study found that adoption and usage of an e-appointment service in a primary care clinic was low after the service had been introduced for 29 months. Several factors appeared to have contributed to this low rate of adoption of the e-health innovation. These included ineffective communication of the availability of the e-appointment service to the patients, a perceived lack of value of the new online service for the majority of patients, the incompatibility of the new service with the patients’ preference for oral communication, and some functional limitations of the service itself. In addition, lack of access to a computer/the Internet at home, low computer literacy levels, and the low socio-economic status of the study population also appeared to be factors causing the low rate of adoption of the new online service. Conversely, the e-appointment service was perceived to be advantageous for those patients who worked full-time and could only make an appointment to see a doctor after business hours.
The findings of this study were in accordance with Rogers’ four determinants of success of innovations. Communication of the new e-health initiative to patients appears to be difficult. This challenge cannot be underestimated for any similar e-health initiatives.
This study provides valuable insight about the feasibility of introducing consumer e-health services in a primary health care setting. The findings point to a need for health care providers to consider and address the identified factors before the implementation of more complicated consumer e-health services, such as PCEHR in Australia. Further researches can be conducted on other types of consumer e-health services and the optimal implementation strategies that could lead to successful adoption, usage and benefits realization.
This study was sponsored by University Research Committee (URC) Internal Industry Linkage Grant Scheme and supported by the Centre Health Complex (CHC) under a grant from the CHC and the University of Wollongong. The authors would like to thank Dr. M.K. Rashid, Dr. Niraj Goureia and Violeta Kuzmanovska for giving us both inspiration and insight to achieve the technical implementation of the e-appointment service in the CHC. The authors greatly acknowledge the help of Dr. Diane Walton in the final language editing of this paper.
- Armstrong BK, Gillespie JA, Leeder SR, Rubin GL, Russell LM. Challenges in health and health care for Australia. The Medical Journal of Australia. 2007;187:485–9.PubMedGoogle Scholar
- Eysenbach G. Recent advances Consumer health informatics. Birtish Medical Journal. 2000;320:1713–6.View ArticleGoogle Scholar
- Carty B, Kenney K. Consumer informatics in primary care. Stud Health Technol Inform. 2006;122:36–7.PubMedGoogle Scholar
- Lewis D, Chang BL, Friedman CP: Consumer Health Informatics. In Consumer Health Informatics: Improving Consumers and Improving health Care. Edited by Deborah Lewis, CGunther Eysenbach, Rita Kukafka, P. Zoe stavri, Holly Jimison: Springer Science + Business Media Inc.; 2005: 1–7Google Scholar
- Michele S. Klein-Fedyshin: Consumer Health Informatics-Integrating Patients, Providers, and Professionals Online. Medical reeference Services Quarterly 2002, 21.Google Scholar
- Keselman A, Logan R, Smith CA, Leroy G, Zeng-Treitler Q. Developing informatics tools and strategies for consumer-centered health communication. J Am Med Inform Assoc. 2008;15:473–83.View ArticlePubMedPubMed CentralGoogle Scholar
- Brennan PF: Patient-Focused Technology and the Health Care Delivery System. In Investing in E-Health: What is Takes to Sustain Consumer Health Informatics. Edited by David H. Gustafson, Patricia Flatley Brennan, Hawkins rP. New York: Springer Science Business Media; 2007: 1–6Google Scholar
- Masys DR, Baker DB. Patient-centered access to secure systems online (PCASSO): a secure approach to clinical data access via the world wide Web. In Proc AMIA Annu Fall Symp pp. 1997;340–343:340–3.Google Scholar
- Concept of Operations: Relating to the Introduction of a Personally Controlled Electronic Health Record System [http://ehealth.gov.au/internet/ehealth/publishing.nsf/content/CA2579B40081777ECA2578F800194110/$File/PCEHR-Concept-of-Operations-1-0-5.pdf]
- Australian Health Ministers' Conference: National E-Health Strategy. (The Department of Health ed. Melbourne: Australian Health Ministers' Conference; 2008.Google Scholar
- Bitner MJ, Brown SW, Meuter ML. Technology Infusion in Service Encounters. J Acad Mark Sci. 2000;28:138–49.View ArticleGoogle Scholar
- Rogers A, Mead N. More than technology and access: primary care patients’ views on the use and non-use of health information in the Internet age. Health & Social Care in the Community. 2004;12:102–10.View ArticleGoogle Scholar
- Williams P, Nicholas D, Huntington P. Non use of health information kiosks examined in an information needs context. Health Information & Libraries Journal. 2003;20:95–103.View ArticleGoogle Scholar
- Jimison H, Gorman P, Woods S, Nygren P, Walker M, Norris S, Hersh W: Barriers and Drivers of Health Information Technology Use for the Elderly, Chronically III, and Underserved. (US): Rockville (MD): Agency for Healthcare Research and Quality (US); 2008.Google Scholar
- Birru MS, Monaco VM, Charles L, Drew H, Njie V, Bierria T, et al. Internet usage by Low-literacy adults seeking health information: an observational analysis. Journal of Medical Internet Research. 2004;6:e25.View ArticlePubMedPubMed CentralGoogle Scholar
- Or CKL, Karsh B-T. A systematic review of patient acceptance of consumer health information technology. J Am Med Inform Assoc. 2009;16:550–60.View ArticlePubMedPubMed CentralGoogle Scholar
- Dohan MS, Tan J: Perceived Usefulness and Behavioral Intention to Use Consumer-Oriented Web-Based Health Tools: A Meta-Analysis. In Proceedings of the Nineteenth Americas Conference on Information Systems; August; Chicago, Illinois. 2013: 15–17.Google Scholar
- Choi N. Relationship between health service use and health information technology use among older adults: analysis of the US National Health Interview Survey. J Med Internet Res. 2011;13:e33.View ArticlePubMedPubMed CentralGoogle Scholar
- Macpherson E, Dhaliwal C, Richardson J. The relationship between the physical functioning of older adults and their Use of a personal health record: a systematic review. Current Geriatrics Reports. 2014;3:142–54.View ArticleGoogle Scholar
- Karahanna E, Straub DW, Chervany NL: Information technology adoption across time: a cross-sectional comparison of pre-adoption and post-adoption beliefs. MIS quarterly 1999:183–213.Google Scholar
- Kreps GL, Neuhauser L. New directions in eHealth communication: Opportunities and challenges. Patient Educ Couns. 2010;78:329–36.View ArticlePubMedGoogle Scholar
- Wilson EV, Balkan S, Lankton NK: Current Trends in Patients' Adoption of Advanced E-Health Services. In IEEE Proceedings fo the 43rd Hawaii International Conference on System Sciences (Sule B, Nancy KL eds.), vol. 0. pp. 1–9. Hawaii: IEEE Computer Society; 2010:1–9.Google Scholar
- Zhang X, Ping Y, Yan J. Patients' adoption of the e-appointment scheduling service. Investing in E-Health: People, Knowledge and Technology for a Healthy Future. 2014;204:176–81.Google Scholar
- Murray M, Tantau C. Same-day appointments: exploding the access paradigm. fam Pract Manag. 1999;7:45–50.Google Scholar
- Dexter F. Design of appointment systems for preanesthesia evaluation clinics to minimize patient waiting times: a review of computer simulation and patient survey studies. Anesth Analg. 1999;89:925.PubMedGoogle Scholar
- Erdem HI, Demirel T, Onut S: An Efficient Appointment System Design For Outpatient Clinic Using Computer. In The Proceedings of the 2002 Summer Computer Simulation Conference; San Diego, CA. 2002: 299–304.Google Scholar
- Gupta D, Dentona B. Appointment scheduling in health care: challenges and opportunities. IIE Trans. 2008;40:800–19.View ArticleGoogle Scholar
- Boyette B, Staley-Sirois M: Clinical no-show rates: is technology a contributor? In Improving healthcare with client focused solutions. pp. 12: DIVURGENT; 2012:12.Google Scholar
- Hordern A, Georgiou A, Whetton S, Prgomet M. Consumer e-health: an overview of research evidence and implications for future policy. Health Information Management Journal. 2011;40:6–14.View ArticlePubMedGoogle Scholar
- Horvath M, Levy J, L'Engle P, Carlson B, Ahmad A, Ferranti J. Impact of health portal enrollment with email reminders on adherence to clinic appointments: a pilot study. Journal of Medical Internet Research. 2011;13:e41.View ArticlePubMedPubMed CentralGoogle Scholar
- Cao W, Wan Y, Tu H, Shang F, Liu D, Tan Z, et al. A web-based appointment system to reduce waiting for outpatients: A retrospective study. BMC Health Serv Res. 2011;11:318.View ArticlePubMedPubMed CentralGoogle Scholar
- Zhang M, Zhang C, Sun Q, Cai Q, Yang H, Zhang Y. Questionnaire survey about use of an online appointment booking system in one large tertiary public hospital outpatient service center in China. BMC Medical Informatics and Decision Making. 2014;14:49.View ArticlePubMedPubMed CentralGoogle Scholar
- Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: Toward a unified view. MIS Q. 2003;27:425–78.Google Scholar
- Rogers EM, Singhal A: Diffusion of Innovations (5th ed). In An Integrated Approach to Communication Theory and Research. Fifth edition. Edited by Salwen M, Stacks D. Mahwah: NJ:LEA; 2003: 409–419Google Scholar
- Tornatzky LG, Klein KJ. Innovation characteristics and innovation adoption-implementation: A meta-analysis of findings. IEEE Trans Eng Manag. 1982;29:28–45.View ArticleGoogle Scholar
- Moore GC, Benbasat I. Development of an instrument to measure the perceptions of adopting an information technology innovation. Information System Research. 1991;12:192–222.View ArticleGoogle Scholar
- Helitzer D, Heath D, Maltrud K, Sullivan E, Alverson D. Assessing or predicting adoption of telehealth using the diffusion of innovations theory: a practical example from a rural program in New Mexico. Telemedicine Journal and e-Health. 2003;9:179–87.View ArticlePubMedGoogle Scholar
- Chew F, Grant W, Tote R. Doctors on-line: using diffusion of innovations theory to understand internet use. Fam Med. 2004;36:645–50.PubMedGoogle Scholar
- Lee T-T. Nurses' adoption of technology: Application of Rogers' innovation-diffusion model. Appl Nurs Res. 2004;17:231–8.PubMedGoogle Scholar
- van der Weide M, Smits J. Adoption of innovations by specialised nurses: personal, work and organisational characteristics. Health Policy. 2004;68:81–92.View ArticlePubMedGoogle Scholar
- Ochieng OG, Ryozo H. Factors influencing diffusion of electronic medical records: a case study in three healthcare institutions in Japan. Health Information Management Journal. 2006;34:120–9.View ArticlePubMedGoogle Scholar
- Cherry B, Carter M, Owen D, Lockhart C. Factors affecting electronic health record adoption in long-term care facilities. J Healthc Qual. 2008;30:37–47.View ArticlePubMedGoogle Scholar
- Greenhalgh T, Stramer K, Bratan T, Byrne E, Mohammad Y, Russell J: Introduction of shared electronic records: multi-site case study using diffusion of innovation theory. BMJ 2008, 337Google Scholar
- Bureau A. Census QuickStats (Australian bureau of statistics ed of statistics: 2011 census quick stats : shellharbour (2011 3rd release). in. Canberra: Australian Bureau of Statistics; 2011. p. 2013.Google Scholar
- Munyisia EN, Yu P, Hailey D. The changes in caregivers’ perceptions about the quality of information and benefits of nursing documentation associated with the introduction of an electronic documentation system in a nursing home. Int J Med Inform. 2011;80:116–26.View ArticlePubMedGoogle Scholar
- Miles MB, Humberman AM. Qualitative Data Analysis: An Expanded Sourcebook. 2nd Revised edn. Thousand Oaks: SAGE Publications Inc.; 1994.Google Scholar
- Murphy E, Dingwall R, Greatbatch D, Paker S, Watson P: Qualitative research methods in health technology assessment: a review of the literature. Health Technology Assessment 1998, 2Google Scholar
- Zhang Y, Yu P, Shen J. The benefits of introducing electronic health records in residential aged care facilities: a multiple case study. Int J Med Inform. 2012;81:690–704.View ArticlePubMedGoogle Scholar
- Lee H, Cho H, Xu W, Fairhurst A. The influence of consumer traits and demographics on intention to Use retail self-service checkouts. Marketing Intelligence and Planning. 2010;28:46–58.View ArticleGoogle Scholar
- Neuhauser L, Kreps GL. Health communication and behavior change: promise and performance. Soc Semiot. 2010;20:9–27.View ArticleGoogle Scholar
- Larose R, Mastro D, Eastin MS. Understanding internet usage: a social-cognitive approach to uses and gratifications. Soc Sci Comput Rev. 2001;19:395–413.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.