This article has Open Peer Review reports available.
Sentinel monitoring of activity of out-of-hours services in Norway in 2007: an observational study
© Hansen et al; licensee BioMed Central Ltd. 2009
Received: 31 March 2009
Accepted: 22 July 2009
Published: 22 July 2009
In Norway, no valid activity statistics from the primary health care out-of-hours services or the pre-hospital emergency health care system have previously been available.
The National Centre for Emergency Primary Health Care has initiated an enterprise called "The Watchtowers" which consists of a representative sample of seven casualty clinics covering 18 Norwegian municipalities. The purpose of the project is to provide routine information over several years, which will enable monitoring, evaluation and comparison of the activities in the out-of-hours services. This paper presents data from 2007, the first full calendar year for the Watchtowers, analyzes some differences in user patterns for the seven casualty clinics involved, and estimates national figures for the use of casualty clinics and out-of-hours services in Norway.
A total of 85 288 contacts were recorded during 2007 [399 per 1 000 inhabitants] of which 64 846 contacts were considered non-urgent [76.6%]. There were 53 467 consultations by a doctor [250 per 1 000], 8 073 telephone consultations by doctor [38 per 1 000], 2 783 home visits and call-outs by doctor [13 per 1000] and 20 502 contacts managed by nurses on their own [96 per 1000]. The most common mode of contact was by telephone. Women, young children and elderly had the highest rates of contact.
Norway has a high rate of contacts to the out-of-hours services compared with some other countries with available data. Valid national figures and future research of these services are important both for local services and policy makers.
Very few reliable national information systems and data exist regarding the demand for out-of-hours services, even though these services constitute a formal and important part of the health services as a whole, and the demand for these services is increasing [1–6]. In Norway, no valid activity statistics from the primary health care out-of-hours services or the pre-hospital emergency health care system have been available . In 2004 the National Centre for Emergency Primary Health Care was established in order to strengthen research and national monitoring in this field.
The Centre has initiated an enterprise called "The Watchtowers" which consists of a representative sample of seven casualty clinics covering 18 Norwegian municipalities . The purpose of the project is to provide routine information over several years, based on a minimal dataset, which will enable monitoring, evaluation and comparison of the activities in the out-of-hours services.
Based on reimbursement claims from regular general practitioners [RGPs], the National Health Insurance has published activity data for the year 2006, showing for the first time national numbers from the out-of-hours emergency primary health care in Norway . The study reported about 1.3 million consultations, 97 000 home visits and 419 000 other contacts by doctor, representing a rate of 392 contacts per 1 000 inhabitants per year, but the report did not contain data on degree of urgency, telephone advice by nurse, or actions taken.
This paper presents data from 2007, the first full calendar year for the Watchtowers, analyses differences in user patterns for the seven casualty clinics involved, and estimates national figures for the use of casualty clinics and out-of-hours services.
The 430 municipalities in Norway are by law responsible for organizing primary health care, including emergency medical services for all inhabitants 24 hours. Each municipality also has a duty to maintain one specific telephone number at a Local Emergency Medical Communication Centre [LEMC], usually located in the casualty clinic. An out-of-hours district can either exist of one or several municipalities, belonging to a LEMC and a casualty clinic. The emergency medical service is usually managed by the RGPs' practices during the office hours, while during evenings, nights and weekends, out-of-hours services are located in casualty clinics staffed with a RGP and in most places registered nurses. Some clinics also serve as a LEMC. A more detailed description of the Norwegian primary care out-of-hours services is given in a previous paper .
The Watchtowers are aimed at being as representative as possible for Norwegian out-of-hours districts and municipalities . Shortly summarised, all municipalities were invited, and after responses to the invitation and checking pre-selection criteria 44 remained for final inclusion. These municipalities were then categorized through several statistical dimensions defined and managed by Statistics Norway . Criteria that were evaluated included population size [absolute number and change] age and gender distribution, degree of centralization, employment, public economy and gross income among men. The selection process was performed in collaboration with Norwegian Social Science Data Services [NSD]. The selection process resulted in a specific invitation to a sample consisting of seven casualty clinics with a total of 18 municipalities from different parts of Norway. All agreed to participate and were contracted for participation on a long term basis. This strategic selection process thus resulted in a group of municipalities with a fair representativeness for Norwegianmunicipalities as a whole. All population sizes are represented among the Watchtowers and the distribution is close to the national, although a large city is lacking. The selection process concerned the representativeness of the geography and populations. We have no reasonsto believe, however, that such an approach should not also give a representative patient distribution. A detailed description of the selection process is given in a methodological paper . In the Watchtowers, the attending nurses record all contacts, both contacts by telephone and contacts by attendance . The Watchtowers served a total of 216 030 inhabitants per January 1, 2007, which constituted 4.6% of the Norwegian population and covered 4.1% of the total Norwegian land area .
Year, week number, day of the week, time of day or night [daytime 08.00–15.29, afternoon 15.30–22.59, and night 23.00–07.59]
Gender, age and name of home municipality
Mode of contact: Telephone contact, direct attendance to the casualty clinic, contact by health professionals, contact by national emergency medical communication centres [EMCC] or others [for example police]
Priority degree. All Watchtowers use nurse triage systems. The degree of urgency is set according to the Norwegian Index for Medical Emergency Assistance . Each call to, or contact with, a Watchtower is classified by priority degree with colour codes "Red", Yellow" or "Green". Red colour is defined as an "acute" response, with the highest priority. Yellow colour is defined as an "urgent" response, with a high, but lower priority. Green colour is defined as a "non-urgent" response, with the lowest priority
Action taken: Telephone advice by a nurse, telephone advice by a doctor, medical examination by a doctor, consultation by a nurse, home visit by a doctor, acute response by ambulance and doctor, and others [e.g. sending ambulance without a doctor, referring to police or to a regular RGP on daytime]
In the analyses of the variable "action taken" the categories "telephone advice by a nurse", "consultation by a nurse" and "others" are merged into "handled by nurse". Diagnoses, symptoms or health problems are not recorded in the Watchtower project. The individual Watchtowers are presented as WT1-WT7 in the tables based on their names in alphabetical order.
For technical reasons some cases were lost during the first week of 2007 in WT2, and during week 10 and the first 5 days of week 11 in WT1. When presenting rates per 1 000 inhabitants the registered numbers are therefore multiplied by 1.011, a calculated number based on the number of average contacts per day for these two casualty clinics throughout the rest of the year. Correspondingly we have multiplied the rates per 1 000 inhabitants with 1,037 for WT1 and 1,017 for WT2 when presenting each WT. When we otherwise present and discuss distributions and figures, we use numbers based on the actually registered cases only [85 288].
SPSS version 15.0 was used to analyse data. Chi-squared tests were used and the statistical significance was defined as p < 0.05. The project was approved by the Privacy Ombudsman for Research.
Contacts according to gender, age groups, time of day and Watchtowers.
Age group and time of day
60 + years
Age group 0–9 years had 18 006 contacts, which gives a contact rate of 660 per 1 000 inhabitants. The range among the casualty clinics was 459 to 1 068. Age group 40–59 years had the lowest contact rate in all but one clinic, the overall rate being 279 per 1 000 inhabitants. In age group 20–39 years the gender difference was 120 per 1 000. In the youngest age group boys had a higher contact rate than girls at night [difference 9 per 1 000], whereas girls in age group 10–19 years had a higher contact rate than boys at night [difference 12 per 1 000].
The distribution of all contacts through day, afternoon and night was 37.0%, 50.8% and 12.2%, respectively, but the distribution of contacts varied significantly between the casualty clinics. Only one clinic had its highest rate of contacts during daytime. The number of daytime contacts ranged from 93 to 372 contacts per 1 000 inhabitants. Afternoon contacts ranged from 165 to 326 contacts per 1 000 inhabitants, and night contact rates varied from 25 to 68 per 1 000 inhabitants.
Saturday and Sunday had a higher number of contacts (20.4% and 19.0%] than weekdays [11.0% to 13.8%]. For weekdays the number of contacts decreased from Monday to Thursday and then increased on Friday. December had the most contacts of the year [10.6%], whereas August had the least [7.2%]. A total of 6.5% of the contacts were made by patients living outside the out-of-hours districts, ranging from 1.8% to 11.0% among the casualty clinics. Contacts made by patients from foreign countries made up 3.2%, ranging from 0.5% to 5.7% between the clinics.
Mode of contacts
Distribution (%) of mode of contact with range between the casualty clinics and mode of contact according to age groups in years.
Age group in years
Mode of contact
Telephone from patient or patient family
Contacts from health professionals
The proportion of telephone contacts to the casualty clinics varied from 74.5% to 86.1%, except for one where 21.3% of contacts were by telephone and 73.5% direct attendance. Correspondingly, direct attendance ranged from 0.5% to 73.5%. Health professionals, EMCC or others [police etc.] initiated 8.9% of all contacts. Requests from EMCC and other health professionals increased with increasing age of the patients, except for age category 20–39 years. Age group 60+ had the largest share of contacts from health professionals.
Distribution (%) of priority degree by age group, gender, time of day, day of week, mode of contact and action taken.
Green (not urgent)
Time of day
Day of week
Mode of contact
Telephone by patient
Telephone consultation by doctor
Consultation by doctor
Handled by nurse
Call out by doctor and ambulance
Home visit by doctor
Regarding mode of contact the most prominent feature was the frequency of red contacts from EMCC, 34.1% compared to 1.4% by telephone from patients and their families. In absolute figures, however, red cases from the two sources are about the same [644 and 758]. Green cases from EMCC varied between the casualty clinics from 2.2% to 49.4%.
Call-out by doctor and ambulance increased with higher priority degree, whereas home visits, consultations by doctor and patients handled by nurse decreased by increasing degree of urgency.
Distribution of action taken (%) by age group, priority degree and casualty clinics.
Telephone consultation by doctor
Medical consultation by doctor
Handled by nurse
Call out of doctor and ambulance
Home visit by doctor
The relative number of contacts handled by nurses was higher for women than men, and women had a lower share of doctor consultations than men. The youngest age group 0–9 years had a larger share of consultations by doctor and was more often handled by nurse, while elderly had the largest share of home visits and telephone advice by doctor. For all age groups consultation by doctor was the most frequent action, and when patients attended the casualty clinic directly 91.2% of the contacts resulted in consultation by a doctor compared to 56.5% when patient or family called the clinic. When EMCC called the casualty clinic 49% resulted in a consultation by a doctor and 30.5% in call-out of ambulance and doctor. When contact was made from health professionals 26.7% resulted in consultation by doctor, 33.5% resulted in telephone advice by doctor, 22.5% were handled by nurses by phone, 12.9% resulted in home visit, and 4.4% in a call-out of doctor and ambulance. Overall, weekends had the largest share of home visits [46.6%]. There were significant differences between the Watchtowers regarding rate of home visit, ranging from 0.5 to 78 per 1 000 inhabitants. Casualty clinics in rural districts had the highest share of home visits, correspondingly urban areas and cities had the lowest.
Patient being handled by nurse was most common among the youngest patients and decreased with increasing age. This action was more common among women than among men, and most frequent in the evening. Patients handled by nurse as a sole response ranged from 13.9% to 37.9% among the casualty clinics.
Estimation of 2007 national activity level
National figures estimated from the Watchtowers' contacts in Norway 2007.
Rates per 1000
1 096 000
Day of week
1 134 000
Time of day
Mode of contact
1 220 000
Green (not urgent)
1 433 000
Handled by nurse
Telephone consultation by doctor
Consultation by doctor
1 179 000
Call out of doctor and ambulance
Home visit by doctor
1 871 000
For the first time we have representative numbers from out-of-hours services from a whole year in Norway, showing that the mean population contact rate in Norway for 2007 was 399 per 1 000 inhabitants. The most common mode of contact was by telephone, and a large proportion of the contacts were non-urgent.
Validity of our data
The Watchtowers are selected to represent Norway in miniature, and we therefore assume that the differences between the casualty clinics express real variations between Norwegian municipalities . We also think that the sum and numbers are fairly valid. Welfare Organisation supports this, as 1.3 million reimbursement claims were submitted for out-of-hours consultations in 2006, almost identical to our estimation of 1.2 million consultations for Norway in 2007. The total contact rate in our study was 399 per 1000 inhabitants, as opposed to the 392 per 1 000 inhabitant reimbursement claims for 2006. The small and less than 2% discrepancy may be due to the fact that the Watchtowers registered all contacts, including contacts that nurses handled on their own, which do not always give right to reimbursement claims.
Lost cases in two casualty clinics were most likely caused by simple technical problems with computers. Loss of data has not been a problem in 2008. To validate contacts recorded in the Watchtowers we also tried to compare the number of doctor consultations registered in eachWatchtower with the number of doctor consultations from the electronic records in the casualty clinic. Such a comparison was not possible, however, due to technical circumstances. In addition, some information was recorded in patient recording systems outside the casualty clinics.
In conclusion, we think that through the Watchtower project we have been able to establish and quality-check a large and representative monitoring system for providing routine data based on a minimal data set for primary health care emergency services in Norway. We have no reason to believe that the patient loads and distributions are very different from the country as a whole.
Studies from the Netherlands, England, Scotland, New Zealand and Poland all showed a lower contact rate than we found in our study [1, 3, 11–13]. The lowest single rate in the Watchtower was four times higher than the lowest rate in Ireland, where the range was 70–370 . However, several aspects of the national health care systems and different definitions of out-of-hours services may account for these differences. In the Watchtower we have recorded all requests 24 hours a day, also on weekdays. Disregarding the contacts on daytime, weekdays, Norway still had the highest contact rate. Another reason for the high contact rate could be that patients in Norway are not allowed to attend an emergency room without consulting a casualty clinic first, while in other countries there is no selection or assessment before patients attend the emergency room. In addition, some RGP's offices have a poor accessibility and the patients have to contact a casualty clinic in the afternoon. In addition, the doctor on call also take part in many emergency situations, while in other countries the ambulance service deal with the most acute situations, without involving a doctor.
The study from New Zealand  recorded contacts between 17.00 and 08.30 on weekdays and all times during weekends, and the study was performed in a rural area, while our study include both rural and urban areas and office hours, weekdays.
The high contact rate among the youngest children could partly be due to the fact that children under 12 years have free medical care in Norway. But studies from England and Ireland also report that the youngest and the oldest patients were the most frequent users of the out-of-hours services in a health care system with same co-payments across ages [14–17]. The difference between reimbursement claims from Norway and the Watchtowers for the age group 0–9 years [500 versus 660 per 1 000 inhabitants] is most probably due to the number of contacts handled by nurses alone.
Mode of contact and action taken
When a patient attended the casualty clinic directly, the contact resulted in a doctor consultation in more than 90% of the instances. The clinic that had the largest share of direct attendances also had the largest share of consultations by doctors. This is understandable, since when a patient has already entered the clinic there is an expectancy of seeing a doctor. There seems to be a large potential for reducing workload in some of the clinics by changing the habits of patients to make contact by telephone instead of by direct attendance.
The rate of consultation by doctor at the casualty clinics was almost twice the rate in Ireland and Poland, 144 and 170 per 1 000 inhabitants, respectively [2, 13]. Similar to findings in other studies, the figures for home visits differed a lot, and it seems that the smallest out-of-hours districts in rural areas made more home visits than the large out-of-hours districts in urban areas. It thus seems that in Norway the small casualty clinics have retained the old house-doctor model and are doing a lot of home visits, while large out-of-hours districts use transportation of patients by ambulance to the clinics. This means poorer services for the inhabitants, in particular vulnerable groups, such as elderly people, patients with chronic diseases living at home, and patients in nursing homes. All out-of-hours clinics should have adequate capacity for home visits.
Studies from several countries have shown that 30% to 55% of the contacts were handled by nurses alone [3, 11, 15, 17–20]. This is higher than the mean result from the Watchtowers. However, the Watchtowers showed large variations, from 14% to 38%. This could be due to little delegation of responsibilities to nurses, and also a high percentage of direct attendance of patients to the clinics.
More than 75% of the contacts were classified as green or non-urgent. A similar study from England classified 40% of the contacts as unnecessary or could have waited to the next morning, 55% as necessary, and 5% as urgent . We believe that such a high percentage of non-urgent contacts to out-of-hours services in Norway is due both to low accessibility to the RGPs during daytime and to the convenience of contacting the casualty clinics in the afternoon.
It is a bit surprising that only one third of the red [acute] contacts came from the EMCC, while almost half of them were telephone contacts directly from patients or their caregivers to the casualty clinic. It is not clear why many people contact their local services in such emergencies instead of the national emergency number [EMCC], but possible reasons include old and local traditions, uncertainty about the urgency grade or where to call, and a wish for a local person to discuss the matter with.
For the first time in Norway we present representative data from out-of- hours services for a whole year. The demand for these services is increasing in other countries, and Norway had a high share of non-urgent cases. Valid national figures and future research are important both for local services and policymakers.
We wish to thank all the personnel engaged in the project in the seven Watchtowers for their commitment and interest. We also want to thank Kenneth Press and Ole-Johan Eikeland who quality-checked and prepared the data for analysis.
- Moll van Charante EP, van Steenwijk-Opdam PC, Bindels PJ: Out-of-hours demand for GP care and emergency services: Patients' choices and referrals by general practitioners and ambulanceservices. BMC Fam Pract. 2007, 8: 46-10.1186/1471-2296-8-46.View ArticlePubMedPubMed CentralGoogle Scholar
- Bury G, Dowling J, Janes D: General practice out-of-hours co-operatives–population contact rates. Ir Med J. 2006, 99: 73-5.PubMedGoogle Scholar
- Salisbury C, Trivella M, Bruster S: Demand for and supply of out of hours care from general practitioners in England and Scotland; observational study based on routinely collected data. BMJ. 2000, 320: 618-21. 10.1136/bmj.320.7235.618.View ArticlePubMedPubMed CentralGoogle Scholar
- Crighton EJ, Bordman R, Wheler D, Franssen E, White D, Bovett M, Drummond N: After-hours care in Canada. Analysis of the 2001 National Family Physician Workforce Survey. Can Fam Physician. 2005, 51: 1504-5.PubMedGoogle Scholar
- Salisbury C: The demand for out -of-hours care from GP's: a review. Fam Pract. 2000, 17: 340-347. 10.1093/fampra/17.4.340.View ArticlePubMedGoogle Scholar
- Hallam L: Primary medical care outside normal working hours; review of published work. BMJ. 1994, 308: 249-53.View ArticlePubMedPubMed CentralGoogle Scholar
- Hansen EH, Hunskaar S: Development, implementation, and pilot study of a sentinel network ["The Watchtowers"] for monitoring emergency primary health care activity in Norway. BMC Health Serv Res. 2008, 8: 62-10.1186/1472-6963-8-62.View ArticlePubMedPubMed CentralGoogle Scholar
- Nossen JP: Hva foregår på legekontorene? Konsultasjonsstatistikk for 2006. (What happens at the GPs surgeries? Consultation statistics for 2006). NAV-rapport 4/2007. 2007, Oslo: NAVGoogle Scholar
- National Census Statistic. Statistics Norway. [http://www.ssb.no/befolkning/]
- Den norske legeforening: Norsk indeks for medisinsk nødhjelp. Stavanger: Åsmund S Lærdal A/S – The Laerdal Foundation for Acute Medicine. 2005, 2.1Google Scholar
- Scott-Jones J, Lawrenson R, Maxwell N: Sharing after hours care in a rural New Zealand community- a service utilization survey. Rural Remote Health. 2008, 8: 1024.PubMedGoogle Scholar
- van Uden CJ, Winkens RA, Wesseling GJ, Crebolder HF, van Schayck CP: Use of out of hours services; a comparison between two organisations. Emerg Med J. 2003, 20: 184-7. 10.1136/emj.20.2.184.View ArticlePubMedPubMed CentralGoogle Scholar
- Margas G, Windak A, Tomasik T: Utilization of the out of hours service in Poland; An observational study from Krakow. BMC Health Serv Res. 2008, 8: 212-10.1186/1472-6963-8-212.View ArticlePubMedPubMed CentralGoogle Scholar
- Beale N, Taylor G, Gwynne M, Peart C: Council tax valuation bands and contacts with a GP out-of-hours services. Br J Gen Pract. 2006, 56: 283-85.PubMedPubMed CentralGoogle Scholar
- Brogan C, Pickard D, Gray A, Fairman S, Hill A: The use of out of hours health services: a cross sectional survey. BMJ. 1998, 316: 524-27.View ArticlePubMedPubMed CentralGoogle Scholar
- Turnbull J, Martin D, Lattimer V, Pope C, Culliford D: Does distance matter? Geographical variation in GP out-of-hours service use: An observational study. Br J Gen Pract. 2008, 58: 471-77. 10.3399/bjgp08X319431.View ArticlePubMedPubMed CentralGoogle Scholar
- O'Reilly D, Stevensen M, McCay C, Jamison J: General practice out-of-hours services, variation in use and equality in access to a doctor: a cross -sectional study. Br J Gen Pract. 2001, 51: 625-29.PubMedPubMed CentralGoogle Scholar
- Livingstone AE, Jewell JA, Robson J: Twenty four hour care in inner cities; Two years' out of hours workload in east London general practice. Br Med J. 1989, 299: 368-70. 10.1136/bmj.299.6695.368.View ArticleGoogle Scholar
- Leibowitz R, Day S, Dunt D: A systematic review of the effect of different models of after-hours primary medical care services on clinical outcome, medical workload, and patient and GP satisfaction. Fam Pract. 2003, 20: 311-17. 10.1093/fampra/cmg313.View ArticlePubMedGoogle Scholar
- Dunt D, Wilson R, Day SE, Kelaher M, Gurrin L: Impact of telephone triage on emergency after hours GP Medicare usage: A time-series analysis. Aust New Zealand Health Policy. 2007, 4: 21-10.1186/1743-8462-4-21.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/9/123/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.