- Research article
- Open Access
- Open Peer Review
Ethics review as a component of institutional approval for a multicentre continuous quality improvement project: the investigator's perspective
BMC Health Services Researchvolume 10, Article number: 223 (2010)
For ethical approval of a multicentre study in Canada, investigators must apply separately to individual Research Ethics Boards (REBs). In principle, the protection of human research subjects is of utmost importance. However, in practice, the process of multicentre ethics review can be time consuming and costly, requiring duplication of effort for researchers and REBs. We used our experience with ethical review of The Canadian Perinatal Network (CPN), to gain insight into the Canadian system.
The applications forms of 16 different REBs were abstracted for a list of standardized items. The application process across sites was compared. Correspondence between the REB and the investigators was documented in order to construct a timeline to approval, identify the specific issues raised by each board, and describe how they were resolved.
Each REB had a different application form. Most (n = 9) had a two or three step application process. Overall, it took a median of 31 days (range 2-174 days) to receive an initial response from the REB. Approval took a median of 42 days (range 4-443 days). Privacy and consent were the two major issues raised. Several additional minor or administrative issues were raised which delayed approval.
For CPN, the Canadian REB process of ethical review proved challenging. REBs acted independently and without unified application forms or submission procedures. We call for a critical examination of the ethical, privacy and institutional review processes in Canada, to determine the best way to undertake multicentre review.
Ethics review of research involving human subjects is essential to protect the rights and safety of research subjects , by promoting socially beneficial research, protecting human subjects from harm and indignity, and maintaining trust between researchers and society . In Canada, the Tri-Council Policy Statement (TCPS), "Ethical Conduct for Research Involving Humans" establishes a common policy of ethical conduct for research based on fundamental ethical principles . Local research ethics boards (REBs) are responsible for reviewing research protocols at the institutional level, according to TCPS definitions of REB composition and function. This model is ideally suited to single centre research studies conducted by investigators based in that centre. However, multicentre collaborative research has become increasingly common [1, 4, 5], and local ethics review of multicentre studies has been criticised because it is time consuming and costly (for REBs and investigators), duplicates review effort, and has no discernible impact on improving patient safety [1, 2, 5, 6].
Local review is further complicated by the need for review of institution-specific requirements, for example availability of institutional resources necessary for the research, and the requirements of provincial privacy legislation. In addition, some institutions require separate scientific review. The lack of standardized institutional review across Canada has complicated the review of multicentre research . Many researchers have expressed frustration with the process and questioned its effectiveness . Variability in ethics review has been documented in various settings , such as multicentre clinical trials [6–8], genetic epidemiology , and in both mailed and telephone survey research [10–13], but not in the context of database research where the primary concern is privacy, rather than specific issues of informed consent.
In 2005, the Canadian Institutes of Health Research (CIHR) funded the Canadian Perinatal Network (CPN) to develop a national database in Canada's 23 tertiary perinatal units. The objective of CPN is to improve quality of care by identifying best obstetric practices. The inaugural project examines threatened preterm birth. We evaluated CPN investigators' experiences with local institutional approval procedure to gain insight into the Canadian multicentre ethics review process for a database study, and to learn specifically how ethics review process is undertaken locally.
CPN collects data, by chart review of maternal and fetal records, on all women who are admitted to a participating tertiary perinatal unit at 220-286 weeks' gestation with threatened very preterm delivery. Personal identifiers are stripped during electronic data transfer to a central computerized database at the CPN Co-ordinating Centre, Vancouver.
From 2005-8, 16 tertiary care academic Canadian hospitals applied for REB approval for CPN. The protocol was unchanged over this time period. We obtained a complete file of REB applications and all correspondence between the CPN investigators, their local REB and the CPN Co-ordinating Centre. We did not contact REBs directly as we were not named on the relevant applications. LM (CPN co-principal investigator) and HE (Obstetrics and Gynaecology resident) independently constructed a timeline from submission to acceptance by the REB, catalogued the standardized content of each REB's application form and compiled a list of specific issues that the individual site investigator was asked to address by the REB. LM and HE were both at arms length from the REB process, other than the site-specific application at BC Women's Hospital (by LM): the new CPN Co-ordinator (TM) who was not involved in this application reviewed the BC Women's data for this analysis. Disagreement between reviewers was resolved by discussion and consensus.
We focused on issues of relevance to database research, determined a priori and identified in Sections 2 and 3 of the TCPS : waiver of consent, accessing identifiable private information from hospital charts, appropriate safeguards for security and confidentiality (including data storage and destruction), confidentiality of reported data, and obtaining and linking data from several sources.
The number of steps involved in the initial application was not consistent across sites. Four sites had a one-step process involving only local REB application. Nine sites required an additional step of either local hospital or administrative approval. Three sites had a third step consisting of either separate scientific review before REB approval plus local hospital review, or REB, hospital plus other administrative or operational approval. In addition, six sites required sign-off by an additional department (information technology [IT] (n = 2), data access office (n = 1), privacy committee (n = 2), and/or communication department (n = 1). Five sites required separate health records approval. Two sites in different provinces involved a provincial privacy office but in both cases, those offices indicated that their involvement was unnecessary as patient protection fell to the hospital. At two sites, the IT department held up network installation of the database because of privacy concerns previously addressed by their local REB, resulting in delays of up to seven months.
Fifteen sites had an application form (all different) with specific questions asked. These questions are presented in Table 1. Three of 15 had specific forms for chart review or database studies; one site had a list of subheadings indicating the items to be addressed. Three of 15 sites asked about review by another REB. One site asked about previous peer review. All sites gathered basic information (e.g., investigator contact details). Fourteen sites asked about the sample size, method of patient selection, time period of the study, and funding source (which at one site was only whether the study was industry sponsored). Consent was a subheading or a question asked by all sites but with various levels of detail; six sites (40%) asked investigators to justify why the requirement for informed consent was waived if consent was not obtained (as for CPN).
Table 2 shows that only some sites asked specific questions about data handling and privacy protection (although questions were later added to the form at one site). Six sites (40%) asked for a general description of privacy measures or for an assurance of confidentiality. There was no apparent relationship between the form version date and the detail requested.
Overall, it took a median [range] of 42 days [4-443] to receive final REB approval. When CPN underwent expedited review (n = 9), the median time to approval was 33 days [8-239]. When local hospital approval was given separately from REB approval, the additional median time to approval was 32 days [4-197]. Ten REBs had no issues with the proposal: their median time to approval was 33 days [8-251]. For the site which required 251 days to receive approval despite no ethical concerns, REB approval took 54 days, but then local hospital approval took a further 197 days. Six REBs requested more information: their median time to approval was 178 days [55-443].
When more information was requested, one REB (of 10 that did not ask the question routinely) asked the investigators to justify why informed consent should be waived for CPN. Three sites had concerns about privacy beyond what was covered in the application: whether identifiers were recorded (n = 4), clarification regarding who had access to the data (n = 2), location of data storage (n = 1), future use of data (n = 2), and technical concerns about database operation (n = 1). Two of the sites were based within the same province: one REB approved the protocol, while the other said that CPN needed approval from the provincial privacy office until the previous REB's approval was brought to their attention. Other issues raised were: administrative issues including the need for additional signatures (n = 2); insufficient salary for the research assistant (n = 1); and grammatical, spelling, or layout issues with the patient information pamphlet (n = 2). One site raised a new issue each time the previous issue was addressed, requiring six different responses.
This paper describes our experience of seeking ethics approval for a Canadian multicentre minimum risk study (collecting anonymised data from hospital charts). We found a similarly "muddled Canadian landscape" to that described by Silversides for clinical trials . In that report, the complexity found in review of invasive interventions includes lack of standardization of ethics review, lack of cooperation between REBs and differing privacy legislation [1, 6]. In our study, we found that much duplication and additional work was required by sites and the CPN Co-ordinating Centre, causing significant delays before the CPN study was finally approved in all 16 participating sites, even though 10 REBs had only minor comments on the protocol.
The time, effort and cost of obtaining multiple ethics approvals have been highlighted by a number of authors. The resources consumed (by form filling and responding to questions from REB) add to the cost of research [4, 14–16], and can delay both the initiation and completion of the research. The result of is an overall decrease in the amount of research undertaken, a cost borne by institutions and society more generally . A high burden of the cost and effort is specifically borne by the REBs, including the paid REB staff and the volunteer members of the REBs who conduct the reviews and debate the ethics of studies [5, 14].
Despite the cost of duplication of ethics review for researchers and REBs, there is no evidence that more review leads to either more ethical research, or greater patient safety . Our study offers an insight to this argument: despite the delays caused as a result of institutional review, our study protocol was eventually adopted without substantive changes in all 16 sites. Indeed, our study highlights the types of queries that cause delays: REB procedural enquiries related to incomplete application forms, concern about the quality of the science, privacy issues and limited institutional resources. Unfortunately our study was a retrospective review of the ethics approval process, and we are unable to accurately determine the contribution that each aspect of review made towards the overall delays in receiving study approval.
Qualitative research involving interviews with investigators provides particular insight into the ethics review process, pointing out that ethics review can be divided into two integrated components: procedural issues, such as form design, checking for incomplete applications or consent forms; and ethics review proper [14, 17]. It is important to remember that perceived flaws in the REB process cannot always be attributed to problems with the ethics review itself . The procedural issues are generally what cause lack of trust and deterioration of relationships between researchers and REBs [14–18], and investigators may contribute significantly to delays in the review process. Many investigators consider ethics review itself to be positive, protecting the researchers as well as patients [2, 15]. In fact, the ethical considerations seemed fairly similar between REBs in the CPN sites, underpinned by common ethical principles detailed in the TCPS in Canada . In FDA inspections of REBs, the majority of citations are for procedural inconsistences, with few highlighting poor review of ethics . It seems likely that differences between sites in procedural processes contribute to preventing collaboration in ethics review between sites .
Consensus exists that the ethics review should be proportionate, seeking to expend most effort on higher risk studies, with less deliberation devoted to studies considered to have no material ethical issues, or to involve minimum risk to patients [3, 14, 20]. Unfortunately the definition of lower risk is subjective, and it is this aspect of ethics review that might further hamper collaboration between REBs. In the case of CPN, collecting anonymised data from hospital charts in 16 sites, privacy was deemed the most significant concern, with REBs consistently raising issues related to privacy and informed consent. In particular, some REBs required assurance that the CPN Co-ordinating Centre would not have access to personal identifiers, although only five of the 15 standardized forms had questions specific to the handling of data and procedures for ensuring confidentiality. This could reflect differing roles of REBs in enforcing privacy legislation in different provinces and may indicate that privacy issues are evolving. Considerable controversy exists among REB chairs regarding access to medical records for research purposes .
The draft second edition of the TCPS recognizes the dangers caused by delays from multiple reviews of multicentre studies, and highlights the threats to implementing studies across institutions . Several solutions have been suggested to reduce the inefficiency of local ethics review for multicentre studies. Centralised (national or regional) REBs have been proposed [17, 23, 24], offering the advantage of having a single administrative (and ethics) system for investigators to know and understand, and availability of specialised expert reviewers [4, 17]. A combination of central review with local endorsement has also been suggested: this allows for local circumstances to be taken into account , but may lead to duplication of effort and causing delays in implementing research [24, 25]. A novel suggestion by Nowak and colleagues, described a coordinated approach to ethics review, using a web-based program to promote communication between REBs which are part of a collaborative REB network . Such a system might well reduce duplication of ethics review, but in order to succeed, a number of changes would need to be mandated. A national accreditation and regulatory system would be needed in any type of centralised or coordinated approach, ideally incorporating operational changes to ensure consistency between REB procedures [4, 19, 24, 26, 27]. To ensure consistency, national training would be needed for REB staff and committee members [4, 19, 24, 27]. Unfortunately it will be difficult to set standards for ethical debate and to assess ethical decisions . Only if REB accreditation was accepted, would REBs be able to trust each others' decisions, and accept approvals from other REBs [2, 19]. The suggestions for centralised review will be unable to take account of local resource availability and privacy legislation that vary between provinces . Québec has moved to a centralized provincial system, like the national system in the UK where local review boards handle only site-specific issues . An alternative model, centralization by discipline, has been implemented by the Ontario Cancer Research Ethics Board; discipline-specific boards allow for expertise to develop in a specific area and for stakeholders to be involved in setting standards . This model will disadvantage multidisciplinary research that involves different medical specialties.
Our results indicate that non-ethics review contributed significantly to the time taken to obtain ethics or institutional approval. In order to understand the contribution of local privacy and resource availability and review, detailed prospective studies are needed of the approval processes for multicentre studies. Investigators and REBs should be willing to contribute to such research that may lead to improvements in the review process.
Despite challenges in seeking ethics review, strategies exist to enhance collaboration between investigators and REBs, and enhance the review process . Investigators should seek ethics training, particularly about the national ethics guidelines (TCPS in Canada) . They should regard the REB members as advocates rather than adversaries, working with the REB, using their knowledge of the local REB system, privacy regulations, and other institution-specific requirements . By working closely in collaboration with the REB to provide all the necessary information about their studies, the investigators will become local REB experts .
Although the REB process varied between CPN sites, all REBs eventually approved the protocol without changes. In the context of publicly funded research, such as the CIHR-funded CPN, the additional delay and cost associated with obtaining multicentre REB approval may present an "unethical barrier" to potentially beneficial research and cause harm through the guise of "protection" by discouraging minimal risk activities that could improve care [4, 30].
We believe that a critical examination of the ethical, privacy and institutional review processes in Canada are necessary, to explore their relative contribution to research delays. Only by divorcing ethics from the other types of more locally specific review could a centralised system of ethics review be workable in the Canadian context. CIHR and other funding agencies should exercise leadership to ensure that new Canadian models of multi-site ethics review are explored and implemented.
Hebert P, Saginur R: Research ethics review: do it once and do it well. CMAJ. 2009, 180 (6): 597-598.
Beagan B, McDonald M: Evidence-based practice of research ethics review?. Health Law Rev. 2005, 13 (2-3): 62-68.
Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council of Canada, Social Sciences and Human Research Council of Canada: Tri-Council policy statement: ethical conduct for research involving humans. 1998, Ottawa: Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council of Canada, Social Sciences and Human Research Council of Canada, (with 2000, 2002, 2005 amendments)
Gold JL, Dewa CS: Institutional Review Boards and multisite studies in health services research: is there a better way?. Health Serv Res. 2005, 40 (1): 291-308. 10.1111/j.1475-6773.2005.00354.x.
Greene S, Geiger A: A review finds that multicenter studies face substantial challenges but strategies exist to achieve institutional review board approval. J Clin Epi. 2006, 59 (8): 784-790. 10.1016/j.jclinepi.2005.11.018.
Silversides A: Clinical trials: the muddled Canadian landscape. CMAJ. 2009, 180 (1): 20-22.
Stair TO, Reed CR, Radeos MS, Koski G, Camargo CA, MARC Investigators, Multicenter Airway Research Collaboration: Variation in Institutional Review Board responses to a standard protocol for a multicenter clinical trial. Acad Emerg Med. 2001, 8 (6): 636-41. 10.1111/j.1553-2712.2001.tb00177.x.
Silverman H, Hull SC, Sugarman J: Variability among institutional review boards' decisions within the context of a multicenter trial. Crit Care Med. 2001, 2: 235-41. 10.1097/00003246-200102000-00002.
McWilliams R, Hoover-Fong J, Hamosh A, Beck S, Beaty T, Cutting G: Problematic variation in local institutional review of a multicenter genetic epidemiology study. JAMA. 2003, 290 (3): 360-6. 10.1001/jama.290.3.360.
Dziak K, Anderson R, Sevick MA, Weisman CS, Levine DW, Scholle SH: Variations among Institutional Review Board reviews in a multisite health services research study. Health Serv Res. 2005, 40 (1): 279-90. 10.1111/j.1475-6773.2005.00353.x.
Greene SM, Geiger AM, Harris EL, Altschuler A, Nekhlyudov L, Barton MB, et al: Impact of IRB requirements on a multicenter survey of prophylactic mastectomy outcomes. Ann Epidemiol. 2006, 16: 275-8. 10.1016/j.annepidem.2005.02.016.
Newgard CD, Hui SH, Stamps-White P, Lewis RJ: Institutional variability in a minimal risk, population-based study: recognizing policy barriers to health services research. Health Serv Res. 2005, 40 (4): 1247-58. 10.1111/j.1475-6773.2005.00408.x.
Middle C, Johnson A, Petty T, Sims L, Macfarlane A: Ethics approval for a national postal survey: recent experience. BMJ. 1995, 311: 659-60.
Burris S, Moss K: US health researchers review their ethics review boards: a qualitative study. J Empir Res Hum Res Ethics. 2006, 1 (2): 9-58.
Whitney S, Alcser K, Schneider C, McCullough L, McGuire A, Volk R: Principal investigator views of the IRB system. Int J Med Sci. 2008, 5 (2): 68-72.
Deslauriers C, Bell E, Palmour N, Pike B, Doyon J, Racine E: Perspectives of Canadian researchers on ethics review of neuroimaging research. J Empir Res Hum Res Ethics. 2010, 5 (1): 49-66. 10.1525/jer.2010.5.1.49.
Fitzgerald M, Phillips P: Centralized and non-centralized ethics review: a five nation study. Account Res. 2006, 13 (1): 47-74.
Gunsalus C: The nanny state meets the inner lawyer: overregulating while underprotecting human participants in research. Ethics Behav. 2004, 14 (4): 369-382. 10.1207/s15327019eb1404_7.
Hunter D: The ESRC research ethics framework and research ethics review at UK universities: rebuilding the Tower of Babel REC by REC. J Med Ethics. 2008, 34: 815-820. 10.1136/jme.2008.024257.
Edwards S, Omar R: Ethics review of research: in pursuit of proportionality. J Med Ethics. 2008, 34: 568-572. 10.1136/jme.2007.022491.
Willison DJ, Emerson C, Szala-Meneok KV, Gibson E, Schwartz L, Weisbaum KM, Fournier F, Brazil K, Coughlin MD: Access to medical records for research purposes: varying perceptions across research ethics boards. J Med Ethics. 2008, 34: 308-314. 10.1136/jme.2006.020032.
Revised Draft 2nd Edition of the Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans (TCPS). 2009, (accessed 24 February 2010), [http://www.pre.ethics.gc.ca/pdf/eng/Revised%20Draft%202nd%20Ed%20PDFs/Revised%20Draft%202nd%20Edition%20TCPS_EN.pdf]
Nowak K, Bankert E, Nelson R: Reforming the oversight of multi-site clinical research: a review of two possible solutions. Account Res. 2006, 13 (1): 11-24.
Downie J: The Canadian agency for the oversight of research involving humans: a reform proposal. Account Res. 2006, 13 (1): 75-100.
Kielmann T, Tierney A, Porteous R, Huby G, Sheikh A, Pinnock H: The Department of Health's research governance framework remains an impediment to multi-centre studies: findings from a national descriptive study. J R Soc Med. 2007, 100 (5): 234-238. 10.1258/jrsm.100.5.234.
Davies H, Wells F, Czarkowski M: Standards for research ethics committees: purpose, problems and the possibilities of other approaches. J Med Ethics. 2009, 35: 382-383. 10.1136/jme.2008.027722.
Lemmens T: Federal regulation of clinical trials: a modest but easy step towards an accountable REB review structure in Canada. Health Law Rev. 2005, 13 (2-3): 39-50.
Tully J, Ninis N, Booy R, Viner R: The new system of review by multicenter Research Ethics Committees: prospective study. BMJ. 2000, 320: 1179-82. 10.1136/bmj.320.7243.1179.
Chaddah MR: The Ontario Cancer Research Ethics Board: a central REB that works. Curr Oncol. 2008, 15 (1): 49-52. 10.3747/co.2008.196.
Baily MA: Harming through protection?. N Engl J Med. 2008, 358 (8): 768-9. 10.1056/NEJMp0800372.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/10/223/prepub
We would like to acknowledge the CPN Steering Committee Members, CPN Site Investigators, CPN Coordinators, Mike Fazio 2008-2010, Beth Payne 2010-ongoing, CPN Database Manager, Larry Li, and CPN Masters of Science student, Kiran Massey.
Funding for the CPN project was provided by CIHR and MSFHR.
Canadian Perinatal Network (CPN) Collaborative Group
This includes the CPN Steering Committee Members, CPN Site Investigators, current CPN Coordinator Beth Payne, CPN Database Manager Larry Li, and CPN Masters of Science student, Kiran Massey.
The CPN Steering Committee members are: Victoria Allen (Dalhousie University, Halifax NS), Mark Ansermino (University of British Columbia, Vancouver BC), François Audibert (Université de Montréal, Montreal QC), Emmanuel Bujold (Université Laval, Québec QC), Joan Crane (Memorial University of Newfoundland, St. John's NF), Nestor Demianczuk (University of Alberta, Edmonton AB), Shoo Lee (University of Alberta, Edmonton AB), Robert Liston (University of British Columbia, Vancouver BC), Laura Magee (University of British Columbia, Vancouver BC), Jean-Marie Moutquin (Université de Sherbrooke, Sherbrooke QC), Bruno Piedboeuf (Université Laval, Québec QC), Graeme Smith (Queen's University at Kingston, Kingston ON), Peter von Dadelszen (University of British Columbia, Vancouver BC), Mark Walker (University of Ottawa, Ottawa ON), Wendy Whittle (University of Toronto, Toronto ON).
The CPN Site Investigators are: Jerome Dansereau (Victoria General Hospital, Victoria, BC), Laura Magee (BC Women's Hospital & Health Centre, Vancouver, BC), Duncan Farquharson (Royal Columbian Hospital, New Westminster, BC), Stephen Wood (Foothills Medical Centre, Calgary, AB), Nestor Demianczuk (Royal Alexandra Hospital, Edmonton, AB), Femi Olatunbosun (Royal University Hospital, Saskatoon, SK), George Carson (Regina General Hospital, Regina, SK), Graeme Smith (Kingston General Hospital, Kingston, ON), Craig Burym (St. Boniface General Hospital and The Women's Hospital, Winnipeg, MB), Sarah McDonald (Hamilton Health Sciences Centre, Hamilton, ON), Renato Natale (Saint Joseph's Health Centre, London, ON), Wendy Whittle (Mount Sinai Hospital, Toronto, ON), Jon Barrett (Women's College Hospital, Toronto, ON), Mark Walker (The Ottawa Hospital, Ottawa, ON), Robert Gagnon (Royal Victoria Hospital, Montréal, QC), Francois Audibert (Hôpital Sainte-Justine, Montréal, QC), Jean-Charles Pasquier (Centre Hôspitalier, Universitairé de Sherbrooke, Sherbrooke, QC), Emmanuel Bujold (Centre Hôspitalier de L'Université Laval, Québec City, QC), Victoria Allen (IWK Health Centre, Halifax, NS), and Joan Crane (Women's Health Program, Eastern Health, St. John's, NF).
The authors declare that they have no competing interests.
All authors have read and approved the final manuscript. HE was involved in the study design, data analysis, interpreting the findings, and writing the manuscript. SR was involved in the study design, interpreting the findings, and writing the manuscript. PVD was involved in the study design, interpreting the findings, writing the manuscript. TM was involved in the study design and collection of data. RL was involved in the study design, interpreting the findings, and writing the manuscript. LAM was responsible for the initial conception and design of the study, interpreting the findings, and writing the manuscript.
Hanna Ezzat, Sue Ross, Peter von Dadelszen, Tara Morris, Robert Liston and Laura A Magee contributed equally to this work.