- Research article
- Open Access
- Open Peer Review
Exploring the success of an integrated primary care partnership: a longitudinal study of collaboration processes
BMC Health Services Researchvolume 15, Article number: 32 (2015)
Forming partnerships is a prominent strategy used to promote integrated service delivery across health and social service systems. Evidence about the collaboration process upon which partnerships evolve has rarely been addressed in an integrated-care setting. This study explores the longitudinal relationship of the collaboration process and the influence on the final perceived success of a partnership in such a setting. The collaboration process through which partnerships evolve is based on a conceptual framework which identifies five themes: shared ambition, interests and mutual gains, relationship dynamics, organisational dynamics and process management.
Fifty-nine out of 69 partnerships from a national programme in the Netherlands participated in this survey study. At baseline, 338 steering committee members responded, and they returned 320 questionnaires at follow-up. Multiple-regression-analyses were conducted to explore the relationship between the baseline as well as the change in the collaboration process and the final success of the partnerships.
Mutual gains and process management were the most significant baseline predictors for the final success of the partnership. A positive change in the relationship dynamics had a significant effect on the final success of a partnership.
Insight into the collaboration process of integrated primary care partnerships offers a potentially powerful way of predicting their success. Our findings underscore the importance of monitoring the collaboration process during the development of the partnerships in order to achieve their full collaborative advantage.
Integrated-care approaches are increasingly being promoted in order to respond to the challenges of the health care systems in high-income countries. Such challenges include reducing costs, improving quality of care and generating better patient outcomes [1-3]. Primary care, considered the cornerstone of these health systems, has proven to be essential for achieving desired health outcomes and limiting costs [3-5]. Primary care provides patients their first contact with professional health care, facilitates access to other health and social services and coordinates care for those with complex needs [5,6]. In this study, we refer to integrated primary care as settings in which a network of multiple professionals and organisations across the health and social care system provide accessible, comprehensive and coordinated services to a population in a community. A key component of integrated service delivery is the collaboration between the different actors involved . Such collaborative partnerships are widely used as a means to provide integrated health care services [8-11]. In this study, the term partnership refers to a setting that includes inter-sectorial collaboration as well as inter-organisational and inter-professional collaboration across a network of multiple organisations and professionals [8-11].
The collaboration processes through which partnerships evolve and are sustained have rarely been addressed empirically [12-16]. There is considerable uncertainty surrounding whether and under what conditions all actors (e.g. health care professionals, managers, and policymakers) involved in the partnership will collaborate . This knowledge is important, as collaborative partnerships are often described as time-consuming, resource intensive, and fraught with challenges [18-20]. Especially in the health and social care systems, partnerships tend to have a high and often early failure rate . There is also a lack of empirical evidence showing how the collaboration process influences the success of a partnership over time .
Bell, Kaats and Opheij (2013)  provided a conceptual framework that consists of five different themes in order to evaluate the collaboration processes of a partnership: 1. Shared ambition (shared commitment of the involved partners), 2. Mutual gains (understanding the various interests of the involved partners), 3. Relationship dynamics (relational capital among the partners), 4. Organisation dynamics (governance arrangements among the partners), and 5. Process management (process steering among the partners). The framework is grounded on a solid base of literature in which the individual themes have been described by various authors. For example, developing a clearly stated shared ambition (e.g. vision and mission) has been emphasized in the literature as an essential aspect of a successful partnership [16,23,24]. Closely related to the shared ambition theme is the mutual gains approach, which refers to the dialogue about the underlying interests of the partners to provide an ideal win-win solution. Numerous scholars [22,25-27] have argued that the mutual gains approach is an essential aspect of developing a sustainable partnership. Another important aspect in the current literature is the relational capital among partners, defined as relational dynamics [16,28-30]. Various researchers [29,31,32] have argued that close interpersonal ties between the partners can act as an effective mechanism to build mutual trust and respect within a partnership. Alliance literature also suggests that formal governance mechanisms, defined as organisational dynamics, are also essential to developing trust and commitment within a partnership [16,33-36]. Finally, a large body of literature has focused on the importance of process management in order to facilitate the complex and delicate nature of forging a collaborative partnership [19,22,37].
Although extensive literature has suggested the importance of the five themes of Bell et al. , empirical evidence on the impact of these themes on the success of a partnership over time is limited. By developing an understanding of how the collaboration process can successfully be managed, partners can better know in advance whether the partnership will achieve the desired “collaborative advantage” . The aim of this paper is to explore the relationship between the collaboration process and the perceived success of a partnership. This paper aims to contribute to an understanding of how partnerships can successfully be established and maintained. Given the non-linear, continual change in development of a partnership [22,39], it seems reasonable to evaluate the collaboration process themes at the start and during the partnership, in order to understand how these themes shape its final success. Therefore, we hypothesised that the perceived degree of success of a partnership is influenced by the presence at baseline of the collaboration process themes and their transformation over time. Specifically, this leads to the following research questions: 1) To what extent do the five collaboration process themes at baseline influence the final success of a partnership? 2) To what extent do changes in the collaboration process themes influence the final success of a partnership? The different themes and their assumed relationships to the perceived success of a partnership are illustrated in our analytical framework (see Figure 1).
Study design and setting
The present study was a longitudinal study conducted among partnerships enrolled in the national integrated primary care programme Op één lijn in The Netherlands (translated as “Primary Focus”) . As an initiative from the Ministry of Health, the programme aimed to stimulate integration through partnerships among local health and social services. Existing and new partnerships were invited to submit a grant application for the development and strengthening of their integrated primary care approach. The following criteria were used by the Netherlands Organization for Health Research and Development (ZonMw) to select and fund 69 eligible partnerships: 1) The subject of the partnership is centred on organisational (re)development aiming towards local multidisciplinary collaboration. The partnership needs to be focused on organisational advancement and processes, not on the organisation of patient care itself; 2) The organisational development aims to provide better quality, accessibility, service, efficiency and/or transparency of care; 3) The partnership focuses on local health and/or social service delivery (in a neighbourhood, village or region); 4) The project team of the partnership is multidisciplinary; 5) The partnership aims to create a sustainable organisational structure after the programme has been completed; 6) Patients or patients’ representatives are involved in the partnership; 7) The partnership provides new knowledge about organisational structures and developments in local health care.
Grant applications were assessed for their relevance and quality using the standardised assessment procedure of the ZonMw .
As part of the programme, the selected partnerships participated in a longitudinal study from 2010 to 2013. For our evaluation, we used data that was collected at the start (T0) and the end (T1) of the funding period of each partnership. The average funding period of the partnerships was 22.9 months (SD: 7.5, range 5–36) and the average time between the program measurement points was 19.5 months (SD: 7.3, range: 6–38). Fifty-eight out of the 69 partnerships (84%) already existed before the start of the program and were operational (e.g. implementing shared agreements) at T0 of the program. To be included in the analyses, partnerships had to meet the following criteria: 1) form an inter/intra-sectorial, inter/intra-organisational and/or inter/intra-professional collaboration among different professionals and/or organisations, 2) provide data on T0 and T1 of the programme measurement points. Based on these two criteria, 59 partnerships out of 69 were considered to be eligible for this study. Ethical approval was not required under Dutch law, as no patients were involved in this study.
Data collection procedure
The collaboration process and perceived final success was examined at the strategic level of the partnership. A questionnaire was sent by e-mail at T0 and T1 to all active steering committee members of the partnerships as identified in the original grant application. The mailing list was verified by the coordinator of each partnership. An active steering committee member was defined as any partner who was involved in the administration and strategic decision making processes in order to realise the collaborative objective of the partnership. In order to maximize the response rate, the partnership coordinator was asked to inform the steering committee members about the purpose of the study and the questionnaire. Furthermore, forced answering (e.g. which required respondents to enter a response before they are allowed to proceed to the next survey question) was used to prevent missing answers. An e-mail reminder was sent after one week to non-respondents. Additional data about the characteristics of the partnership were collected by a semi-structured interview with the partnership coordinator at T0 of the programme. For details about these semi-structured interviews, see “Additional file 1”.
A questionnaire was developed to measure the five collaboration themes, the perceived degree of success of the partnership and to collect descriptive information about the partnerships. The primary outcome measurement was the degree of success of the partnership as perceived by the steering committee members of each of the partnerships. Steering committee members were asked to rate the overall success of their partnership at the end of the evaluation programme on a scale from zero (very bad) to ten (excellent). The five collaboration themes were assessed at T0 and T1. Respondents were asked to indicate the extent to which he/she (dis)agreed with a given statement on a 4-point Likert-scale ranging from 1 (not at all) to 4 (totally). Details of the individual items of shared ambition, mutual gains, relationship dynamics, organisational dynamics and process management are provided in Table 1. In addition, the validity of the questionnaire was assessed during the current study.
Individual responses were aggregated to the partnership level, as the partnership level was the primary unit of analyses. Respondents with more than 30% of missing answers on the collaboration theme items were excluded, as they had stopped their responses on the questionnaire prematurely. Then, the within-partnership variance was examined in relation to the between-partnership variance by using a one-way analysis of variance (ANOVA). The ANOVA test was conducted to determine if it was justifiable to aggregate the individual responses to the partnership level [18,42]. Partnership-level scores were obtained by calculating the scale score for each respondent and then taking the average score of all the respondents within a partnership . Next, the validity and reliability of the collaboration theme subscales at baseline were tested at the partnership level. To test the construct validity, we performed an exploratory principal-component factor analyses with varimax rotation on all of the five subscales . A factor loadings threshold of > .40 was applied to identify items that cluster together . In addition, a Cronbach alpha of > .70 was used as threshold for the reliability of each subscale . Changes in collaboration process were calculated as follows: (scores on T1 – scores on T0)/scores on T0.
Bivariate relationships between the variables were estimated using Pearson correlation coefficients (r).
Multiple regression analyses using forced entry were conducted to answer both research questions. Separate analyses were conducted as the sample size limited the number of independent variables that could be included in the model. The variance inflation factor (VIF) was assessed with a threshold of ≤ 10 for acceptable collinearity . To answer the first research question, the association between the collaboration process at baseline and perceived success was examined. A separate regression analysis was conducted to examine the second research question regarding the change in collaboration process. The significant baseline and change variables of the previous analyses were used in a final regression analysis.
Because of the exploratory nature of this study, p-values between .05 and .10 were considered suggestive for an association, and correlations with a p-value less than .05 were considered as statistically significant . Data analyses were performed using SPSS version 21 for Windows (IBM Statistics).
Fifty-nine out of the 69 enrolled partnerships (86%) met the criteria for inclusion. Table 2 shows the general characteristics of the 59 partnerships at baseline. The overall individual response across these partnerships was 75% (338 out of 450 questionnaires) at T0, and 75% (320 out of 426 questionnaires) at T1. Seventeen respondents at T0 and 16 respondents at T1 missed > 30% of the collaboration theme items and were excluded, resulting in 321 respondents at T0 and 304 at T1.
The within-partnership variance was significantly less (p ≤ .01) in relation to the between-partnership variance for the collaboration process variables and the success of the partnership. These findings suggest that the mean of the individual responses for each scale within a partnership is a good approximation of the partnership as a whole [18,42].
Exploratory principal components factor analyses with varimax rotation showed that the shared ambition, mutual gains and organisational dynamics resulted in a one-factor solution (see Table 1 notes). Initially, the relationship dynamics and process management scale resulted in a two-factor solution, and in both scales, one item did not demonstrate salient factor loading (i.e. > .40). These items (item e for relationship dynamics and item b for process management) were removed from the two scales, resulting in a satisfactory one-factor solution for both cases. In addition, the reliabilities of the scales were more than adequate, with Cronbach’s alphas ranging from .86 for the organisational dynamic scale and .73 for the relationship dynamic scale. The results of the factor and internal reliability analyses as well as the descriptive statistics for all scales at T0 and T1 can be found in Table 1.
Moderate to strong correlations were found between the collaboration process variables at T0 which were all statistically significant (p < .01) (Table 3, rows 1–5). In addition, correlations between the change in collaboration process variables ranged from moderate to strong and were all statistically significant (p < .01, rows 6–10). Finally, statistically significant relations (p < .01) were found for the variables of mutual gains, relationship dynamics, organisational dynamics and process management at T0 and T1 with the perceived success of the partnership (Table 3, row 11).
Baseline collaboration process
The regression analysis showed the results obtained in response to the two main research questions (Table 4). In order to answer the first research question, Model 1 examined the baseline collaboration process variables that were associated with the perceived success of the partnership at T1. The baseline collaboration process explained 27% of the variance in partnership success. Only mutual gains (β = .36, p < .10) and process management (β = .44, p < .10) were predictors for the final success of the partnership. None of the other baseline collaboration process variables had a predictive value for the perceived success.
Change in collaboration process
To answer the second research question, Model 2, as shown in Table 4, was examined for association between the change variables of the collaboration process and the final perceived success of the partnership. Together the change variables of the collaboration process explained 43% of the variance in success, and change in relationship dynamics was found to be the greatest predictor of success (β = .45, p < .05). None of the other change variables of the collaboration process had a predictive value for the final perceived success.
Model 3 of Table 4 identified the association between the significant baseline and changed variables of Models 1 and 2 along with the perceived success of the partnership. Together, these variables explained 72% of the variance in partnership success. Mutual gains (β = .35, p < .001) and process management (β = .32, p < .001) at baseline and the change in relationship dynamics over time (β = .70, p < .001) were predictors for the final success of the partnership.
The aim of this study was to gain a better understanding of the collaboration processes and their relation to the perceived success of a partnership. Partnerships that were more positive about mutual gains and process management at baseline had a significant higher level of perceived success (research question 1). Additionally, partnerships that demonstrated an increase in relationship during the collaboration process also had higher levels of perceived success (research question 2).
Contribution of research findings
To the best of our knowledge, this research is among the first empirical studies to explore how changes in the collaboration process influence the final success of a partnership in an integrated primary care setting. An intriguing finding was that the mutual gains approach at baseline, e.g. being explicit and voicing the interests of the partners, was one of the preconditions related to the success of a partnership. Although the mutual gains approach is considered as an ongoing aspect of the successful functioning of a partnership [22,25-27], mutual gains did not change in the partnerships during our study. Process steering at the start of a partnership, defined as process management, played another crucial role in explaining the final success of a partnership. When comparing the collaboration process themes at the start with the change of collaboration process over time, only relationship dynamics appeared to have a significant effect on the final success of the partnership. This result highlights the importance of building relational capital during the developmental phase of a partnership and is consistent with previous research [16,28,29].
We found no association between higher scores of shared ambition (e.g. vision and mission of the partnership) and the perceived success of a partnership, even though a clear vision and mission is widely regarded as an essential condition for a successful partnership [16,23]. This might be explained by the evolution of the partnerships included in this study. One explanation could be that the partnerships had already developed and sustained a shared ambition at the start of the study, partly as a result of applying for the grant from the funding agency. Likewise, the majority of the partnerships were already formed before the start of the program.
Furthermore, our findings show that organisation dynamics did not appear to have any importance on the final success of a partnership. We found this result surprising given the focus of the “Primary Focus” programme on the organisational arrangements within the partnerships (see Methods section). The need for effective organisational arrangements is suggested in various academic fields (e.g. economics, business administration, management, and public health sciences) [16,33-36]. Existing literature also suggests that both trust-based (relationship dynamics) and control-based (organisational dynamics) governance mechanisms play a crucial role in partnership development [34,35]. Given the fact that an increase in relationship dynamics during the programme had a significant effect on the perceived success, this may indicate that trust-based governance mechanisms are of more importance in the development of integrated primary care projects.
Implications for practice and research
Our findings can help to improve the formation and development of a partnership, as many partnerships struggle to realise their collaborative advantage [16,18-20,38]. The strength of this study is the longitudinal design, which allowed studying a more causal relationship between collaboration process and the perceived success of a partnership. This knowledge is a vital step to understanding and improving the collaborative advantage of integrated care approaches. Another positive point of this study was the relatively high response rates (75%) at both time points. The forced answering method and the cooperation with the project coordinators during the data collection process likely contributed to the high response rates.
The study has also some limitations. Although the included partnerships in this study varied in their duration, scope, objectives and size, they constituted a convenience sample. Due to the potential bias of the selected participants, caution should be taken when generalizing the results of this study. For example, positive results are likely to be overrepresented. Through the selection process of the funding agency, more successful partnerships could have been selected. In particular, the dependency of the partnerships on funding could have resulted in more positive reporting by the steering group members in order to be perceived more favourably for future funding. Moreover, the use of self-reported data always involves risks of social desirability and differences in recall . Furthermore, this study represents the managerial perspective of the steering group members within a partnership. Therefore, the results cannot be generalized without reservations to reflect the perspectives of all the actors (e.g. clients, professionals or policymakers) involved in an integrated primary care setting [2,7]. In addition, to our knowledge, this is one of the few studies that used a survey to study the collaboration process, with little empirical precedent to develop most of the measures that were used. Although the construct validity was assessed at baseline, the reliability of the scales over time (i.e. test-retest reliability) was not assessed. Therefore, there is scope to improve and refine some of the measures used in this study.
Future research should focus on the development of outcome measures that represent the different perspectives of all actors (e.g. policymakers, managers, health care professionals and patients), and can be used as a proxy for partnership performance. Furthermore, it would be useful to develop additional measures using objective data (e.g. meeting hours along with methods and frequency of contacts among partners) and to examine how they relate to corresponding self-report measures. Future research should also examine how the theoretical relationships considered in this study are related to the actual impact of a partnership on health and cost-related outcomes .
The findings of this study allow us to better understand the underlying collaboration process and offer a potentially powerful method to predict the success of an integrated primary care partnership. Our results indicate that managing a successful partnership within an integrated primary care context explicitly requires partners’ interests and process management at the start, and, subsequently, the building of relational capital throughout the collaboration process. While our findings do not guarantee the success of a partnership, our results do underscore the importance of monitoring the collaboration process which underlies the development of partnerships in order to achieve their full collaborative advantage.
Grone O, Garcia-Barbero M. Integrated care: a position paper of the WHO European Office for Integrated Health Care Services. Int J Integr Care. 2001;1:e21.
Kodner DL. All together now: a conceptual exploration of integrated care. Healthc Q. 2009;13(Special Issue):6–15.
Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, and cost. Health Aff. 2008;27(3):759–69.
WHO. The world health report 2008: primary health care - now more than ever. Geneva: World Health Organization; 2008.
Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q. 2005;83(3):457–502.
Starfield B, Shi L. Policy relevant determinants of health: an international perspective. Health Policy. 2002;60(3):201–18.
Valentijn PP, Schepman SM, Opheij W, Bruijnzeels MA. Understanding integrated care: a comprehensive conceptual framework based on the integrative functions of primary care. Int J Integr Care. 2013;13:1–12.
Kodner DL. Whole‐system approaches to health and social care partnerships for the frail elderly: an exploration of North American models and lessons. Health Social Care Community. 2006;14(5):384–90.
Shortell SM, Gillies RR, Anderson DA, Erickson KM, Mitchell JB, Shortell SM, et al. Remaking health care in America: the evolution of organized delivery systems. San Francisco: Jossey-Bass; 2000.
Leutz WN. Five laws for integrating medical and social services: lessons from the United States and the United Kingdom. Milbank Q. 1999;77(1):77–110.
Axelsson R, Axelsson SB. Integration and collaboration in public health—a conceptual framework. Int J Health Plann Manage. 2006;21(1):75–88.
de Stampa M, Vedel I, Bergman H, Novella J, Lechowski L, Ankri J, et al. Opening the black box of clinical collaboration in integrated care models for frail, elderly patients. Gerontologist. 2013;53(2):313–25.
Zwarenstein M, Reeves S. What's so great about collaboration? We need more evidence and less rhetoric. BMJ. 2000;320(7241):1022.
Schofield RF, Amodeo M. Interdisciplinary teams in health care and human services settings: are they effective? Health Soc Work. 1999;24(3):210–9.
D'Amour D, Ferrada-Videla M, San Martin Rodriguez L, Beaulieu M. The conceptual basis for interprofessional collaboration: core concepts and theoretical frameworks. J Interprof Care. 2005;19(S1):116–31.
Cropper S, Ebers M, Huxham C. The Oxford handbook of inter-organizational relations. Oxford, USA: Oxford University Press; 2008.
Zuckerman HS, Kaluzny AD, Ricketts III TC. Alliances in health care: what we know, what we think we know, and what we should know. Health Care Manage Rev. 1995;20(1):54–64.
Weiss ES, Anderson RM, Lasker RD. Making the most of collaboration: exploring the relationship between partnership synergy and partnership functioning. Health Educ Behav. 2002;29(6):683–98.
Roussos ST, Fawcett SB. A review of collaborative partnerships as a strategy for improving community health. Annu Rev Public Health. 2000;21(1):369–402.
Weiner BJ, Alexander JA. The challenges of governing public-private community health partnerships. Health Care Manage Rev. 1998;23(2):39–55.
Das TK, Teng B. The dynamics of alliance conditions in the alliance development process. J Manag Stud. 2002;39(5):725–46.
Bell J, Kaats E, Opheij W. Bridging disciplines in alliances and networks: in search for solutions for the managerial relevance gap. Int J Strateg Bus Alliance. 2013;3(1):50–68.
Gray B. Collaborating: finding common ground for multiparty problems. San Francisco: Jossey-Bass; 1989.
Albers S. Configurations of alliance governance systems. Schmalenbach Bus Rev. 2010;62:204–33.
Susskind L, Field P. Dealing with an angry public: the mutual gains approach to resolving disputes. New York: The Free Press; 1996.
Fisher R, Ury WL, Patton B. Getting to yes. Negotiating agreement without giving in. New York: Penguin; 1991.
Kahane A. Solving tough problems: an open way of talking, listening, and creating new realities. San Francisco: Berrett-Koehler; 2004.
Vangen S, Huxham C. Nurturing collaborative relations Building trust in interorganizational collaboration. J Appl Behav Sci. 2003;39(1):5–31.
Gulati R. Does familiarity breed trust? The implications of repeated ties for contractual choice in alliances. Acad Manag J. 1995;38(1):85–112.
Kale P, Singh H, Perlmutter H. Learning and protection of proprietary assets in strategic alliances: building relational capital. Strateg Manag J. 2000;21:217–37.
Dore R. Goodwill and the spirit of market capitalism. Br J Sociol. 1983;34:459–82.
Ring PS, Van de Ven AH. Structuring cooperative relationships between organizations. Strategic Manage J. 1992;13(7):483–98.
Mitchell SM, Shortell SM. The governance and management of effective community health partnerships: a typology for research, policy, and practice. Milbank Q. 2000;78(2):241–89.
De Man A, Roijakkers N. Alliance governance: balancing control and trust in dealing with risk. Long Range Plann. 2009;42(1):75–95.
Das TK, Teng B. Between trust and control: developing confidence in partner cooperation in alliances. Acad Manag Rev. 1998;23(3):491–512.
Williamson Oliver E. The economic institutions of capitalism: firms, markets, relational contracting. New York: The Free Press; 1985.
Butterfoss FD. Process evaluation for community participation. Annu Rev Public Health. 2006;27:323–40.
Huxham C, Vangen SE. Managing to collaborate: the theory and practice of collaborative advantage. London: Routledge; 2005.
Huxham C, Vangen S. Ambiguity, complexity and dynamics in the membership of collaboration. Hum Relat. 2000;53(6):771–806.
The Netherlands Organization for Health Research and Development (ZonMw) – the primary focus programme. [http://www.zonmw.nl/en/programmes/primary-focus/programme/]
The Netherlands Organization for Health Research and Development (ZonMw) - Grant applications assessment procedure. [http://www.zonmw.nl/en/about-zonmw/method/]
Verran JA, Mark BA, Lamb G. Focus on psychometrics psychometric examination of instruments using aggregated data. Res Nurs Health. 1992;15(3):237–40.
Field A. Discovering statistics using SPSS. 3rd ed. Thousand Oaks, CA: Sage; 2009.
Dückers ML, Spreeuwenberg P, Wagner C, Groenewegen PP. Exploring the black box of quality improvement collaboratives: modelling relations between conditions, applied changes and outcomes. Implement Sci. 2009;4(1):74.
This study was funded by The Netherlands Organization for Health Research and Development (ZonMw) grant no. 154013001, The Hague. The authors are grateful to ZonMw for funding this research. We would like to express our profound gratitude to Linda Baaij and Judith Houtman for facilitating the data collection. Finally, the authors wish to thank all participants of the partnerships for their involvement.
The authors declare that they have no competing interests.
All authors contributed to the conception, design, interpretation of data, drafting and editing of the manuscript. PV acquired the data; PV and MB analyzed the data. All authors have read and approved the manuscript.
Semi-structured interview guide.