- Research article
- Open Access
- Open Peer Review
Striving toward team-based continuity: provision of same-day access and continuity in academic primary care clinics
BMC Health Services Researchvolume 19, Article number: 145 (2019)
An important goal of the patient-centered medical home is increasing timely access for urgent needs, while maintaining continuity. In academic primary care clinics, meeting this goal, along with training medical residents and associated professionals, is challenging.
The aim of this study was to understand how academic primary care clinics provide continuity to patients requesting same-day access and identify factors that may affect site-level success. We conducted qualitative interviews from December 2013–October 2014 with primary care leadership involved with residency programs at 19 Veterans Health Administration academically-affiliated medical centers. Interview recordings were transcribed verbatim. To analyze the data, we created comprehensive, structured transcript summaries for each site. Site summaries were then entered into NVivo 10 software and coded by main categories to facilitate within-case and cross-case analyses. Themes and patterns across sites were identified using matrix analysis.
Interviewees found it challenging to provide continuity for same-day in-person visits. Most sites took a team-based approach to ensure continuity and provide coverage for same-day access, notably using NPs, PAs, and RNs in their coverage algorithms. Further, they reported several adaptations that increased multiple types of continuity for walk-in patients, urgent care between in-person visits, and follow-up care. While this study focused on longitudinal continuity, both by individual PCPs or by a team of professionals, informational continuity and continuity of supervision, as well as, to a lesser extent, relational and management continuity, were also addressed in our interviews. Finally, most interviewees reported clinic intention to provide patient-centered, team-based care and a robust educational experience for trainees, and endeavored to structure their clinics in ways that align these two missions.
In contending with the tension between providing continuity and educating new clinicians, clinics have re-conceptualized continuity as team-based, creating alternative strategies to same-day visits with a usual provider, coupled with communication strategies. Understanding the effect of these strategies on different types of continuity as well as patient experience and outcomes are key next steps in the further development and dissemination of effective models for improving continuity and the transition to team-based care in the academic clinic setting.
An important goal of the patient-centered medical home (PCMH) is increasing timely access for urgent needs, while maintaining continuity [1, 2]. Indeed, the National Committee for Qualitative Assurance (NCQA) 2017 PCMH Recognition standards include same-day access and provision of continuity using team-based approaches. Meeting these standards in academic primary care clinics, where multiple part-time physicians, and associated professionals, provide care, may be particularly challenging [3,4,5]. Many primary care physicians (PCPs) and residents in academic clinics are only available only for clinical care part-time, as they participate in training, research, administrative, or other clinical activities . Consequently, the risk of discontinuity is higher for patients who request same-day access compared to routine visits . Understanding how academic clinics structure delivery of such care is important to mitigate potential negative consequences .
In addition to care delivery, academic clinics play a critical role in training medical residents and other clinical professionals in team-based care. The National Academy of Medicine defines team-based care as “...the provision of health services to individuals, families, and/or their communities by at least two health providers who work collaboratively with patients and their caregivers—to the extent preferred by each patient - to accomplish shared goals within and across settings to achieve coordinated, high-quality care” . In the PCMH model, the PCP shares primary care of a defined patient panel with team members such as registered nurses (RNs), licensed practical nurses (LPNs), pharmacists, and administrative staff, ideally with well-defined team roles and processes. Training in team-based care is essential since “sharing the care” among team members  is fundamental to improving access and providing more efficient and cost-effective care [11, 12].
The emphasis on team-based care also signals a shift in the traditional conceptualization of continuity as consisting of in-person visits over time with a usual PCP, usually termed longitudinal continuity [13, 14]. Longitudinal continuity is a dimension of relational continuity that is necessary for the development of a therapeutic relationship. Although there are strategies to balance individual provider and team-based longitudinal continuity  (i.e. seeing the same team of professionals over time), team-based care in the training environment, with multiple PCPs and residents on a team, can pose additional challenges. And, because longitudinal continuity is more likely to be disrupted in a training environment, other types of continuity -- management continuity (i.e., consistency of clinical management) and informational continuity (i.e., use of information on past events and patient characteristics to deliver appropriate care to a particular patient)  – are also more challenging than in an environment with full time PCPs. Structures and processes must be put in place to share information among multiple PCPs, in addition to other primary care team members. In the academic setting, an additional type of continuity to consider is continuity of supervision, that is, a resident having the same attending supervisor over time in caring for the resident’s patient panel . This provides the potential benefits of longitudinal continuity to both residents and patients.
In 2010, the Veterans Health Administration (VHA) began transitioning its primary care clinics to the PCMH model [17,18,19]. Approximately 120 of the over 900 VHA primary care clinics are academically affiliated and located within medical centers. These clinics fulfill VHA’s dual mission of patient care and medical training. VHA funds about 15% of US internal medicine resident positions, and has instituted innovative inter-professional education that trains medical residents and Nurse Practitioners (NPs) together as part of care teams . This transformation provided the ideal opportunity to understand potential challenges and practical strategies for achieving access and continuity goals during the transition to team-based care within the academic primary care clinic training environment. The focus of this project was on longitudinal continuity, but we also report findings on management and informational continuity, and continuity of supervision, as they arose in our interviews. Specifically, we conducted a multi-site qualitative assessment to: 1) Understand how academic primary care clinics approach providing continuity for patients requesting same-day access; 2) Identify factors that affect site-level success in providing such continuity; and 3) Describe adaptations that clinics have developed to provide continuity. We chose this approach to gain an in-depth understanding of the views and experiences of clinic leaders in dealing with same-day access and continuity issues.
This multi-site quality improvement project took place 3 years after the VHA implemented PACT (Patient Aligned Care Teams), VHA’s version of PCMH, in which care is provided through an ongoing relationship with a designated team of clinical and administrative staff. During this time, one area of focus was same-day access, promoted by a performance measure that assessed the proportion of patient requests for same-day appointments that resulted in a same-day in-person appointment with the patient’s usual PCP (longitudinal continuity, hereafter continuity). For residents, performance was measured at the level of the supervising attending physician. This reinforced the benefit of having the same attending involved with a patient’s care, as well as continuity of supervision. If an attending had their own patient panel, performance for that panel was measured separately. All VHA primary care clinics are internal medicine clinics.
Sampling and data collection
We sent recruitment e-mails to physician clinic administrators involved with the residency program and primary care clinic management at 1 academic medical center in each of the 21 regional Veterans Integrated Service Networks (VISNs), to ensure geographic variation. We aimed to recruit physician administrators because they were most familiar with the residency program; when that person was unavailable, we interviewed another administrator. We were unable to arrange interviews in 5 VISNs, so selected 3 additional medical centers from 3 of the already-participating VISNs to supplement the study sample. Two authors (JF and CR) developed an interview guide with input from the larger study team (Additional file 1). The guide was designed to collect data on a common set of domains across interviewees based on our research questions and our earlier work on PCMH implementation . Domains included clinic structure, resident model, coverage for residents absent from clinic, part-time PCPs, and main challenges. JF and CR conducted semi-structured telephone interviews with 17 physicians and 2 nurse practitioners. Both interviewers participated in the interviews, which occurred from December 2013 through October 2014 and lasted approximately 1 h. For the 2 interviewees who did not grant permission to audio-record the interviews, we captured interview content with thorough notes. Recorded interviews were transcribed verbatim .
From the transcripts and notes, we created comprehensive structured summaries. First, we created a template for the summaries based on immersion in the data, including post-interview discussions, with the goal of addressing the research questions. The template was further refined by constructing summaries for 2 sites and subsequently used to create summaries for all sites. For each category, summaries included descriptive and interpretive comments, as well as supporting exemplar quotations that comprehensively represented the data. Site summaries were then entered into NVivo 10 software and coded by main categories to facilitate within-case and cross-case analyses. Specifically, we created a descriptive matrix with defined rows (one row for each site) and columns (main categories) so we could view and compare summary site characteristics, processes, and recommendations . We identified themes by reviewing data in each category and identifying connections between categories and patterns across sites. To ensure interpretive rigor, we went back to original transcripts when needed to verify interpretations and conclusions . Rigor was also strengthened through the detailed nature of the interviews and discussion of findings with members of a wider team involved in evaluating the PCMH model in VHA, including local primary care administrators and PCPs.
The characteristics of the 19 participating clinics varied across several dimensions, including the number of enrolled primary care patients (approximately 9000 to 100,000), the number of residents (16–144), and the number of attending physicians (5–40) (Table 1). Similarly, clinics had varied organizational structures, such as whether residents were integrated throughout the clinic or assigned to a resident-only team, the percentage of patients assigned a resident PCP (2–43%), and type of residency model (traditional vs. block). In the traditional model, residents’ schedules are dominated by inpatient care, with only a half-day per week devoted to ambulatory care. Block models alternate blocks of inpatient rotations with dedicated ambulatory blocks (e.g., 6 weeks inpatient, 2 weeks outpatient).
Approaches to providing continuity: coverage for residents absent from clinic
Most sites were trying to structure their clinics in ways that align patient care with their teaching mission. Almost all sites, however, were challenged in providing continuity to patients assigned to residents:
“one of the goals of the VA, which we know in the mission statement, is care of the Veteran…but also education...we know that trainee providers just by their very nature are not going to be in the ambulatory setting [everyday], so there’s going to be some discontinuity.” (Site P)
Processes established to provide care when residents were not in clinic were central to attempts to provide continuity to patients requesting same-day visits. Given the scheduling complexities introduced by having residents (and, at most clinics, part-time attendings), and by the focus on team-based care, 12 of 18 sites where residents had their own patient panels took a team-based approach to providing coverage for same-day in-person access (Table 2). That is, when a patient of a resident who wasn’t in clinic needed a same-day in-person visit, most sites attempted to provide team-based continuity to that patient by having someone else on the absent resident’s team -- another resident, attending physician, registered nurse (RN), NP, or physician assistant (PA) -- see the patient. Interviewees perceived maintaining team-based continuity to benefit both training and patient care (Table 3, Quote 1). There was no discernable pattern across sites of coverage arrangements varying by residency model, resident integration into clinic, or number of residents in clinic.
Notably, 7 sites included NPs, PAs, NP trainees, or RNs, not just medical residents and attendings, in their coverage algorithm. For example, at Site M, each team had an assigned PA who was often first in line to see a walk-in patient of an absent resident on their team. At this site, residents were integrated across teams (Quote 2).
Six sites used walk-in clinics, 4 staffed by residents to see patients requiring same-day access, at 2 others, walk-in clinics were second in the coverage algorithm. Five of these 6 sites stated that residents staffing walk-in clinics were “making up” ambulatory hours mandated by the Accreditation Council for Graduate Medical Education (ACGME) that they didn’t fulfill with continuity visits with their own patients. Walk-in clinics were perceived to compromise continuity, but at all but 1 of the sites using walk-in clinics, interviewees described attempting to provide continuity either at the attending physician level or by the team RN.
About half of the sites expected residents to address urgent between-visit needs, through checking and responding to electronic health record view alerts and, at some sites, being available to their team via page, text, or secure e-mail (Quote 3), with attending physicians or RNs responsible for assuring timely patient care.
Barriers to providing team-based and other types of continuity
Interviewees described the following barriers to providing continuity for both same-day and routine visits.
Residency program-related barriers
Low predictability of resident clinic schedules was thought to make it more challenging for a co-team resident to see an absent resident’s walk-in patient (Quote 4), affecting team-based continuity for same-day visits. It was also more difficult to have residents and their assigned attendings in clinic at the same time, affecting continuity of supervision and team attending-level continuity for both same-day and routine visits. About half of interviewees described their academic affiliate as putting constraints on residents’ schedules. (Quote 5). For example, at Site D, with a traditional residency model, residents often changed their clinic date because they were post-call (i.e., just finished an overnight inpatient shift) or “on a rotation they can’t get out of.” This seemed to primarily affect continuity for routine visits for patients with a resident PCP.
Three facilitators of higher resident schedule predictability, and therefore potentially continuity, included: 1) a move toward the block model (Quote 6); 2) the ability of leadership to negotiate scheduling with the academic affiliate; and 3) early communication with their academic affiliate regarding scheduling.
The first clinic-related barrier to providing continuity was lack of attending physician availability. Fifteen sites had attending physicians with duties other than precepting residents and seeing their own patients. These duties took them away from clinic, and made it difficult to see patients of residents they supervised, or patients of other residents on their team (Quote 7). One site had attending physicians who were in clinic full-time either precepting or seeing their own patients, but because they were under pressure to provide access, they were too busy to see their residents’ walk-in patients (“I don’t see how you would ever get anything done.” Site K).
Second, clinics with a large number of residents and/or attending physicians found it difficult for attending physicians and their residents to be in clinic at the same time to provide attending--level continuity to patients and continuity of supervision to residents. And, even high resident schedule predictability did not guarantee high continuity of supervision. At Site J, with 18 part-time attendings who were in clinic infrequently, team RNs provided continuity instead of attending physicians. Site N had both multiple part-time attending physicians and low resident schedule predictability, and, to facilitate team-based continuity, NPs “provided the glue.” Interviewees saw continuity of supervision as beneficial for both training and patient care (Table 3, Quote 8).
The third clinic-related barrier was that multiple schedulers lacked knowledge of coverage arrangements, and had difficulty dealing with scheduling for a large number of residents. These barriers affected sites’ ability to match patients with their assigned provider (e.g., Site M, with 70 residents). Site P, with 50 residents, reported addressing this problem by programming their coverage algorithm in the electronic medical record that all schedulers could access.
Finally, scarcity of open visit slots for walk-in patients made it more difficult for attending physicians to see their residents’ walk-in patients. Site B reported that attending physicians, who were all part-time, rarely had open slots, and had a difficult time providing coverage for their assigned residents (Quote 9).
Adaptations to increase team-based continuity
Sites described several adaptations to increase team-based continuity for walk-in patients, as well as for routine care, urgent care between in-person visits, and follow-up care. Adaptations included expanding the types of team members in the coverage algorithm, using team full-time attending physicians or co-team residents, and using other modalities for providing care.
For example, a team NP, PA, or RN provided coverage for walk-in patients at several sites (Table 2). One site noted that including within-team RN visits would provide another layer of continuity, as the team RN would see the patient instead of a non-team provider. Site P included NP trainees to form a “practice partner triad”, consisting of 2 resident partners and an NP trainee who each had their own panels, but cross-covered one another. This site reported being quite successful at providing team-based continuity (Quote 10); team meetings (i.e., huddles) strengthened informational continuity through discussion of care of individual patients (Quote 11).
Site L depended on attendings who were full-time preceptors to provide continuity for their residents’ walk-in patients: “Same day access is not a problem really…the attending will see the patient.” Site S increased the number of attending physicians who were full-time preceptors to improve continuity. On the other hand, Site G paired co-team residents so they had the same patient panel, and could address between-visit needs while their partner was on inpatient rotation. Site A had a co-team resident who was in clinic the subsequent week to manage test results. Two interviewees commented that resident cross coverage and sharing of patient panels was positive for training and patient care. (Quote 12).
In keeping with the PCMH model, sites also urged residents to use secure e-mail and telephone appointments for care between clinic days, thus strengthening relational continuity. Another strategy, having RNs available for follow-up after huddling with residents about the care of individual patients, was aimed at using informational continuity to improve patient management. (Quote 13).
This is the first multi-site, qualitative, in-depth look at how academic primary care clinics transitioning to the PCMH model approach providing continuity for patients requesting same-day access. Most sites took a team-based approach to ensure continuity and provide coverage for same-day access, notably using NPs, PAs, and RNs in their coverage algorithms. Further, they reported several adaptations that increased multiple types of continuity for walk-in patients, urgent care between in-person visits, and follow-up care. While this study focused on longitudinal continuity, both by individual PCPs or by a team of professionals, informational continuity and continuity of supervision, as well as, to a lesser extent, relational and management continuity, were also addressed in our interviews. Finally, most interviewees reported clinic intention to provide patient-centered, team-based care and a robust educational experience for trainees, and endeavored to structure their clinics in ways that align these two missions.
We found that coverage arrangements that promoted team-based care and continuity could be at the PCP level (i.e., resident and resident’s attending, team resident, NP, or PA) or with the wider team (i.e., RN). These strategies are like those reported as improving access and continuity by a public hospital resident primary care clinic . When thinking about improving clinic processes, it is important to note that processes to ensure informational and management continuity, in addition to longitudinal continuity, would depend on which team member is providing coverage. For example, a resident and the resident’s attending have regular opportunities to exchange patient information and to think about management of the patient as part of the resident’s supervision by the attending. On the other hand, natural opportunities for a resident and an RN to exchange information may be more limited, and processes such as clear and accessible documentation in the electronic medical record, or huddles would be needed to bridge that gap.
Team-based coverage arrangements can have little positive effect on patient care without informational continuity. Strategies for achieving informational continuity are important to team-based care generally, and especially in academic clinics that have multiple part-time PCPs on a team. Some interviewees reported that intra-team communication through huddles and electronic means facilitated communication. These strategies have potential to provide the informational continuity essential to filling “continuity gaps” in the context of part-time providers and team-based care [3, 25,26,27,28]. Brown et al. found that an increase in informational continuity in an academic PCMH clinic through information technology and team meetings improved management continuity across the team, including for urgent patients not seeing their assigned provider . NCQA recognized the importance of informational continuity by adding a new element to its 2014 PCMH certification standards requiring a structured communication process focused on individual patient care .
Our findings also suggest that predictable resident and attending schedules, and a smaller number of attendings, may facilitate multiple types of continuity, including resident- and team attending-level longitudinal continuity and continuity of supervision, for same-day and routine visits. These findings are consistent with evidence that block models increase longitudinal continuity with resident providers , and with Gupta et al.’s “Clinic First Model.” This model, based on qualitative findings from a multi-site study, recommends eliminating tensions between inpatient and outpatient duties and developing a small core of attendings to increase longitudinal continuity, improve resident training, and decrease provider burnout . Dedicated outpatient time may also spur more physicians to choose to go into primary care . Notably, 6 of 19 participating sites had transitioned away from the traditional residency model, with 8 more planning to or considering doing so.
Finally, we found that there was recognition of patient care and teaching mission alignment in the context of PCMH, and efforts to adapt care delivery to accommodate both. Achieving this alignment is powerful, but not easy, from both care delivery and training perspectives . However, provision of all types of continuity is both a patient care and educational goal, and to attain these goals, sites used strategies such as having attending physicians and their residents in clinic at the same time to improve continuity of supervision, pairing residents with the same patient panel on opposite ambulatory and inpatient blocks to promote management and informational continuity, and having team-based NP trainees participate in providing coverage for same-day access. This last strategy has been reported elsewhere , and is consistent with recommendations for educational curricula that emphasize “strengthening the union between inter-professional learning, team-based practice, and high-value care .” From a practice standpoint, however, further development of these strategies may require partnerships between not only physician and nurse educators, but also clinic administrators, front-line care providers, quality improvement professionals, and patients.
In addition to highlighting the variety of strategies for promoting access and continuity in the academic primary care clinic training environment, our findings may also provide a basis for constructing a taxonomy of approaches to support future evaluation. Given these variable approaches, further evaluation is needed to determine, which strategies improve different types of continuity in specific contexts and why, and how these models affect patient outcomes. Because context is so important, context-sensitive evaluation approaches such as realistic and developmental evaluation [33, 34], would be promising, as would the use of mixed methods techniques to capture context, mechanisms, experiences, and outcomes. Further, any evaluation of clinic models designed to promote continuity in academic settings should include evaluation of patients’ experience and perceptions of continuity, including continuity with a care team. Questions to be addressed include: How do patients experience team based continuity, i.e., continuity with more than one professional? What is important to patients concerning continuity, and how does that compare in the context of continuity with a single PCP vs. multiple PCPs vs. a care team that includes nurses and other professionals? How do patients weigh the trade-offs between access and continuity in a range of circumstances (e.g., acute vs. chronic illness) ?
This work has limitations. First, we interviewed only one participant at each site, and were not able to conduct site visits that would have provided observation data. Additional interviewees and observations would have provided a more holistic understanding of each site and strengthened validity . Finally, we conducted this work within a publically-funded integrated health system; contextual factors, particularly the presence of electronic health records, variation in reimbursement models, and degree of control of resident schedules, may affect transferability of these findings to other systems and independent practices.
Same-day access and continuity provided through team-based care are critical PCMH requirements. Academic primary care clinics face challenges in meeting these requirements while trying to ensure a robust training environment for new clinicians. As PCMH becomes a prevalent model of primary care delivery, clinics will need to overcome barriers and implement strategies that fulfill both patient care and teaching missions. In contending with part-time providers and residents with complex schedules, clinics themselves have by necessity re-conceptualized continuity within a team-based model by creating alternatives to same-day visits with a usual provider, coupled with communication strategies. Understanding the effect of these alternative strategies on different types of continuity as well as on patient experience and outcomes are key next steps in the further development and dissemination of effective models for improving continuity and the transition to team-based care in the academic clinic setting.
Accreditation Council for Graduate Medical Education
National Committee for Qualitative Assurance
Patient Aligned Care Teams
Patient-centered medical home
Primary care physician
Veterans Health Administration
Veterans Integrated Service Network
National Committee for Quality Assurance. Patient-centered medical home (PCMH) recognition, 2017 standards preview. Available at: https://www.wypca.org/wp-content/uploads/Introduction-to-PCMH-2017.pdf. Accessed 26 Feb 2019.
Stange KC, Nutting PA, Miller WL, et al. Defining and measuring the patient-centered medical home. J Gen Intern Med. 2010;25:601–12.
Hern T, Talen M, Babiuch C, Durazo-Arvizu R. Patient care management teams: improving continuity, office efficiency, and teamwork in a residency clinic. J Grad Med Educ. 2009;1:67–72.
Fernald DH, Deaner N, O’Neill C, Jortberg BT, deGruy IIIFV, Perry Dickinson W. Overcoming early barriers to PCMH practice improvement in family medicine residencies. Fam Med. 2011;43:503–9.
Fortuna RJ, Garfunkel L, Mendoza MD, et al. Factors associated with resident continuity in ambulatory training practices. J Grad Med Educ. 2016;8:532–40.
Robinson CH, Harrod M, Kerr EA, Forman J, Tremblay A, Rosland AM. Challenges to meeting access and continuity performance measures in a large hospital-based primary care clinic implementing the patient-centered medical home: a qualitative study. Jt Comm J Qual Patient Saf. 2016;42:417–24.
Rosland AM, Krein SL, Kim HM, et al. Measuring patient-centered medical home access and continuity in clinics with part-time clinicians. Am J Manag Care. 2014;21:e320–8.
Brienza RS. At a crossroads: the future of primary care education and practice. Acad Med. 2016;91:621–3.
Pamela H. Mitchell, Matthew K. Wynia, Robyn Golden, Bob McNellis, Sally Okun, C. Edwin Webb, Valerie Rohrbach, Isabelle Von Kohorn. Core Principles & Values of Effective Team-Based Health Care. NAM Perspectives. 2012;2(10).
Bodenheimer T, Laing BY. The teamlet model of primary care. Ann Fam Med. 2007;5:457–461.
Bodenheimer T, Ghorob A, Willard-Grace R, Grumbach K. The 10 building blocks of high-performing primary care. Ann Fam Med. 2014;12:166–71.
Grumbach K, Bodenheimer T. Can health care teams improve primary care practice? JAMA. 2004;291:1246–51.
Haggerty JL, Reid RJ, Freeman GK, Starfield BH, Adair CE, McKendry R. Continuity of care: a multidisciplinary review. BMJ. 2003;327:1219–21.
Freeman G, Hughes J. Continuity of care and the patient experience. London: The King’s Fund; 2010.
Weir SS, Page C, Newton WP. Continuity and access in an academic family medicine center. Fam Med. 2016;48:100–7.
Hirsh DA, Ogur B, Thibault GE, Cox M. “Continuity” as an organizing principle for clinical education reform. N Engl J Med. 2007;356:858–66.
Reid A, Baxley E, Stanek M, Newton W. Lessons from the I3 PCMH collaborative. Fam Med. 2011;43:487–94.
Henschen BL, Garcia P, Jacobson B, et al. The patient centered medical home as curricular model: perceived impact of the “education-centered medical home”. J Gen Intern Med. 2013;28:1105–9.
Jortberg BT, Fernald DH, Dickinson LM, et al. Curriculum redesign for teaching the PCMH in Colorado family medicine residency programs. Fam Med. 2014;46:11–8.
Gilman SC, Chokshi DA, Bowen JL, Rugen KW, Cox M. Connecting the dots: interprofessional health education and delivery system redesign at the veterans health administration. Acad Med. 2014;89:1113–6.
Maxwell JA. Qualitative research design: an interactive approach. Thousand Oaks: SAGE Publications; 2013.
Miles MB, Huberman AM, Saldana J. Qualitative data analysis: a methods sourcebook. 3rd ed. Thousand Oaks: SAGE Publications; 2014.
Forman J, Damschroder L. Qualitative content analysis. In: Siminoff LA, Jacoby L, eds. Empirical methods for bioethics: a primer. Oxford: Emerald Group Publishing Limited; 2008:57–59.
Gupta R, Davis E, Horton C. Interval examination: building primary care teams in an urban academic teaching clinic. J Gen Intern Med. 2013;28:1517–21.
Markova T, Mateo M, Roth LM. Implementing teams in a patient-centered medical home residency practice: lessons learned. J Am Board Fam Med. 2012;25:224–31.
Brown KK, Master-Hunter TA, Cooke JM, Wimsatt LA, Green LA. Applying health information technology and team-based care to residency education. Fam Med. 2011;43:726–30.
Forman J, Harrod M, Robinson C, et al. First things first: foundational requirements for a medical home in an academic medical center. J Gen Intern Med. 2014;29:640–8.
Wieland ML, Jaeger TM, Bundrick JB, et al. Resident physician perspectives on outpatient continuity of care. J Grad Med Educ. 2013;5:668–73.
National Committee for Quality Assurance. Patient-centered medical home (PCMH) 2014 Part 1: Standards 1-3. PowerPoint presentation. Available at: http://www.acofp.org/acofpimis/Acofporg/Apps/2014_PCMH_Finals/Tools/1_PCMH_Recognition_2014_Front_Matter.pdf. Accessed 26 Feb 2019.
Francis MD, Wieland ML, Drake S, et al. Clinic design and continuity in internal medicine resident clinics: findings of the educational innovations project ambulatory collaborative. J Grad Med Educ. 2015;7:36–41.
Gupta R, Barnes K, Bodenheimer T. Clinic first: 6 actions to transform ambulatory residency training. J Grad Med Educ. 2016;8:500–3.
Long T, Chaiyachati K, Bosu O, et al. Why aren’t more primary care residents going into primary care? A qualitative study. J Gen Intern Med. 2016;31:1452–9.
Pawson R, Tilley N. Realistic evaluation. London: Sage; 1997.
Patton MQ. Developmental evaluation: applying complexity concepts to enhance innovation and use. New York: Guilford Press; 2010.
The authors would like to thank the clinic leaders who participated in this work. The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the US government.
This work was undertaken as part of the Veterans Administration’s PACT Demonstration Laboratory initiative, supporting and evaluating VA’s transition to a patient-centered medical home, with funding provided by the VA Office of Patient Care Services. Dr. Krein is supported by a VA Health Services Research and Development Research Career Scientist Award (RCS 11–222). The funding sources had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Availability of data and materials
Data will not be shared due to the confidentiality of qualitative materials collected in the study.
Ethics approval and consent to participate
Per VHA Program Guide 1200.21 (VHA Operations Activities That May Constitute Research), this evaluation was conducted as a non-research operations activity and, as such, does not require written informed consent from participants. To ensure that the safety, rights, and welfare of participants were protected, they were emailed an information sheet that included a project description, potential risks and benefits of participation, a statement that participation was voluntary, and contact information for JF. Verbal consent was obtained for each interview.
VHA’s Office of Patient Care Services, and all VHA authors of this manuscript, attest that the activities that resulted in producing this manuscript were not conducted as part of a research project, but as part of the non-research evaluation conducted under the authority of the Office of Patient Care Services.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Interview Guide.docx. Contains interview guide used during data collection. (DOCX 21 kb)