Background 

Some internal medicine residency programs on X+Y schedules have modified clinic preceptor schedules to mimic those of the resident cohort (resident matched). This is in contrast to a traditional model, in which preceptors supervise on the same half-day each week.

Objective 

We assessed preceptor and resident perceptions of the 2 precepting models.

Methods 

We surveyed 44 preceptors and 97 residents at 3 clinic sites in 2 academic medical centers. Two clinics used the resident-matched model, and 1 used a traditional model. Surveys were completed at 6 months and 1 year. We assessed resident and preceptor perceptions in 5 domains: relationships between residents and preceptors; preceptor familiarity with complex patients; preceptor ability to assess milestone achievements; ability to follow up on results; and quality of care.

Results 

There was no difference in perceptions of interpersonal relationships or satisfaction with patient care. Preceptors in the resident-matched schedule reported they were more familiar with complex patients at both 6 months and 1 year, and felt more comfortable evaluating residents' milestone achievements at 6 months, but not at 1 year. At 1 year, residents in the resident-matched model perceived preceptors were more familiar with complex patients than residents in the traditional model. The ability to discuss patient results between clinic weeks was low in both models.

Conclusions 

The resident-matched model increased resident and preceptor perceptions of familiarity with complex patients and early preceptor perceptions of comfort in assessment of milestone achievements.

What was known and gap

Internal medicine ambulatory clinic block scheduling that enhances educational continuity for residents disrupts continuity with faculty if traditional 1-day-a-week faculty schedules are maintained.

What is new

A new approach to faculty preceptor scheduling that mirrors block scheduling of the residents.

Limitations

Low response rate; survey without validity evidence; assessment limited to perceptions.

Bottom line

The new resident-matched model increased resident and preceptor perceptions of familiarity with complex patients, and preceptor perceptions of comfort in assessing residents on milestones early in the academic year.

The ambulatory clinic has long been a key venue for clinical continuity for internal medicine residents, and allows for relationships between patients, preceptors, and interprofessional teams. Continuity between residents and preceptors is important to learner development and patient care.14  Competency-based education and workplace-based assessment have focused attention on preceptor-resident relationships that enable direct observation, effective assessment, and graduated skill development.510  Ambulatory preceptors who follow a small group of learners longitudinally over the course of residency may offer a relationship that provides a level of observation and assessment necessary for optimal evaluation.

Newer models of scheduling that separate inpatient and ambulatory rotations (commonly referred to as block or X+Y, where X and Y indicate inpatient and ambulatory rotations, respectively) have grown in popularity as programs strive to reduce the conflict between inpatient and outpatient duties.1115  However, block scheduling can pose a challenge to preceptor-resident continuity in the ambulatory setting. Traditional clinic precepting models have preceptors attend in clinic on a fixed half-day per week. In a traditional resident schedule, where residents spend on average 1 half-day (ie, Thursday afternoon) in clinic most weeks regardless of rotation, they experienced continuity with the same attending on the same half-day over time. In an X+Y model, residents are in clinic for 1 or more weeks at a time. If traditional precepting continues in the X+Y model, residents work with many different preceptors during their clinic weeks, and preceptors are likewise exposed to and responsible for evaluating many different residents. In an attempt to improve resident and preceptor continuity, some programs have adopted a new model of precepting. In this model, 1 preceptor precepts a cohort of residents on the majority of their days in clinic (resident-matched schedule), and preceptors on a traditional schedule fill gaps a few days per week. The resident-matched preceptor rotates onto a precepting week in an X+Y fashion, which is integrated into the schedule of his or her resident cohort.

The goal of our study was to assess preceptor and resident perceptions of the resident-matched and traditional models for precepting in the continuity clinic. We explored 5 domains: (1) the opportunity to form interpersonal relationships between residents and preceptors; (2) preceptor familiarity with residents' complex patients; (3) preceptor comfort with assessing milestone achievements; (4) the opportunity to discuss patients' results during and between clinic weeks; and (5) overall satisfaction with quality of care in resident clinic.

We hypothesized that residents and preceptors in the resident-matched model would be more likely to form interpersonal relationships than those in the traditional model. Interpersonal relationships are defined as knowing residents well enough to correctly identify their career goals and their learning needs for advancement. We also hypothesized that preceptors in the resident-matched model would be more familiar with residents' complex patients and would be more comfortable assessing residents on their milestone achievements. We hypothesized that residents may find it easier to reach out to resident-matched preceptors for discussions about patients' test results, and that preceptors in the resident-matched model would be more satisfied with the quality of care in the resident clinic (due to being more familiar with complex chronic patients). Finally, we hypothesized that some of these differences may lessen as the academic year progresses.

Study Design and Setting

Our study included 2 internal medicine resident continuity clinics at the University of Colorado (Lowry Clinic and Anschutz Clinic), and a single continuity clinic at the University of Vermont Medical Center (Burlington Adult Primary Care Clinic).

All the clinics operate within a 4+1 block-scheduling model. The Lowry and Burlington clinics have a resident-matched preceptor model, and the Anschutz clinic has a traditional model. A pictorial description of the 2 precepting models is shown in the figure. The Burlington clinic started the resident-matched model in June 2012, and the Lowry Clinic started it in June 2014. The preceptors in the resident-matched model supervise an average of 5 (out of 8) clinic sessions per week and remain with the same resident cohort on successive rotations. In the traditional model, preceptors are scheduled to precept 1 to 2 clinic sessions per week. They are in the clinic on days when the resident-matched preceptors are not, and may co-precept with their resident-matched colleagues. In the traditional model, faculty precepts 1 to 2 clinic sessions per week throughout the year regardless of resident schedule. There were 10 clinic weeks per year in both models.

figure

Comparison of Resident-Matched and Traditional Models

figure

Comparison of Resident-Matched and Traditional Models

Close modal

A total of 97 residents and 44 preceptors (10 resident matched, 34 traditional) worked in the 3 clinics (table 1). The authors created the preceptor and resident surveys, and did not further test these instruments. The web-based surveys included definitions of resident-matched and traditional preceptors, basic demographic information, and Likert scale questions (1, strongly disagree, to 5, strongly agree) regarding perceptions of each of the 5 domains previously described. All sites were surveyed in December 2014 (survey 1 at 6 months) and again in May 2015 (survey 2 at approximately 1 year), using the same questions. The purpose of the second survey was to evaluate whether the perceptions of preceptors and residents changed over time. Both residents and preceptors completed the voluntary, anonymous survey via e-mail.

table 1

Characteristics of Each Resident Continuity Clinic

Characteristics of Each Resident Continuity Clinic
Characteristics of Each Resident Continuity Clinic

The Institutional Review Board at each academic medical center declared the study to be exempt.

Statistical Analysis

To analyze differences between the resident-matched and traditional precepting models, we used the Wilcoxon rank sum test. Because the surveys were anonymous, it was not possible to link the survey 1 and survey 2 responses for individual respondents, and results for the 2 time points were analyzed separately. Results were analyzed using SAS version 9.4 (SAS Institute Inc, Cary, NC). We did not correct for multiple comparisons.

Survey 1: 6 Months Into Academic Year

There were 26 of 44 preceptor survey responses (59%) and 75 of 97 resident responses (77%) to the first survey (6 months into the academic year) that depict the data from preceptors and residents from survey 1. Resident-matched preceptors reported feeling more familiar with the residents' complex patients (4.00 ± 0.76 versus 2.88 ± 1.23, P = .048) and more comfortable accurately assessing residents' achievement of milestones (4.38 ± 0.52 versus 3.72 ± 0.67, P = .017) than traditional preceptors (table 2a). Both groups gave low ratings to the opportunity to discuss patient results between clinic weeks. There was no difference seen in perception of the quality of care.

table 2a

Survey 1: Faculty Perceptions—Resident-Matched Versus Traditional Comparisons

Survey 1: Faculty Perceptions—Resident-Matched Versus Traditional Comparisons
Survey 1: Faculty Perceptions—Resident-Matched Versus Traditional Comparisons

Table 2b shows resident data at 6 months. Residents gave mean Likert ratings of 4 or above to the opportunity to develop interpersonal relationships with preceptors; knowing preceptor practice preferences and teaching styles; preceptor familiarity with complex patients; preceptors having adequate exposure to assess resident performance; and to their satisfaction with the ability to follow up with preceptors during the clinic week—with no significant differences between residents in resident-matched and traditional model settings. Ratings of the ability to follow up with preceptors between clinic weeks was low for both groups, though significantly higher for residents in the resident-matched model (3.21 ± 1.00 versus 2.42 ± 0.92, P = .001).

table 2b

Survey 1: Resident Perceptions—Resident-Matched Versus Traditional Comparisons

Survey 1: Resident Perceptions—Resident-Matched Versus Traditional Comparisons
Survey 1: Resident Perceptions—Resident-Matched Versus Traditional Comparisons

Survey 2: At the End of 1 Academic Year

There were 19 of 44 preceptor responses (43% response rate) and 57 of 97 resident responses (59% response rate) for the second survey at the end of 1 year. Table 3a provides preceptor results. Preceptors in the resident-matched model continued to feel more familiar with the residents' complex chronic patients (4.00 ± 0.00 versus 2.71 ± 0.91, P = .022). There was no difference between the 2 groups in perceived ability to assess residents' milestones. Both groups gave low ratings to the opportunity to discuss patient results between clinic weeks.

table 3a

Survey 2: Faculty Perceptions—Resident-Matched Versus Traditional Comparisons

Survey 2: Faculty Perceptions—Resident-Matched Versus Traditional Comparisons
Survey 2: Faculty Perceptions—Resident-Matched Versus Traditional Comparisons

Table 3b shows the resident survey results at the end of 1 year. Trainees in the resident-matched model perceived their preceptors were more familiar with their chronic complex patients than residents in the traditional model (4.32 ± 0.88 versus 3.63 ± 1.02, P = .013). Residents gave ratings of 4 and above to the opportunity to develop interpersonal relationships with preceptors; to know preceptor practice preferences and teaching styles; to having adequate preceptor exposure to inform assessment; and to the ability to follow up with preceptors during clinic weeks, with no significant differences between the resident-matched and traditional groups. Ratings of the ability to follow up between clinic weeks were low and, unlike results at 6 months, showed no difference between groups.

table 3b

Survey 2: Resident Perceptions—Resident-Matched Versus Traditional Comparisons

Survey 2: Resident Perceptions—Resident-Matched Versus Traditional Comparisons
Survey 2: Resident Perceptions—Resident-Matched Versus Traditional Comparisons

After the first 6 months of the academic year, preceptors in the resident-matched model perceived themselves to be more comfortable accurately assessing residents' milestone achievements and to be more familiar with the residents' chronic complex patients than preceptors in the traditional model. At 1 year, the only persistent difference was that preceptors and residents in the resident-matched model perceived preceptors to be more familiar with the residents' chronic complex patients.

Our finding that preceptors in the resident-matched model felt more comfortable accurately assessing residents' milestones at 6 months is important, because identifying learners who may need remediation is important to patient safety and eventual resident success. This difference did not persist at 1 year, which may reflect preceptors in the traditional model becoming more familiar with the residents as the year progresses.

A second finding is that preceptors in the resident-matched model perceived greater familiarity with the residents' chronic complex patients, a finding that was corroborated by the resident survey. Attending familiarity with patients could prove relevant for the quality and cost-effectiveness of care patients receive. Such informational continuity has been associated with increased patient satisfaction.1618  Residents' ability to discuss results may lead to improved diagnostic closure and enhance diagnostic reasoning,19  and lower than anticipated performance in this area should be further explored.

Our study has limitations. The reduced preceptor response rate in survey 2, the inability to pair responses between survey periods, and the small number of preceptors in the resident-matched model limit the power to detect potentially meaningful differences between the 2 models. Some of the significant findings may be spurious, as no correction was made for multiple associations. Our survey assessed perceptions, and questions may not have been interpreted by respondents as intended, as no validity evidence was collected.

Studies with larger sample sizes and those that occur over a longer duration should investigate the impact of the new precepting model on learner and patient outcomes including quality metrics and patient satisfaction.

A resident-matched preceptor model produced perceptions of greater familiarity of preceptors with complex patients over 1 year, in comparison with a traditional model. In the resident-matched model, preceptors felt better prepared to assess residents' milestones at 6 months, although not at 1 year.

1
Aagaard
E,
Kane
GC,
Conforti
L,
et al.
Early feedback on the use of the internal medicine reporting milestones in assessment of resident performance
.
J Grad Med Educ
.
2013
;
5
(
3
):
433
438
.
2
Green
ML,
Aagaard
EM,
Caverzagie
KJ,
et al.
Charting the road to competence: developmental milestones for internal medicine residency training
.
J Grad Med Educ
.
2009
;
1
(
1
):
5
20
.
3
Bowen
JL,
Hirsh
D,
Aagaard
E,
et al.
Advancing educational continuity in primary care residencies: an opportunity for patient-centered medical homes
.
Acad Med
.
2015
;
90
(
5
):
587
593
.
4
Willett
LL,
Estrada
CA,
Adams
M,
et al.
Challenges with continuity clinic and core faculty accreditation requirements
.
Am J Med
.
2013
;
126
(
6
):
550
556
.
5
Holmboe
ES,
Bowen
JL,
Green
M,
et al.
Reforming internal medicine residency training. A report from the Society of General Internal Medicine's task force for residency reform
.
J Gen Intern Med
.
2005
;
20
(
12
):
1165
1172
.
6
Holmboe
ES,
Ward
DS,
Reznick
RK,
et al.
Faculty development in assessment: the missing link in competency-based medical education
.
Acad Med
.
2011
;
86
(
4
):
460
467
.
7
Warm
EJ,
Held
JD,
Hellmann
M,
et al.
Entrusting observable practice activities and milestones over the 36 months of an internal medicine residency
.
Acad Med
.
2016
;
91
(
10
):
1398
1405
.
8
Meyers
FJ,
Weinberger
SE,
Fitzgibbons
JP,
et al.
Redesigning residency training in internal medicine: the consensus report of the Alliance for Academic Internal Medicine Education Redesign Task Force
.
Acad Med
.
2007
;
82
(
12
):
1211
1219
.
9
Kogan
JR,
Conforti
LN,
Yamazaki
K,
et al.
Commitment to change and challenges to implementing changes after workplace-based assessment rater training
.
Acad Med
.
2016
;
92
(
3
):
394
402
.
10
Accreditation Council for Graduate Medical Education; American Board of Internal Medicine
.
The Internal Medicine Milestone Project
. ,
2017
.
11
Chaudhry
SI,
Balwan
S,
Friedman
KA,
et al.
Moving forward in GME reform: a 4 + 1 model of resident ambulatory training
.
J Gen Intern Med
.
2013
;
28
(
8
):
1100
1104
.
12
Mariotti
JL,
Shalaby
M,
Fitzgibbons
JP.
The 4:1 schedule: a novel template for internal medicine residencies
.
J Grad Med Educ
.
2010
;
2
(
4
):
541
547
.
13
Heist
K,
Guese
M,
Nikels
M,
et al.
Impact of 4 + 1 block scheduling on patient care continuity in resident clinic
.
J Gen Intern Med
.
2014
;
29
(
8
):
1195
1199
.
14
Francis
MD,
Thomas
K,
Langan
M,
et al.
Clinic design, key practice metrics, and resident satisfaction in internal medicine continuity clinics: findings of the educational innovations project ambulatory collaborative
.
J Grad Med Educ
.
2014
;
6
(
2
):
249
255
.
15
Francis
MD,
Wieland
ML,
Drake
S,
et al.
Clinic design and continuity in internal medicine resident clinics: findings of the Educational Innovations Project Ambulatory Collaborative
.
J Grad Med Educ
.
2015
;
7
(
1
):
36
41
.
16
Saultz
JW.
Defining and measuring interpersonal continuity of care
.
Ann Fam Med
.
2003
;
1
(
3
):
134
143
.
17
Saultz
JW,
Albedaiwi
W.
Interpersonal continuity of care and patient satisfaction: a critical review
.
Ann Fam Med
.
2004
;
2
(
5
):
445
451
.
18
Saultz
JW,
Lochner
J.
Interpersonal continuity of care and care outcomes: a critical review
.
Ann Fam Med
.
2005
;
3
(
2
):
159
166
.
19
Bowen
JL.
Educational strategies to promote clinical diagnostic reasoning
.
N Engl J Med
.
2006
;
355
(
21
):
2217
2225
.

Author notes

Funding: The authors report no external funding source for this study.

Competing Interests

Conflict of interest: Dr Aagaard receives small stipends from the American Board of Internal Medicine and the National Board of Medical Examiners for board-related work.

This study was presented as a poster at the Society of General Internal Medicine New England Regional Meeting, Boston, Massachusetts, March 11, 2016; as a poster at the Society of General Internal Medicine National Meeting, Hollywood, Florida, May 10, 2016; and as an oral presentation at the University of Vermont Teaching Academy Mud Season Retreat, Burlington, Vermont, April 14–15, 2016.

Supplementary data