ABSTRACT
Some internal medicine residency programs on X+Y schedules have modified clinic preceptor schedules to mimic those of the resident cohort (resident matched). This is in contrast to a traditional model, in which preceptors supervise on the same half-day each week.
We assessed preceptor and resident perceptions of the 2 precepting models.
We surveyed 44 preceptors and 97 residents at 3 clinic sites in 2 academic medical centers. Two clinics used the resident-matched model, and 1 used a traditional model. Surveys were completed at 6 months and 1 year. We assessed resident and preceptor perceptions in 5 domains: relationships between residents and preceptors; preceptor familiarity with complex patients; preceptor ability to assess milestone achievements; ability to follow up on results; and quality of care.
There was no difference in perceptions of interpersonal relationships or satisfaction with patient care. Preceptors in the resident-matched schedule reported they were more familiar with complex patients at both 6 months and 1 year, and felt more comfortable evaluating residents' milestone achievements at 6 months, but not at 1 year. At 1 year, residents in the resident-matched model perceived preceptors were more familiar with complex patients than residents in the traditional model. The ability to discuss patient results between clinic weeks was low in both models.
The resident-matched model increased resident and preceptor perceptions of familiarity with complex patients and early preceptor perceptions of comfort in assessment of milestone achievements.
What was known and gap
Internal medicine ambulatory clinic block scheduling that enhances educational continuity for residents disrupts continuity with faculty if traditional 1-day-a-week faculty schedules are maintained.
What is new
A new approach to faculty preceptor scheduling that mirrors block scheduling of the residents.
Limitations
Low response rate; survey without validity evidence; assessment limited to perceptions.
Bottom line
The new resident-matched model increased resident and preceptor perceptions of familiarity with complex patients, and preceptor perceptions of comfort in assessing residents on milestones early in the academic year.
Introduction
The ambulatory clinic has long been a key venue for clinical continuity for internal medicine residents, and allows for relationships between patients, preceptors, and interprofessional teams. Continuity between residents and preceptors is important to learner development and patient care.1–4 Competency-based education and workplace-based assessment have focused attention on preceptor-resident relationships that enable direct observation, effective assessment, and graduated skill development.5–10 Ambulatory preceptors who follow a small group of learners longitudinally over the course of residency may offer a relationship that provides a level of observation and assessment necessary for optimal evaluation.
Newer models of scheduling that separate inpatient and ambulatory rotations (commonly referred to as block or X+Y, where X and Y indicate inpatient and ambulatory rotations, respectively) have grown in popularity as programs strive to reduce the conflict between inpatient and outpatient duties.11–15 However, block scheduling can pose a challenge to preceptor-resident continuity in the ambulatory setting. Traditional clinic precepting models have preceptors attend in clinic on a fixed half-day per week. In a traditional resident schedule, where residents spend on average 1 half-day (ie, Thursday afternoon) in clinic most weeks regardless of rotation, they experienced continuity with the same attending on the same half-day over time. In an X+Y model, residents are in clinic for 1 or more weeks at a time. If traditional precepting continues in the X+Y model, residents work with many different preceptors during their clinic weeks, and preceptors are likewise exposed to and responsible for evaluating many different residents. In an attempt to improve resident and preceptor continuity, some programs have adopted a new model of precepting. In this model, 1 preceptor precepts a cohort of residents on the majority of their days in clinic (resident-matched schedule), and preceptors on a traditional schedule fill gaps a few days per week. The resident-matched preceptor rotates onto a precepting week in an X+Y fashion, which is integrated into the schedule of his or her resident cohort.
The goal of our study was to assess preceptor and resident perceptions of the resident-matched and traditional models for precepting in the continuity clinic. We explored 5 domains: (1) the opportunity to form interpersonal relationships between residents and preceptors; (2) preceptor familiarity with residents' complex patients; (3) preceptor comfort with assessing milestone achievements; (4) the opportunity to discuss patients' results during and between clinic weeks; and (5) overall satisfaction with quality of care in resident clinic.
We hypothesized that residents and preceptors in the resident-matched model would be more likely to form interpersonal relationships than those in the traditional model. Interpersonal relationships are defined as knowing residents well enough to correctly identify their career goals and their learning needs for advancement. We also hypothesized that preceptors in the resident-matched model would be more familiar with residents' complex patients and would be more comfortable assessing residents on their milestone achievements. We hypothesized that residents may find it easier to reach out to resident-matched preceptors for discussions about patients' test results, and that preceptors in the resident-matched model would be more satisfied with the quality of care in the resident clinic (due to being more familiar with complex chronic patients). Finally, we hypothesized that some of these differences may lessen as the academic year progresses.
Methods
Study Design and Setting
Our study included 2 internal medicine resident continuity clinics at the University of Colorado (Lowry Clinic and Anschutz Clinic), and a single continuity clinic at the University of Vermont Medical Center (Burlington Adult Primary Care Clinic).
All the clinics operate within a 4+1 block-scheduling model. The Lowry and Burlington clinics have a resident-matched preceptor model, and the Anschutz clinic has a traditional model. A pictorial description of the 2 precepting models is shown in the figure. The Burlington clinic started the resident-matched model in June 2012, and the Lowry Clinic started it in June 2014. The preceptors in the resident-matched model supervise an average of 5 (out of 8) clinic sessions per week and remain with the same resident cohort on successive rotations. In the traditional model, preceptors are scheduled to precept 1 to 2 clinic sessions per week. They are in the clinic on days when the resident-matched preceptors are not, and may co-precept with their resident-matched colleagues. In the traditional model, faculty precepts 1 to 2 clinic sessions per week throughout the year regardless of resident schedule. There were 10 clinic weeks per year in both models.
A total of 97 residents and 44 preceptors (10 resident matched, 34 traditional) worked in the 3 clinics (table 1). The authors created the preceptor and resident surveys, and did not further test these instruments. The web-based surveys included definitions of resident-matched and traditional preceptors, basic demographic information, and Likert scale questions (1, strongly disagree, to 5, strongly agree) regarding perceptions of each of the 5 domains previously described. All sites were surveyed in December 2014 (survey 1 at 6 months) and again in May 2015 (survey 2 at approximately 1 year), using the same questions. The purpose of the second survey was to evaluate whether the perceptions of preceptors and residents changed over time. Both residents and preceptors completed the voluntary, anonymous survey via e-mail.
The Institutional Review Board at each academic medical center declared the study to be exempt.
Statistical Analysis
To analyze differences between the resident-matched and traditional precepting models, we used the Wilcoxon rank sum test. Because the surveys were anonymous, it was not possible to link the survey 1 and survey 2 responses for individual respondents, and results for the 2 time points were analyzed separately. Results were analyzed using SAS version 9.4 (SAS Institute Inc, Cary, NC). We did not correct for multiple comparisons.
Results
Survey 1: 6 Months Into Academic Year
There were 26 of 44 preceptor survey responses (59%) and 75 of 97 resident responses (77%) to the first survey (6 months into the academic year) that depict the data from preceptors and residents from survey 1. Resident-matched preceptors reported feeling more familiar with the residents' complex patients (4.00 ± 0.76 versus 2.88 ± 1.23, P = .048) and more comfortable accurately assessing residents' achievement of milestones (4.38 ± 0.52 versus 3.72 ± 0.67, P = .017) than traditional preceptors (table 2a). Both groups gave low ratings to the opportunity to discuss patient results between clinic weeks. There was no difference seen in perception of the quality of care.
Table 2b shows resident data at 6 months. Residents gave mean Likert ratings of 4 or above to the opportunity to develop interpersonal relationships with preceptors; knowing preceptor practice preferences and teaching styles; preceptor familiarity with complex patients; preceptors having adequate exposure to assess resident performance; and to their satisfaction with the ability to follow up with preceptors during the clinic week—with no significant differences between residents in resident-matched and traditional model settings. Ratings of the ability to follow up with preceptors between clinic weeks was low for both groups, though significantly higher for residents in the resident-matched model (3.21 ± 1.00 versus 2.42 ± 0.92, P = .001).
Survey 2: At the End of 1 Academic Year
There were 19 of 44 preceptor responses (43% response rate) and 57 of 97 resident responses (59% response rate) for the second survey at the end of 1 year. Table 3a provides preceptor results. Preceptors in the resident-matched model continued to feel more familiar with the residents' complex chronic patients (4.00 ± 0.00 versus 2.71 ± 0.91, P = .022). There was no difference between the 2 groups in perceived ability to assess residents' milestones. Both groups gave low ratings to the opportunity to discuss patient results between clinic weeks.
Table 3b shows the resident survey results at the end of 1 year. Trainees in the resident-matched model perceived their preceptors were more familiar with their chronic complex patients than residents in the traditional model (4.32 ± 0.88 versus 3.63 ± 1.02, P = .013). Residents gave ratings of 4 and above to the opportunity to develop interpersonal relationships with preceptors; to know preceptor practice preferences and teaching styles; to having adequate preceptor exposure to inform assessment; and to the ability to follow up with preceptors during clinic weeks, with no significant differences between the resident-matched and traditional groups. Ratings of the ability to follow up between clinic weeks were low and, unlike results at 6 months, showed no difference between groups.
Discussion
After the first 6 months of the academic year, preceptors in the resident-matched model perceived themselves to be more comfortable accurately assessing residents' milestone achievements and to be more familiar with the residents' chronic complex patients than preceptors in the traditional model. At 1 year, the only persistent difference was that preceptors and residents in the resident-matched model perceived preceptors to be more familiar with the residents' chronic complex patients.
Our finding that preceptors in the resident-matched model felt more comfortable accurately assessing residents' milestones at 6 months is important, because identifying learners who may need remediation is important to patient safety and eventual resident success. This difference did not persist at 1 year, which may reflect preceptors in the traditional model becoming more familiar with the residents as the year progresses.
A second finding is that preceptors in the resident-matched model perceived greater familiarity with the residents' chronic complex patients, a finding that was corroborated by the resident survey. Attending familiarity with patients could prove relevant for the quality and cost-effectiveness of care patients receive. Such informational continuity has been associated with increased patient satisfaction.16–18 Residents' ability to discuss results may lead to improved diagnostic closure and enhance diagnostic reasoning,19 and lower than anticipated performance in this area should be further explored.
Our study has limitations. The reduced preceptor response rate in survey 2, the inability to pair responses between survey periods, and the small number of preceptors in the resident-matched model limit the power to detect potentially meaningful differences between the 2 models. Some of the significant findings may be spurious, as no correction was made for multiple associations. Our survey assessed perceptions, and questions may not have been interpreted by respondents as intended, as no validity evidence was collected.
Studies with larger sample sizes and those that occur over a longer duration should investigate the impact of the new precepting model on learner and patient outcomes including quality metrics and patient satisfaction.
Conclusion
A resident-matched preceptor model produced perceptions of greater familiarity of preceptors with complex patients over 1 year, in comparison with a traditional model. In the resident-matched model, preceptors felt better prepared to assess residents' milestones at 6 months, although not at 1 year.
References
Author notes
Funding: The authors report no external funding source for this study.
Competing Interests
Conflict of interest: Dr Aagaard receives small stipends from the American Board of Internal Medicine and the National Board of Medical Examiners for board-related work.
This study was presented as a poster at the Society of General Internal Medicine New England Regional Meeting, Boston, Massachusetts, March 11, 2016; as a poster at the Society of General Internal Medicine National Meeting, Hollywood, Florida, May 10, 2016; and as an oral presentation at the University of Vermont Teaching Academy Mud Season Retreat, Burlington, Vermont, April 14–15, 2016.