Abstract
Frequent missed patient appointments in resident continuity clinic is a well-documented problem, but whether rates of missed appointments are disproportionate to standard academic practice, what patient factors contribute to these differences, and health care outcomes of patients who frequently miss appointments are unclear.
The overall population for the study was composed of patients in an academic internal medicine continuity clinic with 5 or more office visits between January 2006 and December 2008. We randomly selected 325 patients seen by resident physicians and 325 patients cared for by faculty. Multivariate linear regression was used to examine the relationship between patient factors and missed appointments. Health outcomes were compared between patients with frequent missed appointments and the remainder of the study sample, using Cox regression analysis.
Resident patients demonstrated significantly higher rates of missed appointments than faculty patients, but this difference was explained by patient factors. Factors associated with more missed appointments included use of a medical interpreter, Medicaid insurance, more frequent emergency department visits, less time impanelled in the practice, and lower proportion of office visits with the primary care provider. Patients with frequent missed appointments were less likely to be up to date with preventive health services and more likely to have poorly controlled blood pressure and diabetes.
We found that the disproportionate frequency of missed appointments in resident continuity clinic is explained by patient factors and practice discontinuity, and that patients with frequent missed appointments demonstrated worse health care outcomes.
Introduction
Continuity clinic is a mandatory component of resident education to allow residents to learn outpatient disease management in the context of prevention and health promotion, while providing them opportunity to build longitudinal relationships with their patients.1 Missed patient appointments in continuity clinic is a well-documented problem, resulting in discontinuity, disrupted schedules, and lost learning opportunities for residents to see the outcome of their treatment plans.2–7 Whether rates of missed appointments are disproportionate to standard academic practice, and what patient factors (if any) contribute to these differences is not clear.
Previous studies have demonstrated that patients who frequently miss appointments tend to be younger, of lower socioeconomic status, have a history of missed appointments, and have government-provided insurance.8–11 Yet little is known about the health care outcomes of patients who frequently miss appointments. We compared missed appointment rates in resident and faculty primary care practices, evaluated patient characteristics associated with missed appointments, and ascertained health care outcomes of patients with frequent missed appointments. These results will be used to inform quality improvement initiatives aimed at reducing rates of missed appointments in continuity clinic.
Methods
Setting and Study Sample
This study was conducted in the primary care internal medicine (PCIM) clinics at Mayo Clinic Rochester, an academic practice where patients are assigned to either a faculty member or resident as their primary care provider. PCIM includes 38 faculty physicians and 96 internal medicine residents, divided equally across all 3 years of training, who collectively care for more than 39 000 patients. Faculty physicians spend most of their time seeing their own impanelled patients, and most supervise resident continuity clinic one half-day per week. During the study interval, each resident saw patients in clinic one half-day per week for 10 months of the year plus burst continuity experiences for 1 month during his or her first and third years. Residents have a 93% fill rate and see an average of 157 patients in an academic year (3.6 visits per half-day).
After approval by the Institutional Review Board, all PCIM patients who had 5 or more office visits between January 1, 2006, and December 31, 2008, were identified, and subsets of 325 patients impanelled to resident providers and 325 patients impanelled to faculty providers were randomly selected for evaluation. A missed appointment was defined as a scheduled PCIM visit that was neither attended by the patient nor previously canceled. The number of missed appointments, demographic information, patient characteristics, and practice characteristics of this sample were retrieved by manual chart review.
Health Outcome Measurements
Three health outcome domains were evaluated in the study sample: completion of age-appropriate preventive health services, glycemic control among patients with diabetes, and blood pressure control. Age-appropriate preventative services as recommended by the US Preventive Services Task Force12 were extracted by chart review. Patients who lacked at least 2 of these preventive services as of December 30, 2008, were defined as not being up to date. At the time of the study, the American Diabetes Association recommended glycemic control to target hemoglobin A1c (HgbA1c) <7%.13 We defined poor diabetic control as having at least 2 HgbA1c >7% during the time period 2006–2008. Poorly controlled blood pressure was defined as having at least 2 separate systolic pressures ≥160 and/or diastolic pressures ≥100 (stage 2 hypertension).14
Statistical Analysis
Baseline characteristics were compared between faculty and resident patients using the Student t test. Linear multiple regression analysis was performed to compare the rate of missed appointments between the faculty and resident patients, controlling patient characteristics. Patients who missed appointments ≥20% of the time or had ≥5 missed appointments during the study interval were characterized as a “frequent missed appointments” group. Health outcomes were compared between the frequent missed appointments group and the remainder of the study sample using Cox regression analysis.
Results
Comparison of Missed Appointments Between Resident and Faculty Patients
Resident patients demonstrated significantly higher rates of missed appointments than faculty patients (table 1). Resident patients were younger than faculty patients, more likely to have Medicaid insurance, and more likely to require a medical interpreter. Resident patients' office visits were less likely to be with their primary care provider than faculty patients' visits, and resident patients were more likely to have a shorter affiliation with the PCIM clinic. Resident patients had more emergency department visits during the study interval, but the number of hospitalizations and number of active prescriptions were statistically similar between the 2 groups (table 1).
Associations Between Patient Characteristics and Missed Appointments
Patient factors associated with higher frequency of missed appointments included use of a medical interpreter, Medicaid insurance, and more frequent emergency department visits (table 2). Patient factors associated with lower frequency of missed appointments included longer affiliation with the PCIM clinic and higher proportion of office visits with the primary care provider (table 2). After adjustment for the above, there was no difference in rates of missed appointments between the resident and faculty practices (table 3).
Comparison of Demographics, Practice Characteristics, and Health Care Outcomes Between Patients With Frequent Missed Appointments and the Remainder of the Study Sample

Associations Between Missed Appointments and Health Outcomes
Of the 650 patients in the study, 228 (35%) were identified as those with frequent missed appointments (missed appointments ≥20% of the time or ≥5 missed appointments during the study interval; table 2). These patients were less likely to be up to date with age-appropriate preventive health services. Among the 166 patients with a diagnosis of diabetes, patients with frequent missed appointments were more likely to have HgbA1c >7. Finally, among 279 patients with a diagnosis of hypertension, patients with frequent missed appointments were more likely to have poor blood pressure control (table 4).
Discussion
Despite sharing similar clinical practice parameters and allied health staff, the resident practice had a much higher rate of missed appointments compared with the faculty practice. The high rate of missed appointments in resident continuity clinic is consistent with previous reports, but the comparison with a faculty practice adds to the literature by demonstrating that the difference in missed appointments between the 2 practices is explained by patient factors. Differences in patient characteristics between resident and faculty practices are well documented nationally, such that socioeconomic position of resident patients tends to be lower than for faculty practice patients.15–17 The reasons for these discrepancies are not clear, but may include the notion that faculty practices are more likely to be at capacity, thereby shifting new and less socioeconomically stable patients to resident panels. Further, patients with higher socioeconomic position may be more likely to request a faculty provider.
It is essential that clinic support for these patients and their resident providers are optimized. First, support for comprehensive outpatient care (eg, allied health staff services) should be equally robust between the resident and faculty practices.18 Second, resident continuity clinic redesign should maximize access to and utilization of evidence-based multidisciplinary models of care for their patients (eg, medical home).19 Finally, resident education and mentorship regarding the care of vulnerable populations should permeate the continuity clinic experience,20,21 particularly in the context of low knowledge among residents about factors affecting underserved patients22 and waning attitudes toward these populations as training proceeds.23
Consistent with prior reports,7–10 our study demonstrated that patients who required an interpreter and have government-provided health insurance missed more appointments to continuity clinic. Our study adds to this literature by demonstrating that patients with frequent missed appointments are less likely to have a long-term relationship with their primary care practice, have a lower proportion of visits with their own physician, and are more likely to visit the emergency department. Barriers to completing medical appointments among these patient populations have been inadequately explored in the literature. Qualitative studies among patients who frequently miss appointments have identified transportation, wait times, not knowing the reason for the appointment, competing priorities, inefficiencies with the booking system, and perceived disrespect as barriers to keeping appointments.9,10
Interventions with success at reducing rates of missed appointments include reminders through mail and phone,24,25 text message reminders,26 and orientation to the clinic.27 Testing of interventions aimed specifically at improving rates of missed appointments in resident continuity clinic is needed. In addition to reminder mechanisms, our findings suggest that recent trends toward redesign of resident continuity clinic practices aimed at enhancing provider or team continuity with patients may reduce rates of missed appointments.28
We found that patients with frequent missed appointments were less likely to have received preventive health services and more likely to have poorly controlled hypertension and diabetes. Two earlier studies also correlated missed appointments with worse glycemic control and medication adherence among patients with diabetes.29,30 Although these associations are not likely to be causal, a high rate of missed appointments may serve as a useful barometer of barriers to self-care. This easily measured variable may help identify patients most likely to benefit from case management. Prior attempts to identify patients for case management have focused on surrogates for medical complexity (eg, age, number of active medications, number of diagnoses, etc).31,32 This may leave out socioeconomically disadvantaged patients with chronic illness who may benefit from case management to remove barriers to keeping appointments and adhering to treatment plans.
Limitations of our study include its retrospective, observational nature, and the availability of particular variables for analysis. Causality among variables cannot be implied. Our single-center findings may not be generalized to other academic practices. Although differences in resident and faculty practice demographics are consistent with other reports, the rate of missed appointments in our sample is lower than in previous studies.
Conclusion
We found that the disproportionate frequency of missed appointments in resident continuity clinic is explained by patient factors and practice continuity, and that a high rate of missed appointments predicts worse health care outcomes. These findings emphasize the importance of further exploratory studies aimed at identifying barriers to attending appointments and testing of interventions at the level of residents, patients, and continuity clinic systems to further address these behaviors.
References
Author notes
All authors are in the Division of Primary Care Internal Medicine, Mayo Clinic College of Medicine. Douglas L. Nguyen, MD, is Instructor in Medicine; Ramona S. DeJesus, MD, is Assistant Professor of Medicine; and Mark L. Wieland, MD, MPH, is Assistant Professor of Medicine.
The authors would like to thank primary care internal medicine (PCIM) office staff Susan Claxton and Cami McElmury for their assistance in the data collection process. This work was at presented at the 2010 National American College of Physicians Meeting in Toronto, Canada.
Funding: The authors report no external funding source.