ABSTRACT
Burnout is a common issue in internal medicine residents, and its impact on medical errors and professionalism is an important subject of investigation.
To evaluate differences in medical errors and professionalism in internal medicine residents with and without burnout.
A single institution observational cohort study was conducted between June 2011 and July 2012. Burnout was measured using the Maslach Burnout Inventory to generate subscores for the following 3 domains: emotional exhaustion, depersonalization, and sense of personal accomplishment. By convention, burnout was defined as a high emotional exhaustion or depersonalization subscore. Medication prescription error rate was the chosen measure of medical errors. Professionalism was measured cumulatively through examining discharge summaries completed within 48 hours, outpatient charts completed within 72 hours, and the average time to review outpatient laboratory tests.
Of a total of 54 eligible first-year residents, 53 (98%) and 32 (59%) completed the initial and follow-up surveys, respectively. Residents with year-end burnout had a lower rate of medication prescription errors (0.553 versus 0.780, P = .007). Discharge summaries completed within 48 hours of discharge (83.8% versus 84.0%, P = .93), outpatient charts completed within 72 hours of encounter (93.7% versus 94.3%, P = .31), and time (minutes) to review outpatient laboratory test results (72.3 versus 26.9, P = .28) were similar between residents with and without year-end burnout.
This study found a small decrease in medical errors in residents with year-end burnout compared to burnout-free residents and no difference in selected measures of professionalism.
Introduction
Burnout in internal medicine (IM) resident physicians occurs commonly1–3 and may lead to depression and suboptimal medical care.1,3 Recently, there has been increasing attention to medical errors4,5 and professionalism in physicians.6–8 The Accreditation Council for Graduate Medical Education (ACGME) has addressed these concerns by mandating core competencies in practice-based learning and improvement and professionalism.9
The relationship between resident burnout, medical errors, and professionalism remains uncertain. Most studies of this population have relied on self-reported data. Few have examined objective correlates of burnout. One study measuring objective outcomes found that, while depressed pediatrics residents made more medical errors than their nondepressed peers, burnout was not associated with increased medical errors.10 Self-perceived medical errors have been correlated with burnout in IM residents,11 and self-reported unprofessional conduct has been associated with burnout in medical students.12 We conducted a study to examine our hypothesis that burnout in first-year IM residents correlates with selected objective measures of medical errors and professionalism.
Methods
All 54 first-year IM residents at the Icahn School of Medicine at Mount Sinai between June 2011 and July 2012 were eligible for this study. Internal medicine interns received surveys containing basic demographic information and the Maslach Burnout Inventory (MBI). Surveys were distributed first during orientation in June 2011 and a second time at year-end meetings and clinical sessions between April and June 2012.
Burnout was quantified using the MBI. This tool includes 22 questions covering 3 domains: emotional exhaustion, depersonalization, and sense of personal accomplishment. By convention, we defined burnout as a high emotional exhaustion or high depersonalization subscore using the MBI scaling algorithm. The instrument has some validity evidence for this population, setting, and purpose, based on a previously published study of 1104 medical personnel. It is commonly used for measuring burnout in medical trainees.13
We chose to measure inpatient medication prescription errors among first-year IM residents. Based on definitions from the published literature, prescription errors were defined as medication orders with the potential to cause adverse drug events.10 If followed, these medication orders may lead to dangerous interactions, inappropriate dosing, and incorrect or duplicate administration. At our hospital, a pharmacist reviews all electronic medication orders prior to dispensing medications and annotates orders that require additional clarification for safety. We reviewed all annotated orders by IM residents in our study and tallied those that had potential to cause an adverse drug event. This was measured per resident as a rate per 100 prescriptions.
Professionalism was assessed through 3 quality metrics: the percentage of inpatient discharge summaries completed within 48 hours of discharge; the percentage of outpatient charts completed within 72 hours of encounter; and the time to review outpatient laboratory studies in the electronic health record once resulted. The rationale for using these variables is that our residents are aware of the expectation to address these measures and should know that failure to do so would constitute an example of unprofessional behavior.
The authors obtained approval from our institution's Human Subject Research Review Board.
Our error and professionalism results were collected cumulatively between July 1, 2011, and June 30, 2012, and were compared between residents with and without burnout at the end of the study period. SAS statistical software version 9.3 for Windows (SAS Institute Inc, Cary, NC) was used to conduct t test comparisons to identify statistically significant differences between burnout and nonburnout groups after a Bonferroni correction (P < .013).
Results
Of the 54 eligible first-year residents, 53 (98%) completed an initial survey and 32 (59%) completed a follow-up survey. Burnout prevalence was 36% (19 of 53) at the beginning of intern year and 75% (24 of 32) at year-end.
We found a significant correlation (figure) between the cumulative rate of medication prescription errors and year-end burnout. Residents with year-end burnout had a lower cumulative error rate relative to their burnout-free counterparts (0.553 versus 0.780, P = .007).
Medication Prescription Error Rates Measured Per 100 Prescriptions
Note: Bars distinguish between internal medicine residents without burnout (dark) and with burnout (light) at year-end.
Medication Prescription Error Rates Measured Per 100 Prescriptions
Note: Bars distinguish between internal medicine residents without burnout (dark) and with burnout (light) at year-end.
Residents with year-end burnout showed no significant differences (table) in the 3 measured domains of professionalism, compared with their burnout-free counterparts: percentage of discharge summaries completed within 48 hours of discharge (83.8% [1027 of 1225] versus 84.0% [363 of 432], P = .93); percentage of outpatient clinic charts closed within 72 hours of patient encounter (93.7% [4545 of 4853] versus 94.3% [1650 of 1749], P = .31); and time (minutes) to review outpatient diagnostic studies (72.3 versus 26.9, P = .28).
We found similar results in the relationship between our cumulative performance measures and burnout measured at the onset of residency. There were also no differences noted when comparing residents who started and remained burnout-free with residents who began burnout-free and developed burnout over the course of the year.
Discussion
To the best of our knowledge, this is the first study examining the effect of burnout on objective medical errors and professionalism in IM residents. We found no correlation between resident burnout and our chosen measures of professionalism. Burnout was associated with a small decrease in the rate of medical errors; however, the rate was so low that the clinical significance is unclear. Our findings differ with other studies that found either no correlation10 or an increased rate of self-reported medical errors in burnt-out IM residents.3,11
One explanation for our findings is our chosen definition of medical errors. Other studies have defined medical errors as adverse events directly affecting patient care or related to errors in judgment.14–16 We chose our measure based on a preexisting pharmacy annotation system that tracked potential medication errors. Another hypothesis to consider in future studies is the possibility that committing medical errors can lead to stress and burnout.
One possibility for the lack of an observed correlation between burnout and professionalism is the adequacy of our professionalism assessment. There are many tools to assess professionalism.17,18 The 360 evaluation, for instance, utilizes multidisciplinary assessments to evaluate resident performance and has the potential for use in future research.19,20 Another possibility is that professionalism might be a characteristic that degrades last when residents experience burnout.21 There could also exist a relationship between burnout and professionalism in which unprofessional behavior leads to burnout. Our results could also represent a true finding: burnout in IM residents is not associated with increased medical errors or unprofessional behaviors.
Our study also showed a high rate of burnout at the onset of internship in IM residents. This finding is consistent with results in previous studies involving interns and fourth-year medical students.22,23
Limitations of our investigation include a small study population, single center study site, and loss of nearly 50% of the study to follow-up. We also observed a high burnout rate that limited our analysis due to the small burnout-free comparison group. Another limitation relates to the MBI, which in measuring depersonalization may actually detect a normal healthy amount of emotional detachment that young physicians need to develop in order to become effective providers. The instrument may therefore overestimate burnout in this population.1,2,21 Future study efforts that improve survey response rates might address this issue.
Conclusion
Our study found a small decrease in medical errors in residents with burnout compared to burnout-free residents; however, there was no difference in selected measures of professionalism. Future studies will likely benefit from larger, more diverse, multicenter investigations that examine additional objective measures.
References
Author notes
Funding: This study was supported by the Division of General Internal Medicine in the Department of Medicine at the Icahn School of Medicine at Mount Sinai.
Competing Interests
Conflict of interest: The authors declare they have no competing interests.
These data were presented in 2 oral presentations at the 37th Annual Meeting of the Society of General Internal Medicine, San Diego, California, April 23–26, 2014.