Background

Medical error is a major cause of preventable morbidity and mortality. Resident fatigue is likely to be a significant contributor.

Objectives

We calculated and compared predicted fatigue impairment in surgical residents on varying schedules by using the validated Sleep, Activity, Fatigue, and Task Effectiveness model and Fatigue Avoidance Scheduling Tool; we identified specific times of day and rotations during which residents were most affected, instituted countermeasures, and measured the predicted response.

Methods

We compared 4 scheduling patterns: day shift, trauma shift, night shift, and prework hour restriction Q3 call (or every-third-night call). The dependent variables were mean daily effectiveness while at work and the percentage of time residents worked with critical fatigue impairment (defined as an effectiveness score of less than 70 correlated with an increased risk for error and a blood alcohol content of 0.08). Fatigue countermeasures (ie, a 30-minute nap, eliminating 24-hour shifts) were applied to rotations with significant impairment to determine impairment plasticity.

Results

Calculated mean effectiveness scores and percentage of time spent impaired at work were as follows: day shift, 90.3, 0%; trauma shift, 82.0, 7.5%; prework hour restriction Q3 call shift, 80.7, 23%; and night shift, 68.0, 50% (P < .001). Fatigue optimization countermeasures for night shift rotation improved mean daily effectiveness to 87.1 with only 1.9% of time working while impaired (P < .001).

Conclusions

There is a significant potential for fatigue impairment in residents, with work schedule a significant factor. Once targeted, fatigue impairment may be minimized with specific countermeasures. Fatigue optimization tools provide data for targeted scheduling interventions, which reduce fatigue and may mitigate medical error.

What was known

The 2008 Institute of Medicine's report on resident duty hours implicated fatigue in human error in teaching settings.

What is new

A fatigue avoidance model (SAFTE) and a scheduling tool (FAST) showed that countermeasures applied to night shift rotations would improve mean daily effectiveness and reduce the percentage of time the simulation indicated residents would be working while fatigued.

Limitations

The SAFTE model did not measure fatigue in residents, could not account for schedule and sleep variability among individuals and institutions, and has not been validated in the medical field.

Bottom line

Fatigue optimization tools can provide data for targeted scheduling interventions to reduce resident fatigue. This has the potential to mitigate medical error due to fatigue.

The Institute of Medicine's To Err Is Human: Building a Safer Health System1 ranked medical error as one of the leading causes of death in the United States. Medical error continues to be a significant problem worldwide27 and does not appear to be abating.8 Errors due to health care worker fatigue may play a substantial role.9,10 In 2008, the Institute of Medicine's report Resident Duty Hours: Enhancing Sleep, Supervision, and Safety concluded that “the science on sleep and human performance is clear that fatigue makes errors more likely to occur.”10 

Concomitantly, the Accreditation Council for Graduate Medical Education (ACGME) limited resident work hours to an average 80-hour work week in 2003 and implemented further work hour restrictions in 2011. The link between patient safety and ACGME work hour changes is controversial; recent reviews demonstrate no benefit to both patient safety and educational outcomes,11,12 while the ACGME changes are projected to cost $1.6 billion annually. However, if effective, the benefits of reduced errors and harm resulting from the ACGME duty hour limits could offset these costs.13 

Fatigue risk management systems (FRMS) have emerged in many other industries as an effective way to manage and reduce employee fatigue. These systems use fatigue optimization scheduling simulations to optimize the work schedule, investigate fatigue-related accidents, and improve worker lifestyle. Fatigue optimization scheduling allows for the identification of specific time periods when performance may be compromised. It also establishes the cumulative effects of different work and rest schedules on overall performance capability and accident risk.14 Recent advances allow for accurate prediction of fatigue-related impairment and risk for error.15 The Sleep, Activity, Fatigue, and Task Effectiveness (SAFTE) model and Fatigue Avoidance Scheduling Tool (FAST; Fatigue Science, Honolulu, HI) are used for this purpose in other safety-sensitive occupational settings.1620 

Fatigue optimization scheduling simulation will likely be a valuable tool for residency programs and program directors in managing resident fatigue. The purpose of this study is to apply fatigue optimization scheduling to various surgical resident schedules to calculate and compare predicted fatigue impairment and associated risk for error. A secondary aim is to identify specific times of day and rotations during which residents are most affected by fatigue, then institute countermeasures and measure the predicted response. Our null hypothesis is that there will be no difference between predicted effectiveness, based on the different schedules. This study was exempt from institutional review board approval.

Study Design

We performed a computer simulation experimental study by using 3 typical modern orthopedic surgery rotations (day shift, trauma shift, night shift) and a prework hour restriction schedule with overnight call every third night (Q3 call) as a historical control. Over a randomly generated 28-day continuous work period, proposed resident wake/rest schedules, sleep quantity, and sleep quality were entered into the FAST computer application and processed through the SAFTE model, from specific rotation schedules. The dependent variables addressed were rotation mean daily effectiveness and the percentage of time at critical fatigue impairment. Effectiveness is defined as the percentage of one's maximal capacity of cognitive performance.18 Impairment was defined as an effectiveness score of less than 70. This is correlated with an increased risk for error and a blood alcohol content of 0.08.15,2123 Schedules identified with significant fatigue profiles (mean effectiveness score of less than 70) were subjected to fatigue countermeasure implementation to determine the plasticity of the fatigue and identify solutions to minimize potential patient harm.

Tools

The FAST tool is a computer application of the SAFTE model that allows a continuous calculation of predicted performance during periods of measurement, based on the following inputs: wake/rest schedules, sleep quantity, sleep quality, time zone, geographic changes, and sunlight exposure.24 The SAFTE model has been validated against laboratory-controlled assessments and is able to predict performance degradation effects of fatigue and the rate of recovery with excellent reliability in published scientific studies (R2 of 0.94, 0.89, and 0.98).16,17,19 

Independent Variables

Schedules selected were based on actual rotations at a large academic orthopedic surgery residency program (table 1). Emphasis was placed on rotations with defined schedules, heavy workloads, compliance with ACGME work hour restrictions, and variability with regard to circadian rhythm disruption and rest opportunities to enhance the ability to generalize to other surgical residency programs. The prework hour restriction Q3 call shift was used as a historical control for comparison. We assumed daily sleep across rotations was an average of 6 hours, from published studies.25,26 We also assumed 1 hour for commuting, 1 hour for reading and case preparation, and 2 hours for fitness, eating, hygiene, and family (for a total of 4 hours). Any periods not accounted for by scheduled shifts or the daily 4 hours were imputed as naps.

table 1

Characteristics of Simulated Resident Schedules Based on Actual Rotations

Characteristics of Simulated Resident Schedules Based on Actual Rotations
Characteristics of Simulated Resident Schedules Based on Actual Rotations

Dependent Variables

The outcome measurements were each rotation's mean daily effectiveness and the percentage of time at work with critical fatigue impairment. Details of this effectiveness calculation were previously published.18,20 The percentage of time working with critical fatigue impairment was calculated by measuring the duration of predicted effectiveness below a score of 70 for the 28-day period, dividing this time by the total time spent at work for the 28-day period, and converted into a percentage.

Statistical Analysis

Average effectiveness scores for time at work were recorded for each period the subject was awake and at work. Descriptive statistics were reported. Means between all groups were compared by using an analysis of variance. Means between the night shift and the modified night shift schedules were compared with Student t test.

Fatigue Optimization Scheduling Countermeasures

Modern rotations with significant performance degradation were identified (rotations with a mean effectiveness score of less than 70). Countermeasures were added to the schedule (table 2) and the schedule was analyzed by using FAST.

table 2

Implementation of Fatigue Countermeasures to the Night Shift Rotation to Potentially Minimize the Incidence of Resident Fatigue and Error

Implementation of Fatigue Countermeasures to the Night Shift Rotation to Potentially Minimize the Incidence of Resident Fatigue and Error
Implementation of Fatigue Countermeasures to the Night Shift Rotation to Potentially Minimize the Incidence of Resident Fatigue and Error

Each session was for a 28-day period, generating a daily effectiveness score, both at work and awake. A random time period was generated, with selection of January 5, 2011, to January 28, 2011, in Chicago, Illinois, as the time period to be analyzed. table 3 summarizes the descriptive statistics for each rotation. The predicted effectiveness results for residents on each rotation are summarized in table 4.

table 3

Descriptive Statistics for Each of the 5 Rotations Analyzed

Descriptive Statistics for Each of the 5 Rotations Analyzed
Descriptive Statistics for Each of the 5 Rotations Analyzed
table 4

Summary and Comparison of Effectiveness Scores for Each Rotation

Summary and Comparison of Effectiveness Scores for Each Rotation
Summary and Comparison of Effectiveness Scores for Each Rotation

The night shift schedule was associated with significant fatigue, with critical fatigue levels for more than 50% of the time spent at work. Implementation of fatigue countermeasures reduced the critical fatigue levels from 50% of the time to 1.9% of the time at work (P < .001) (table 5).

table 5

Comparison of Night Shift and Modified Night Shift Schedules

Comparison of Night Shift and Modified Night Shift Schedules
Comparison of Night Shift and Modified Night Shift Schedules

We found significant differences between mean daily effectiveness scores among the various schedule simulations. Thus, our simulation shows resident fatigue may be influenced by work hours, but also by the quantity and quality of sleep and circadian rhythms.

A critical finding is the significant impairment from fatigue that a resident may encounter while working the night shift schedule. We found a mean effectiveness score of 68.0, indicating that more than 50% of the time residents are potentially working while impaired. A fatigue impairment score below 70 suggests an increased risk for error as well as its severity.27 The extended shift and circadian rhythm disruption are the primary drivers of resident fatigue impairment on night shift. These drivers are so powerful that they result in twice the impairment predicted for the prework hour shift where residents were on call every third night with no work limitations or days off.

A secondary aim was to quantify the effectiveness of fatigue countermeasures. We found that the predicted impairment from fatigue on the night shift can be significantly reduced by instituting fatigue countermeasures. Implementing the day shift and modified night shift would essentially eliminate predicted critical resident fatigue impairment.

Our findings demonstrate the potential value of fatigue optimization scheduling and fatigue optimization countermeasures. Sometimes resident fatigue is unavoidable, but by identifying those scenarios, alternative safety checks can be implemented to prevent errors from reaching the patient. Fatigue optimization scheduling is currently used in aviation and by the US Military and Federal Transportation Association.28 Despite use within these large industries, the role of fatigue optimization scheduling in reducing medical error has had limited exploration to date.29,30 Fatigue optimization scheduling has significant potential value for use in residency programs and in large practices for minimizing medical error and improving patient safety.

This study has several limitations. Primarily, the results are based on a computer simulation and do not measure actual fatigue. There is likely to be significant schedule and sleep variability between institutions, individuals, and workdays, affecting the generalizability to other programs. Moreover, the schedules are based on assumptions (ie, sleep quality and quantity, and adherence to the work schedule). There may be significant variability within these measures in real-world application. Also, this study does not account for the safety checks or other countermeasures that are already in place to prevent fatigue-related error from bringing harm to the patient. Finally, the SAFTE model is predictive; it does not directly measure fatigue or medical error, nor has it been validated in the medical field.

There is significant potential for fatigue impairment in residents. Work schedule may be a significant factor in predicted effectiveness. Once targeted, impairment due to fatigue can be minimized with countermeasures. Fatigue optimization tools provide data for targeted scheduling interventions, which reduce fatigue and may mitigate medical error.

1
Kohn
LT
,
Corrigan
JM
,
Donaldson
MS
.
To Err Is Human: Building a Safer Health System
.
Washington, DC
:
National Academy Press
;
1999
.
2
Vincent
C
,
Neale
G
,
Woloshynowych
M
.
Adverse events in British hospitals: preliminary retrospective record review
.
BMJ
.
2001
;
322
:
517
519
.
3
Schioler
T
,
Lipczak
H
,
Pedersen
BL
,
Mogensen
TS
,
Bech
KB
,
Stockmarr
A
,
et al .
Incidence of adverse events in hospitals: a retrospective study of medical records [in Danish]
.
Ugeskr Laeger
.
2001
;
163
:
5370
5378
.
4
Davis
P
,
Lay-Yee
R
,
Briant
R
,
Ali
W
,
Scott
A
,
Schug
S
.
Adverse events in New Zealand public hospitals I: occurrence and impact
.
N Z Med J
.
2002
;
115
:
U271
.
5
Davis
P
,
Lay-Yee
R
,
Briant
R
,
Ali
W
,
Scott
A
,
Schug
S
.
Adverse events in New Zealand public hospitals II: preventability and clinical context
.
N Z Med J
.
2003
;
116
:
U624
.
6
Baker
GR
,
Norton
PG
,
Flintoft
V
,
Blais
R
,
Brown
A
,
Cox
J
,
et al .
The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada
.
CMAJ
.
2004
;
170
(
11
):
1678
1686
.
7
Donaldson
L
,
Philip
P
.
Patient safety: a global priority
.
Bull World Health Organ
.
2004
;
82
:
892
.
8
Landrigan
CP
,
Parry
GJ
,
Bones
CB
,
Hackbarth
AD
,
Goldmann
DA
,
Sharek
PJ
.
Temporal trends in rates of patient harm resulting from medical care
.
N Engl J Med
.
2011
;
363
:
2124
2134
.
9
Barger
LK
,
Ayas
NT
,
Cade
BE
,
Cronin
JW
,
Rosner
B
,
Speizer
FE
,
et al .
Impact of extended-duration shifts on medical errors, adverse events, and attentional failures
.
PLoS Med
.
2006
;
3
:
e487
.
10
Ulmer
C
,
Miller Wolman
D
,
Johns
MME
.
Resident Duty Hours: Enhancing Sleep, Supervision, and Safety
.
Washington DC
:
Insitute of Medicine, National Academy Press
;
2008
.
11
Moonesinghe
SR
,
Lowery
J
,
Shahi
N
,
Millen
A
,
Beard
JD
.
Impact of reduction in working hours for doctors in training on postgraduate medical education and patients' outcomes: systematic review
.
BMJ
.
2011
;
342
:
d1580
.
12
Baldwin
K
,
Namdari
S
,
Donegan
D
,
Kamath
AF
,
Mehta
S
.
Early effects of resident work-hour restrictions on patient safety: a systematic review and plea for improved studies
.
J Bone Joint Surg Am
.
2011
;
93
(
2
):
e5
.
doi:10.2106/JBJS.J.00367
.
13
Nuckols
TK
,
Bhattacharya
J
,
Wolman
DM
,
Ulmer
C
,
Escarce
JJ
.
Cost implications of reduced work hours and workloads for resident physicians
.
N Engl J Med
.
2009
;
360
:
2202
2215
.
14
Mallis
MM
,
Mejdal
S
,
Nguyen
TT
,
Dinges
DF
.
Summary of the key features of seven biomathematical models of human fatigue and performance
.
Aviat Space Environ Med
.
2004
;
75
:
A4
14
.
15
Hursh
SR
,
Raslear
TG
,
Kaye
AS
,
Fanzone
JF
.
Validation and Calibration of a Fatigue Assessment Tool for Railroad Work Schedules, Summary Report
.
Washington, DC
.
US Department of Transportation
;
2006
.
Report No. DOT/FRA/ORD-06/21
.
16
Angus
R
,
Heslegrave
R
.
Effects of sleep loss on sustained cognitive performance during a command and control simulation
.
Behav Res Meth Instrum Comput
.
1985
;
17
:
55
67
.
17
Van Dongen
HP
.
Comparison of mathematical model predictions to experimental data of fatigue and performance
.
Aviat Space Environ Med
.
2004
;
75
:
A15
A36
.
18
Hursh
SR
,
Redmond
DP
,
Johnson
ML
,
Thorne
DR
,
Belenky
G
,
Balkin
TJ
,
et al .
Fatigue models for applied research in warfighting [discussion in Aviat Space Environ Med. 2004;75(3 suppl):A54–A60]
.
Aviat Space Environ Med
.
2004
;
75
(
3 suppl
):
A44
A53
.
19
Balkin
T
,
Thorne
D
,
Sing
H
,
Thomas
M
,
Redmond
D
,
Wesensten
N
,
et al .
Effects of Sleep Schedules on Commercial Driver Performance
.
Washington, DC
:
US Department of Transportation, Federal Motor Carrier Safety Administration
;
2000
.
Report No. DOT-MC-00–133
.
20
Hursh
SR
,
Redmond
DP
,
Johnson
ML
,
Thorne
DR
,
Belenky
G
,
Balkin
TJ
,
et al .
The DOD Sleep, Activity, Fatigue, and Task Effectiveness Model
.
Aviat Space Environ Med
.
2004
;
75
:
A44
A53
.
21
Arnedt
JT
,
Wilde
GJ
,
Munt
PW
,
MacLean
AW
.
How do prolonged wakefulness and alcohol compare in the decrements they produce on a simulated driving task
?
Accid Anal Prev
.
2001
;
33
:
337
344
.
22
Dawson
D
,
Reid
K
.
Fatigue, alcohol and performance impairment
.
Nature
.
1997
;
388
:
235
.
23
Arnedt
JT
,
Owens
J
,
Crouch
M
,
Stahl
J
,
Carskadon
MA
.
Neurobehavioral performance of residents after heavy night call vs after alcohol ingestion
.
JAMA
.
2005
;
294
:
1025
1033
.
24
Sadeh
A
,
Acebo
C
.
The role of actigraphy in sleep medicine
.
Sleep Med Rev
.
2002
;
6
:
113
124
.
25
Baldwin
DC
Jr ,
Daugherty
SR
.
Sleep deprivation and fatigue in residency training: results of a national survey of first- and second-year residents
.
Sleep
.
2004
;
27
:
217
223
.
26
McCormick
F
,
Kadzielski
J
,
Landrigan
CP
,
Evans
B
,
Herndon
JH
,
Rubash
HE
.
Surgeon fatigue: a prospective analysis of the incidence, risk, and intervals of predicted fatigue-related impairment in residents
.
Arch Surg
.
2012
;
147
(
5
):
430
435
.
27
Hursh
SR
,
TG, Kaye
AS
,
Fanzone
JF
.
Validation and Calibration of a Fatigue Assessment Tool for Railroad Work Schedules, Final Report
.
Washington, DC
:
US Dept of Transportation
;
2008
:
71
.
28
Caldwell
JA
,
Caldwell
JL
,
Schmidt
RM
.
Alertness management strategies for operational contexts
.
Sleep Med Rev
.
2008
;
12
:
257
273
.
29
Landrigan
CP
,
Rothschild
JM
,
Cronin
JW
,
Kaushal
R
,
Burdick
E
,
Katz
JT
,
et al .
Effect of reducing interns' work hours on serious medical errors in intensive care units
.
N Engl J Med
.
2004
;
351
:
1838
1848
.
30
Littner
M
,
Kushida
CA
,
Anderson
WM
,
Bailey
D
,
Berry
RB
,
Davila
DG
,
et al .
Practice parameters for the role of actigraphy in the study of sleep and circadian rhythms: an update for 2002
.
Sleep
.
2003
;
26
:
337
341
.

Author notes

Frank McCormick, MD, is Sports Medicine Fellow at Midwest Orthopedics at Rush Hospital, Chicago, Illinois; John Kadzielski, MD, is Hand Fellow at Massachusetts General Hospital; Brady T. Evans, BS, is Medical Student at Harvard Medical School; Christopher P. Landrigan, MD, MPH, is Associate Professor of Medicine and Pediatrics, Harvard Medical School, Associate Physician, Division of Sleep Medicine Department of Medicine, Brigham and Women's Hospital; James Herndon, MD, MBA, is Chairman Emeritus, Partners Department of Orthopedics; and Harry Rubash, MD, is Chairman, Department of Orthopedic Surgery, Massachusetts General Hospital.

Funding: The authors report no external funding source for this study.