The COVID-19 pandemic has led many patients to delay or eschew care, causing the quantity and quality of clinical education to arguably suffer.13  In response, many residency programs were forced to adjust their formal didactics to provide socially distanced education and augment lost clinical education.4,5  Simulation as a teaching modality provides residents and fellows with the efficacious and satisfying transfer of medical knowledge, as well as psychosocial, communication, and procedural skills in a relatively safe and low-stakes environment.69  Prior to COVID-19, residency programs typically scheduled regular simulation scenarios as part of their didactic conferences.

Our residency program transitioned from a monthly simulation session that was directly viewed and then live-debriefed by all conference attendees to a weekly remote format that featured prerecorded cases with a small group of residents and was subsequently broadcasted via a video conferencing platform to the larger virtual audience. Even with the reinstatement of in-person conferences, our transition illuminated various advantages to being able to effectively transmit simulation learning in a virtual format.1013  By offering the opportunity to view and contribute feedback to participants remotely, faculty engagement with resident education has increased. Our program continues to conduct weekly live sessions with our core simulation faculty and a monthly virtual simulation to encourage participation from faculty at different campuses. This Perspectives article reviews our division's experience of this transition. We offer recommendations for overcoming obstacles and provide advice to other programs that may need to create or optimize a virtual simulation experience.

Although literature suggests that observers can gain from the viewing experience and the debrief, incorporating observers into the active learning phase proved to be difficult.14,15  The viewing process must be optimized, as distanced learners can become quickly disengaged or distracted.16,17  The process of conducting remote simulation can be broken down into the following subtasks: conducting a pre-brief, recording the participants, broadcasting to the audience, and facilitating an interactive conversation during the debrief (Box).

Box Recommendations for Optimizing Virtual Simulations During Residency
  1. Prioritize psychological safety during the pre-brief.

  2. Identify optimal equipment to record and transmit sessions to the larger audience.

  3. Incorporate The Basic Assumption to facilitate effective debriefing and participant well-being and increase virtual learner engagement.

  4. Use the pause button during the debriefing process for incremental reflection.

Multiple studies show that video review during simulation debriefing augments the experience,1820  but the preservation of psychological safety is of the utmost importance. The pre-briefing process for direct participants and observers must be standardized and must preemptively acknowledge and validate the stress associated with being recorded and critiqued by a large, and now remote, audience.21  The facilitator should obtain consent prior to recording, must establish the use of safe words (agreed-upon phrases that confer an immediate pause or end to the current scenario, such as “Stop Simulation”), and must reinforce The Basic Assumption, a core value from the Center for Medical Simulation that everyone is intelligent, capable, and trying their best to improve.22  After each session, faculty held unstructured and informal check-ins with residents to solicit their comfort levels and strategies for improvement. Despite video recording being a new facet of our simulation, residents stated they were indifferent or viewed the experience positively.

Effective recording of both video and audio components proved to be a difficult task, as has been documented in prior literature.14,16,17  After several trials, we chose to record with mobile phone cameras that were plugged into high-quality Shure external microphones.23  Difficulty with broadcasting effectively has been documented by numerous programs transitioning to virtual simulation.14  Some problems include wi-fi and mobile services that are unable to support streaming videos, difficulty in conveniently distributing large audiovisual recordings files, and hospital security firewalls. Our ultimate solution was to transfer files onto a hardwired hospital desktop computer and then broadcast them via the Zoom platform's “optimize for video” feature.24 

Our initial attempts at debriefing by casting a physical white board proved unsatisfactory, as it was difficult for participants to view at home. Debriefing proved to be most engaging when using the Zoom built-in whiteboard feature and scribing on a tablet device.25 

The development of both technical and nontechnical skills is significantly enhanced when debriefing occurs.2628  Debriefing is a delicate, multistep process with various forms and no clear superior method.29  We utilized a Promoting Excellence and Reflective Learning in Simulation (PEARLS) debriefing architecture, soliciting participants' emotional responses before scribing Plus/Delta feedback on the virtual whiteboard, followed by a deeper discussion of the medical learning objectives.30  Establishing a sense of ease and safety among participants is paramount to optimizing reflection and growth, especially with physicians' significantly elevated baseline anxiety levels during the COVID-19 pandemic.31  To establish a culture where individuals are comfortable volunteering and receiving feedback during simulation conferences, efforts should be tailored to consistent use of pre-briefing, skilled and positive facilitation, and maintenance of The Basic Assumption.14,21,22  The larger and impersonal audiences associated with virtual learning can lead to decreased willingness to participate due to anxiety around perceived failure.32,33  The in-person group of learners and facilitators should be kept relatively small and should be the primary drivers of the discussion. Remote observers should type their questions and comments into the chat Box, where facilitators can read them aloud to the in-person participants or call on the person to unmute themselves. This will shrink the perceived size of the group and may mitigate any apprehension in participation.

As noted earlier, video-assisted feedback has been shown to improve experiential learning.34,35  Utilizing video playback grants facilitators the ability to pause at a scenario's various branching points, which are optimal breaks for incremental reflection and focused discussion.36  Facilitators benefit from cognitive offloading in that they can address a particular learning objective and then move on.37  Feedback on this methodology has been largely positive, with participants reporting that this makes the medical take-home points of cases more easily digestible. This method can also help participants develop a systematic approach to a case scenario. During a pause, the remote observers are encouraged to discuss their current opinions without knowing the progression of the case, which significantly augments genuine debriefing by limiting hindsight bias, and as an added bonus, helps ease anxiety levels of the participants.38 

The COVID-19 pandemic mandated adjustments to our simulation processes with its risk attached to in-person interactions. Most of these adjustments impeded the fluidity and comfort of the simulation experience, but they also better replicated the new work environment. Full personal protective equipment (PPE) was donned and doffed by all within the simulation environment, as per real-life practices. PPE makes both verbal and nonverbal communication challenging and makes all individuals more difficult to identify.39,40  Formal introductions, role assignments, closed loop communication, and direct eye contact became fundamental in real time and consequently warranted more attention during simulation. We commonly advise, “The more you treat this like an actual clinical encounter, the more you'll benefit.” It was only fitting to embrace these inconveniences, which became commonplace in the new daily work environment, to bolster the learning experience.

The COVID-19 pandemic has forced the medical education community to adapt to a new normal, one reliant on remote learning. The transition to video-broadcasted simulation learning can be difficult, but programs can incorporate these lessons to augment their simulation experience. We recommend that developers prioritize the reinforcement of psychological safety in well-planned pre-briefings, identify the optimal settings on readily available equipment and video conferencing platforms, incorporate The Basic Assumption into the virtual environment, and use the pause and reflect method during the debrief to highlight key learning points.

1. 
Edigin
E,
Eseaton
PO,
Shaka
H,
Ojemolon
PE,
Asemota
IR,
Akuna
E.
Impact of COVID-19 pandemic on medical postgraduate training in the United States
.
Med Educ Online
.
2020
;
25
(1)
:
1774318
.
2. 
Mukhopadhyay
S,
Booth
AL,
Calkins
SM,
et al
Leveraging technology for remote learning in the era of COVID-19 and social distancing
.
Arch Pathol Lab Med
.
2020
;
144
(9)
:
1027
1036
.
3. 
Schneider
SL,
Council
ML.
Distance learning in the era of COVID-19 [published online ahead of print May 8,
2020]
.
4. 
Chick
RC,
Clifton
GT,
Peace
KM,
et al
Using technology to maintain the education of residents during the COVID-19 pandemic
.
J Surg Educ
.
2020
;
77
(4)
:
729
732
.
5. 
Diaz
MCG,
Walsh
BM.
Telesimulation-based education during COVID-19
.
Clin Teach
.
2021
;
18
(2)
:
121
125
.
6. 
Nestel
D,
Groom
J,
Eikeland-Husebø
S,
O'Donnell
JM.
Simulation for learning and teaching procedural skills: the state of the science
.
Simul Healthc
.
2011
;
(suppl 6)
:
10
13
. doi:https://doi.org/10.1097/SIH.0b013e318227ce96
7. 
Issenberg
SB,
McGaghie
WC,
Petrusa
ER,
Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review
.
Med Teach
.
2005
;
27
(1)
:
10
28
.
8. 
McGaghie
WC,
Issenberg
SB,
Cohen
ER,
Barsuk
JH,
Wayne
DB.
Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence
.
Acad Med
.
2011
;
86
(6)
:
706
711
.
9. 
Okuda
Y,
Bryson
EO,
DeMaria
S
Jr,
et al
The utility of simulation in medical education: what is the evidence?
Mt Sinai J Med
.
2009
;
76
(4)
:
330
343
.
10. 
McCoy
CE,
Sayegh
J,
Rahman
A,
Landgorf
M,
Anderson
C,
Lotfipour
S.
Prospective randomized crossover study of telesimulation versus standard simulation for teaching medical students the management of critically ill patients
.
AEM Educ Train
.
2017
;
1
(4)
:
287
292
.
11. 
Roach
E,
Okrainec
A.
Telesimulation for remote simulation and assessment
.
J Surg Oncol
.
2021
;
124
(2)
:
193
199
.
12. 
Pennington
KM,
Dong
Y,
Coville
HH,
Wang
B,
Gajic
O,
Kelm
DJ.
Evaluation of TEAM dynamics before and after remote simulation training utilizing CERTAIN platform
.
Med Educ Online
.
2018
;
23
(1)
:
1485431
.
13. 
O'Regan
S,
Molloy
E,
Watterson
L,
Nestel
D.
Observer roles that optimise learning in healthcare simulation education: a systematic review
.
Adv Simul (Lond)
.
2016
;
1
:
4
.
14. 
Society for Academic Emergency Medicine.
You're on Mute: Lessons Learned & Best Practice for Taking Simulation Virtual
.
2021
.
15. 
Bullard
MJ,
Weekes
AJ,
Cordle
RJ,
et al
A mixed-methods comparison of participant and observer learner roles in simulation education
.
AEM Educ Train
.
2018
;
3
(1)
:
20
32
.
16. 
Haile-Mariam
T,
Koffenberger
W,
McConnell
HW,
Widamayer
S.
Using distance-based technologies for emergency medicine training and education
.
Emerg Med Clin North Am
.
2005
;
23
(1)
:
217
229
.
17. 
Shao
M,
Kashyap
R,
Niven
A,
et al
Feasibility of an international remote simulation training program in critical care delivery: a pilot study
.
Mayo Clin Proc Innov Qual Outcomes
.
2018
;
2
(3)
:
229
233
.
18. 
Zhang
H,
Mörelius
E,
Goh
SHL,
Wang
W.
Effectiveness of video-assisted debriefing in simulation-based health professions education
.
Nurse Educ
.
2019
;
44
(3)
:
e1
e6
.
19. 
Hamad
GG,
Brown
MT,
Clavijo-Alvarez
JA.
Postoperative video debriefing reduces technical errors in laparoscopic surgery
.
Am J Surg
.
2007
;
194
(1)
:
110
114
.
20. 
Britton
GW,
Switzer
MS,
Colombo
CJ.
Reflections in the lens: video-assisted debriefing augments simulation-based medical education
.
Crit Care Med
.
2020
;
48
(9)
:
1387
1388
.
21. 
Lindon-Morris
E,
Laidlaw
A.
Anxiety and self-awareness in video feedback
.
Clin Teach
.
2014
;
11
(3)
:
174
178
.
22. 
Center for Medical Simulation.
The Basic Assumption. harvardmedsim.org/resources/the-basic-assumption/. Accessed December 1,
2021
.
24. 
Zoom.
Optimizing a shared video clip in full screen. support.zoom.us/hc/en-us/articles/202954249-Optimizing-a-shared-video-clip-in-full-screen. Accessed December 1,
2021
.
25. 
Zoom.
Sharing a Whiteboard. support.zoom.us/hc/en-us/articles/205677665-Sharing-a-whiteboard. Accessed December 1,
2021
.
26. 
Dieckmann
P,
Molin Friis S, Lippert A, Ostergaard D. The art and science of debriefing in simulation: ideal and practice
.
Med Teach
.
2009
;
31
(7)
:
e287
e294
.
27. 
Rudolph
JW,
Simon
R,
Raemer
DB,
Eppich
WJ.
Debriefing as formative assessment: closing performance gaps in medical education
.
Acad Emerg Med
.
2008
;
15
(11)
:
1010
1016
.
28. 
Arafeh
JM,
Hansen
SS,
Nichols
A.
Debriefing in simulated-based learning: facilitating a reflective discussion
.
J Perinat Neonatal Nurs
.
2010
;
24
(4)
:
302
311
.
29. 
Levett-Jones
T,
Lapkin
S.
A systematic review of the effectiveness of simulation debriefing in health professional education
.
Nurse Educ Today
.
2014
;
34
(6)
:
e58
e63
.
30. 
Eppich
W,
Cheng
A.
Promoting Excellence and Reflective Learning in Simulation (PEARLS): development and rationale for a blended approach to health care simulation debriefing
.
Simul Healthc
.
2015
;
10
(2)
:
106
115
.
31. 
Rodriguez
RM,
Medak
AJ,
Baumann
BM,
et al
Academic emergency medicine physicians' anxiety levels, stressors, and potential stress mitigation measures during the acceleration phase of the COVID-19 pandemic
.
Acad Emerg Med
.
2020
;
27
(8)
:
700
707
.
32. 
McCoy
CE,
Sayegh
J,
Alrabah
R,
Yarris
LM.
Telesimulation: an innovative tool for health professions education. AEM Educ Train
.
2017
;
1
(2)
:
132
136
.
33. 
Tosterud
R,
Hall-Lord
ML,
Petzäll
K,
Hedelin
B.
Debriefing in simulation conducted in small and large groups—nursing students' experiences. J Nursing Educ Pract.
2014
;
4
(9)
.
34. 
Reed
SJ,
Andrews
CM,
Ravert
P.
Debriefing simulations: comparison of debriefing with video and debriefing alone. Clin Simul Nursing.
2013
;
9
(12)
.
35. 
Grant
JS,
Moss
J,
Epps
C,
Watts
P.
Using video-facilitated feedback to improve student performance following high-fidelity simulation. Clin Simul Nursing.
2010
;
6
(5)
.
36. 
Schober
P,
Kistemaker
KRJ,
Sijani
F,
Schwarte
LA,
van Groeningen
D,
Krage
R.
Effects of post-scenario debriefing versus stop-and-go debriefing in medical simulation training on skill acquisition and learning experience: a randomized controlled trial
.
BMC Med Educ
.
2019
;
19
(1)
:
334
.
37. 
Young
JQ,
Van Merrienboer
J,
Durning
S,
Ten Cate O. Cognitive Load Theory: implications for medical education: AMEE Guide No. 86
.
Med Teach
.
2014
;
36
(5)
:
371
384
.
38. 
Motavalli
A,
Nestel
D.
Complexity in simulation-based education: exploring the role of hindsight bias
.
Adv Simul (Lond)
.
2016
;
1
:
3
.
39. 
Barreras-Espinoza
JA,
Leyva-Moraga
FA,
Leyva-Moraga
E,
et al
Communication in the ICU during the COVID-19 pandemic
.
Eur J Anaesthesiol
.
2021
;
38
(10)
:
1009
1011
.
40. 
Bernstein
AJ.
Smize: a mid-pandemic guide to non-verbal communication. MJM.
2021
.