The COVID-19 pandemic has dramatically altered the clinical arena. While already acclimating to changes regarding telehealth and clinical visits, now is the opportunity to similarly adapt our educational programs. Here we address the assessment of surgical trainee competency in this unpredictable clinical environment.
The Accreditation Council for Graduate Medical Education (ACGME) requires residents from all surgical specialties to reach a minimum number of cases upon graduation.1-5 Implementation of these minimum requirements have had varying consequences across different surgical specialties. In orthopedics, a majority of residents are meeting the minimum criteria, though there has been a decrease in the total number of procedures performed by residents.6 Conversely, an overall increase in case volume has been described in general surgery, but the variety of cases has narrowed with fewer subspecialty cases being performed.7 Obstetrics and gynecology has seen yet another challenge with 50% of graduating residents not meeting the minimum, which is partially due to increased utilization of nonsurgical interventions.8 Compounding this change in case volumes is the COVID-19 pandemic. In 2020, elective surgical cases were halted nationally as part of the initial response to the COVID-19 pandemic, and the current surge in hospitalizations related to the Delta and Omicron variants remains an ongoing threat to elective surgical cases. While there is some variability regarding the policies surrounding postponement or cancellation of elective surgeries across the country, surgical case volumes for residents have become unreliable, unpredictable, and often decreased. The active clinical learning necessary for surgeon training is often jeopardized.
The COVID-19 pandemic has brought many previously misunderstood or poorly represented facts to light. While residency program directors are familiar with the role of minimum requirements, they may erroneously view these requirements as the primary targets for determining competency. Case minimums reflect a program's surgical experiences; however, program directors and faculty must still determine trainee surgical competency. Doing so remains challenging due to the ongoing pandemic and delayed return to surgical volumes. Additionally, the severity of the impact on trainee education likely varies by specialty, with surgical specialties focused on elective procedures being most affected. We can no longer rely solely on our institutions' historical surgical volumes to provide adequate surgical experiences for trainee competency determination. Thus, there is an urgent need to develop strategies for surgical assessment during this unique time.
Competency-based medical education has increasingly gained traction to objectively assess residents. In the United States, the ACGME Milestones assess resident progress across 6 core competency domains throughout residency and are uniquely designed for each specialty.9 Despite the standardized assessment, subjectivity remains a challenge. To assist with the determination of competency, many surgical specialties apply the Objective Structured Assessment of Technical Skills (OSATS) framework.10 The OSATS assessment includes a procedural checklist and a global rating scale of surgical skill (such as tissue handling and use of an assistant). OSATS assessment of core procedures could also be incorporated into the board certification process, with centralized review of a predetermined list of recorded procedures. While OSATS is largely objective, it is imperfect and not without the potential for bias.
In addition to competency assessment, simulation may be used to assess preparation for the limited number of procedures performed during the pandemic. Throughout medicine, many tested low-fidelity models exist for the training of specific tasks that are appropriate for junior residents. A first step toward competency assessment may be demonstrating perfect techniques during simulation before demonstration and assessment on patients. Surgical cases and patient encounters can then focus on the art of surgery and the appropriate application of previously learned procedures. Simulation cannot serve as the sole measure of competency, as it does not completely replicate the complexity of patient encounters and real-time problem solving. Even programs with broad evidence of validity, such as the Fundamentals of Laparoscopic Surgery (FLS), are limited in their specialty-specific skill sets. While FLS was initially designed for and broadly relevant to general surgery procedures and principles, it does not adequately address the nuances of other surgical disciplines. Focusing on specialty-specific modules is likely to be more beneficial to surgical trainees
Surgical coaching, distinct from traditional mentorship relationships, is another pathway to assess competency. A coach guides the trainee in self-directed reflection and goal setting rather than simply instructing based on preference or style. Prior studies have demonstrated improved surgical skill competency and self-reflection with the use of coaching programs.11-13 Coaching emphasizes positive behavior reinforcement via the incorporation of immediate and directive feedback, video debriefing, and behavior modeling.11-13 Incorporating routine surgical coaching into surgical residency programs requires a shift to a learner-centered teaching philosophy. In our opinion, faculty development focusing on the role and skills of a surgical coach is essential to successful integration.
The above solutions can be adapted to all surgical and procedural programs. However, looking to the future, other potential (and somewhat controversial) options exist to focus surgical training. One commonly discussed long-term global solution is the tracking of residents into integrated surgical residencies. This approach has been successfully accomplished in several surgical subspecialties, such as vascular and plastic surgery.14,15 This allows for a comprehensive basic surgical experience combined with a focus on individual specialty interest and may allow a redistribution of surgical case types based on a resident's declared pathway. Other surgical specialties, such as obstetrics and gynecology, may find similar benefits to this approach; the Cleveland Clinic currently utilizes resident tracking through a customizable curriculum.16
The COVID-19 pandemic has had profound effects on surgical education through reduced numbers of cases, impairing the development of surgical competency as well as competency assessment. Several alternative approaches may enhance preparation for procedures and resident assessment, including planned integration of OSATS and simulation and surgical attending coaching. In addition, consideration of early resident tracking into specialties—and more integrated residencies—may allow targeting of limited case numbers toward residents planning on specialty careers. These strategies may become even more critical if incoming residents experience continued limited surgical exposures during medical school. The COVID-19 pandemic has magnified the need for thoughtful and deliberate changes to surgical assessment.