Appendix A1. General Characteristics of Sponsoring Institutions (SIs)
A1.1. Sponsoring Institution Distribution by Region and Type
A1.2. Sponsoring Institution Distribution by Number of ACGME-Accredited Residency and Fellowship Programs, and Participating Sites
Note. aLimited to three SIs in Puerto Rico.
A1.3. Number and Distribution of Core Faculty Members at Sponsoring Institutions by Specialty Grouping
A1.4. Number and Distribution of Residents and Fellows at Sponsoring Institutions by Gender, Level of Training, and Specialty Grouping
Appendix A2. General Characteristics of Clinical Learning Environmentsa
A2.1. Clinical Learning Environment Distribution by Type of Ownership and Services
A2.2. Clinical Learning Environment Distribution by Beds and Staffing
Note. aBased on the 2013 American Hospital Association Annual Survey.
bMember of Council of Teaching Hospital of the Association of American Medical Colleges.
cIncludes psychiatric, rehabilitation, acute long-term care hospital, children's general medical and surgical, and other types of services.
dPhysicians, residents, interns, and other trainees omitted from staff count.
eFull-time and part-time personnel only; excludes full-time and part-time equivalent personnel.
Appendix A3. Clinical Learning Environments Visited: Number of Programs at Sitea
Appendix A4. CLER Visits: Characteristics of Groups Intervieweda
A4.1. Selected Characteristics of Residents and Fellows in the Group Interviews
Note. aBased on audience response system data.
*Missing data (<2.0%) has been omitted; percentages based on valid percent.
A4.2. Selected Characteristics of Faculty Members and Program Directors in the Group Interviews
Note. *Missing data (<2.0%) has been omitted; percentages based on valid percent.
Appendix B. Selected Results from Resident and Fellow Group Interviewsa
B1. Percentage of residents and fellows who reported knowing the clinical site's priorities in the area of patient safety
Note. aAll percentages are rounded to whole numbers (values of .50 or above are rounded to the next highest whole number).
bMissing data=92.
cResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
dDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.01.
**Statistically significant at p<.0001.
B2. Percentage of residents and fellows who reported knowing the clinical site's process for reporting an adverse event, near miss/close call, or unsafe condition in patient care
Note. aMissing data=139.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.05.
**Statistically significant at p<.0001.
B3. Percentage of residents and fellows who reported experiencing an adverse event, near miss/close call, or unsafe condition
Note. aMissing data=126.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.01.
**Statistically significant at p<.0001.
B4. Percentage of residents and fellows who reported experiencing an adverse event, near miss/close call, or unsafe condition and submitted a report through the clinical site's reporting system
Note. aMissing data=98.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.0001.
B5. Percentage of residents and fellows who reported a near miss/close call event
Note. aMissing data=90.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.01.
**Statistically significant at p<.0001.
B6. Percentage of residents and fellows who reported receiving feedback on the outcome of a report submitteda through the clinical site's reporting system
Note. aReport submitted by resident or fellow or through a nurse or supervisor.
bMissing data=426.
cResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
dDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.01.
**Statistically significant at p<.0001.
B7. Percentage of residents and fellows (PGY-3 and above) who reported participating in an interprofessional (physicians, nurses, administrators, others) investigation of a patient event (e.g., root cause analysis)
Note. aMissing data=120.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.01.
**Statistically significant at p<.0001.
B8. Percentage of residents and fellows (PGY-2 and above) who reported knowing the clinical site's priorities in the area of quality improvement
Note. aMissing data=112.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.05.
**Statistically significant at p<.01.
***Statistically significant at p<.0001.
B9. Percentage of residents and fellows (PGY-2 and above) who reported participating in a quality improvement project of their own design or one designed by their program or department
Note. aMissing data=129.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.05.
**Statistically significant at p<.01.
***Statistically significant at p<.0001.
B10. Percentage of residents and fellows who reported participating in a quality improvement project linked to one or more of the clinical site's quality improvement goals
Note. aMissing data=135.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.05.
**Statistically significant at p<.0001.
B11. Percentage of residents and fellows who reported being engaged in interprofessional quality improvement teams (e.g., nurses, administrators, pharmacists, etc.) while participating in a quality improvement project directly linked to one or more of the clinical site's quality improvement goals
Note. aMissing data=88.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 88% or more of the 297 CLEs.
*Statistically significant at p<.01.
**Statistically significant at p<.0001.
B12. Percentage of residents and fellows who reported having ready access to organized systems for collecting and analyzing data for the purpose of quality improvement
Note. aMissing data=206.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.05.
**Statistically significant at p<.01.
B13. Percentage of residents and fellows who reported knowing the clinical site's priorities with regard to addressing health care disparities
Note. aMissing data=148.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.05.
**Statistically significant at p<.0001.
B14. Percentage of residents and fellows who reported following a standardized process for handling transitions of care during hand-offs between shifts
Note. aMissing data=284.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.05.
**Statistically significant at p<.01.
***Statistically significant at p<.0001.
B15. Percentage of residents and fellows who reported following a standardized process that included a standardized written template for communication for handling transitions of care during hand-offs between shifts
Note. aMissing data=163.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.0001.
B16. Percentage of residents and fellows who reported having been placed, or witnessing one of their peers placed, in a situation where they believed there was inadequate supervision at the clinical site (e.g., the attending wasn't available)
Note. aMissing data=213.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.01.
**Statistically significant at p<.0001.
B17. Percentage of residents and fellows who reported knowing what they were allowed to do with and without direct supervision
Note. aMissing data=134.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.05.
**Statistically significant at p<.01.
***Statistically significant at p<.0001.
B18. Percentage of residents and fellows who reported having an objective way to know what procedures residents and fellows from other services were allowed to do with and without direct supervision when they consulted on patients
Note. aMissing data=675.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.01.
**Statistically significant at p<.0001.
B19. Percentage of residents and fellows who reported that they would power through to hand-off if placed in a situation in which they were impaired by fatigue, maxed out on caffeine, and a 15 minute nap had no effect
Note. aMissing data=368.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.05.
**Statistically significant at p<.0001.
B20. Percentage of residents and fellows who reported having attended institutional training on topics of professionalism and ethics
Note. aMissing data=124.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs. *Statistically significant at p<.01.
B21. Percentage of residents and fellows who reported that their clinical site provided a supportive, non-punitive environment for coming forward with concerns regarding honesty in reporting (e.g., patient data, duty hours)
Note. aMissing data=163.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.05.
B22. Percentage of residents and fellows who reported having felt pressured to compromise their honesty or integrity to satisfy an authority figure during their training at the clinical site
Note. aMissing data=146.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
B23. Percentage of residents and fellows who reported they had documented a history or physical finding in a patient chart that they did not personally elicit at the clinical site (e.g., copying and pasting from another note)
Note. aMissing data=267.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
cDistribution includes 90% or more of the 297 CLEs.
*Statistically significant at p<.05.
**Statistically significant at p<.0001.
Appendix C. Selected Qualitative Results from Site Visit Reportsa
C1. Percentage of CLEs by proportion of resident and fellow knowledge of basic patient safety terminology and principlesb
Note. aResults based on 297 site visit reports; all percentages are rounded to whole numbers (values of .50 or above are rounded to the next highest whole number).
bMissing data=73. It should be noted that missing data is largely due to the development and refinement of a formal template of the written site visit report in the early stages of program implementation.
cResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
C2. Percentage of CLEs that tracked the number of patient safety event reports submitted by residents and fellowsa
Note. aMissing data=53. It should be noted that missing data is largely due to the development and refinement of a formal template of the written site visit report in the early stages of program implementation.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
C3. Percentage of CLEs where residents and fellows frequently submitted patient safety event reportsa
Note. aMissing data=29. It should be noted that missing data is largely due to the development and refinement of a formal template of the written site visit report in the early stages of program implementation.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
C4. Percentage of CLEs by proportion of resident and fellow knowledge of basic quality improvement conceptsa
Note. aMissing data=45. It should be noted that missing data is largely due to the development and refinement of a formal template of the written site visit report in the early stages of program implementation.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
C5. Percentage of CLEs with cultural competency training for residents and fellowsa
Note. aMissing data=32. It should be noted that missing data is largely due to the development and refinement of a formal template of the written site visit report in the early stages of program implementation.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
C6. Percentage of CLEs with hand-off processes that were standardized across programs, based on direct observationsa
Note. aMissing data=18. It should be noted that missing data is largely due to the development and refinement of a formal template of the written site visit report in the early stages of program implementation.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
C7. Percentage of CLEs by mechanism used for identification of resident and fellow competency to perform clinical procedures, as reported by nursesa
Note. aMissing data=9. It should be noted that missing data is largely due to the development and refinement of a formal template of the written site visit report in the early stages of program implementation.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
C8. Percentage of CLEs where patient safety and quality leaders recalled patient safety events related to resident and fellow fatiguea
Note. aMissing data=67. It should be noted that missing data is largely due to the development and refinement of a formal template of the written site visit report in the early stages of program implementation.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
C9. Percentage of CLEs where executive leadership recalled incidents concerning professionalisma
Note. aMissing data=23. It should be noted that missing data is largely due to the development and refinement of a formal template of the written site visit report in the early stages of program implementation.
bResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
C10. Percentage of CLEs where disruptive or disrespectful behavior was reported across more than one clinical unit
Note. aResults from CLEs in Puerto Rico (n=3) have been omitted to protect their anonymity.
