Purpose:

To present the first 14 years’ data from 1 academic institution using the American Foundation for Suicide Prevention's online Interactive Screening Program (ISP). The ISP probes suicide risk factors in healthcare workers, utilization of mental health services, levels of engagement, and seeks to reduce barriers to help-seeking.

Design:

Data from all healthcare system students, medical trainees, physicians, nurses, and staff who completed the ISP's online Stress and Depression Questionnaire between May 1, 2009, and April 30, 2023, were tabulated and analyzed for features related to burnout, depression, suicide risk, treatment, and engagement with program counselors.

Results:

5368 individuals engaged in ISP screening. Findings included 39.9% experiencing depression symptoms, 53.9% symptoms of burnout, and 10% suicidal ideation. In this self-selecting group, medical students reported depression symptoms less than physicians in practice, nurses almost 3 times more than physicians, and females more than males. Suicide risk was indicated by multiple domains of distress, with 49.4% in the highest risk tier. At the time of completing the questionnaire, 13.1% were receiving counseling/therapy. After receiving feedback, more than one-quarter of all participants (27.6%) engaged with the program counselors, with an additional 941 individuals who were not already receiving counseling or therapy accepting referrals to mental health providers.

Conclusion:

The unattended high distress levels throughout the healthcare training and workforce demonstrated the need for safe screening and referral, while the level of engagement and referrals generated by the ISP attested to its effectiveness.

The practice of medicine is both rewarding and stressful. Life and death decisions are made daily, and healthcare workers are asked to care for patients in what is often the most challenging phase of their and their families’ lives.1  Thus, it is no surprise that healthcare trainees and practitioners experience high rates of burnout, dissatisfaction with life and career, depression, substance use, and suicide.1-5  Yet, despite their knowledge and resources, the healthcare workforce is equally likely, or perhaps even less likely, than others to seek mental health care.1,3,4  Today's healthcare workforce has inherited a stoic culture of self-sufficiency and real and/or perceived barriers to help-seeking which often neglects deterioration in wellbeing as well as opportunities to prevent the spiral into more severe, entrenched mental health problems.6-8  Unaddressed depression not only leads to unhappiness and misery in professional and personal spheres, but also may be the most actionable risk for healthcare professional suicide.9,10 

As part of its overall wellness and healthcare workforce suicide prevention efforts, the UC San Diego Health Healer Education, Assessment, and Referral (HEAR) program aims to facilitate help-seeking behavior in its students, trainees, faculty physicians and professional staff.11  This suicide prevention program's signature intervention is its implementation of the American Foundation for Suicide Prevention's (AFSP) Interactive Screening Program (ISP).12  Developed by AFSP as a unique method of engaging at risk individuals into mental health services, the ISP provides a convenient and confidential way for individuals to take a brief screening for stress, depression, and other mental health conditions, and receive a personal response from a program counselor with information about mental health services available to them.

The ISP has been the key component of UC San Diego's healthcare workforce suicide prevention program since 2009. Over time, the ISP has been supplemented by a variety of educational and support interventions for health system departments, clinical units, and training programs: on-demand educational and training programs, group and individual debriefings for clinical services after critical events, Schwartz Center Rounds,13  confidential short-term counseling for medical trainees, individual “check-in” appointments for new trainees and attending physicians, peer support trainings, and individualized consultation and/or referrals upon request. In this article, we present the first 14 years’ data from the ISP to illustrate the occurrence of suicide risk factors in students, trainees, faculty and staff, utilization of mental health services, levels of engagement prompted by the ISP, concerns voiced by our healthcare workforce, and the extent to which barriers to help-seeking are addressed in this population.

Participants

UC San Diego Health-affiliated physicians, nurses, trainees, students, and other staff (eg: social workers, medical assistants, etc.) who completed the online Stress and Depression Questionnaire between May 1, 2009, and April 30, 2023, were included in our study. The program's initial target audience included all faculty physicians, residents, and medical students. In the second year of the program, 2010, it expanded to include pharmacy students and in 2016 to a broader expansion that included nursing staff and the entire health system staff from health system professionals to support personnel.

The Interactive Screening Program (ISP)

The University of California, San Diego Health HEAR program offers the ISP, a voluntary and anonymous online screening and referral tool that includes a Stress and Depression Questionnaire.11,12  The screening tool connects respondents with HEAR counselors and, when appropriate, provides referrals for additional mental health treatment. The online tool is widely disseminated and can be completed at any time and any location. In addition, physicians, nurses, trainees, students, and other staff receive e-mails yearly with an invitation and link to complete the screening. Historically, between 7% and 26% of e-mail recipients have completed the screening.11,14-18 

Before starting the questionnaire, participants create a self-assigned user identification (ID) allowing complete anonymity. Although designed for participants to complete only once, participants may sign up again with a new user ID (as identified by the responses with repeated IDs). The present study included only the data associated with an individual's most recent response. The ISP questionnaire includes demographics and items screening for depression; measures of intense emotional distress; alcohol, and drug use; disordered eating behaviors; burnout; current suicidal thoughts, behaviors, and suicidal plans, past suicide attempts; impairment; and current mental health treatment. Lastly, an open-ended question asks about stressors. To encourage participation and personal sense of safety all questions are optional and anonymous.

Demographics

Optional limited demographic information includes age (open-ended), gender identity, ethnicity and/or race, and position (including medical student, pharmacy student, resident, fellow, pharmacist, faculty [MD, PhD, PharmD or other], nurse or other healthcare staff).

Depression severity

Depression severity in the prior 2 weeks was evaluated using the PHQ-9.19  PHQ-9 item response choices were not at all, some of the time, a lot of the time, and most or all of the time. Participants were classified as having no or minimal (PHQ-9 score of 0-4), mild (5-9), or moderate to severe depression (10-19). For purposes of this article, participants scoring in the moderate to severe depression range (10-19) were considered to meet criteria for depression.

Intense affective states associated with suicide risk

Using items adapted from the Affective State Questionnaire,20  participants rated the frequency of 10 intense feeling states that have been linked to depression with suicidal ideation (SI); Feeling nervous or worrying a lot; becoming easily annoyed or irritable; feeling life is too stressful; having arguments or fights; feeling intensely anxious or having anxiety attacks, feeling intensely lonely; feeling intensely angry; feeling hopeless; feeling desperate, and feeling out of control. Item response choices were, not at all, some of the time, a lot of the time, and most or all the time, with a lot of the time and most or all of the time regarded as endorsements.

Drinking or substance use

Participants rated the frequency of “Feeling like you were drinking too much” over the course of the 4 weeks prior to taking the questionnaire. Item response choices were not at all, some of the time, a lot of the time, and most or all of the time, with a lot of the time and most or all of the time regarded as endorsements.

Eating disturbance

Participants rated the frequency of “Feeling like you can't control what or how much you eat” over the course of the 4 weeks prior to taking the questionnaire. Item response choices were not at all, some of the time, a lot of the time, and most or all of the time, with a lot of the time and most or all of the time regarded as endorsements.

Burnout

In 2016, 3 items were added to the questionnaire to measure burnout: “feeling burned out from your work;” “feeling emotionally drained from your work,” and “having become more callous toward people since you took this job.” For this study, burnout was represented by a score of ≥2 on the single item, “Feeling burned out from your work,” which was rated on a 4-point scale ranging from 0 (not at all), 1 (some of the time), 2 (a lot of the time) to 3 (most or all of the time) over the preceding 4 weeks. Other studies have found a single-item measure of burnout may be reliably used as an alternative to the Maslach Burnout Inventory to abbreviate survey material and potentially increase response rates among physicians.21 

Suicidal thoughts and behaviors

Questions to assess suicidal thoughts and behaviors included: thoughts about taking your own life? planned ways of taking your own life? and done things to hurt yourself? over the past 2 weeks. Item response choices were not at all, some of the time, a lot of the time, and most or all of the time, with some of the time, a lot of the time and most or all of the time regarded as endorsements. Also included was a yes/no item for any past suicide attempt throughout the participant's lifetime.

Impairment

Adapted from the PHQ-9 impairment item,19  participants rated the degree of difficulty to the item “If you checked off any problems on this questionnaire, how difficult have these problems made it for you to do your work, take care of things at home, or get along with other people?” Item response choices were not at all difficult, somewhat difficult, very difficult, and extremely difficult.

Current mental health treatment

Included were yes/no items for whether the participant was currently, at the time of taking the questionnaire: taking any medication for anxiety, any medication for depression, or getting counseling or therapy.

Procedure

After submission of the questionnaire, an algorithm is used to analyze risks classified into 1 of 4 tiers: Tier 1a, Tier 1b, Tier, 2, and Tier 3, indicating high, moderate, and low distress. Tier 1a designation requires high distress, including current suicidal ideation, plans, or behaviors; or a PHQ– 9 score of 15 or higher, and feeling intensely anxious, angry, hopeless, desperate or out of control “a lot of the time” or “most of the time,” or feeling nervous or worrying a lot, becoming easily annoyed or irritable, feeling life is too stressful, having arguments or fights, or feeling intensely lonely “most or all of the time.” Tier 1b requires high distress without current suicidal ideation, plans, or behaviors; and a PHQ-9 score of 10 to 14; or prior suicide attempts; or problems related to alcohol or drug use; or distressing eating behavior; or indications that the current problems make it difficult to function. Tier 2 requires moderate distress without current suicidal ideation, plans, or behaviors, or prior suicide, attempts; or a PHQ score of 10 to 14; or problems associated with alcohol or drug use; or problematic eating behaviors; or indications that current problems make it “somewhat difficult” to function. Tier 3 indicates minimal to no distress.

Program guidelines call for all Tier 1 participants contracted to be answered by a dedicated program counselor within 24 hours, Tier 2 participants within 36 hours, and Tier 3 participants within 48 hours. Within the appropriate time frame, program counselors review the participants’ questionnaires and create a detailed, personalized response and assessment for each participant, using a template specific to the participant's distress tier, which encourages interaction between participant and counselor. After the counselors post their responses to the ISP platform, the responses are accessible to participants by logging back onto the program platform with the user ID and password they created to take the questionnaire. Participants who provide an e-mail address automatically receive an e-mail notification alerting them of the response with a link to the program platform. Participants can also return independently to the platform and log in to view the counselor's response, regardless of having provided an e-mail address. It is worth noting that viewing the counselor's response thus requires active effort, since it is only accessible to the participant after logging back onto the platform.

In addition to the assessment, the counselor addresses any questions or comments left by participants in an open-ended comment box at the end of the questionnaire. Participants are invited to exchange dialogue messages with the counselor using the ISP platform's messaging system, or to contact the counselor directly using contact information provided by the counselor, including the counselor's name, office location and phone number. Therefore, participants maintain the ability to remain anonymous. All Tier 1 and Tier 2 participants are urged to contact the counselor to arrange an in-person meeting. All participants, regardless of tier designation, are offered the option of using the platform's “dialogue” feature to communicate online with the counselor while remaining anonymous. In general, the counselor's key aims in the responses are to convey interest, support, and availability, and to encourage engagement, whether in-person or virtual meetings, or through anonymous online dialogue.

This report includes user data from the screening questionnaire from the first 14 years of the program, May 2009 through May 2023, including 3 items on burnout that were added to the questionnaire in 2016. The current study included 5368 unique responses from medical students, pharmacy students, residents, and fellows house staff, attending physicians, nurses and nonphysician faculty, pharmacists, and other clinical and nonclinical hospital staff.

The data gathering was reviewed by the UC San Diego Institutional Review Board (IRB) and deemed not to require IRB oversight. As this study involved data-gathering via anonymous surveys, signed informed consent from participants was deemed not necessary by the IRB. Furthermore, information provided on the program platform where the screening is conducted contains the key elements of informed consent, and consent is implied by the participant's completion of the questionnaire.

Data Analysis

Descriptive statistics were first used to examine the characteristics of each position group. Next, a series of linear regression models were used to test for position differences in 7 measures of distress (PHQ-9 score and ratings of intense anger, anxiety/ anxiety attacks, loss of control, hopelessness, desperation, and anxiety) and 1 measure of functioning (the 10th item of the PHQ-9 which evaluates the impact of symptoms on functioning) and the single item assessment of burnout. Logistic regression models were employed to test for position differences on suicide risk (suicidal thoughts, plans for self-harm, Tier 1 vs. lower risk, and a composite reflecting risk on any of these 3 measures vs. none of them). A final logistic model tested for differences in the likelihood of dialoging with a counselor at least once. All models included gender, racial/ethnic background, and age as covariates. The model of dialoging with counselors also included binary covariates reflecting whether respondents were in treatment or not and whether they were identified as at risk on the risk composite or not. The initial model also included interactions between these 2 covariates and position; nonsignificant interactions were not retained in the final model. Significant interactions were followed by tests of simple effects to aid interpretation. In all models, physicians were the reference group compared to each of the other position groups. We conceptualized our inferential statistics as testing 4 families of outcomes (distress, functioning, risk, and dialogue with counselors), and thus performed a family-wise adjustment to set alpha at. 05/4 =.0125.

Participants

A total of 5368 participants completed the ISP questionnaire during the 14-year period, May 1, 2009, through May 31, 2023. This included 671 medical students, 280 pharmacy students, 814 residents and physician fellows, 338 attending physicians, 1172 nurses, and 2093 others (eg: pharmacists, social workers, allied health, hospital staff, and/or those who left this field blank).

Table 1 provides descriptive data for the overall sample and each position group on demographic characteristics, depressive symptom severity, burnout, intense emotional states associated with suicide risk, drinking, and eating behaviors, suicidal thoughts and risk tier, self-perceived functioning, current treatment, and engagement with program counselors after receiving written feedback.

Table 1

Interactive Screening Program Data for HEAR Program: May 6, 2009 to May 31, 2023

Interactive Screening Program Data for HEAR Program: May 6, 2009 to May 31, 2023
Interactive Screening Program Data for HEAR Program: May 6, 2009 to May 31, 2023

Demographics: Except for attending physicians, most participants were under 40 years of age (attending physicians 33.1%; overall 65.6%). A majority also identified themselves as “female,” (71.5%) and 51.4% as “white.”

Clinical Features: On the PHQ-9, 39.9% scored as at least moderately depressed (PHQ-9 score >10) and on the single-item burnout item, 53.9% rated themselves as burned out from work. About half of the participants endorsed feeling nervous or anxious (50.7%), 49.6% felt life was too stressful, and 19% felt hopeless. Fewer, 5.3%, believed they were drinking too much, while 16.9% could not control their weight or how much they ate, 10% had thoughts of suicide, 3.7% endorsed planning ways of taking their own lives and, 17.5% felt at least 1 of these problems had made it difficult for them to do their work, take care of things at home, or get along with other people.

Treatment: Only 703 (13.1%) of all 5368 participants were currently receiving counseling or therapy. As tracked by the ISP platform, 3967 (73.9%) participants who completed the questionnaire returned to the ISP platform to view the counselor's posted response and 1482 (37.3%) of those that viewed the counselor's response subsequently engaged in 1 or more anonymous online dialogues with the counselor. While only 58 of 814 (7.1%) residents/ fellows were receiving counseling or therapy when they completed the questionnaire, over one-third of the residents/fellows, 281 (34.5%), dialogued with counselors after submitting their questionnaires.

The model of PHQ-9 scores is shown in Table 2. Results indicated that, controlling for gender, age, and racial/ethnic background, medical students tended to have significantly lower PHQ-9 scores than physicians, while nurses and those in the other group had higher scores than physicians. Pharmacy students and residents/fellows did not differ from physicians. In terms of covariates, PHQ-9 scores were higher among female than male respondents, among both non-white groups compared to respondents who identified as white, and among younger respondents.

Table 2

Association of Age, Gender, Race/Ethnicity, and Position with PHQ-9 Scores

Association of Age, Gender, Race/Ethnicity, and Position with PHQ-9 Scores
Association of Age, Gender, Race/Ethnicity, and Position with PHQ-9 Scores

Models of other distress outcomes produced generally similar results as depression, as summarized in Table 3. In terms of differences between position groups, medical students reported significantly lower levels of anger, anxiety/anxiety attacks, hopelessness, desperation, and loss of control compared to physicians. In contrast, nurses reported higher levels of anger, anxiety/anxiety attacks, nervousness, hopelessness, desperation, and loss of control. With regards to covariates, respondents who identified as female reported significantly higher levels of anxiety/anxiety attacks and nervousness compared to respondents who identified as male. Higher distress was significantly associated with identifying as non-white and with younger age. Similarly, compared with physicians, nurses reported significantly greater difficulty functioning, and medical and pharmacy students reported significantly less. Women reported greater difficulty functioning than men, and difficulty was inversely associated with age. In contrast, higher burnout was significantly associated only with younger age, and with being a physician relative to being a pharmacy student.

Table 3

Summary of Standardized Regression Coefficients from Other Models of Distress and Functioning Outcomes

Summary of Standardized Regression Coefficients from Other Models of Distress and Functioning Outcomes
Summary of Standardized Regression Coefficients from Other Models of Distress and Functioning Outcomes

The next series of models used logistic regression to test for position differences in measures of risk; the model evaluating the likelihood of a positive score on any risk measure is shown in Table 4. Results indicated that medical students were 43% less likely than physicians, and nurses 83% more likely than physicians to be classified as at risk. Other position groups did not differ from physicians. Respondents who identified as female or non-white, and younger respondents, were also significantly more likely to be at risk. The only other risk outcome for which significant position differences were found was tier classification, where medical students were 47% less likely and nurses 65% more likely to be classified as Tier 1, both compared with physicians. Tier 1 classification was 18% less likely for those identifying as male vs. female, and 40-41% more likely for those identifying as Asian or other non-white versus white. Tier 1 was also more likely for younger participants. There were no differences between position groups in terms of the likelihood of suicidal thoughts or plans. The likelihood of suicidal thoughts and plans were each associated with identifying as male. Suicidal thoughts were more common among younger respondents, whereas suicidal plans were more common among those who identified as Asian versus non-Hispanic white.

Table 4

Binary Logistic Regression Model of Likelihood of Being at Risk

Binary Logistic Regression Model of Likelihood of Being at Risk
Binary Logistic Regression Model of Likelihood of Being at Risk

Finally, we used logistic regression to model the associations of position, treatment status, risk status, and their interactions with the likelihood of dialoging with program counselors after receiving feedback (Table 5). Interaction terms involving the position variable were not significant and were not retained, but there was a significant treatment status * risk status interaction. The model indicated some significant differences between position groups, namely that medical students were 61% less likely and pharmacy students 71% less likely than physicians to dialogue with counselors, after adjusting for demographics and risk and treatment statuses. There was also a significant inverse association with age, such that each additional year of age was associated with a 1% greater likelihood of dialoging. To aid interpretation or the treatment status * risk status interaction, we conducted simple effects tests by removing the interaction term and the treatment status variable and re-fitting the model for those in treatment and not in treatment separately. Both models were comparable to the main model in terms of associations between dialog likelihood and demographic and position variables, but the strength of the association with risk status differed. For respondents who were not currently in treatment, being classified as at risk was associated with 213% greater odds of dialoging with a counselor [Odds Ratio (OR) = 2.13 (95% confidence interval 1.80, 2.53), p < .001]. For those in treatment, those classified as at risk were not significantly more likely to dialogue with a counselor than those not at risk [OR = 1.30 (1.05, 1.62), p = .017].

Table 5

Binary Logistic Regression Model of Likelihood of Dialoging with a Counselor

Binary Logistic Regression Model of Likelihood of Dialoging with a Counselor
Binary Logistic Regression Model of Likelihood of Dialoging with a Counselor

Overall, over the 14-year period, 1681 individuals who were not currently receiving mental health counseling or therapy accepted referrals to mental health providers (UCSD's total health system population is approximately 14000). Of these, 941 came directly from the ISP and 740 were provided by the program counselors after other requests for referrals, such as individuals requesting referrals by phone or e-mail, after group debriefs, or during one-to-one “check-ins” (Supplementary Table 1).

Supplementary Table 1

Referrals to Mental Health Treatment

Referrals to Mental Health Treatment
Referrals to Mental Health Treatment

Supplementary Table 2 provides the numbers and percentages of concerns endorsed by participants from each group. The most common concerns were about burning out (74.0%), mental health (64.9%), family life (64.1%), physical health (63.3%), and fatigue (61.0%). There was modest variation in frequencies and rank ordering of concerns between groups. A distinct majority of medical and pharmacy students worried about academic performance (86.6% and 91.1% respectively) and of matching into their preferred specialties (59.9% and 61.5% respectively). The majority of all respondents, 55.8%, felt there were adequate mental health and wellbeing resources available, especially the medical (72.6%) and pharmacy (70.4%) students.

Supplementary Table 2

Participant Concerns

Participant Concerns
Participant Concerns

This report describes the activities and outcomes of the UC San Diego HEAR program's utilization of the AFSP's ISP from its inception in May 2009 through April 2023. HEAR was designed and implemented primarily for physician suicide prevention between 2009 and 2015. In 2016, when expanded for use by the entire health organization, results demonstrated that the ISP's screening, engaging, and referring activities were embraced by physicians and non-physicians alike. The unattended high distress levels throughout the health training and healthcare workforce demonstrated the need for safe screening and referral, and the level of engagement and referrals generated by the ISP attested to its effectiveness.

The participant categories added in 2016—nurses and other nonphysician healthcare staff—account for more than 50% of responses. That these groups so eagerly embraced HEAR resources, including the ISP, was not a surprise. At our institution, nurses and other nonphysician healthcare staff far outnumber medical and physician learners, staff, and faculty. Further, nursing is a female-dominated profession, where approximately 80% of nurses are women. In both the general population and among healthcare workers, women have higher rates of depression and suicide attempts and other markers of stress and distress than men which might also help explain the disproportionate use of the HEAR program among females,22, 23  and hence among nurses and other staff added in 2016. The overall increase in the ISP's utilization after 2016 likely extends beyond the addition of nurses and other staff, but also include an increase in program staffing after 2016 (from 1 to 2 and then 2.5 FTE program counselors), increased recognition and visibility of the program, and the increased stress, burnout and depression accompanying COVID.23 

Although in any given year the number of potential respondents completing the ISP was never greater than about 1 out of 4, and usually much lower,11,14-18  the numbers added up over time, reaching well over 5000 individuals, including almost 1000 medical and pharmacy students, over 1000 residents/ fellows and attending physicians, and more than 1000 nurses. That so many of the respondents were in the Tier 1 high risk group, 2652/5368 (49.4%) suggests the ISP preferentially reaches its target group, those in need of further emotional support and mental health care. And that so many received and accepted mental health referrals, 1681 during this 14-year period, more than half of whom came directly from the ISP, supports the utility of such a program. These findings confirm and expand a previous report from Mortali and Moutier that described the implementation of ISP from 6 medical schools over a 7-year period (2007– 2013).12  Their study included 1449 medical students, residents, and faculty physicians. The current study adds pharmacy students, nurses, and other healthcare workers. In both studies, most respondents were designated as having moderate or high distress, and only a small minority were receiving any type of counseling or therapy. Also, in both studies, the ISP was found to help identify, engage “at risk” individuals and facilitate mental health care referrals.

Despite the considerable mental health distress experienced by physicians, nurses experience even more distress across several indicators. Even after adjusting for gender and other demographic features, they were more likely to score in the moderate to higher depression level on the PHQ-9, to experience each of the painful emotional states that have been associated with suicide risk and were more likely to be rated as “high-risk.” This is consistent with reports of nurses, more so than physicians, to die by suicide compared to non-nurse and non-physician counterparts.7  It also suggests the critical importance of paying more individual and institutional attention to nurses’ unique occupational stressors as a way of enhancing engagement and wellbeing of nurses working in this uniquely challenging calling.18 

In contrast, even after adjusting for age and gender, we found medical students were less likely than physicians to score as moderate or greater depression, experience intense negative effects, express difficulty functioning, or be rated as “high-risk;” and pharmacy students were less likely than physicians to rate themselves as burned out. We suspect the earlier prioritization of student wellbeing and the implementation of wellness directors at the medical and pharmacy schools were at least partially responsible for these unanticipated findings. That conclusion is buttressed by the high proportion, over 70%, of medical and pharmacy students who expressed satisfaction with the availability of mental health and wellness resources at the institution.

The overall rate of “feeling like you were drinking too much” as an indicator of problematic drinking is lower than might be expected based on previous reports of alcohol abuse and dependence in healthcare workers,24  but this report uses a single screening item regarding participants’ own judgment rather than a validated instrument to measure alcohol misuse. In a previous HEAR study featuring alcohol use among medical students, house staff and faculty,25  we reported a rate of 2.1% participants endorsing drinking “too much,” “a lot,” or “most” of the time, similar to rates provided in the present report. However, if we added those who endorsed “some of the time” the percentage rose to 18.3%, more consistent with other reports using validated measures to identify alcohol abuse and dependence.24, 25  In our previous study, we found those who reported “drinking too much” exhibited greater overall distress, depression, and suicidality, yet were no more likely that others to be receiving mental health care suggesting a troubling unfulfilled need for treatment in this high-risk group. That said, we were gratified to see that those who reported “drinking too much” were more likely to accept referrals, suggesting that the HEAR program may be helping this potentially undertreated population to find much needed support.25 

It is difficult to locate comparable programs to help put these results in perspective. In an earlier 8-year review of the UC San Diego HEAR program14  we reported similar rates of overall distress, depression, and suicidal ideation, and that HEAR had referred 320 individuals for ongoing mental health care from May 2009 through June 2017 (196 directly from the ISP and 124 by other HEAR mechanisms), but at that time the number of non-physicians participating in the ISP was negligible and burnout was not being measured. A subsequent HEAR study found increases in untreated burnout, depression and intense negative feeling states in the 2-years after COVID-19 compared to the 2-years before COVID-19.26  UC Davis published a report of their implementation of the ISP 2013/2014 for residents, fellows and faculty physicians.27  They reported 37% of respondents at high risk (Tier 1), and that 11% (17 individuals) were referred for further mental health treatment or evaluation. These numbers were quite similar to what we report in this study for the comparable groups. Finally, in their 20072013 review of various programs’ implementation of the ISP, Mortality and Moutier also reported that most respondents were designated as having moderate or high distress.12  In contrast to the current report, Mortality and Moutier reported higher rates of distress among medical students and residents versus faculty physicians,12  but that study period predated the increased attention to burnout and mental distress in most medical schools and institutions,28  and did not control for age or gender, both of which are associated with burnout, depression and suicide risk. The importance of adjusting for demographic features cannot be overstated.

The rate of program engagement in the Mortali and Moutier study was comparable to ours, with the majority in both studies reviewing the counselors’ responses, especially among those most distressed. The earlier HEAR study, UC Davis study, and the Mortali and Moutier studies all demonstrated the ISP as a feasible tool for engaging at-risk medical students, residents and physicians who were not currently utilizing mental health services. Our current study confirms those results and adds nurses and other clinical and non-clinical staff to the groups benefiting from this screening, engagement, and referral program.

The low rates of mental health treatment prior to engaging in the ISP is concerning. It parallels the low rates mental health treatment found in other reports on medical students and physicians using the IPS,12, 27  as well as those found in longitudinal studies of physicians in training29  and in epidemiological studies of the general population.30  Others have noted that healthcare practitioners are likely to suffer in silence, largely due to their perceived stigma associated with experiencing “stress” and “mental illness” as well as fear of getting their medical license withdrawn.31, 32  The ISP, especially when supported by other educational and support measures, may be a way forward.

This study adds to previous findings that when proactive, anonymous, screening and outreach is made available to healthcare students, trainees, faculty and staff, enhanced help-seeking behavior may be the result.12, 27  It was gratifying to see engagement with HEAR counselors was highest in those most distressed who were not already in treatment. This provides an opportunity that could be lifesaving for those most in need. The ISP is one cost effective approach that facilitates that welcome outcome.

The study sample may not be representative of the UC San Diego population, nor the larger population of healthcare students, trainees, providers, and staff. We do not know whether respondents differed in any systematic way from those who chose not to participate. Thus, we cannot generalize the results to other students, trainees, or healthcare workers at UC San Diego, or at other institutions. Unfortunately, we were unable to compare this sample to the overall UC San Diego Health population which would help uncover any skewed representation. The data is entirely self-reported without any way of knowing how accurately respondents answered items. The single item, self-defined burnout measure may have underestimated burnout relative to a more nuanced burnout measure, such as the Maslach Burnout Inventory.33  Most of the outcome data do not come from non-validated measures; thus, findings should be interpreted with caution.

Still, the ISP was not designed as a research tool. Rather, it is a screening and engagement program created to facilitate mental health treatment for those in need. The use of this confidential, anonymous screening instrument along with the critical component of dialogue, engagement, support, and the use of motivational interviewing-style techniques by ISP counselors seems to be working. We conceptualize this approach as a vital component in the broader context of the emerging Workplace Suicide Prevention efforts, which have growing evidence and traction across numerous industries.34 

In this summary of the HEAR Program's impact over a 14-year period in an academic medical center comprised of over 10000 faculty, staff, and trainees in any given year, over 5000 individuals engaged in ISP screening and 1482 dialoged with program counselors. Notable findings in this voluntary, self-selecting group of physicians, nurses, trainees and staff included ~40% experiencing depression symptoms, ~50% symptoms of burnout, ~10% suicidal ideation, with medical students surprisingly experiencing clinically meaningful depression symptoms less frequently than physicians in practice, females more than males and nurses at almost 3 times the rate of physicians. Suicide risk was indicated by multiple domains of distress, and almost half of all participants were in the highest risk tier. All groups frequently engaged with the program counselors and an appreciable number, almost 1000 individuals, accepted referrals to mental health providers as part of the ISP process.

This 14-year history on 1 health system's implementation of the AFSP's ISP supports its feasibility and effectiveness. The ISP is an evidence-based, innovative program that has been widely adopted across institutions of higher education, medical and professional degree schools, organizations, and workplaces and has connected over 280000 people to professional support.35  The ISP has received recognition and endorsement from various organizations. It is listed by the Accreditation Council for Graduate Medical Education's Tools and Resources for Physician Well-Being,36  as a recommended program in the American Hospital Association's report, Suicide Prevention: Evidence-Informed Interventions for the Health Care Workforce37  and in the US Surgeon General's report, Addressing Health Worker Burnout: The US Surgeon General's Advisory on Building a Thriving Health Workforce.38  We are delighted to be part of this long overdue national conversation on addressing healthcare workers’ suicide prevention, mental health and wellness.

The authors would like to thank Maggie Mortali and Laura Hoffman for their collegiality and expertise while maintaining the American Foundation for Suicide Prevention's Interactive Screening Program and providing data for this study, and the leadership the UC San Diego School of Medicine and Health Services for their unflagging support of the Healer Education, Assessment and Referral (HEAR) program.

1.
Murthy
VH.
Confronting health worker burnout and well-being
.
N Engl J Med.
2022
Aug
18
387
7
577
9
doi:
10.1056/NEJMp2207252
2.
Dyrbye
LN
,
Thomas
MR
,
Harper
W
,
Massie
FS
Jr,
Power
DV
,
Eacker
A
, et al.
The learning environment and medical student burnout: a multicenter study
.
Med Educ
.
2009
Mar
;
43
(
3
):
274
-
82
.
doi:
10.1111/j.1365-2923.2008.03282.x
3.
Zhou
AY
,
Panagioti
M
,
Esmail
A
,
Agius
R
,
Van Tongeren
M
,
Bower
P.
Factors associated with burnout and stress in trainee physicians: a systematic review and meta-analysis
.
JAMA Netw Open
.
2020
Aug
3;3
(
8
): e2013761.
doi:
10.1001/jamanetworkopen.2020.13761
4.
Shanafelt
TD
,
West
CP
,
Sinsky
C
,
Trockel
M
,
Tutty
M
,
Satele
DV
, et al.
Changes in burnout and satisfaction with work-life integration in physicians and the general US working population between 2011 and 2017
.
Mayo Clin Proc.
2019
;
94
(
9
):
1681
-
1694
.
doi:
10.1016/j.mayocp.2018.10.023
5.
Dyrbye
LN
,
Shanafelt
TD
,
Johnson
PO
,
Johnson
LA
,
Satele
D
,
West
CP.
A cross-sectional study exploring the relationship between burnout, absenteeism, and job performance among American nurses
.
BMC Nursing.
2019
;(
20
):
1
-
8
.
doi:
10.1186/s12912-019-0382-7
6.
Moutier
C.
Physician mental health: an evidence-based approach to change
.
J Med Regul.
2018
;(
1
):
7
-
13
.
doi:
10.30770/2572-1852-104.2.7
7.
Davidson
JE
,
Proudfoot
J
,
Lee
K
,
Terterian
G
,
Zisook
S.
A longitudinal analysis of nurse suicide in the United States (2005–2016) with recommendations for action
.
Worldviews Evid Based Nurs.
2020
Feb
;
17
(
1
):
6
-
15
.
doi:
10.1111/wvn.1241
8.
Gold
KJ
,
Schwenk
TL.
Physician suicide—a personal and community tragedy
.
JAMA Psychiatry
.
2020
Jun
1
77
6
559
60
doi:
10.1001/jamapsychiatry.2020.0009
9.
Petrie
K
,
Crawford
J
,
Baker
ST
,
Dean
K
,
Robinson
J
,
Veness
BG
, et al.
Interventions to reduce symptoms of common mental disorders and suicidal ideation in physicians: a systematic review and meta-analysis
.
Lancet Psychiatry
.
2019
Mar
1
6
3
225
34
doi:
10.1016/S22150366(18)30509-1
10.
Harvey
SB
,
Epstein
RM
,
Glozier
N
,
Petrie
K
,
Strudwick
J
,
Gayed
A
, et al.
Mental illness, and suicide among physicians
.
Lancet
.
2021
Sep
4
398
10303
920
30
doi:
10.1016/S0140-6736(21)01596-8
11.
Moutier
C
,
Norcross
W
,
Jong
P
,
Norman
M
,
Kirby
B
,
McGuire
T
, et al.
The suicide prevention and depression awareness program at the University of California, San Diego School of Medicine
.
Acad Med
.
2012
Mar
1
87
3
320
6
doi:
10.1097/ACM.0b013e31824451ad
12.
Mortali
M
,
Moutier
C.
Facilitating help-seeking behavior among medical trainees and physicians using the interactive screening program
.
J Med Regul
.
2018
Jul
1
104
2
27
36
doi:
10.30770/2572-1852-104.2.27
13.
Lown
BA
,
Manning
CF.
The Schwartz Center Rounds: evaluation of an interdisciplinary approach to enhancing patient-centered communication, teamwork, and provider support
.
Acad Med
.
2010
Jun
1
85
6
1073
81
doi:
10.1097/ACM.0b0103e3181dbf741
14.
Norcross
WA
,
Moutier
C
,
Tiamson-Kassab
M
,
Jong
P
,
Davidson
JE
,
Lee
KC
, et al.
Update on the UC San Diego healer education assessment and referral (HEAR) program
.
J Med Regul
.
2018
Jul
1
104
2
17
26
doi:
10.30770/2572-1852-104.2.17
15.
Rubanovich
CK
,
Zisook
S
,
Bloss
CS.
Associations between privacy-related constructs and depression and suicide risk in health care professionals, trainees, and students
.
Acad Med
.
2022
Feb
1
97
2
239
46
doi:
10.1097/ACM.0000000000004513
16.
Downs
N
,
Feng
W
,
Kirby
B
,
McGuire
T
,
Moutier
C
,
Norcross
W
, et al.
Listening to depression and suicide risk in medical students: the Healer Education Assessment and Referral (HEAR) Program
.
Acad Psychiatry
.
2014
Oct
;
38
:
547
-
53
.
doi:
10.1007/s40596-014-0115-x
17.
Zisook
S
,
Young
I
,
Doran
N
,
Downs
N
,
Hadley
A
,
Kirby
B
, et al.
Suicidal ideation among students and physicians at a US medical school: A healer education, assessment, and referral (HEAR) program report
.
OMEGA-Journal of Death and Dying.
2016
Nov
;
74
(
1
):
35
-
61
.
doi:
10.1177/0030222815598045
18.
Davidson
JE
,
Zisook
S
,
Kirby
B
,
DeMichele
G
,
Norcross
W.
Suicide prevention: a healer education and referral program for nurses
.
J Nurs Adm
.
2018
Feb
1
48
2
85
92
doi:
10.1097/NNA.0000000000000582
19.
Kroenke
K
,
Spitzer
RL
,
Williams
JB.
The PHQ-9: validity of a brief depression severity measure
.
J Gen Intern Med
.
2001
Sep
;
16
(
9
):
606
-
13
.
doi:
10.1046/j.1525-1497.2001.016009606.x
20.
Hendin
H
,
Maltsberger
JT
,
Haas
AP
,
Szanto
K
,
Rabinowicz
H.
Desperation and other affective states in suicidal patients
.
Suicide Life Threat Behav
.
2004
Dec
1
34
4
386
394
doi:
10.1521/suli.34.4.386.53734
21.
Rohland
BM
,
Kruse
GR
,
Rohrer
JE.
Validation of a single-item measure of burnout against the Maslach Burnout Inventory among physicians
.
Stress and Health
.
2004
Apr
;
20
(
2
):
75
-
9
.
doi:
10.1002/smi.1002
22.
Bommersbach
TJ
,
Rosenheck
RA
,
Rhee
TG.
National trends of mental health care among US adults who attempted suicide in the past 12 months
.
JAMA Psychiatry
.
2022
Mar
1
79
3
219
31
doi:
10.1001/jamapsychiatry.2021.3958
23.
Lai
J
,
Ma
S
,
Wang
Y
,
Cai
Z
,
Hu
J
,
Wei
N
, et al.
Factors associated with mental health outcomes among health care workers exposed to Coronavirus disease 2019
.
JAMA Netw Open.
2020
;
3
(
3
): e203976.
doi:
10.1001/jamanetworkopen.2020.3976
24.
Oreskovich
MR
,
Shanafelt
T
,
Dyrbye
LN
,
Tan
L
,
Sotile
W
,
Satele
D
, et al.
The prevalence of substance use disorders in American physicians
.
Am J Addict
.
2015
Jan
;
24
(
1
):
30
-
8
.
doi:
10.1111/ajad.12173
25.
Martinez
S
,
Tal
I
,
Norcross
W
,
Newton
IG
,
Downs
N
,
Seay
K
, et al.
Alcohol use in an academic medical school environment: A UC San Diego Healer Education Assessment and Referral (HEAR) Report
.
Annals of Clinical Psychiatry
,
May
1
28
2
85
94
26.
Zisook
S
,
Doran
N
,
Downs
N
,
Lee
D
,
Nestsiarovich
A
,
Davidson
JE.
Healthcare provider distress before and since Covid-19
.
Gen Hosp Psychiatry
.
2022
.
Nov
;
79
:
180
.
doi:
10.1016/j.genhosppsych.2022.08.005
27.
Haskins
J
,
Carson
JG
,
Chang
CH
,
Kirshnit
C
,
Link
DP
,
Navarra
L
, et al.
The suicide prevention, depression awareness, and clinical engagement program for faculty and residents at the University of California, Davis Health System
.
Acad Psychiatry
.
2016
Feb
;
40
:
23
-
9
.
doi:
10.1007/s40596-021-01439-6.
28.
Beresin
EV
,
Milligan
TA
,
Balon
R
,
Coverdale
JH
,
Louie
AK
,
Roberts
LW.
Physician wellbeing: a critical deficiency in resilience education and training
.
Acad Psychiatry
.
2016
Feb
;
40
:
9
-
12
.
doi:
10.1007/s40596-015-0475-x
29.
Fang
Y
,
Bohnert
AS
,
Pereira-Lima
K
,
Cleary
J
,
Frank
E
,
Zhao
Z
, et al.
Trends in depressive symptoms and associated factors during residency, 2007 to 2019: a repeated annual cohort study
.
Ann Internal Med
.
2022
Jan
;
175
(
1
):
56
-
64
.
doi:
10.7326/M21-159
30.
Terlizzi
EP
,
Norris
T.
Mental health treatment among adults: United States, 2020
.
NCHS Data Brief
.
2021
.
Oct
(
419
):
1
-
8
.
31.
Mehta
SS
,
Matthew
BA
,
Edwards
L.
Suffering in silence: mental health stigma and physicians’ licensing fears
.
Am J Psychiatry Resid J
.
2018
(
13
):
2
-
4
.
doi:
10.1176/appi. ajp-rj.2018.131101
32.
Knaak
S
,
Mantler
E
,
Szeto
A.
Mental illness-related stigma in healthcare: barriers to access and care and evidence-based solutions
.
Healthc Manage Forum.
(
2017
)
30
:
111
-
6
.
doi:
10.1177/0840470416679413
33.
Knox
M
,
Willard-Grace
R
,
Huang
B
,
Grumbach
K.
Maslach burnout inventory and a self-defined, single-item burnout measure produce different clinician and staff burnout estimates
.
J Gen Intern Med
.
2018
Aug
;
33
:
1344
-
51
.
doi:
10.1007/s11606-018-4507-6
34.
National Action Alliance of Suicide Prevention: Comprehensive Blueprint for Workplace Suicide Prevention
.
Published 2018
. Accessed August 13,
2024
.
35.
American Foundation for Suicide Prevention: Interactive Screening Program
.
Published 2024
. Accessed August 13,
2024
.
36.
Accreditation Council for Graduate Medical Education: Improving Physician Well-Being, Restoring Meaning in Medicine
.
Published 2024
. Accessed August 13,
2024
.
37.
American Hospital Association. Suicide Prevention: Evidence-Informed Interventions for the Health Care Workforce
.
Published 2022
. Accessed August 13,
2024
.
38.
Office of the Surgeon General (OSG)
.
Addressing Health Worker Burnout: The US Surgeon General's Advisory on Building a Thriving Health Workforce
.
US Department of Health and Human Services
.
Published 2022
. Accessed August 13, 2024.

Funding/support: This work was supported by a grant from the T. Denny Sanford Institute for Empathy and Compassion at the University of California, San Diego.

Other disclosures: Dr. Zisook receives research support from COMPASS Pathways Ltd.

Ethics statement: This study was determined to be exempt by the UC San Diego Institutional Review Board

Author contributions: Study concept, design, analysis, and data interpretation (ND, CM, JD, SZ); Data acquisition (CS, RA); Critical revisions of the manuscript for important intellectual content (All)