ABSTRACT
Combined internal medicine and pediatrics (medicine-pediatrics) residencies were Accreditation Council for Graduate Medical Education (ACGME) accredited separately from their corresponding categorical residencies in June 2006.
We investigated how ACGME accreditation of medicine-pediatrics programs has affected the levels of support (both financial and personnel), the National Resident Matching Program (NRMP) match rate, performance on the board examination, and other graduate outcomes.
From 2009 through 2013 we sent an annual SurveyMonkey online survey to members of the Medicine-Pediatrics Program Directors Association. Questions pertained to program characteristics, program director support, recruitment, ambulatory training, and graduate data. More than 79% of responders completed the entire survey for each year (sample size was 60 program directors).
Compared to the time prior to accreditation of the specialty, there was an increase in program directors who are dually trained (89% versus 93%), an increase in program director salary ($134,000 before accreditation versus $185,000 in 2013, P < .05), and an increase in the average full-time equivalent support (0.32 before accreditation versus 0.42 in 2013, P < .05). There was also an increase in programs with associate program directors (35% versus 78%), programs with chief residents (71% versus 91%), and an increase in program budgets controlled by program directors (52% versus 69%). The 2013 NRMP match rates increased compared to those of 2005 (99% versus 49%). Performance on the American Board of Pediatrics examination was comparable to that for pediatrics residents. Since accreditation, a larger number of residents are choosing careers in hospital medicine.
Our data show widespread improved support for medicine-pediatrics programs since the 2006 start of ACGME accreditation.
Internal medicine-pediatrics programs were accredited by the Accreditation Council for Graduate Medical Education in June 2006, making this type of program a candidate for studying the impact of accreditation.
This study found improved financial and personnel support for medicine-pediatrics programs between 2009 and 2013.
Lack of validity evidence for the survey instrument; some survey attrition.
Recent data show favorable trends for medicine-pediatrics programs compared to the period before the specialty was accredited. Further study is needed to confirm a causative relationship with accreditation.
Introduction
Internal medicine-pediatrics (medicine-pediatrics) is the only combined specialty accredited by the Accreditation Council for Graduate Medical Education (ACGME). In 2012, 362 positions were offered in the National Resident Matching Program (NRMP), which represent 1.5% of all available positions and 78% of combined residency positions. As of June 2006, combined medicine-pediatrics programs were accredited separately from their categorical residencies. Since 2007, a few medicine-pediatrics programs have been discontinued, although the number of residents participating in training has remained stable.1 Regardless of the change to accreditation, combined residency program directors still work with the core programs of internal medicine and pediatrics. Robbins et al2 demonstrated that since 1999 there has been a movement toward greater administrative and financial independence for medicine-pediatrics programs. The study found that program directors were more likely to be dually trained, and that programs that employed a greater number of medicine-pediatrics faculty, were more likely to have a budget independent from the pediatrics and internal medicine budgets, and were more likely to have a chief resident.2 This information was collected in 2004 and 2005, prior to ACGME accreditation. Data on postaccreditation changes in combined medicine-pediatrics programs from 2009 to 2013 may inform those currently sponsoring these programs and those considering the development of new training programs.
The Medicine-Pediatrics Program Directors Association (MPPDA) has conducted an annual membership survey since 2009. We utilized the MPPDA members as our primary source of data. We sought to examine how the levels of financial and personnel support, the board passing rate, the NRMP match rate, and graduate outcomes for medicine-pediatrics programs have changed in the half-decade since accreditation.
Methods
Survey
From 2009 through 2013, we invited each MPPDA member via e-mail to complete an annual SurveyMonkey online survey, with reminders sent every 2 weeks for 2 months. E-mail addresses were obtained from the MPPDA and ACGME lists. Each survey was divided into sections pertaining to (1) program characteristics; (2) program director support (ie, administrative personnel, program director, associate program director, chief resident, program coordinator, and financial contributions); (3) recruitment; (4) ambulatory training; and (5) graduate data. The content of the survey remained the same each year to maintain standardization.
Survey Creation and Validation
The survey was created by a MPPDA research committee, in which questions were created and refined and then approved by the MPPDA executive committee. No validity evidence was obtained.
An exemption was obtained by the State University of New York Buffalo Institutional Review Board.
Data Analysis
Data obtained for each year were compared to preaccreditation data from Robbins et al2 where available. Multiple linear regression analysis was used in determining factors (attrition, NRMP fill rates, industry support) associated with board pass rates. Statistical analyses were done using a Student t test. Data are presented as mean ± SD. A P value of .05 or less was considered significant.
Results
Overall Survey Response
We had a high response rate, with 81% (64 of 79), 71% (57 of 80), 80% (63 of 79), 76% (60 of 79), and 71% (57 of 74) from 2009 to 2013, respectively. More than 77% (49 of 64) of responders completed the entire survey instrument for each year. The average sample size was 60 program directors, and the average completion rate was 91% (274 of 301).
Program Director Demographics
Table 1 summarizes demographics and support data for program directors from 2009 to 2013 compared to preaccreditation.2 After accreditation, medicine-pediatrics program directors received an increase in salary support ($134,000 prior to accreditation versus $185,000 in 2013) and an increase in full-time equivalent (FTE) support (0.32 FTE prior to accreditation versus 0.42 FTE in 2013). A total of 88% of preaccreditation program directors in the Robbins et al2 study reported having trained in a combined medicine-pediatrics residency compared to 94% (58 of 62), 98% (55 of 56), 94% (58 of 62), 97% (56 of 58), and 93% (53 of 57) for 2009 to 2013, respectively.
Levels of Program Support
Table 2 shows an increase in medicine-pediatrics staff, personnel, and administrative support compared to 2007. In 2013, 78% (43 of 55) of the programs had an associate program director, compared with 35% in the Robbins et al study.2 The proportion of programs with a medicine-pediatrics chief resident had increased from 71% to 91% (50 of 55) in 2013. Prior to accreditation, 52% of programs directors controlled a separate budget for the medicine-pediatrics residency2 ; in 2012 and 2013, that number was 65% (36 of 55) and 69% (38 of 55), respectively. The number of programs receiving support from the industry decreased from 34% in 20052 to 11% (6 of 55) in 2013.
Board Performance Data
Table 3 shows the trends in board pass rates during the first years of accreditation. The reported American Board of Internal Medicine (ABIM) pass rates for medicine-pediatrics and internal medicine residents in 2006 were 88% and 91%, respectively.2–4 These results show a modest decline in the ABIM pass rate compared to 2006. For 2011, we found that first-time passing of the ABIM certification examination was negatively associated with attrition from the training program but not with fill rates on the NRMP or industry support. Our data also showed that medicine-pediatrics residents' pass rate on the American Board of Pediatrics (ABP) increased in both 2012 and 2013 compared with the period prior to accreditation, and is similar to the pass rate for pediatrics residents.
NRMP Match Data
Graduate Outcomes
In the 2013 survey of program directors, we found that the graduates of medicine-pediatrics programs were choosing more hospital-based careers compared with the years before accreditation. In 2013, 33% (68 of 209) of graduates were planning an ambulatory career and 21% (44 of 209) were planning a hospitalist career. Of those planning a hospitalist career, 61% (27 of 44) chose a medicine-pediatrics position, 34% (15 of 44) chose an internal medicine position, and 5% (2 of 44) chose a pediatrics position. In 2013, 33% (68 of 209) of graduates planned to enter fellowship training. Of those choosing a fellowship, 49% (33 of 68) chose an internal medicine subspecialty, 35% (24 of 68) chose a pediatrics subspecialty, and 16% (11 of 68) selected a medicine-pediatrics fellowship position.
Discussion
Our study is the first comprehensive review of medicine-pediatrics program support and training outcomes since ACGME accreditation. Overall, we found increasing levels of financial and personnel support for medicine-pediatrics programs, comparable board performance to internal medicine and pediatrics programs, and an increasing NRMP Match rate. It is plausible that these changes are due to ACGME accreditation.
We found an increase in the number of program directors and associate program directors and an increase in program-controlled budgets compared with the 2007 Robbins et al study2 and a study by Wolfsthal et al5 that assessed support for internal medicine programs. We believe that this increased support is most likely due to increased recognition as an accredited residency by the sponsoring institution. No other public data are available on financial and personnel support of other residency programs since ACGME accreditation. Future studies are necessary to determine the positive outcomes of ACGME accreditation on other residency programs.
Robbins et al2 demonstrated that 49% of responding medicine-pediatrics residency programs filled all of their positions in the NRMP; this was positively correlated with a higher first-time ABIM pass rate, and the presence of combined noon conferences as part of the curriculum. In 2013, we found that an astonishing 99% of medicine-pediatrics positions were filled in the NRMP Match. In our study, no other factor was associated with filling the Match, and we can only hypothesize that the increase in match performance since 2006 is due to ACGME accreditation and an enhanced emphasis on educational outcomes.
A study by Falcone6 demonstrated that the pass rate for examinees from accredited medicine-pediatrics programs was higher than that for examinees from programs without medicine-pediatrics programs. The authors proposed that the underlying cause for this observation was that residencies with internal medicine-pediatrics programs were larger, with substantially higher numbers of examinees than residencies without these programs.6 This study did not consider changes in ACGME accreditation as a factor in examination outcomes. We found that both ABIM and ABP certification examination pass rates have remained variable. Ultimately, the reasons for examination performance are largely unclear; further study of variables associated with board pass rates is needed. Further research also is needed to assess whether medicine-pediatrics graduates are able to sustain some level of a combined practice postresidency.
Medicine-pediatrics training has been available for more than 40 years,7 and several studies have examined the changing curriculum, the adequacy of training, and the career paths of graduates.7–12 Primary care has been the most common career choice of medicine-pediatrics graduates, but our data suggest, similar to other disciplines, that the popularity of that choice is diminishing. Data for 2000 to 2006 showed that 93% of medicine-pediatrics graduates entered private practice. Chamberlain et al7 surveyed medicine-pediatrics residents and found that 55% planned a career in primary care, while 7% planned a career in hospital medicine. Our data show that a larger percentage (21%) now are choosing careers in hospital medicine. This may be a more general trend for internal medicine and pediatrics graduates, as data from the Society of Hospital Medicine show that the number of hospitalists increased 172% between 2003 and 2010.13 In 2012, there were approximately 34 000 hospitalists working in US hospitals.14
The major limitation to our study was the lack of validity evidence for our survey; other limitations included self-reported data, bias, and some attrition.15 We also did not have access to all of the raw data from the Robbins et al article2 ; therefore, we were unable to make statistical comparisons in some key areas. Although this study reports important findings about the impact of ACGME accreditation on medicine-pediatrics programs, future studies are needed to confirm our findings and attribute these finding directly with changes in ACGME accreditation. Additional studies will also be necessary to determine the effects of a new accreditation system that emphasizes competency-based assessment and improvement in patient safety and quality outcomes16 on medicine-pediatrics programs and outcomes for their graduates.
Conclusion
Our data show widespread improved support for medicine-pediatrics programs since 2006, the start of ACGME accreditation. This includes improvements in financial and personnel support, improved performance in the NRMP Match, and stabilized board pass rates.
References
Author notes
Funding: The authors report no external funding source for this study.
Competing Interests
Conflict of interest: The authors declare they have no competing interests.