Abstract
Board certification is an important professional qualification and a prerequisite for credentialing, and the Accreditation Council for Graduate Medical Education (ACGME) assesses board certification rates as a component of residency program effectiveness. To date, research has shown that preresidency measures, including National Board of Medical Examiners scores, Alpha Omega Alpha Honor Medical Society membership, or medical school grades poorly predict postresidency board examination scores. However, learning styles and temperament have been identified as factors that may affect test-taking performance. The purpose of this study is to characterize the learning styles and temperaments of pediatric residents and to evaluate their relationships to yearly in-service and postresidency board examination scores.
This cross-sectional study analyzed the learning styles and temperaments of current and past pediatric residents by administration of 3 validated tools: the Kolb Learning Style Inventory, the Keirsey Temperament Sorter, and the Felder-Silverman Learning Style test. These results were compared with known, normative, general and medical population data and evaluated for correlation to in-service examination and postresidency board examination scores.
The predominant learning style for pediatric residents was converging 44% (33 of 75 residents) and the predominant temperament was guardian 61% (34 of 56 residents). The learning style and temperament distribution of the residents was significantly different from published population data (P = .002 and .04, respectively). Learning styles, with one exception, were found to be unrelated to standardized test scores.
The predominant learning style and temperament of pediatric residents is significantly different than that of the populations of general and medical trainees. However, learning styles and temperament do not predict outcomes on standardized in-service and board examinations in pediatric residents.
Introduction
Board certification is increasingly important as a quality measure—the quality of individual physicians—and is aggregated to the program level as a measure of the effectiveness of the residency education program.1,2 The general public values physicians with board certification or maintenance of certifications highly.3 However, the American Board of Pediatrics certification pass rates for first-time takers averages between 75% and 79%.4 There is no correlation between preresidency measures, such as National Board of Medical Examination scores, Alpha Omega Alpha membership, and medical school grades, and in-service or board-certification test performance.5–8
The theory of experiential learning suggests that hereditary factors, life experiences, and the environment influence individuals' learning styles.9 Temperament is the configuration of individuals' traits, attitudes, values, and talents, which influences how they perceive information and subsequently apply it to life experiences.10 Temperament and learning styles could potentially influence academic achievement. Although there are studies that have investigated the influences of these psychosocial factors on academic achievement in undergraduate and graduate medical learners, the same investigation has not been done in pediatric residents.11–14 We sought to explore the relationship between pediatric residents' temperaments and learning styles and objective measures of pediatric residents' educational performance, specifically, standardized test performance.
Methods
We invited current residents of the University of Florida pediatric residency program and residents who had graduated from the program within the previous 6 years to participate in this investigation. The University of Florida Institutional Review Board reviewed and approved this study, and we obtained signed, informed consent from participants.
Temperament and Learning Style Identification
All participants were asked to complete 3 psychometric instruments: the Kolb Learning Style Inventory (KLSI), the Felder-Silverman Learning Style test (FSLS), and the Keirsey Temperament Sorter (KTS). The KLSI was paper-based, whereas the other 2 were online. The FSLS was free, whereas the other 2 tests had a per-test cost. We compared results to the normative data available for the KLSI and the KTS.
The KLSI determines an individual's predominant learning style based on the “Experiential Cycle of Learning” (figure 1).15 It categorizes subjects into 4 styles (accommodators, assimilators, convergers, and divergers).
The FSLS is an online instrument used to assess preferences on 4 dimensions (active/reflective, sensing/intuitive, visual/verbal, and sequential/global).16 This test was used as an alternative to the KLSI for residents who had already graduated (because it could be completed online).16
The KTS is an online test that determines an individual's psychological personality10,17: (artisan, guardian, idealist, and rational) and 16 subtypes, based on their relative preference for each of 4 pairs of scales (extraversion/introversion, sensation/intuition, thinking/feeling, and perception/judgment).
Standardized Test Data
In-service scores of all participating residents were obtained from the program director's resident files (no self-reports). Board certification scores of former residents were obtained directly from the data center at the American Board of Pediatrics. We used the scores of these standardized tests as outcome variables for each participant's learning style and temperament.
Data Analysis
We used the χ2 test to determine whether there was a dominant learning style or temperament among pediatric residents and to compare residents' KLSI and KTS distributions with population norms. Individual residents' temperament and learning style data were compared with their respective standardized test scores using descriptive statistics and analysis of variance procedures. We performed the analyses using Statistical Package for the Social Sciences (v. 17, formerly SPSS, Chicago, IL; now, IBM Corporation, Armonk, NY) with P < .05 being significant. Following data collection, we conducted a post hoc calculation of statistical power using G*Power.18
Results
Eighty-six of 150 current or former residents (57%) participated and completed at least 1 of 3 psychometric instruments. Most of the participants were current residents. The KLSI was completed by 75 residents (87.2% of participants), the FSLS by 46 residents (53.5%) and the KTS by 56 residents (65.1%). Thirty-seven residents (40.7%) completed all 3 tests. In-service examination (ISE) scores were available for all residents that participated in the study (100%), whereas board certification examination (BCE) scores from the American Board of Pediatrics were available for 60 residents (100% of participating residents who have graduated and taken the boards to date).
Learning Styles KLSI (figure 2)
Kolb Learning Style Index in Pediatric Residents Compared With the General Population
Kolb Learning Style Index in Pediatric Residents Compared With the General Population
The learning styles of the 75 pediatric residents that completed this assessment differed significantly from the general population overall (P < .01).9 Sex was evaluated as a possible confounding factor but was not significant.
Learning Styles FSLS (figure 3)
Relative Preference of Pediatric Residents for the 4 Scales on Felder-Silverman Index of Learning Styles
Relative Preference of Pediatric Residents for the 4 Scales on Felder-Silverman Index of Learning Styles
After evaluation of the 46 residents that completed this assessment, certain patterns emerged. No generalized population data, or data from medical students or residents, was available for comparison. We compared the distribution of residents between the FSLS and the KLSI because both had scales that measured reflective versus active and sensing versus intuitive learning preferences and found that the distribution was different between the 2 tests (n = 37).
Temperament Styles KTS (figure 4)
Pediatric Resident Temperament by Keirsey Temperament Sorter Compared With the General Population
Pediatric Resident Temperament by Keirsey Temperament Sorter Compared With the General Population
The temperament distribution of the 56 pediatric residents that completed this assessment was significantly different from the general population (P = .04)19 and did not vary significantly by sex.
ISE and BCE Performance (figures 5 and 6)
Comparison of Kolb Learning Styles With In-Service Training Examination and Board Certifications Scores
Comparison of Kolb Learning Styles With In-Service Training Examination and Board Certifications Scores
Comparison of In-Service Training Scores of Visual Versus Verbal Learners on the Felder-Silverman Learning Style Test
Comparison of In-Service Training Scores of Visual Versus Verbal Learners on the Felder-Silverman Learning Style Test
As expected, the average score for the ISE for each residency year of training (postgraduate level [PL]-1, PL-2, and PL-3) increased with the years of residency training. Analysis of KLSI data (figure 5) provides indication that there was little variation in in-training examination performance between learning styles, until the PL-3 year; after which, the converging style tended to score higher, on average. Also, residents with stronger inclinations toward learning by active experimentation (convergers and accommodators) performed better on their PL-1 ISE. Residents who were visual learners on the FSLS (figure 6) scored significantly higher on their PL-1 year ISE. All other analyses revealed no association.
Comparing temperaments to test scores, no statistically significant relationships were found between KTS temperament classification and any of the ISEs or the BCEs. Artisans tended to perform better on the ISE, but not in a statistically significant manner (figure 7).
Comparison of Keirsey Temperament Sorter Temperament Styles With In-Service Training Examination and Board Certifications Scores
Comparison of Keirsey Temperament Sorter Temperament Styles With In-Service Training Examination and Board Certifications Scores
Power Analysis
Using a relatively small effect size (f2 = .1), the research design elicited power (1-β err probability) of .896. Based on this calculation we are relatively certain of our sample's ability to discern effect.20
Discussion
Our findings show that pediatric residents have learning styles and temperaments significantly different from the general population. Bitran and colleagues21 compared the choice of medical specialty by medical students to their learning styles and personalities and found that 70% of the medical students that selected pediatrics belonged to the personalities characterized by sensing and judging (similar to the guardian temperament), and none were of the sensing-perceiving (artisan) personality. This is similar to our results. Also, we found a predominance of converging learning styles in pediatric residents, which is consistent with the Kolb9 study that shows that medical professionals, in general, tend to be predominantly convergers.
Certain learning styles tended to do better in standardized tests than others. Two studies of 227 medical students and 16 surgical residents found that the converger learning style had better outcomes on standardized testing.12,14 This is consistent with our results too. This may be because convergers are the thinkers-doers, a learning style that has been shown to perform better on single, best-answer type tests.12,22
Lacorte and Risucci11 and Reich et al13 found that the temperaments of anesthesiology and pediatric residents, respectively, correlated with clinical performance during residency. Our study evaluated outcomes of standardized testing, rather than clinical performance and showed no correlation with temperament.
Limitations of our study include its small sample size and single-site intervention. Also, although we had a robust participation rate and included graduated residents, the total number of participants was low because we have an average-sized pediatric residency program. However, power analyses suggest that we had an adequate number of participants for significance. The other potential limitation was that this study was performed within one pediatric residency program. It is possible that the distribution of learning styles and temperaments was not random and could have reflected a selection bias by our faculty when selecting residents. Repeating this study with multiple pediatric residency programs would allow us to further evaluate these results and other hypotheses. Finally, we found that the 2 tests of learning styles did not correlate, which may be due to the small numbers that completed both tests. Having all residents complete the same learning style tool may have led to results with more statistical significance.
Conclusion
Pediatric residents vary greatly, among themselves and across known normative data, in their learning and temperament styles. Although certain learning styles and temperaments expressed by pediatric residents tended to perform better on standardized tests, they did not consistently predict their performance on in-service and board examinations. Given the variety of learning styles and temperaments in these residents, however, it may be beneficial to augment pediatric resident educational curricula to better reflect the learning styles and temperament of each pediatric residency group.
References
Author notes
All authors are at the University of Florida. Sanjeev Y. Tuli, MD, is Associate Professor and Chief of the Division of Ambulatory Pediatrics; Lindsay A. Thompson, MD, MS, is Assistant Professor in the Division of Ambulatory Pediatrics and in Epidemiology and Health Policy Research; Heidi Saliba, BA, is Research Assistant in the Division of Ambulatory Pediatrics; Erik W. Black, PhD, is Assistant Professor in the Division of Ambulatory Pediatrics and in the College of Education, School of Teaching and Learning; Kathleen A. Ryan, MD, is Assistant Professor in the Division of Ambulatory Pediatrics; Maria N. Kelly, MD, is Assistant Professor in the Division of Ambulatory Pediatrics; Maureen Novak, MD, is Associate Professor in the Division of Ambulatory Pediatrics; Jane Mellott, MD, is Assistant Professor in the Division of Ambulatory Pediatrics; and Sonal S. Tuli, MD, is Associate Professor and Residency Program Director in the Department of Ophthalmology.
Funding: The authors report no external funding source.