Objectives

We implemented a curriculum using self-directed learning plans (SDLPs) based on clinical questions arising from the residents' practice, and we report on perceptions and attitudes from residents in internal medicine regarding the use of SDLPs conceived at point of care.

Methods

Internal medicine residents at a single community hospital in the Midwest were surveyed in 2006 regarding SDLPs. We report their perceived effectiveness in identifying knowledge gaps, the processes used to fill those gaps, and the resident outcomes using descriptive statistics.

Results

A total of 26 out of 37 residents (70%) responded. Most (24 of 26; 92%) perceived SDLPs helped them to identify and fill knowledge gaps and that their skills in framing questions (23 of 26; 88%), identifying resources (21 of 26; 81%), and critically appraising the evidence (20 of 26; 77%) improved through regular use. They also felt these plans led to a meaningful change in their practice or provided further direction for learning (17 of 26; 65%). Most (21 of 26; 81%) reported their intent to include point-of-care learning in their continuing education after residency. We found no significant differences in the responses of first-year compared with second- or third-year residents.

Conclusions

Questions arising during patient care are strong motivators for physician self-directed learning. The residents' responses indicated that they accepted the SDLPs and intend to use them in practice. Embedding the discussion of the SDLPs in preclinic conferences has ensured sustainability during the past 5 years and has enabled us to demonstrate teaching of practice-based learning and improvement.

Research has highlighted the chasm between what is known and what is practiced in medicine,1–6 and it is widely appreciated that physician competence after completion of residency benefits from the application of self-directed learning (SDL) skills situated in the practice context. Current trainees will face a practice world in which SDL must be documented as part of maintenance of certification and licensure.7,8 Requisite skills of SDL include recognition of knowledge and proficiency gaps through self-assessment. After the implementation of strategies to fill the gaps, a reflective process is used to determine the learning endeavor's success.9 SDL is one component of life-long learning.

Teaching and evaluation of the skills for lifelong learning are required of all residency training programs in the United States and is included in the competencies of practice-based learning and improvement (PBLI) and professionalism.10 Many have suggested that self-directed learning skills are a specific skill set11 and should be taught during training.12–15 However, there is limited knowledge on the acceptability of sustained use of self-directed learning plans by residents.

To teach residents self-directed learning skills, in 2004, we implemented an ongoing curriculum integrated with their clinical practice. Residents record one clinical question monthly that forms the basis of a structured exercise. They document the patient encounter triggering the question, describe resources used and the answer found, and reflect on its effect on patient management. Residents discuss their self-directed learning plans (SDLPs) monthly at the preclinic conference, where only their postgraduate year (PGY) cohorts (PGY-1 versus PGY-2 and PGY-3 residents) are present. The purpose of this report is to describe perceptions and attitudes of residents in internal medicine using SDLPs conceived in the resident-patient encounters.

Study Design and Population

In November 2006, 17 months after curricular implementation, we invited all residents (N  =  37) in our program to complete a questionnaire administered anonymously at the residents' noon conference. We did not collect individual identifiers because of the small size of our program. A second invitation was made 2 weeks later by placing the questionnaires in the residents' mailboxes. Explicit instructions were given to participants to complete the questionnaire only once. Data collection was completed during November and December of 2006.

The questionnaire was developed by the investigators and was tested on a small convenience sample. It consisted of 17 items to assess the residents' perceptions and self-reported behaviors relevant to the use of SDLPs, self-identified knowledge gaps, the effect of SDLPs on their practice, and the intent to use SDLPs after residency.

The study was approved by the institutional review board.

Data Analysis

Descriptive statistics were used to report the findings. All the results were presented as proportions and percentages. Respondents rated the items concerning their attitudes toward SDLPs, the effect of doing SDLPs on their knowledge gaps, and their critical appraisal skills on a 5-point Likert scale from “strongly agree” to “strongly disagree.” We dichotomized the responses (strongly agree or agree responses and disagree and strongly disagree were combined).

Number of SDLPs, Duration, and Time Spent

Most (16 of 17) upper-level residents (94%) had completed 5 or more SDLPs. Half of all respondents spent 30 minutes or less, and the other half spent more time, up to 2 hours, to complete an SDLP.

Self-Assessment and Learning

Most (24 out of 26) of the residents (92%) responded that SDLPs had helped them to identify and fill their knowledge gaps (table) without a significant difference between upper- and lower-level residents. However, more upper-level residents indicated that they benefited from listening to others' SDLPs (15 of 17 [88%] versus 6 of 9 [67%]) and that the use of SDLPs improved their ability to search for evidence, (15 of 17 [88%] versus 6 of 9 [67%]).

TABLE

Attitudes and Perceptions of 26 Residents in Internal Medicine Regarding Self-Directed Learning Plans (SDLPs) Conceived at Point of Care, 2006

Attitudes and Perceptions of 26 Residents in Internal Medicine Regarding Self-Directed Learning Plans (SDLPs) Conceived at Point of Care, 2006
Attitudes and Perceptions of 26 Residents in Internal Medicine Regarding Self-Directed Learning Plans (SDLPs) Conceived at Point of Care, 2006

Evidence-Based Medicine Application

Most (23 out of 26; 88%) indicated that completing the SDLPs was an opportunity to practice framing questions in a systematic format. Similarly, residents responded that it improved their ability to look for evidence (21 out of 26; 81%), and helped them practice their critical appraisal skills (20 out of 26; 77%).

Resources for SDLPs

Residents predominantly used electronic resources including PubMed and UpToDate (22 out of 26; 85%).

Outcomes of SDLPs

Although one-third of residents responded that the outcome was to confirm their present clinical practice, the rest (17 out of 26; 65%) indicated that the most common outcome was either a meaningful change in their current practice or a direction for further learning.

Future Use of SDLPs

Most of the residents (23 out of 26; 88%) indicated that they plan to integrate SDLPs into their practice habits.

Most residents reported that completing SDLPs enabled them to recognize and fill knowledge gaps, and they noted enhancement of their literature searching and appraisal skills. These findings are consistent with systematic reviews of the evidence-based medicine (EBM) literature, which showed clinically integrated curricula result in a change in physicians' EBM skills, attitudes, and behaviors.16,17 

Practicing physicians and trainees have many clinical questions arising during their patient care.18–20 Our residents reported formulating and finding answers to questions in practice resulted in a change in patient management or provided direction for further learning, consistent with findings in other publications.21–25 Learning embedded in patient encounters may represent the single greatest motivator for meaningful physician learning.26,27 The challenge lies in incorporating the habit into a busy practice.

Our residents used primary research articles and summary sources, such as electronic textbooks and synthesized and preappraised sources of evidence to complete their SDLPs. They reported most commonly using PubMed and UpToDate to answer questions, comparable to other studies that concluded that summary resources often fulfill information needs at point of care.28 

Our curriculum with its regular practice and faculty guidance should increase learners' self-efficacy in clinical question follow-up, thereby perpetuating further learning episodes. We also found that more upper-level residents indicated that they benefitted from listening to SDLPs presented by their cohorts (15 of 17 [88%] versus 6 of 9 [67%]). This may reflect the greater sophistication of the SDLPs of the upper-level groups making their discussions more useful.

In addition, residents accepted the SDLP format and endorsed its value and ease of use for documenting clinical questions and learning activities, consistent with the findings of others.8 Self-directed learning skills will be important to residents in their continuous professional development and licensure, because continuing medical education (CME) credits, which are required for licensure renewal, are available through organizations such as American College of Physicians' Physician Information and Education Resource for similar activities.29 In addition, the American Board of Internal Medicine is offering an Internet-based learning portfolio as an optional exercise toward maintenance of certification (MOC), based on a pilot in which the portfolio was well received as a CME activity due to its relevance to practice.8 Self-directed learning skills will be important in a resident's future MOC.

Residents reported acceptance of SDLPs as a point-of-care learning method, and embedding SDLPs in the preclinic conference has ensured sustainability and has enabled us to demonstrate teaching of PBLI. The process of residents formally discussing their clinical questions and their learning with peers and faculty reinforces the importance of PBLI in practice. It establishes the relevance of “situated learning,” which has been shown to be important in “deep learning” and the “construction of knowledge.”30,31 

Our study has several limitations. The small sample size in a single institution may limit the generalizability of our findings. Also, given the nearly universal success of this learning method with our learners, and the lack of specific information about each participant's learning style, we could not draw conclusions about the few residents for whom this learning method was not effective.

The responses of most residents reflected their acceptance of point-of-care learning in the form of an SDLP. The SDLPs helped the residents to identify and fill knowledge-base gaps, enhanced their literature searching and critical appraisal skills, and promoted reflection on their learning outcomes.

1
Davis
D
,
Evans
M
,
Jadad
A
,
et al.
The case for knowledge translation: shortening the journey from evidence to effect
.
BMJ
.
2003
;
327
(
405
):
33
35
.
2
Bellande
BJ
,
Winicur
ZM
,
Cox
KM
.
Urgently needed: a safe place for self-assessment on the path to maintaining competence and improving performance
.
Acad Med
.
2010
;
85
(
1
):
16
18
.
3
Davis
D
,
O'Brien
MAT
,
Freemantle
N
,
Wolf
FM
,
Mazmanian
P
,
Taylor-Vaisey
A
.
Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes
?
JAMA
.
1999
;
282
(
9
):
867
874
.
4
Davis
D
,
Davis
N
.
Selecting educational interventions for knowledge translation
.
CMAJ
.
2010
;
182
(
2
):
E89
E93
.
5
Leape
LL
,
Fromson
JA
.
Problem doctors: is there a system-level solution
?
Ann Intern Med
.
2006
;
144
(
2
):
107
115
.
6
Choudry
N
,
Fletcher
R
,
Soumerai
S
.
Systematic review: the relationship between clinical experience and quality of health care
.
Ann Intern Med
.
2005
;
142
(
4
):
269
273
.
7
Parboosingh
J
.
Revalidation for doctors should reflect doctors' performance and continuing professional development
.
BMJ
.
1998
;
317
(
7166
):
1094
1095
.
8
Green
ML
,
Reddy
SG
,
Holmboe
E
.
Teaching and evaluating point of care learning with an internet-based clinical question portfolio
.
J Contin Educ Health Prof
.
2009
;
29
(
4
):
209
219
.
9
Candy
PC
.
Self-Direction for Lifelong Learning: A Comprehensive Guide to Theory and Practice
.
San Francisco, CA
:
Jossey-Bass Publishers
;
1991
.
10
Accreditation Council for Graduate Medical Education
.
ACGME Outcome Project: ACGME General Competencies. Ver 1.3 (9.28.99)
.
Chicago, IL
:
ACGME
;
1999
.
11
Jennett
P
,
Jones
D
,
Mast
T
,
Egan
K
,
Hotvedt
M
.
The characteristics of self-directed learning
.
In:
Davis
DA
,
Fox
RD
,
eds
.
The Physician as Learner: Linking Research to Practice
.
Chicago, IL
:
American Medical Association
;
1994
:
47
65
.
12
Li
ST
,
Favreau
MA
,
West
DC
.
Pediatric resident and faculty attitudes toward self-assessment and self-directed learning: a cross-sectional study
.
BMC Med Educ
.
2009
;
9
:
16
.
13
Li
ST
,
Tancredi
DJ
,
Co
JPT
,
West
DC
.
Factors associated with successful self-directed learning using individualized learning plans during pediatric residency
.
Acad Pediatr
.
2010
;
10
(
2
):
124
130
.
14
Stuart
E
,
Sectish
TC
,
Huffman
LC
.
Are residents ready for self-directed learning? A pilot program of individualized learning plans in continuity clinic
.
Ambul Pediatr
.
2005
;
5
(
5
):
298
301
.
15
Bravata
DMT
,
Huot
SJ
,
Abernathy
HS
,
Skeff
KM
,
Bravata
DMC
.
The development and implementation of a curriculum to improve clinicians' self-directed learning skills: a pilot project
.
BMC Med Educ
.
2003
;
3
:
7
.
16
Coomarasamy
A
,
Khan
KS
.
What is the evidence that postgraduate teaching in evidence-based medicine changes anything? a systematic review
.
BMJ
.
2004
;
329
(
7473
):
1017
1021
.
17
Khan
KS
,
Coomarasamy
A
.
A hierarchy of effective teaching and learning to acquire competence in evidence-based medicine
.
BMC Med Educ
.
2006
;
6
:
59
68
.
18
Covell
DG
,
Uman
GC
,
Manning
PR
.
Information needs in office practice: are they being met
?
Ann Intern Med
.
1985
;
10
(4)3
:
596
599
.
19
Osheroff
JA
,
Forsythe
DE
,
Buchanan
BG
,
Bankowitz
RA
,
Blumenfeld
BH
,
Miller
RA
.
Physicians' information needs: analysis of questions posed during clinical teaching
.
Ann Intern Med
.
1991
;
114
(
7
):
576
581
.
20
Smith
R
.
What clinical information do doctors need
?
BMJ
.
1996
;
313
(
7064
):
1062
1068
.
21
Straus
SE
,
Ball
C
,
Balcombe
N
,
Sheldon
J
,
McAlister
FA
.
Teaching evidence-based medicine skills can change practice in a community hospital
.
J Gen Intern Med
.
2005
;
20
(
4
):
340
343
.
22
Schilling
LM
,
Steiner
JF
,
Lundahl
K
,
Anderson
RJ
.
Residents' patient-specific clinical questions: opportunities for evidence-based learning
.
Acad Med
.
2005
;
80
(
1
):
51
56
.
23
McGinn
T
,
Seltz
M
,
Korenstein
D
.
A method for real-time, evidence-based general medical attending rounds
.
Acad Med
.
2002
;
77
(
11
):
1150
1152
.
24
Crowley
SD
,
Owens
TA
,
Schardt
CM
,
et al.
A web-based compendium of clinical questions and medical evidence to educate internal medicine residents
.
Acad Med
.
2003
;
78
(
3
):
270
274
.
25
Thom
DH
,
Haugen
J
,
Sommers
PS
,
Lovett
P
.
Description and evaluation of an EBM curriculum using a block rotation
.
BMC Med Educ
.
2004
;
4
:
19
.
26
Parboosingh
J
.
Tools to assist physicians to manage their information needs
.
In:
Bruce
C
,
Candy
P
,
eds
.
Information Literacy: Models for the Future. 1st ed
.
Melbourne, Australia
:
Charles Stuart University Centres
;
2000
:
121
136
.
27
Parboosingh
J
,
Badat
MC
,
Wooster
D
.
Individualized learning strategies
.
In:
Davis
D
,
Fox
R
,
Barnes
B
,
eds
.
CME-CPD Professional: Tasks and Tools
.
Chicago, IL
:
AMA Press
;
2003
.
28
Slawson
DC
,
Shaughnessy
AF
.
Teaching information mastery: creating informed consumers of medical information
.
J Am Board Fam Pract
.
1999
;
12
(
6
):
444
449
.
29
Glassberg
H
,
Desai
R
.
Physician Information and Educational Network
.
Philadelphia, PA
:
American College of Physicians
.
http://pier.acponline.org/index.html. Accessed September 1, 2010
.
30
Lave
J
,
Wenger
E
.
Situated Learning: Legitimate Peripheral Participation
.
New York, NY
:
Cambridge University Press
;
1991
.
31
Jordan
M
,
Lanham
HJ
,
Crabtree
BF
,
et al.
The role of conversation in health care interventions: enabling sensemaking and learning
.
Implement Sci
.
2009
;
4
:
15
.

Author notes

Susan J. Smith, MD, is Associate Professor and Internal Medicine Program Director, Department of Medicine, McLaren Regional Medical Center-Michigan State University; Radhika R. Kakarala, MD, MS, is Associate Clinical Professor and Internal Medicine Research Director, Department of Medicine, McLaren Regional Medical Center-Michigan State University; Siva K. Talluri, MD, is Assistant Professor, Department of Medicine, McLaren Regional Medical Center- Michigan State University; Parul Sud, MD, is Assistant Professor and Associate Program Director, Department of Medicine, McLaren Regional Medical Center- Michigan State University; and John Parboosingh, MBChB, is Professor Emeritus, University of Calgary, Alberta, Canada, and Former Director, Professional Development, Royal College of Physicians and Surgeons of Canada.

Funding: The authors report no external funding for this study.