Objective

The purpose of this study was to assess chiropractic interns' knowledge and adherence to radiographic clinical practice guidelines (CPGs) and compare their clinical decisions to previous surveys of established practitioners in Canada and Australia.

Methods

A clinical decision-making survey was administered to 88 interns. The survey contained clinical scenarios and vignettes with inquiries regarding indications for radiographic referral, the likelihood of referral, and the application of CPGs.

Results

Forty-four percent (43.75%) of the interns were aware of CPGs, 38.75% were unsure, and 17.5% were not aware. When asked specific questions about the appropriateness of diagnostic imaging, the interns' responses were similar to those of practitioners in Canada and Australia. When interns evaluated a clinical vignette, there was lower compliance with CPGs.

Conclusion

The interns' clinical decisions regarding the use of diagnostic radiography did not significantly differ from those of practitioners who were surveyed in other related studies. Interns were inconsistent in applying their decision making in clinical cases. Notwithstanding the similarities with practitioners, some deviation from the guidelines indicates the need for further intern education to improve the implementation of CPGs for optimal cost-effective and clinically appropriate care.

The prevalence of low-back pain (LBP) in numerous countries, including the United States, has been reported to range from 15% to 20% of adults in a single year, with an estimated 50% to 80% of adults experiencing LBP at some point in their life. More than 50% of US adults have received chiropractic care at some time in their life, and 30% of patients with spinal pain in the United States have sought out chiropractic care.1,2

Costs per episode of acute LBP are not the same among types of practitioners. Findings from a 2009 study were as follows: $369 for standard medical care only,$560 for chiropractic care only, $579 for chiropractic care with physical modalities, and$760 for medical care with physical therapy.3,4  In 2006, the total costs associated with LBP in the United States were more than $100 billion per year, inclusive of health care, lost wages, and decreased productivity.5 Another study reported that as much as$238 billion is spent every year in the United States for direct and indirect health care costs.6  In 2013, neck and back pain accounted for the 3rd largest portion of total national health spending, after diabetes and ischemic heart disease.7  The continued rise in the use of technology for assessments is expected to increase the cost of services. This is especially noteworthy since US health care spending has continued to increase for many years and accounted for 17% of the US economy in 20167 and 17.7% in 2020.8

Inappropriate diagnostic imaging contributes to the increasing costs of spinal health care and may expose patients to unnecessary radiation, depending on the diagnostic imaging procedure performed.9,10  It has been reported that diagnostic imaging (on initial evaluation) does not usually provide a benefit to patients with LBP, and most clinical practice guidelines (CPGs) do not recommend it unless there are red flags.6,11  A meta-analysis revealed that there was no difference in short- or long-term outcome measures reported between patients who received immediate lumbar imaging and usual care and patients who did not receive immediate imaging for LBP.12  Low-quality evidence indicates that performing radiography or magnetic resonance imaging is associated with an increase in overall health care utilization and costs. It has been suggested that adherence to CPGs could help reduce health care utilization and costs.6  Despite the lack of documented benefit, imaging is performed in 21.7% to 28.8% of the patients with acute LBP in the United States in the 1st 4 to 6 weeks of care, with radiography performed on 12% to 32% of the total patients with acute LBP.13

The Centers for Medicare & Medicaid Services (CMS) of the US government noted that utilization management has been an integral part of all public and private health insurance plans since 1991.14  CMS reported that utilization management had a limited impact on controlling health care costs and expected the process would be improved with the development of CPGs.15  CMS expenditure projections for 2018 to 2027 indicate a likelihood that prices for services will grow even faster during this period.16  Initial utilization management was often performed by claims reviewers based more on cost than a substantiation of medical necessity. The conflict between utilization management and the clinician necessitated the research, creation, evaluation, and implementation of chiropractic CPGs. This resulted in professional associations and specialty organizations sponsoring a CPG-generation process. After a systematic review and Delphi panel recommendations, recent CPGs have recommended ordering or referring radiographic examination based on CPG criteria.14,17  Chiropractic clinical decision making was investigated by De Carvalho et al18  and Jenkins.19  Their studies looked at the use of radiographic CPGs in the clinical decision-making process of established chiropractic practitioners. Clinical vignettes revealed that 75% of the practitioners followed CPGs.18

Current relevant US CPGs for LBP diagnosis and treatment, including imaging, have been codified by the Clinical Compass Evidence Center.20  A recently published rapid literature review found that no relevant studies assessed the clinical utility of routine or repeat spinal radiographs to assess function or structure in the absence of red flags. There was no evidence that routine or repeat radiographs improved clinical outcomes or benefited patients.21  Current CPG recommendations for lumbar radiographs with LBP patients were also codified by the American College of Radiology Appropriateness Criteria. The use of lumbar radiographs for uncomplicated LBP (variant 1 or 2) was categorized as usually not appropriate in the absence of red flags.11

Chiropractic students are trained in evidence-based practice. In 2018, the World Federation of Chiropractic and Association of Chiropractic Colleges issued a set of consensus statements from attendees at the 2018 Education Conference. One of these statements was that chiropractic education programs should support an evidence-based teaching and learning environment.22,23  Texas Chiropractic College's (TCC's) mission is to promote education in quality evidence-based practice.24  The Grand Rounds at TCC has 1 hour of intern radiology guideline education to cover the TCC clinic radiology guidelines. These clinic guidelines comply with fulfilling the CCE Meta-Competency No. 6 – Information and Technology Literacy.25  These guidelines are reinforced throughout the intern's education.

This study aimed to assess the level of knowledge of radiographic CPGs by chiropractic interns and their potential use in clinical practice. A secondary objective was to compare interns' CPG knowledge and adherence to published estimates of utilization by established practitioners in other countries.

### Survey Design

The survey was modeled after those previously used in Australia19,26  and Canada18  to investigate CPG use by established practitioners, with adaptations made for applicability to interns. Walker et al26  stated that the survey was “tested in a cluster randomized controlled trial of 880 chiropractors.” However, De Carvalho et al18  and Jenkins19  used the survey without conducting any tests to assess the validity of the survey prior to implementation. Since the survey was already tested and only insignificant changes were made to reflect the earlier stage of the careers of interns, no validity or pilot testing was performed.

The survey included a demographic section, a section on knowledge, a section on implementation during an internship, and an opinion on the future use of radiologic imaging. Additional questions addressed their awareness and belief system regarding CPGs. Clinical vignettes were used to assess the likelihood of intern adherence and utilization of radiology CPGs for LBP. The vignettes were modeled after those used in past studies.18,19,26  Some questions were added or adapted to be applicable to interns (rather than practitioners). Otherwise, the vignettes were the same as those published previously. The study was determined to be exempt under 45CFR 46.101 (b) by the Texas Chiropractic College institutional review board.

### Study Design

This was a cross-sectional descriptive survey. It was provided to all 7th- through 10th-trimester interns in a 10-trimester chiropractic degree program at Texas Chiropractic College (Appendix A). It was administered in 2 iterations. The 1st iteration was conducted in April 2021 and the 2nd in August 2021. Students were advised not to complete it a 2nd time to ensure that responses were unique. The administration of the survey was performed online via SurveyMonkey (Momentive Inc, San Mateo, CA, USA) at a clinical rounds meeting. Participation was voluntary and anonymous. The 1st survey question asked for permission to use the responses for research purposes. A descriptive statistical analysis was performed by downloading the survey results to SPSS Statistics software (IBM Inc, Armonk, NY, USA).

### Analysis

Descriptive statistics were used to calculate the percentage of correct responses to each question and vignette, in concordance with the common published CPGs.18,19,2628  The data were compared with practitioner information from previous studies.18,19,26

Open comments were grouped and categorized by content with common themes and accounted for in an Excel datasheet (Microsoft Corp, Redmond, WA, USA) as a percentage of the total surveyed. The results of the clinical vignettes provided more quantitative data on the percentage of appropriate radiology orders for a clinical case. The results were compared with previously published studies that focused on established practitioners' adherence to CPGs. This was tabulated and similarly analyzed.

### Demographics

Eighty of 88 students responded (91% response rate). Twenty-five percent (n = 20) were in the 7th trimester 55% (n = 44) in the 8th, 11% (n = 9) in the 9th, and 9% (n = 7) were in the 10th trimester. Their clinical experience was likewise variable, with 16% of interns having had >200 patient encounters, 25% with 101 to 200 encounters, 28% with 51 to 100 encounters, 26% with 11 to 50 encounters, and 5% with 6 to 10 patient encounters. All interns had received instruction about CPGs in earlier trimesters.

### Awareness of Guidelines

There were 9 response options for awareness, including the classroom guideline, “other,” “do not use,” and 6 specific CPGs.11,12,20,27,29,30  Although all interns attended the same doctoral program, their awareness of CPGs differed (Table 1). Notably, 17.5% stated that they were not aware of guidelines. Sixty-seven percent of the 9th-trimester interns reported that they were aware of the guidelines, but that was out of a total of 6 interns. The largest participation was among the 8th-trimester interns, among whom 37% (n = 46) reported awareness of guidelines. Most of the students stated that they rely on what is taught in the classroom (58%). Thirty percent of the students were aware of the Council of Chiropractic Guidelines and Practice Parameters guidelines.31  Only 15% were aware of the American College of Radiology guidelines.32  There was minimal awareness of other guidelines.

Table 1

- Awareness of Guidelines

Comments included familiarity with some guidelines and knowledge of where to find them for reference. There was also mention of the familiarity with the “Official Disability Guidelines,” which were not included in the survey. The limited experience of the interns was indicated by the degree of opportunity for these interns to make a clinical decision on imaging. This was evenly split, with 53% stating that they have not yet had the opportunity to make a clinical decision about ordering imaging.

### Adherence to Guidelines Based on Clinical Case Vignettes

Four LBP clinical case vignettes were provided to the interns to allow them to make a clinical decision about the need to order lumbosacral radiographs, full-spine radiographs, or imaging not being medically necessary. The 1st 3 cases did not indicate any medical necessity for imaging, but it would have been appropriate in the 4th case vignette (a 67-year-old woman with risk of osteoporosis and fracture).

#### Clinical Case Vignette 1

This case was an acute LBP without radiculopathy in a 48-year-old office worker with a nontraumatic soft-tissue injury in which the patient requested “X-rays.” Despite the patient's request, 82% of respondents correctly did not order imaging on this patient (Table 2). There were 106 different comments. Reasons to not order imaging included the following: no trauma (n = 19), no red flags (n = 5), no neurologic signs or symptoms (n = 23), perform an initial period of trial therapy before ordering imaging (n = 24), no indications of pathology (n = 10), guidelines do not indicate the need (n = 4), and case diagnosis of a soft-tissue lesion (n = 21). There were 4 reasons to order radiographs: differential diagnosis, ruling out disc herniation, responding to a patient request for fear of losing the patient, and ruling out a possible pathology.

Table 2

- Types of Images Ordered for Each Vignette

#### Clinical Case Vignette 2

This was a case of chronic LBP in a 57-year-old office worker without radiculopathy. The patient had comorbidities and a family history of diabetes but no history of trauma, and the pain was dull, mild, and of 8 weeks' duration. The patient had anxiety about severe underlying pathology and requested “X-rays.” Despite the anxiety and requests for “X-rays,” only 36% of respondents found imaging medically unnecessary, leaving 64% ordering clinically unnecessary radiographs. The reasons for ordering were similar to those in vignette 1. Most gave the reason that the patient requested it (n = 20), and others gave age as a reason (n = 11). Still, others provided the reasons for prolonged duration of symptoms, overweight, and family history of diabetes. Reasons for not ordering the radiographs consisted of no trauma (n = 26), no red flags (n = 3), no neurologic signs or symptoms (n = 11), performing a treatment trial first (n = 11), no indications of pathology (n = 7), and a diagnosis of soft-tissue lesion (n = 3). One respondent noted that radiographs would not change the outcome of the care, which correlates with the guidance of CPGs.

#### Clinical Case Vignette 3

This was a subacute moderate LBP of 6 weeks' duration in a 36-year-old real estate agent without radiculopathy following a heavy-lifting activity. The patient was under an existing nonacute care program (more akin to maintenance care) over the previous 4 weeks. The patient never received acute relief care and requested a referral for further workup. Seventy-two percent of respondents would improperly order imaging. The major reason given for ordering the imaging was that there was no improvement over 6 weeks (n = 50) and patient request (n = 6).

#### Clinical Case Vignette 4

This case consisted of acute LBP in a 67-year-old woman with a risk of osteoporosis and fracture, which was traumatic in onset. The patient was a senior citizen, and the pain was constant and of immediate onset after a fall. Interns would have complied with CPGs and ordered radiographs on this patient in 98% of respondents. Reasons (total = 166) given for the medical necessity of radiographs included trauma (n = 57), suspicion of fracture (n = 43), suspected osteopenia/osteoporosis (n = 9), and age (n = 55), and 2 respondents mentioned CPG. Interestingly, when imaging was recommended, the types of imaging ordered included 43 full-spine radiographs, contrary to all CPGs.

### Utilization of Lumbar Spine Imaging

To investigate referral patterns, the intern survey questioned their likelihood of referring for low-back radiographs in different clinical presentations (Table 3). Respondents referred for lumbar spine radiographs occasionally (65%) and rarely referred on new patients, unless there was clinical suspicion of a traumatic injury (79% referral rate) or red flags (95%). The interns would refer when there was suspicion of arthritis. Fewer than half of interns would use radiographs to regularly assess for biomechanical pathology. Most interns would refer for radiographs to screen for subclinical contraindications. There is lack of agreement of the ordering of radiographs for patient reassurance (Table 3).

Table 3

- Reason to Refer for Lumbar Radiographs

Table 4

- Agreement With Radiographic Indication Statements (n/%)

Intern responses to imaging necessity were compared with the data from practitioners in other studies (Fig. 1). The results indicated a strong comparison to the clinical decisions of Australian and Canadian chiropractic practitioners.

Figure 1

- Radiographic medical necessity: responses of interns compared with previously published responses of practitioners.

Figure 1

- Radiographic medical necessity: responses of interns compared with previously published responses of practitioners.

Close modal

This study was intended to assess the radiographic clinical decision making of interns and to compare their decisions to field practitioners (as reported in the literature) and to the reported CPGs. The 1st 3 clinical vignettes presented cases in which imaging was medically unnecessary. In case 1, only 15.5% of interns complied with the CPG, while De Carvalho et al18  found 88% compliance in practitioners and Walker et al26  found 37% compliance (Table 5). This would suggest that the interns' lack of experience and confidence may result in patients convincing the intern to order unnecessary imaging. This is supported by the 2nd case, in which the anxious patient convinces 64% of the interns to unnecessarily order a radiograph, with only 36% complying with CPGs. Interestingly, the practitioners in Canada were more compliant (75%) with CPGs, whereas the Australian practitioners had even lower compliance than the interns did (16%). In the 3rd case, the interns complied with CPGs (70%) more than the practitioners did in the other 2 studies (38% and 39%). It is possible that the patient's direct request was more evident to the interns than in the other cases. In the 4th case, which involved trauma to an older patient with comorbidities, medical necessity may have been more evident to the experienced practitioners (71% and 95% compliance) than to the interns (48% compliance).

Table 5

- Intern vs Practitioner Case Compliance With Clinical Practice Guidelines (CPGs)

The overall average intern case compliance to CPG was 42.3% as compared with 68% of the Canadian practitioners18  and 46.8% of the Australian practitioners26  or an average of 57.4% compliance of practitioners. The interns' radiology ordering criteria in specific situations revealed many similarities between the interns and practitioners (Fig. 1). They agreed with the CPG more often than not and were very similar to the agreement rate of Canadian doctors of chiropractic. The interns' reasoning for imaging to refer in the 4 vignettes was similar to the CPGs for 7 out of the 9 reasons presented. However, the interns would benefit from further education regarding subclinical contraindications and especially about communication with patients to provide indications and contraindications. The interns scored well on the radiographic indication statements. They followed the CPG in 10 of 13 clinical situations presented (Table 4). The interns' overall case compliance (with vignettes) was 42% as compared with 57% compliance by the practitioners, indicating a need for education for both groups.

Further education is needed regarding the utilization of full-spine radiographs and the use of radiographs as a screening tool for contraindications or to confirm a LBP diagnosis. The interns have gained most of their knowledge through the integration of the CPG recommendations into the classroom curriculum. Implementation of the CPG needs to be further reinforced by specifically addressing the different CPGs, similarities and differences, and applying to cases during the clinical internship to provide a carryover into practice and improve care.33

### Limitations

This study is limited in its validity due to a small sample, and it is the first time the questionnaire was used on this sample base. The questionnaire replicated past questionnaires from other studies for ease of comparison. However, the questionnaire needs updating. Because of the sample of participants all being students of 1 college, a direct correlation to practitioners or extending conclusions to other chiropractic college students cannot be made beyond the comparison. Although no survey validity testing was performed in this study, it was performed in previous studies. Comparisons of interns were made in a secondary manner by comparing their responses to data from previous studies.

Although some differences were apparent, the overall level of intern knowledge and their adherence to radiographic CPG were comparable with that of practitioners in previous studies when presented with specific clinical reasons but differed when evaluating a full case presentation. Still, there is a need to increase interns' knowledge level to ensure clinically effective and cost-effective compliance with CPGs. Reinforcement is needed throughout the internship to improve the clinical decisions of current and future practitioners. The didactic educational content may need to focus more on the current CPG, integrate it into cases and testing, and reinforce it throughout the internship experience.

The authors acknowledge Claire Noll, MS, for her expert proofreading and advice and Michael Sheppard, DC, for assisting in distribution of the surveys.

1.
Weeks
WB,
Goertz
CM,
Meeker
WC,
Marchiori
DM.
Public perceptions of doctors of chiropractic: results of a national survey and examination of variation according to respondents' likelihood to use chiropractic, experience with chiropractic, and chiropractic supply in local health care markets
.
J Manipulative Physiol Ther
.
2015
;
38
(8)
:
533
544
.
2.
Hays
RD,
Sherbourne
CD,
Spritzer
KL,
et al
Experiences with chiropractic care for patients with low back or neck pain
.
J Patient Exp
.
2020
;
7
(3)
:
357
364
.
3.
Crow
WT,
Willis
DR.
Estimating cost of care for patients with acute low back pain: a retrospective review of patient records
.
J Am Osteopath Assoc
.
2009
;
109
(4)
:
229
233
.
4.
Kominski
GF,
Heslin
KC,
Morgenstern
H,
Hurwitz
EL,
Harber
PI.
Economic evaluation of four treatments for low-back pain: results from a randomized controlled trial
.
Med Care
.
2005
;
43
(5)
:
428
435
.
5.
Katz
JN.
Lumbar disc disorders and low-back pain: socioeconomic factors and consequences
.
J Bone Joint Surg Am
.
2006
;
88
(suppl 2)
:
21
24
.
6.
Lemmers
GPG,
van Lankveld
W,
Westert
GP,
van der Wees
PJ,
Staal
JB.
Imaging versus no imaging for low back pain: a systematic review, measuring costs, healthcare utilization and absence from work
.
Eur Spine J
.
2019
;
28
(5)
:
937
950
.
7.
Dieleman
JL,
Baral
R,
Birger
M,
et al
US Spending on personal health care and public health, 1996-2013
.
JAMA. 12
2016
;
316
(24)
:
2627
2646
.
8.
Center for Medicare and Medicaid Services.
Medicare. Center for Medicare and Medicaid Services.
9.
French
SD,
Green
ME,
Bhatia
RS,
et al
Imaging use for low back pain by Ontario primary care clinicians: protocol for a mixed methods study—the Back ON study
.
BMC Musculoskelet Disord
.
2019
;
20
(1)
:
50
.
10.
Berrington de Gonzalez
A,
Darby
S.
Risk of cancer from diagnostic X-rays: estimates for the UK and 14 other countries
.
Lancet
.
2004
;
363
(9406)
:
345
351
.
11.
Appropriateness criteria. Accessed February 4,
2021
.
12.
Chou
R,
Fu
R,
Carrino
JA,
Deyo
RA.
Imaging strategies for low-back pain: systematic review and meta-analysis
.
Lancet
.
2009
;
373
(9662)
:
463
472
.
13.
Pham
HH,
Landon
BE,
Reschovsky
JD,
Wu
B,
Schrag
D.
Rapidity and modality of imaging for acute low back pain in elderly patients
.
Arch Intern Med
.
2009
;
169
(10)
:
972
981
.
14.
Whalen
W,
Farabaugh
RJ,
Hawk
C,
et al
Best-practice recommendations for chiropractic management of patients with neck pain
.
J Manipulative Physiol Ther
.
2019
;
42
(9)
:
635
650
.
15.
US Center for Medicare & Medicaid Services.
Utilization management as a cost-containment strategy. CMS.
16.
Center for Medicare & Medicaid Services.
National health expenditure projections 2018-2027.
17.
Hawk
C,
Whalen
W,
Farabaugh
RJ,
et al
Best practices for chiropractic management of patients with chronic musculoskeletal pain: a clinical practice guideline
.
J Altern Complement Med
.
2020
;
26
(10)
:
884
901
.
18.
De Carvalho
D,
Bussieres
A,
French
SD,
et al
.
Chiropr Man Therap
.
2021
;
29
(1)
:
4
.
19.
Jenkins
HJ.
Awareness of radiographic guidelines for low back pain: a survey of Australian chiropractors
.
Chiropr Man Therap
.
2016
;
24
:
39
.
20.
Clinical Compass Evidence Center.
Diagnostic imaging. Evidence center.
21.
Corso
M,
Cancelliere
C,
Mior
S,
Kumar
V,
Smith
A,
Cote
P.
The clinical utility of routine spinal radiographs by chiropractors: a rapid review of the literature
.
Chiropr Man Therap
.
2020
;
28
(1)
:
33
.
22.
World Federation of Chiropractic. Empowered to teach, inspired to learn: Creating excellence in chiropractic education.
2018
.
23.
Innes
SI,
Cope
V,
Leboeuf-Yde
C,
Walker
BF.
A perspective on Chiropractic Councils on Education accreditation standards and processes from the inside: a narrative description of expert opinion: Part 1: Themes
.
Chiropr Man Therap
.
2019
;
27
:
57
.
24.
Texas Chiropractic College.
Mission Statement. Website.
25.
Council on Chiropractic Education.
CCE accreditation standards: principles, processes & requirements for accreditation.
Accessed August 23, 2022. Available from: chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://www.cce-usa.org/uploads/1/0/6/5/106500339/2021_cce_accreditation_standards__current_.pdf
26.
Walker
BF,
French
SD,
Page
MJ,
et al
Management of people with acute low-back pain: a survey of Australian chiropractors
.
Chiropr Man Therap
.
2011
;
19
(1)
:
19
29
.
27.
Bussieres
AE,
Taylor
JA,
Peterson
C.
Diagnostic imaging practice guidelines for musculoskeletal complaints in adults-an evidence-based approach-part 3: spinal disorders
.
J Manipulative Physiol Ther
.
2008
;
31
(1)
:
33
88
.
28.
Bussieres
AE,
Peterson
C,
Taylor
JA.
Diagnostic imaging practice guidelines for musculoskeletal complaints in adults—an evidence-based approach: introduction
.
J Manipulative Physiol Ther
.
2007
;
30
(9)
:
617
683
.
29.
National Institute for Healthcare Excellence (NIHE).
Early management of persistent non-specific low back pain. Clinical guideline 88.
30.
Chou
R,
Qaseem
A,
Owens
DK,
Shekelle
P;
Clinical Guidelines Committee of the American College of Physicians. Diagnostic imaging for low back pain: advice for high-value health care from the American College of Physicians
.
Ann Intern Med
.
2011
;
154
(3)
:
181
189
.
31.
Council of Chiropractic State Organizations.
Council of Chiropractic guidelines and practice parameters. Clinical compass.
2022
.
32.
Patel
ND,
Broderick
DF,
Burns
J,
et al
ACR appropriateness criteria low back pain
.
.
2016
;
13
(9)
:
1069
1078
.
33.
Jenkins
HJ,
Kongsted
A,
French
SD,
et al
What are the effects of diagnostic imaging on clinical outcomes in patients with low back pain presenting for chiropractic care: a matched observational study
.
Chiropr Man Therap
.
2021
;
29
(1)
:
46
.

FUNDING AND CONFLICTS OF INTEREST This work was funded internally. The authors have no conflicts of interest to declare relevant to this work.

## Author notes

Concept development: CH. Design: CH, DNT. Supervision: CH. Data collection/processing: DNT. Analysis/interpretation: CH, DNT. Literature search: DNT. Writing: DNT. Critical review: DNT, CH.