Context.—Adenocarcinoma in situ of the cervix is a recently recognized interpretation in the Bethesda 2001 system. Although specific morphologic criteria have been published, recognizing this entity is still difficult.

Objective.—To compare pathologists' ability to correctly identify and categorize adenocarcinoma in situ with their ability to identify and categorize adenocarcinoma, high-grade squamous intraepithelial lesion, and squamous cell carcinoma.

Design.—Pathologists' reviews in the 2001 and 2002 College of American Pathologists Interlaboratory Comparison Program in Cervicovaginal Cytology Program, an interlaboratory comparison program for gynecologic cytology, were examined. Cases were usually reviewed by multiple pathologists. False-negative rates, the percentage of reviews with exact agreement with reference interpretations, and the percentage of cases in which all reviews were in exact agreement with the reference interpretation for adenocarcinoma in situ, adenocarcinoma, high-grade squamous intraepithelial lesion, and squamous cell carcinoma were compared.

Results.—A total of 213 reviews of cases categorized as adenocarcinoma in situ were compared with 2821 reviews of adenocarcinoma, 7535 reviews of high-grade squamous intraepithelial lesion, and 1886 reviews of squamous cell carcinoma. The false-negative rate for adenocarcinoma in situ (11.7%) was significantly higher than that for high-grade squamous intraepithelial lesion (4.6%, P < .001) and squamous cell carcinoma (3.3%, P < .001) but not for adenocarcinoma (8.9%, P = .16). Of all the reviews of adenocarcinoma in situ cases, 46.5% were interpreted specifically as adenocarcinoma in situ, compared to 72.2% of reviews of adenocarcinoma, 73.2% of high-grade squamous intraepithelial lesion, and 75.1% of squamous cell carcinoma. No individual case of adenocarcinoma in situ was always specifically recognized as adenocarcinoma in situ; 26.5% of cases of adenocarcinoma were specifically recognized as such in all reviews. Findings were similar with and without the inclusion of high-grade squamous intraepithelial lesion/carcinoma, not otherwise specified, as an acceptable review interpretation for cases of adenocarcinoma, squamous cell carcinoma, and high-grade squamous intraepithelial lesion.

Conclusion.—These data from expert-referenced and biopsy-proven cases suggest that adenocarcinoma in situ is not as easily recognized or categorized as other serious diagnoses.

Use of the interpretive category of adenocarcinoma in situ of the cervix is becoming increasingly common in cytologic material. There are several reasons for this. First, the incidence of the disease appears to be increasing.1–4 Second, better endocervical sampling devices are used commonly.5 Third, the morphologic criteria for the entity in cytologic material have been defined and increasingly refined.6–15 These studies have culminated in the recent recommendation by the International Academy of Cytology Task Force that cases of adenocarcinoma in situ be specifically diagnosed when possible16 and, most recently, with the inclusion of adenocarcinoma in situ as a separate interpretive category in the Bethesda 2001 classification system.17 However, several studies show no clear evidence that Papanicolaou test screening is an effective method of detecting either adenocarcinoma or adenocarcinoma in situ or that screening has reduced the mortality from adenocarcinoma.18–20 

Although specific morphologic criteria have been published, there is significant variability in the interpretation of glandular lesions.12,21 The likelihood of the recognition and precise categorization of this entity in the United States is not well known. To address this, we reviewed the results of the College of American Pathologists Interlaboratory Comparison Program in Cervicovaginal Cytology (PAP Program) with conventional preparations for adenocarcinoma in situ during the years 2001–2002 and compared them with the results for other significant lesions.

The PAP Program is a quarterly mailed, glass-slide quality improvement program. The College of American Pathologists Laboratory Accreditation Program requires that all laboratories evaluating cervicovaginal cytology enroll in the PAP Program or an equivalent glass-slide program. As the single largest glass-slide educational cervicovaginal cytology interlaboratory comparison program, the PAP Program served 1169 laboratories in 2001, including 3831 pathologists and 3407 cytotechnologists. Cytology laboratories of all types participate, with the largest number (approximately 60%) being hospital laboratories. In addition, independent laboratories, federal and government laboratories, university laboratories, and others such as those associated with a group practice or physician's office also participate. The number of participants did not change significantly in 2002.

Participants and committee members generously contribute slides to the program. After receipt and accessioning into the program, the slides are reviewed by at least 3 experienced cytopathologists from the College of American Pathologists Cytopathology Resource Committee. Before acceptance into the program, each slide must be judged to be of good technical quality and an excellent example of the reference interpretation. All 3 reviewers must agree on the exact target interpretation, which must agree with the submitted interpretation. Further, slides submitted with an interpretation of low-grade squamous intraepithelial lesion or higher must be biopsy confirmed prior to acceptance into the program.

The PAP Program consists of 5 glass slides of cervicovaginal material mailed 4 times a year. The coded answer sheets have diagnostic menus that use terminology modified from the Bethesda system (Table 1). Referenced slides are placed into 1 of 3 selection series: the 000 series for unsatisfactory slides; the 100 series for normal, infectious, and reparative conditions; and the 200 series for epithelial cell abnormalities and carcinoma.

In the year 2001, cases with a reference interpretation of adenocarcinoma in situ were introduced into the program. As a result, few cases were available that had met the program's validation criteria, one of which requires at least 20 reviews by participants. Cases that have not yet met the validation criteria are placed into educational sets for circulation. Therefore, cases of adenocarcinoma in situ were only compared with cases of adenocarcinoma, high-grade squamous intraepithelial lesion, and squamous cell carcinoma that were in the educational portion of the program and had also not yet met the criteria for validation.

In this analysis, any interpretation in the 200 series (including low-grade squamous intraepithelial lesion, high-grade squamous intraepithelial lesion, squamous cell carcinoma, adenocarcinoma, adenocarcinoma in situ, and high-grade squamous intraepithelial lesion/carcinoma, not otherwise specified [NOS]) is counted as a true-positive result. Only cases interpreted as unsatisfactory, as negative, or as only containing organisms were counted as false-negative results. The percentages of review interpretations in exact agreement with the reference interpretation and the percentage of cases with a review interpretation of glandular abnormality (adenocarcinoma in situ or adenocarcinoma) among those with a reference interpretation of adenocarcinoma in situ or adenocarcinoma were calculated. In addition, the percentage of cases for which all review interpretations were concordant with the reference interpretation was calculated. All cases were conventional Papanicolaou tests. Categoric results were compared using a 2-tailed chi-square test unless specifically noted.

Case Distribution

During the 2 years studied, a total of 26 separate cases of adenocarcinoma in situ were available for review. There were 213 reviews of these 26 Papanicolaou tests categorized as adenocarcinoma in situ, compared with 2821 reviews of adenocarcinoma, 7535 reviews of high-grade squamous intraepithelial lesion, and 1886 reviews of squamous cell carcinoma.

False-Negative Rate

The false-negative rate for adenocarcinoma in situ (11.7%) was significantly greater than that for high-grade squamous intraepithelial lesion (4.6%, P < .001) and squamous cell carcinoma (3.3%, P < .001). The false-negative rate of adenocarcinoma (8.9%, P = .16) was not statistically significantly different from that of adenocarcinoma in situ.

Recognition of Glandular Nature

The percentage of adenocarcinoma in situ cases that were recognized as glandular (either adenocarcinoma in situ or adenocarcinoma, NOS) was compared with the percentage of adenocarcinoma cases that were recognized as glandular. Of the 213 reviews of adenocarcinoma in situ, 146 (68.5%) were recognized as glandular, compared with 2025 (71.8%) of 2821 cases of adenocarcinoma. These percentages were not statistically significantly different (P = .31).

Specific Recognition of Adenocarcinoma In Situ

Adenocarcinoma in situ was specifically recognized in only 99 (46.5%) of 213 reviews, compared with 1873 (66.4%) of 2821 reviews of adenocarcinoma that were specifically recognized as adenocarcinoma (P < .001) and 2036 (72.2%) of 2821 reviews of adenocarcinoma that were specifically recognized as either adenocarcinoma or high-grade squamous intraepithelial lesion/carcinoma, NOS (P < .001).

Cases With Consistent Recognition of the Reference Interpretation

Of the 26 cases of adenocarcinoma in situ, 20 had at least 5 reviews. Of these 20, no cases were recognized as adenocarcinoma in situ in all reviews, compared with 63 (22.9%) of 275 (P = .01) of adenocarcinoma cases with at least 5 responses that were specifically recognized as adenocarcinoma and 73 (26.5%) of 275 of adenocarcinoma cases with at least 5 responses that were specifically recognized as either adenocarcinoma or high-grade squamous intraepithelial lesion/carcinoma, NOS, in all reviews (P = .005, 2-tailed Fisher exact test). Of squamous cell carcinoma and high-grade squamous intraepithelial lesion cases with at least 5 reviews, 41 (21.7%) of 189 squamous cell carcinomas and 115 (15.1%) of 763 high-grade squamous intraepithelial lesions had exact review interpretations in all reviews. When high-grade squamous intraepithelial lesion/carcinoma, NOS, is considered an acceptable response, the corresponding proportions are 68 (36.0%) of 189 and 196 (25.7%) of 763, respectively. The comparison of adenocarcinoma in situ to high-grade squamous intraepithelial lesion when high-grade squamous intraepithelial lesion/carcinoma, NOS, is not considered an acceptable response approaches statistical significance (P = .06). All other comparisons of the percentage of cases with exact review interpretations in all reviews showed statistical significance.

The false-negative rates, the percentage of reviews in which the reference interpretation was specifically recognized, and the percentage of cases in which the reference interpretation was specifically recognized in all reviews for adenocarcinoma in situ, adenocarcinoma, squamous cell carcinoma, and high-grade squamous intraepithelial lesion are presented in Table 2.

Distribution of Interpretations of Adenocarcinoma In Situ Cases

Of the 213 adenocarcinoma in situ review interpretations, 25 were false negatives. Twenty-one of these were interpreted as negative for intraepithelial lesions or as containing organisms. Three were interpreted as unsatisfactory, and one was interpreted as atrophic vaginitis. Frequencies of interpretations of adenocarcinoma in situ cases are shown in Table 3.

The histology of adenocarcinoma in situ was first described in the early 1950s as glands with features resembling invasive adenocarcinoma but lacking stromal invasion. Changes similar to adenocarcinoma in situ were noted at the periphery of invasive adenocarcinoma, and adenocarcinoma in situ was thought to be a precursor of invasive adenocarcinoma. Common cytologic features of adenocarcinoma in situ include tightly crowded sheets of malignant cells that are architecturally disorganized and that may have short strips of pseudostratified columnar cells protruding off the edges. Nuclei at the periphery or in the strips may be partially denuded, which gives a frayed or feathered appearance. Isolated strips and rosettes may be seen. More poorly differentiated cases may not be as tightly crowded. Nuclei are enlarged, usually oval, and moderately to markedly hyperchromatic. Poorly differentiated cases may have round or bizarrely shaped nuclei. The chromatin is finely to moderately granular. Nucleoli are present in approximately half of the cases. Notably, tumor diathesis is absent.22,23 The cytologic features are illustrated in Figures 1 and 2.

Defining the difficulty of making the exact interpretation for a particular diagnostic entity is challenging, since the results of any study will depend heavily on the cases that are included in that study. We believe that adenocarcinoma in situ is relatively difficult to both recognize and precisely subcategorize. To support this hypothesis, we have chosen to compare the difficulty of interpreting adenocarcinoma in situ with the difficulties of interpreting adenocarcinoma, high-grade squamous intraepithelial lesion, and squamous cell carcinoma. For all the cases included in this study, the process for selecting the slides is similar in that each case is reviewed by 3 cytopathologists, and each case has a biopsy follow-up. The uniformity of this selection process supports the idea that these cases can be appropriately compared.

However, there are differences among these groups. First, there are many more cases of adenocarcinoma, high-grade squamous intraepithelial lesion, and squamous cell carcinoma than of adenocarcinoma in situ. This is both because of the relative incidence of the disease and because cases of adenocarcinoma in situ have been specifically categorized and used in the program only within the past 2 years. Most cases suggestive of adenocarcinoma in situ have been classified with atypical glandular cells in the past, and previous Papanicolaou surveys show that atypical glandular cells have a median laboratory reporting rate of 0.3%.24 It is possible that the performance we have demonstrated will improve with the inclusion of additional cases of adenocarcinoma in situ. Second, adenocarcinoma in situ is a relatively new diagnostic option in the program that has been introduced only in the past few years; the other diagnoses have been used for more than a decade. It is not unreasonable to assume that there is a learning curve associated with the introduction of each new interpretation and that the performance will improve as participants get accustomed to making that interpretation. It has been shown that with specific directed educational efforts, the recognition of adenocarcinoma in situ can be improved.8 

Nevertheless, with these caveats in mind, the results of this study are quite striking. In most respects that we can measure, adenocarcinoma in situ is more difficult to diagnose than adenocarcinoma, high-grade squamous intraepithelial lesion, or squamous cell carcinoma. Cases of adenocarcinoma in situ are more frequently missed than are cases of high-grade squamous intraepithelial lesion and squamous cell carcinoma and are less frequently specifically recognized than are cases of adenocarcinoma, high-grade squamous intraepithelial lesion, and squamous cell carcinoma. Adenocarcinoma in situ and adenocarcinoma are recognized as glandular lesions at similar rates, however. In addition, there were no individual cases in which all participants agreed that the interpretation was adenocarcinoma in situ. This is significantly less than the percentage of cases of high-grade squamous intraepithelial lesion, adenocarcinoma, and squamous cell carcinoma.

Reasons for the increased misclassification rate observed in this study are not known precisely, but it is possible that the abnormal architecture of the groups of endocervical cells was not appreciated. In the false-negative cases, the groups were likely overlooked or interpreted as reactive. Twenty-four (11.3%) of the review interpretations were high-grade squamous intraepithelial lesions or squamous cell carcinomas. This observation illustrates one of the difficulties of recognizing adenocarcinoma in situ. High-grade squamous intraepithelial lesions with glandular extension may have an appearance that is very similar to the crowded sheets of adenocarcinoma in situ, and high-grade squamous intraepithelial lesions are much more common entities. In these cases, the presence of a significant lesion would be recognized, and the correct diagnosis would probably be made on a follow-up histologic specimen.

The results of this study suggest that adenocarcinoma in situ cannot be routinely recognized or precisely subcategorized in routine practice. The Papanicolaou test was designed to detect squamous abnormalities. Despite the increased interest in and recognition of glandular lesions, there is no evidence that this test is an effective screening tool for these lesions. A major reason for this is because of sampling. However, our results suggest that simply recognizing and categorizing these lesions remain a problem as well. At present, there is little evidence that most cases of adenocarcinoma in situ can always be recognized as such in routine clinical practice. According to Bethesda 2001, Papanicolaou tests with specific criteria for adenocarcinoma in situ can be classified as such.17 However, this study suggests that laboratories and clinicians cannot expect all biopsy-proven adenocarcinoma in situ cases to be specifically identified. Cytopathology professionals may need to educate providers about this problem. Also, missed cases of adenocarcinoma in situ constitute a significant proportion of litigated Papanicolaou test cases in which a false-negative interpretation of the slide in question is alleged.25 This study indicates that it may not be practical to assert that a reasonable practitioner standard of care requires the detection of adenocarcinoma in situ in all cases. Whether or not there are specific morphologic characteristics that are associated with an increased likelihood of a false-negative interpretation is unknown at this time.

Hopkins
,
M. P.
and
G. W.
Morley
.
A comparison of adenocarcinoma and squamous cell carcinoma of the cervix.
Obstet Gynecol
1991
.
77
:
912
917
.
Peters
,
R. K.
,
A.
Chao
,
T. M.
Mack
,
D.
Thomas
,
L.
Bernstein
, and
B. E.
Henderson
.
Increased frequency of adenocarcinoma of the uterine cervix in young women in Los Angeles County.
J Natl Cancer Inst
1986
.
76
:
423
428
.
Alfsen
,
G. C.
,
S. O.
Thoresen
,
G. B.
Kristensen
,
E.
Skovlund
, and
V. M.
Abeler
.
Histopathologic subtyping of cervical adenocarcinoma reveals increasing incidence rates of endometrioid tumors in all age groups: a population based study with review of all nonsquamous cervical carcinomas in Norway from 1966 to 1970, 1976 to 1980, and 1986 to 1990.
Cancer
2000
.
89
:
1291
1299
.
Zheng
,
T.
,
T. R.
Holford
, and
Z.
Ma
.
et al
.
The continuing increase in adenocarcinoma of the uterine cervix: a birth cohort phenomenon.
Int J Epidemiol
1996
.
25
:
252
258
.
Mody
,
D. R.
Agonizing over AGUS.
Cancer
1999
.
87
:
243
244
.
Raab
,
S. S.
,
C.
Isacson
,
L. J.
Layfield
,
J. C.
Lenel
,
D. D.
Slagel
, and
P. A.
Thomas
.
Atypical glandular cells of undetermined significance: cytologic criteria to separate clinically significant from benign lesions.
Am J Clin Pathol
1995
.
104
:
574
582
.
Lee
,
K. R.
,
L. J.
Minter
, and
S. R.
Granter
.
Papanicolaou smear sensitivity for adenocarcinoma in situ of the cervix: a study of 34 cases [see comments].
Am J Clin Pathol
1997
.
107
:
30
35
.
Lee
,
K. R.
Adenocarcinoma in situ with a small cell (endometrioid) pattern in cervical smears: a test of the distinction from benign mimics using specific criteria.
Cancer
1999
.
87
:
254
258
.
DiTomasso
,
J. P.
,
I.
Ramzy
, and
D. R.
Mody
.
Glandular lesions of the cervix:.
validity of cytologic criteria used to differentiate reactive changes, glandular intraepithelial lesions and adenocarcinoma [erratum appears in Acta Cytol. 1997;41:619–620]
.
Acta Cytol
1996
.
40
:
1127
1135
.
Lee
,
K. R.
,
D. R.
Genest
,
L. J.
Minter
,
S. R.
Granter
, and
E. S.
Cibas
.
Adenocarcinoma in situ in cervical smears with a small cell (endometrioid) pattern: distinction from cells directly sampled from the upper endocervical canal or lower segment of the endometrium [see comments].
Am J Clin Pathol
1998
.
109
:
738
742
.
Veljovich
,
D. S.
,
M. H.
Stoler
,
W. A.
Andersen
,
J. L.
Covell
, and
L. W.
Rice
.
Atypical glandular cells of undetermined significance: a five-year retrospective histopathologic study.
Am J Obstet Gynecol
1998
.
179
:
382
390
.
Lee
,
K. R.
,
T. M.
Darragh
, and
N. E.
Joste
.
et al
.
Atypical glandular cells of undetermined significance (AGUS): interobserver reproducibility in cervical smears and corresponding thin-layer preparations.
Am J Clin Pathol
2002
.
117
:
96
102
.
Ishii
,
K.
,
T.
Katsuyama
, and
H.
Ota
.
et al
.
Cytologic and cytochemical features of adenoma malignum of the uterine cervix [erratum appears in Cancer. 1999;87:395].
Cancer
1999
.
87
:
245
253
.
Ashfaq
,
R.
,
D.
Gibbons
,
C.
Vela
,
M. H.
Saboorian
, and
F.
Iliya
.
ThinPrep Pap Test: accuracy for glandular disease:.
acta Cytol
1999
.
43
:
81
85
.
Roberts
,
J. M.
,
J. K.
Thurloe
,
R. C.
Bowditch
,
J.
Humcevic
, and
C. R.
Laverty
.
Comparison of ThinPrep and Pap smear in relation to prediction of adenocarcinoma in situ.
Acta Cytol
1999
.
43
:
74
80
.
Solomon
,
D.
,
W. J.
Frable
, and
G. P.
Vooijs
.
et al
.
ASCUS and AGUS criteria. International Academy of Cytology Task Force summary. Diagnostic Cytology Towards the 21st Century: An International Expert Conference and Tutorial.
Acta Cytol
1998
.
42
:
16
24
.
Wright
,
T. C. Jr
,
J. T.
Cox
,
L. S.
Massad
,
L. B.
Twiggs
, and
E. J.
Wilkinson
.
ASCCP-Sponsored Consensus Conference. 2001 Consensus Guidelines for the management of women with cervical cytological abnormalities [see comments].
JAMA
2002
.
287
:
2120
2129
.
Nieminen
,
P.
,
M.
Kallio
, and
M.
Hakama
.
The effect of mass screening on incidence and mortality of squamous and adenocarcinoma of cervix uteri.
Obstet Gynecol
1995
.
85
:
1017
1021
.
Boon
,
M. E.
,
J. C.
de Graaff Guilloud
,
L. P.
Kok
,
P. M.
Olthof
, and
E. J.
van Erp
.
Efficacy of screening for cervical squamous and adenocarcinoma: the Dutch experience.
Cancer
1987
.
59
:
862
866
.
Mitchell
,
H.
,
G.
Medley
,
I.
Gordon
, and
G.
Giles
.
Cervical cytology reported as negative and risk of adenocarcinoma of the cervix: no strong evidence of benefit.
Br J Cancer
1995
.
71
:
894
897
.
Raab
,
S. S.
,
K. R.
Geisinger
,
J. F.
Silverman
,
P. A.
Thomas
, and
M. W.
Stanley
.
Interobserver variability of a Papanicolaou smear diagnosis of atypical glandular cells of undetermined significance.
Am J Clin Pathol
1998
.
110
:
653
659
.
Pacey
,
N. F.
and
A. B. P.
Ng
.
Glandular neoplasms of the uterine cervix.
In: Bibbo M, ed. Comprehensive Cytopathology. 2nd ed. Philadelphia, Pa: WB Saunders Co; 1997:239–249.
Covell
,
J.
,
D.
Wilbur
,
B.
Guidos
,
K.
Lee
,
D.
Chhieng
, and
D.
Mody
.
Epithelial abnormalities: glandular.
In: Solomon D, Nayar R, eds. The Bethesda System for Reporting Cervical Cytology. 2nd ed. New York, NY: Springer-Verlag; 2004. In press
.
Davey
,
D. D.
,
S.
Woodhouse
,
P.
Styer
,
J.
Stastny
, and
D.
Mody
.
Atypical epithelial cells and specimen adequacy: current laboratory practices of participants in the College of American Pathologists Interlaboratory Comparison Program in Cervicovaginal Cytology.
Arch Pathol Lab Med
2000
.
124
:
203
211
.
Colgan
,
T. J.
,
R. M.
Austin
, and
D. D.
Davey
.
The annual Papanicolaou test: women's safety and public policy.
Cancer
2001
.
93
:
81
85
.

Author notes

Reprints: George G. Birdsong, MD, Department of Anatomic Pathology, Grady Health System, 80 Butler St SE, Atlanta, GA 30335-3801 ([email protected])