Seegene Medical Foundation, one of the major clinical laboratories in South Korea, developed SeeDP, an artificial intelligence (AI)–based postanalytic daily quality control (QC) system that reassesses all gastrointestinal (GI) endoscopic biopsy (EB) slides for incorrect diagnoses.
To review the operational records and clinical impact of SeeDP since its launch in March 2022.
Operational records of SeeDP were retrieved for the period of March 1, 2022, to February 28, 2023. Among cases scanned during 40 working days (March 10, 2022, to May 4, 2022), all discordant cases encountered by 2 pathologists were reviewed. Cases of SeeDP-assisted revised diagnoses were collected and compared with cases recognized using conventional methods.
Occasional scanner failures and various types of aberrant errors compromised QC coverage, resulting in the scanning of only 67.7% (572 254 of 844 906) of all EB slides submitted and 0.8% of the scanned slides being further excluded from the AI analysis. The AI predictions differed from the pathologists’ diagnoses in 42 760 of the 557 672 gastrointestinal EB slides (7.7%) successfully assessed by the AI models; however, a detailed review of discordant slides revealed that true misdiagnosis accounted for only 5.5% (25 of 454) of the disagreements. Compared with conventional error recognition methods, SeeDP detected more misdiagnoses (7 versus 14) within a significantly shorter time (average, 3.6 versus 38.7 days; P < .001), including 1 signet ring cell carcinoma initially diagnosed as gastritis.
AI-based daily QC systems are plausible solutions to guarantee high-quality pathologic diagnosis by enabling rapid detection and correction of misdiagnosis.
Author notes
This research was supported by the Seegene Medical Foundation, South Korea, under the project “Research on Developing a Next Generation Medical Diagnosis System Using Deep Learning” (Grant Number: G01180115).
All authors report employment with Seegene Medical Foundation. Jang, Park, and Ko have intellectual property interests relevant to the work that is the subject of this paper. The authors have no other relevant financial interest in the products or companies described in this article.
Portions of this manuscript were presented as a poster at the 35th European Congress of Pathology; Dublin, Ireland; September 10, 2023.