Development of a computer-aided detection system for colonoscopy and a publicly accessible large colonoscopy video database (with video)

      Background and Aims

      Artificial intelligence (AI)–assisted polyp detection systems for colonoscopic use are currently attracting attention because they may reduce the possibility of missed adenomas. However, few systems have the necessary regulatory approval for use in clinical practice. We aimed to develop an AI-assisted polyp detection system and to validate its performance using a large colonoscopy video database designed to be publicly accessible.


      To develop the deep learning–based AI system, 56,668 independent colonoscopy images were obtained from 5 centers for use as training images. To validate the trained AI system, consecutive colonoscopy videos taken at a university hospital between October 2018 and January 2019 were searched to construct a database containing polyps with unbiased variance. All images were annotated by endoscopists according to the presence or absence of polyps and the polyps’ locations with bounding boxes.


      A total of 1405 videos acquired during the study period were identified for the validation database, 797 of which contained at least 1 polyp. Of these, 100 videos containing 100 independent polyps and 13 videos negative for polyps were randomly extracted, resulting in 152,560 frames (49,799 positive frames and 102,761 negative frames) for the database. The AI showed 90.5% sensitivity and 93.7% specificity for frame-based analysis. The per-polyp sensitivities for all, diminutive, protruded, and flat polyps were 98.0%, 98.3%, 98.5%, and 97.0%, respectively.


      Our trained AI system was validated with a new large publicly accessible colonoscopy database and could identify colorectal lesions with high sensitivity and specificity. (Clinical trial registration number: UMIN 000037064.)


      AI (artificial intelligence), CI (confidence interval)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Gastrointestinal Endoscopy
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • van Rijn J.C.
        • Reitsma J.B.
        • Stoker J.
        • et al.
        Polyp miss rate determined by tandem colonoscopy: a systematic review.
        Am J Gastroenterol. 2006; 101: 343-350
        • le Clercq C.M.
        • Bouwens M.W.
        • Rondagh E.J.
        • et al.
        Postcolonoscopy colorectal cancers are preventable: a population-based study.
        Gut. 2014; 63: 957-963
        • Wang P.
        • Xiao X.
        • Glissen Brown J.R.
        • et al.
        Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy.
        Nat Biomed Eng. 2018; 2: 741-748
        • Urban G.
        • Tripathi P.
        • Alkayali T.
        • et al.
        Deep learning localizes and identifies polyps in real time with 96% accuracy in screening colonoscopy.
        Gastroenterology. 2018; 155: 1069-1078
        • Yamada M.
        • Saito Y.
        • Imaoka H.
        • et al.
        Development of a real-time endoscopic image diagnosis support system using deep learning technology in colonoscopy.
        Sci Rep. 2019; 9: 14465
        • Misawa M.
        • Kudo S.E.
        • Mori Y.
        • et al.
        Artificial intelligence-assisted polyp detection for colonoscopy: initial experience.
        Gastroenterology. 2018; 154: 2027-2029
        • Wang P.
        • Liu X.
        • Berzin T.M.
        • et al.
        Effect of a deep-learning computer-aided detection system on adenoma detection during colonoscopy (CADe-DB trial): a double-blind randomised study.
        Lancet Gastroenterol Hepatol. 2020; 5: 343-351
        • Wang P.
        • Berzin T.M.
        • Glissen Brown J.R.
        • et al.
        Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: a prospective randomised controlled study.
        Gut. 2019; 68: 1813-1819
        • Gong D.
        • Wu L.
        • Zhang J.
        • et al.
        Detection of colorectal adenomas with a real-time computer-aided system (ENDOANGEL): a randomised controlled study.
        Lancet Gastroenterol Hepatol. 2020; 5: 352-361
        • Su J.R.
        • Li Z.
        • Shao X.J.
        • et al.
        Impact of a real-time automatic quality control system on colorectal polyp and adenoma detection: a prospective randomized controlled study (with videos).
        Gastrointest Endosc. 2020; 91: 415-424
        • Liu W.N.
        • Zhang Y.Y.
        • Bian X.Q.
        • et al.
        Study on detection rate of polyps and adenomas in artificial-intelligence-aided colonoscopy.
        Saudi J Gastroenterol. 2020; 26: 13-19
        • Medtronic
        Medtronic launches the first artificial intelligence system for colonoscopy at United European Gastroenterology Week 2019.
        (Available at:)
        • Pentax Medical
        HOYA Group PENTAX Medical Cleared CE Mark for DISCOVERY™, an AI assisted polyp detector.
        (Available at:)
      1. Fujifilm Corporation. Fujifilm acquires CE mark and launches CAD EYE, a function of colonic polyp detection utilizing AI technology, in Europe. Available at: Accessed February 25, 2020.

        • Chinzei K.
        • Shimizu A.
        • Mori K.
        • et al.
        Regulatory science on AI-based medical devices and systems.
        Adv Biomed Eng. 2018; 7: 118-123
        • Tajbakhsh N.
        • Gurudu S.R.
        • Liang J.
        Automated polyp detection in colonoscopy videos using shape and context information.
        IEEE Trans Med Imaging. 2016; 35: 630-644
        • Bernal J.
        • Sanchez F.J.
        • Fernandez-Esparrach G.
        • et al.
        WM-DOVA maps for accurate polyp highlighting in colonoscopy: validation vs. saliency maps from physicians.
        Comput Med Imaging Graph. 2015; 43: 99-111
        • Pogorelov K.
        • Randel K.R.
        • Griwodz C.
        • et al.
        Kvasir: a multi-class image dataset for computer aided gastrointestinal disease detection.
        (Proceedings of the 8th ACM on Multimedia Systems Conference)2017: 164-169
        • Silva J.
        • Histace A.
        • Romain O.
        • et al.
        Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer.
        Int J Comp Assist Radiol Surg. 2014; 9: 283-293
      2. Redmon J, Farhadi A. YOLOv3: an incremental improvement. arXiv preprint arXiv:180402767. 2018. Available at: Accessed September 28, 2020.

      3. Kingma DP, Ba J. Adam: a method for stochastic optimization. arXiv preprint arXiv:14126980. 2014. Available at: Accessed September 28, 2020.

        • RC Team
        R: a language and environment for statistical computing.
        (Vienna, Austria. Available at:) (Accessed November 1, 2011)
        • Fernandez-Esparrach G.
        • Bernal J.
        • Lopez-Ceron M.
        • et al.
        Exploring the clinical potential of an automatic colonic polyp detection method based on the creation of energy maps.
        Endoscopy. 2016; 48: 837-842
        • Mori Y.
        • Kudo S.E.
        • Misawa M.
        • et al.
        Real-time use of artificial intelligence in identification of diminutive polyps during colonoscopy: a prospective study.
        Ann Intern Med. 2018; 169: 357-366

      Linked Article