Artificial intelligence in endoscopy

Published:December 21, 2019DOI:
      Endoscopy is one of the cornerstones in the field of gastroenterology. The original fiberoptic endoscope was developed in the 1950s. From this point in time and decade after decade the field of endoscopy continues to this day to grow and evolve. Endoscopic retrograde cholangiography was developed in the 1970s and EUS in the 1980s, further showing the potential of endoscopy to have no boundaries. The image quality of the scope is now high-definition white light along with optical enhancements such as narrow-band imaging (NBI), with the goal to improve mucosal surface area inspection to both identify and interpret abnormal areas. Outside of medicine, we have seen the growth of artificial intelligence (AI) in our daily lives, from Waze for navigation, smartphones, and, most recently, self-driving cars. It was only a matter of time before AI would enter the GI arena in the area of endoscopy. AI applications in medicine have occurred in ophthalmology and dermatology along with other areas. In endoscopy, AI started out in colonoscopy to help improve polyp detection and adenoma detection and to interpret the lesion patterns, differentiating between benign and precancerous polyps.


      ADR (adenoma detection rate), AI (artificial intelligence), AUC (area under the curve), BE (Barrett’s esophagus), CAD (computer-aided diagnosis), CNN (convoluted neural network), NBI (narrow-band imaging), NPV (negative predictive value), PPV (positive predictive value), VLE (volumetric laser endomicroscopy), WCE (wireless capsule endoscopy)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Gastrointestinal Endoscopy
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Misawa M.
        • Kudo S.-E.
        • Mori Y.
        • et al.
        Artificial intelligence-assisted polyp detection for colonoscopy: initial experience.
        Gastroenterology. 2018; 154: 2027-2029
        • Guizard N.
        • Ghalehjegh S.H.
        • Henkel M.
        • et al.
        Artificial intelligence for real-time multiple polyp detection with identification, tracking, and optical biopsy during colonoscopy [abstract].
        Gastroenterology. 2019; 156: S48-9
        • Wang P.
        • Berzin T.M.
        • Brown J.R.G.
        • et al.
        Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: a prospective randomised controlled study.
        Gut. 2019; 68: 1813-1819
        • Klare P.
        • Sander C.
        • Prinzen M.
        • et al.
        Automated polyp detection in the colorectum: a prospective study (with videos).
        Gastrointest Endosc. 2019; 89: 576-582
        • Byrne M.F.
        • Shahidi N.
        • Rex D.K.
        Will computer-aided detection and diagnosis revolutionize colonoscopy?.
        Gastroenterology. 2017; 153: 1460-1464
        • Byrne M.F.
        • Chapados N.
        • Soudan F.
        • et al.
        Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model.
        Gut. 2017; 68: 94-100
        • Lui T.K.-L.
        • Yee K.
        • Wong K.
        • et al.
        Artificial intelligence image classifier based on nonoptical magnified images accurately predicts histology and endoscopic resectability of different colonic lesions.
        Gastroenterology. 2019; 156: S48
        • Hotta K.
        • Kudo S.
        • Mori Y.
        • et al.
        Computer-aided diagnosis for small colorectal lesions: a multi-center validation “endobrain study” designed to obtain regulatory approval.
        Gastrointest Endosc. 2019; 89: AB76
        • Mori Y.
        • Kudo S.-E.
        • Misawa M.
        • et al.
        Real-time use of artificial intelligence in identification of diminutive polyps during colonoscopy.
        Ann Inter Med. 2018; 169: 357
        • Sehgal V.
        • Rosenfeld A.
        • Graham D.
        • et al.
        Machine learning creates a simple endoscopic classification system that improves dysplasia detection in Barrett’s oesophagus amongst non-expert endoscopists.
        Gastroenterol Res Pract. 2018; 65: A283
        • Sommen F.V.D.
        • Zinger S.
        • Curvers W.L.
        • et al.
        Computer-aided detection of early neoplastic lesions in Barrett’s esophagus: towards a supportive detection system in endoscopy.
        Gastroenterology. 2016; 48: 617-624
        • Struyvenberg M.R.
        • Groof J.D.
        • Putten J.V.D.
        • et al.
        Deep learning algorithm for characterization of barretts neoplasia demonstrates high accuracy on NBI-zoom images.
        Gastroenterology. 2019; 156: S58
        • Trindade A.J.
        • McKinley M.
        • Fan C.
        • et al.
        Endoscopic surveillance of Barrett’s esophagus using volumetric laser endomicroscopy with artificial intelligence image enhancement.
        Gastroenterology. 2019; 157: 303-305
        • Swager A.F.
        • van der Sommen F.
        • Klomp S.R.
        • et al.
        Computer-aided detection of early Barrett’s neoplasia using volumetric laser endomicroscopy.
        Gastrointest Endosc. 2017; 86: 839-846
        • Kamboj A.K.
        • Hoversten P.
        • Kahn A.K.
        • et al.
        Interpretation of volumetric laser endomicroscopy in Barrett’s esophagus using image enhancement software.
        Dis Esophagus. 2019; 32: doz037
        • Horie Y.
        • Yoshio T.
        • Aoyama K.
        • et al.
        Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks.
        Gastrointest Endosc. 2019; 89: 25-32
        • Wu L.
        • Zhang J.
        • Zhou W.
        • et al.
        Randomised controlled trial of WISENSE, a real-time quality improving system for monitoring blind spots during esophagogastroduodenoscopy.
        Gut. 2019; 68: 2161-2169
        • Wu L.
        • Zhou W.
        • Wan X.
        • et al.
        A deep neural network improves endoscopic detection of early gastric cancer without blind spots.
        Endoscopy. 2019; 51: 522-531
        • Okumura S.
        • Yasuda T.
        • Ichikawa H.
        • et al.
        Unsupervised machine learning based automatic demarcation line drawing system on NBI images of early gastric cancer.
        Gastroenterology. 2019; 156: S-937
        • Ikenoyama Y.
        • Hirasawa T.
        • Ishioka M.
        • et al.
        Comparing artificial intelligence using deep learning through convolutional neural networks and endoscopist’s diagnostic ability for detecting early gastric cancer [abstract].
        Gastrointest Endosc. 2019; 89: AB75
        • Alaskar H.
        • Hussain A.
        • Al-Aseem N.
        • et al.
        Application of convolutional neural networks for automated ulcer detection in wireless capsule endoscopy images.
        Sensors. 2019; 19: 1265
        • Leenhardt R.
        • Vasseur P.
        • Li C.
        • et al.
        A neural network algorithm for detection of GI angiectasia during small-bowel capsule endoscopy.
        Gastrointest Endosc. 2018; 89: 189-194
        • Krishna S.G.
        • Chao W.-L.
        • Strobel S.G.
        • et al.
        Application of machine learning and artificial intelligence in the detection of dysplasia in intraductal papillary mucinous neoplasms using EUS-guided needle-based confocal laser endomicroscopy [abstract].
        Gastroenterology. 2019; 156: S938
        • Jacot G.P.
        • Qu C.
        • Cahill J.
        • et al.
        Use of artificial intelligence to predict future risk for improved colon cancer screening intervals.
        Gastroenterology. 2014; 146: S734-5
        • Cooper G.
        • Sivak M.V.
        More on endoscopy databases.
        Gastrointest Endosc. 2000; 51: 759-761
        • Hicks S.
        • Smedsrud P.
        • Riegler M.
        • et al.
        Deep learning for automatic generation of endoscopy reports [abstract].
        Gastrointest Endosc. 2019; 89: AB77