Proceedings from the First Global Artificial Intelligence in Gastroenterology and Endoscopy Summit

Published:April 25, 2020DOI:

      Background and Aims

      Artificial intelligence (AI), specifically deep learning, offers the potential to enhance the field of GI endoscopy in areas ranging from lesion detection and classification to quality metrics and documentation. Progress in this field will be measured by whether AI implementation can lead to improved patient outcomes and more efficient clinical workflow for GI endoscopists. The aims of this article are to report the findings of a multidisciplinary group of experts focusing on issues in AI research and applications related to gastroenterology and endoscopy, to review the current status of the field, and to produce recommendations for investigators developing and studying new AI technologies for gastroenterology.


      A multidisciplinary meeting was held on September 28, 2019, bringing together academic, industry, and regulatory experts in diverse fields including gastroenterology, computer and imaging sciences, machine learning, computer vision, U.S. Food and Drug Administration, and the National Institutes of Health. Recent and ongoing studies in gastroenterology and current technology in AI were presented and discussed, key gaps in knowledge were identified, and recommendations were made for research that would have the highest impact in making advances and implementation in the field of AI to gastroenterology.


      There was a consensus that AI will transform the field of gastroenterology, particularly endoscopy and image interpretation. Powered by advanced machine learning algorithms, the use of computer vision in endoscopy has the potential to result in better prediction and treatment outcomes for patients with gastroenterology disorders and cancer. Large libraries of endoscopic images, “EndoNet,” will be important to facilitate development and application of AI systems. The regulatory environment for implementation of AI systems is evolving, but common outcomes such as colon polyp detection have been highlighted as potential clinical trial endpoints. Other threshold outcomes will be important, as well as clarity on iterative improvement of clinical systems.


      Gastroenterology is a prime candidate for early adoption of AI. AI is rapidly moving from an experimental phase to a clinical implementation phase in gastroenterology. It is anticipated that the implementation of AI in gastroenterology over the next decade will have a significant and positive impact on patient care and clinical workflows. Ongoing collaboration among gastroenterologists, industry experts, and regulatory agencies will be important to ensure that progress is rapid and clinically meaningful. However, several constraints and areas will benefit from further exploration, including potential clinical applications, implementation, structure and governance, role of gastroenterologists, and potential impact of AI in gastroenterology.


      ADR (adenoma detection rate), AI (artificial intelligence), CAD (computer-aided diagnosis), FDA (U.S. Food and Drug Administration)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Gastrointestinal Endoscopy
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • McKinsey Global Institute
        Artificial intelligence: The next digital frontier?.
        (Available at:) (McKinsey&Company; Accessed Jan 10, 2020)
        • Poplin R.
        • Varadarajan A.V.
        • Blumer K.
        • et al.
        Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning.
        Nat Biomed Eng. 2018; 2: 158-164
        • Gulshan V.
        • Peng L.
        • Coram M.
        • et al.
        Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs.
        JAMA. 2016; 316: 2402-2410
        • Esteva A.
        • Kuprel B.
        • Novoa R.A.
        • et al.
        Dermatologist-level classification of skin cancer with deep neural networks.
        Nature. 2017; 542: 115-118
        • U.S. Food and Drug Administration
        FDA permits marketing of artificial intelligence-based device to detect certain diabetes-related eye problems.
        (Available at:)
        • Tischendorf J.J.
        • Gross S.
        • Winograd R.
        • et al.
        Computer-aided classification of colorectal polyps based on vascular patterns: a pilot study.
        Endoscopy. 2010; 42: 203-207
        • Wang P.
        • Xiao X.
        • Glissen Brown J.R.
        • et al.
        Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy.
        Nat Biomed Eng. 2018; 2: 741-748
        • Mori Y.
        • Kudo S-e
        • Misawa M.
        • et al.
        Real-time use of artificial intelligence in identification of diminutive polyps during colonoscopy: a prospective study.
        Ann Intern Med. 2018; 169: 357-366
        • Wang P.
        • Berzin T.M.
        • Glissen Brown J.R.
        • et al.
        Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates: a prospective randomised controlled study.
        Gut. 2019; 68: 1813-1819
        • Vinsard D.G.
        • Mori Y.
        • Misawa M.
        • et al.
        Quality assurance of computer-aided detection and diagnosis in colonoscopy.
        Gastrointest Endosc. 2019; 90: 55-63
        • Hirasawa T.
        • Aoyama K.
        • Tanimoto T.
        • et al.
        Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images.
        Gastric Cancer. 2018; 21: 653-660
        • Zhu Y.
        • Wang Q.C.
        • Xu M.D.
        • et al.
        Application of convolutional neural network in the diagnosis of the invasion depth of gastric cancer based on conventional endoscopy.
        Gastrointest Endosc. 2019; 89: 806-815
        • Horie Y.
        • Yoshio T.
        • Aoyama K.
        • et al.
        Diagnostic outcomes of esophageal cancer by artificial intelligence using convolutional neural networks.
        Gastrointest Endosc. 2019; 89: 25-32
        • Pan G.
        • Yan G.
        • Song X.
        • et al.
        BP neural network classification for bleeding detection in wireless capsule endoscopy.
        J Med Eng Technol. 2009; 33: 575-581
        • Xiao J.
        • Meng M.Q.
        A deep convolutional neural network for bleeding detection in wireless capsule endoscopy images.
        Conf Proc IEEE Eng Med Biol Soc. 2016; 2016: 639-642
        • Hassan A.R.
        • Haque M.A.
        Computer-aided gastrointestinal hemorrhage detection in wireless capsule endoscopy videos.
        Comput Methods Progr Biomed. 2015; 122: 341-353
        • Mori Y.
        • Kudo S.E.
        • Wakamura K.
        • et al.
        Novel computer-aided diagnostic system for colorectal lesions by using endocytoscopy (with videos).
        Gastrointest Endosc. 2015; 81: 621-629
        • Jordan M.I.
        • Mitchell T.M.
        Machine learning: trends, perspectives, and prospects.
        Science. 2015; 349: 255-260
        • Shung D.
        • Simonov M.
        • Gentry M.
        • et al.
        Machine learning to predict outcomes in patients with acute gastrointestinal bleeding: a systematic review.
        Dig Dis Sci. 2019; 64: 2078-2087
        • Waljee A.K.
        • Wallace B.I.
        • Cohen-Mekelburg S.
        • et al.
        Development and validation of machine learning models in prediction of remission in patients with moderate to severe crohn disease.
        JAMA Netw Open. 2019; 2e193721
        • Thakkar S.
        • Carleton N.M.
        • Rao B.
        • Syed A.
        Use of artificial intelligence-based analytics from live colonoscopies to optimize the quality of the colonoscopy examination in real time: proof of concept.
        Gastroenterology. 2020; 158 (e2): 1219-1221
        • Su J.R.
        • Li Z.
        • Shao X.J.
        • et al.
        Impact of a real-time automatic quality control system on colorectal polyp and adenoma detection: a prospective randomized controlled study (with videos).
        Gastrointest Endosc. 2020; 91: 415-424
        • Wu L.
        • Zhang J.
        • Zhou W.
        • et al.
        Randomised controlled trial of WISENSE, a real-time quality improving system for monitoring blind spots during esophagogastroduodenoscopy.
        Gut. 2019; 68: 2161-2169
        • Zia J.
        • Schroeder J.
        • Munson S.
        • et al.
        Feasibility and usability pilot study of a novel irritable bowel syndrome food and gastrointestinal symptom journal smartphone app.
        Clin Transl Gastroenterol. 2016; 7: e147
        • Epstein D.
        • Cordeiro F.
        • Bales E.
        • et al.
        Taming data complexity in lifelogs: exploring visual cuts of personal informatics data.
        (Proceedings of the 2014 Conference on Designing Interactive Systems) ACM, Vancouver, BC, Canada2014: 667-676
        • Bentley F.
        • Tollmar K.
        • Stephenson P.
        • et al.
        Health mashups: presenting statistical patterns between wellbeing data and context in natural language to promote behavior change.
        ACM Trans Comput Hum Interact. 2013; 20: 1-27
        • Chung C.F.
        • Wang Q.
        • Schroeder J.
        • et al.
        Identifying and planning for individualized change: patient-provider collaboration using lightweight food diaries in healthy eating and irritable bowel syndrome.
        Proc ACM Interact Mob Wearable Ubiquitous Technol. 2019; 3: 7
        • Endoscopic Classification Review Group
        Update on the Paris classification of superficial neoplastic lesions in the digestive tract.
        Endoscopy. 2005; 37: 570-578
      1. Requests for feedback and meetings for medical device submissions: the U.S. Food and Drug Administration Q-submission program.
        (Available at:)
        • Stamm J.A.
        • Korzick K.A.
        • Beech K.
        • et al.
        Medical malpractice: reform for today's patients and clinicians.
        Am J Med. 2016; 129: 20-25
        • Altman R.B.
        Artificial intelligence (AI) systems for interpreting complex medical datasets.
        Clin Pharmacol Ther. 2017; 101: 585-586