Performance indicators in colonoscopy after certification for independent practice: outcomes and predictors of competence

Published:August 01, 2018DOI:https://doi.org/10.1016/j.gie.2018.07.032

      Background

      Robust real-world performance data of newly independent colonoscopists are lacking. In the United Kingdom, provisional colonoscopy certification (PCC) marks the transition from training to newly independent practice. We aimed to assess changes in key performance indicators (KPIs) such as cecal intubation rate (CIR) in the periods pre- and post-PCC, particularly regarding rates and predictors of trainees exhibiting a drop in performance (DIP), defined as CIR <90% in the first 50 procedures post-PCC.

      Methods

      A prospective United Kingdom–wide observational study of Joint Advisory Group on Gastrointestinal Endoscopy Electronic Training System (JETS) e-portfolio colonoscopy entries (257,800) from trainees awarded PCC between July 2011 and 2016 was undertaken. Moving average analyses were used to study KPI trends relative to PCC. Pre-PCC trainee, trainer, and training environment factors were compared between DIP and non-DIP cohorts to identify predictors of DIP.

      Results

      Seven hundred thirty-three trainees from 180 centers were awarded PCC after a median of 265 procedures and 3.1 years. Throughout the early post-PCC period, average CIRs surpassed the national 90% standard. Despite this, not all trainees achieved this standard post-PCC, with DIP observed in 18.4%. DIP was not influenced by trainer presence and diminished after 100 additional procedures. On multivariable analysis, pre-PCC CIRs and trainer specialty were predictive of DIP. Trainees with DIP incurred higher post-PCC rates of moderate to severe discomfort despite requiring higher analgesic dosages and were more likely to require trainer assistance in failed procedures.

      Conclusions

      The current PCC requirements are appropriate for diagnostic colonoscopy. It is possible to identify predictors of underperformance in trainees, which may be of value to training leads and could improve the patient experience.

      Abbreviations:

      CIR (cecal intubation rate), DIP (drop in performance), JETS (Joint Advisory Group on Gastrointestinal Endoscopy Training System), KPI (key performance indicator), PCC (provision colonoscopy certification), PDR (polyp detection rate), SAE (serious adverse event)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Gastrointestinal Endoscopy
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Dunckley P.
        • Elta G.
        Quality assurance of training.
        Best Pract Res Clin Gastroenterol. 2011; 25: 397-407
        • Kaminski M.F.
        • Wieszczy P.
        • Rupinski M.
        • et al.
        Increased rate of adenoma detection associates with reduced risk of colorectal cancer and death.
        Gastroenterology. 2017; 153: 98-105
        • Corley D.A.
        • Jensen C.D.
        • Marks A.R.
        • et al.
        Adenoma detection rate and risk of colorectal cancer and death.
        N Engl J Med. 2014; 370: 1298-1306
        • Gray J.A.M.
        • Patnick J.
        • Blanks R.G.
        Maximising benefit and minimising harm of screening.
        BMJ. 2008; 336: 480-483
        • Rees C.J.
        • Thomas Gibson S.
        • Rutter M.D.
        • et al.
        UK key performance indicators and quality assurance standards for colonoscopy.
        Gut. 2016; 65: 1923-1929
        • Kaminski M.F.
        • Thomas-Gibson S.
        • Bugajski M.
        • et al.
        Performance measures for lower gastrointestinal endoscopy: a European Society of Gastrointestinal Endoscopy (ESGE) quality improvement initiative.
        United Eur Gastroenterol J. 2017; 5: 309-334
        • Shahidi N.
        • Ou G.
        • Telford J.
        • et al.
        Establishing the learning curve for achieving competency in performing colonoscopy: a systematic review.
        Gastrointest Endosc. 2014; 80: 410-416
        • Sedlack R.E.
        Training to competency in colonoscopy: assessing and defining competency standards.
        Gastrointest Endosc. 2011; 74: 355-366
        • Spier B.J.
        • Benson M.
        • Pfau P.R.
        • et al.
        Colonoscopy training in gastroenterology fellowships: determining competence.
        Gastrointest Endosc. 2010; 71: 319-324
        • Ward S.
        • Mohammed M.
        • Walt R.
        • et al.
        An analysis of the learning curve to achieve competency at colonoscopy using the JETS database.
        Gut. 2014; 63: 1746-1754
        • Joint Advisory Group
        JAG trainee certification process: colonoscopy (provisional and full).
        (Available at:) (Accessed January 15, 2018)
        • Siau K.
        • Dunckley P.
        • Valori R.
        • et al.
        Changes in scoring of direct observation of procedural skills (DOPS) forms and the impact on competence assessment.
        Endoscopy. 2018; 50: 770-778
        • Barton J.R.
        • Corbett S.
        • van der Vleuten C.P.
        The validity and reliability of a direct observation of procedural skills assessment tool: assessing colonoscopic skills of senior endoscopists.
        Gastrointest Endosc. 2012; 75: 591-597
        • Ekkelenkamp V.E.
        • Dowler K.
        • Valori R.M.
        • et al.
        Patient comfort and quality in colonoscopy.
        World J Gastroenterol. 2013; 19: 2355-2361
        • Rees C.
        • Thomas Gibson S.
        • Rutter M.
        • et al.
        UK key performance indicators and quality assurance standards for colonoscopy.
        Gut. 2016; 65: 1923-1929
      1. Biswas S, Alrubaiy L, China L, et al. Trends in UK endoscopy training in the BSG trainees’ national survey and strategic planning for the future. Frontline Gastroenterol. Epub 2017 Sept 23.

        • Baxter N.N.
        • Sutradhar R.
        • Forbes S.S.
        • et al.
        Analysis of administrative data finds endoscopist quality measures associated with postcolonoscopy colorectal cancer.
        Gastroenterology. 2011; 140: 65-72
        • Valori R.M.
        • Damery S.
        • Gavin D.R.
        • et al.
        A new composite measure of colonoscopy: the performance indicator of colonic intubation (PICI).
        Endoscopy. 2018; 50: 40-51
        • Gavin D.R.
        • Valori R.M.
        • Anderson J.T.
        • et al.
        The national colonoscopy audit: a nationwide assessment of the quality and safety of colonoscopy in the UK.
        Gut. 2013; 62: 242
        • Ward S.T.
        • Hancox A.
        • Mohammed M.A.
        • et al.
        The learning curve to achieve satisfactory completion rates in upper GI endoscopy: an analysis of a national training database.
        Gut. 2017; 66: 1022-1030
        • American Society for Gastrointestinal Endoscopy
        Ensuring competence in endoscopy.
        (Available at:) (Accessed January 15, 2018)

      Linked Article

      • The path to quality colonoscopy continues after graduation
        Gastrointestinal EndoscopyVol. 89Issue 3
        • Preview
          The effort over the past decade to improve quality in colonoscopy was marked by several essential steps forward. These included definition of quality indicators,1,2 the development and validation of objective skills assessment tools such as the American Society for Gastrointestinal Endoscopy assessment of competency in endoscopy tool, the direct observation of procedural skills (DOPS),3,4 and the investment in infrastructure to track and benchmark performance for key indicators such as the GI quality improvement consortium (GIQuIC)5 and the Joint Advisory Group on GI Endoscopy - Endoscopy Training System eportfolio in the United Kingdom.
        • Full-Text
        • PDF