An Evaluation of Peer-Rated Surgical Skill and its Relationship With Detrusor Muscle Sampling in Transurethral Resection of Bladder Tumor



      To assess the reliability of peer-review of TURBT videos as a means to evaluate surgeon skill and its relationship to detrusor sampling.


      Urologists from an academic health system submitted TURBT videos in 2019. Ten blinded peers evaluated each surgeon's performance using a 10-item scoring instrument to quantify surgeon skill. Normalized composite skill scores for each surgeon were calculated using peer ratings. For surgeons submitting videos, we retrospectively reviewed all TURBT pathology results (2018-2019) to assess surgeon-specific detrusor sampling. A hierarchical logistic regression model was fit to evaluate the association between skill and detrusor sampling, adjusting for patient and surgeon factors.


      Surgeon skill scores and detrusor sampling rates were determined for 13 surgeons performing 245 TURBTs. Skill scores varied from -6.0 to 5.1 [mean: 0; standard deviation (SD): 2.40]. Muscle was sampled in 72% of cases, varying considerably across surgeons (mean: 64.5%; SD: 30.7%). Among 8 surgeons performing >5 TURBTs during the study period, adjusted detrusor sampling rate was associated with sending separate deep specimens (odds ratio [OR]: 1.97; 95% confidence interval [CI]: 1.02-3.81, P = .045) but not skill (OR: 0.81; 95% CI: 0.57-1.17, P = .191).


      Surgeon skill was not associated with detrusor sampling, suggesting there may be other drivers of variability of detrusor sampling in TURBT.
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Urology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


      1. American Urologic Association & Society of Urologic Oncology. Diagnosis and treatment of non-muscle invasive bladder cancer. 2020.

      2. National Comprehensive Cancer Society. NCCN guidelines for bladder cancer. 2020.

        • Brausi M
        • Collette L
        • Kurth K
        • et al.
        Variability in the recurrence rate at first follow-up cystoscopy after TUR in stage Ta T1 transitional cell carcinoma of the bladder: a combined analysis of seven EORTC Studies.
        European Urology. 2002; 41: 523-531
        • Gendy R
        • Delprado W
        • Brenner P
        • et al.
        Repeat transurethral resection for non-muscle-invasive bladder cancer: a contemporary series.
        BJU Int. 2016; 117: 54-59
        • Capogrosso P
        • Capitanio U
        • Ventimiglia E
        • et al.
        Detrusor muscle in TUR-derived bladder tumor specimens: can we actually improve the surgical quality?.
        J Endourol. 2016; 30: 400-405
        • Shoshany O
        • Mano R
        • Margel D
        • Baniel J
        • Yossepowitch O
        Presence of detrusor muscle in bladder tumor specimens–predictors and effect on outcome as a measure of resection quality.
        Urol Oncol. 2014; 32: 40
        • Gordon PC
        • Thomas F
        • Noon AP
        • Rosario DJ
        • Catto JWF
        Long-term outcomes from re-resection for high-risk non-muscle-invasive bladder cancer: a potential to rationalize use.
        Eur Urol Focus. 2019; 5: 650-657
        • Mariappan P
        • Johnston A
        • Padovani L
        • et al.
        Enhanced quality and effectiveness of transurethral resection of bladder tumour in non-muscle-invasive bladder cancer: a multicentre real-world experience from Scotland's quality performance indicators programme.
        Eur Urol. 2020; 78: 520-530
        • Das A
        • Cohen JE
        • Ko OS
        • et al.
        Surgeon scorecards improve muscle sampling on transurethral resection of bladder tumor and recurrence outcomes in patients with nonmuscle invasive bladder cancer.
        J Urol. 2021; 205: 693-700
        • Dutta SC
        • Smith JA
        • Shappell SB
        • Coffey CS
        • Chang SS
        • Cookson MS
        Clinical under staging of high risk nonmuscle invasive urothelial carcinoma treated with radical cystectomy.
        J Urol. 2001; 166: 490-493
        • Herr HW
        The value of a second transurethral resection in evaluating patients with bladder tumors.
        J Urol. 1999; 162: 74-76
        • Mariappan P
        • Zachou A
        • Grigor KM
        • Edinburgh Uro-Oncology Group
        Detrusor muscle in the first, apparently complete transurethral resection of bladder tumour specimen is a surrogate marker of resection quality, predicts risk of early recurrence, and is dependent on operator experience.
        Eur Urol. 2010; 57: 843-849
        • Birkmeyer JD
        • Finks JF
        • O'Reilly A
        • et al.
        Surgical skill and complication rates after bariatric surgery.
        N Engl J Med. 2013; 369: 1434-1442
        • Stulberg JJ
        • Huang R
        • Kreutzer L
        • et al.
        Association between surgeon technical skills and patient outcomes.
        JAMA Surg. 2020;
        • Brajcich BC
        • Stulberg JJ
        • Palis BE
        • et al.
        Association between surgical technical kkill and long-term survival for colon cancer.
        JAMA Oncol. 2021; 7: 127-129
        • Martin JA
        • Regehr G
        • Reznick R
        • et al.
        Objective structured assessment of technical skill (OSATS) for surgical residents.
        Br J Surg. 1997; 84: 273-278
        • Scally CP
        • Varban OA
        • Carlin AM
        • Birkmeyer JD
        • Dimick JB
        Michigan bariatric surgery collaborative. Video ratings of surgical skill and late outcomes of bariatric surgery.
        JAMA Surg. 2016; 151e160428
        • Vaidya A
        • Aydin A
        • Ridgley J
        • Raison N
        • Dasgupta P
        • Ahmed K
        Current status of technical skills assessment tools in surgery: a systematic review.
        J Surg Res. 2020; 246: 342-378
      3. Krippendorff K. Computing Krippendorff's alpha-reliability. Departmental Papers (ASC). Available at: Accessed December 18, 2020.

        • Putka DJ
        • Le H
        • McCloy RA
        • Diaz T
        Ill-structured measurement designs in organizational research: implications for estimating interrater reliability.
        J Appl Psychol. 2008; 93: 959-981
        • Vande Walle KA
        • Quamme SRP
        • Beasley HL
        • et al.
        Development and assessment of the Wisconsin surgical coaching rubric.
        JAMA Surg. 2020; 155: 486-492
        • Pradarelli JC
        • Yule S
        • Panda N
        • et al.
        Optimizing the implementation of surgical coaching through feedback from practicing surgeons.
        JAMA Surg. 2021; 156: 42-49
        • Cathcart P
        • Sridhara A
        • Ramachandran N
        • Briggs T
        • Nathan S
        • Kelly J
        Achieving quality assurance of prostate cancer surgery during reorganisation of cancer services.
        Eur Urol. 2015; 68: 22-29
        • Prebay ZJ
        • Peabody JO
        • Miller DC
        • Ghani KR
        Video review for measuring and improving skill in urological surgery.
        Nat Rev Urol. 2019; 16: 261-267