Expert and Crowdsourced Evaluation of Image Quality From a Novel Endoscopy Phone Light Adapter

Published:October 01, 2020DOI:


      To evaluate the image quality of cystourethroscopy using a novel 3D printed phone light adapter with subject expert and crowdsourced evaluators.


      A simple 3D printed light adaptor for a flexible cystoscopy was developed and made open source. Two videos were then recorded of a simulated cystourethroscopy, one using the novel adapter and the other using a traditional endoscopy light source. Expert evaluators (urology trainees and attendings) were then asked to evaluate the video quality using a double stimulus impairment scale. They were also asked to rate their level of confidence in using the novel adapter in clinical scenarios. Using Amazon's Mechanical Turk marketplace, 100 crowdsourced evaluators viewed the same videos and completed the same rating scale. The Mann-Whitney U test was then used to compare the expert and crowdsourced ratings.


      Expert and crowdsourced evaluators saw minimal degradation of video quality for the simulated urethroscopy (P= .66). However, while expert evaluators did identify degradation in the cystoscopy video, the crowdsourced evaluators did not (P = .012). 96% of the expert evaluators would either “often” or “always” use the novel adapter for difficult Foley placements and removal of ureteric stents.


      The novel light adapter caused minimal degradation in image quality for urethroscopy as compared to a traditional endoscopy light source, with vast majority of raters believing it would be adequate to perform common bedside cystoscopy procedures.
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Urology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Clayman RV
        • Kramolowsky EV
        Bedside flexible cystoscopy: an approach to the critically ill patient.
        J Urol. 1986; 135: 1179-1180
        • Beaghler M
        • Grasso III, M
        • Loisides P
        Inability to pass a urethral catheter: the bedside role of the flexible cystoscope.
        Urology. 1994; 44: 268-270
        • Samplaski MK
        • Jones JS
        Two centuries of cystoscopy: the development of imaging, instrumentation and synergistic technologies.
        BJU Int. 2009; 103: 154-158
      1. Stryker 1288 HD Video Endoscopy Tower System. (n.d.). Retrieved April 21, 2020, from

        • Canales BK
        • Gleason JM
        • Hicks N
        • Monga M
        An independent analysis of flexible cystoscope repairs and cost.
        J Urol. 2007; 178: 2098-2102
        • Yoon R
        • Capretz T
        • Patel RM
        • Okhunov Z
        • Landman J
        • Clayman RV
        Global survey of a novel smartphone mobile endoscopy system.
        J Endourol. 2018; 32: 451-454
        • Ribeiro Flávio
        • Florencio Dinei
        • Nascimento Vítor
        Crowdsourcing subjective image quality evaluation.
        in: 2011 18th IEEE International Conference on Image Processing. IEEE. 2011
        • Series BT
        Methodology for the subjective assessment of the quality of television pictures.
        Recommendation ITU-R BT. 2012; : 500-513
        • Watterson JD
        • Denstedt JD
        Ureteroscopy and cystoscopy simulation in urology.
        J Endourol. 2007; 21: 263-269
        • Davidson JR
        • Ford K
        • Ade-Ajayi N
        • Paul A
        Improvise, adapt, overcome: mobile phone LED used as a light source for cystoscopy and resection of posterior urethral valves in a low-cost setting.
        J Pediatr Urol. 2019; 15: 85-86
        • Butler JJ
        • White SF
        • Myint CWM
        • Groves WM
        The feasibility of utilizing smartphone flashlights as an alternative endoscopic light source in emergency situations.
        Ear Nose Throat J. 2019;
        • Baskoun Y
        • El Alami M
        • Qanadli SD
        • Arouch M
        • Taouzari M
        An innovate adapter to use smartphone flashlight as a light source for endoscopy in emergency and LMICs.
        Int J Emerg Trends Eng Res. 2020; 8: 808-812