Attention: Restrictions on use of AUA, AUAER, and UCF content in third party applications, including artificial intelligence technologies, such as large language models and generative AI.
You are prohibited from using or uploading content you accessed through this website into external applications, bots, software, or websites, including those using artificial intelligence technologies and infrastructure, including deep learning, machine learning and large language models and generative AI.
Artificial Intelligence Applications in Urology
By: Giovanni E. Cacciamani, MD, Inderbir S. Gill, MD; Andrew J. Hung, MD | Posted on: 28 Jul 2021
Urology has always been in pole position to endorse new technologies (lasers, 3-dimensional [3D] printing and imaging, augmented and mixed reality, robotics) due to its diversity in clinical, surgical, oncologic and diagnostic applications.1-6 Artificial intelligence (AI) is no exception, and it finds a natural dimension and fertile ground in our field. In this brief overview, we want to highlight the pros and cons of adopting AI in urology and its possible impact on our daily practice.
In the last few years, we have witnessed increasing usage of AI in health care that ranges from optimizing patient workflow and increased diagnosis accuracy as well as enhanced radiological and pathological image computer analysis to “precision medicine” granted by the big data analysis powered by smart data recording. However, before going further, a precise classification of the AI basic taxonomy is needed to provide a better understanding of this new field of technology (see figure).7-12
The applications of this new technology range from tumor detection and diagnosis to surgical training and prognosis prediction. In particular, deep learning (DL) model-based techniques have shown potential applications in urologic oncology since they offer a noninvasive characterization of the tumor using a group of quantifiable tumor metrics—such as the radiomics signature—which can be extracted from multimodality medical images.
The applications of machine learning (ML) and DL modeling to prostate cancer (PCa) are rapidly increasing.7,13 ML algorithms can be used to recognize groups of genes responsible for tumor development and therefore could allow a more focused screening for specific individuals who express these genes. In terms of diagnosis, ML algorithms are now being tested to perform prostate segmentation (organ automated contouring and peripheral zone vs. central zone boundary) and tumor characterization. ML-based technology has shown potential to identify PCa location and extracapsular extension, assisting the surgeon with an augmented image-guided procedure.
Another example can be the assessment of bladder cancer (BCa).14 Currently, tumor stage evaluation is based on cystoscopy findings, transurethral resection of bladder tumor (TURBT) and imaging. A standard disease assessment method is direct visualization of BCa from cystoscopy and routine cross-sectional imaging of the abdomen and pelvis using computerized tomography or magnetic resonance imaging (MRI). Cystoscopy, TURBT and cross-sectional imaging represent the gold standard procedures for assessing the staging and other pathological information for the appropriate management of the patients. However, these approaches are not immune from limitations and could have significant impact on the quality of life and cost of care. A DL-based multi-omics approach could integrate patients’ pathological and radiological characteristics8 to understand the behavior of the disease. For example, this new approach could help in predicting the response to neoadjuvant chemotherapy, distinguishing between patients who are responding to it vs. those who may not benefit, and avoiding any unnecessary delay to radical cystectomy.
Small renal masses that are incidentally detected represent a heterogeneous group of potential tumors, and an accurate evaluation of malignant behavior should be performed before patients undergo treatment. Although in some cases a renal biopsy could be achieved, it could lead to complications. Radiomics ML-based analysis could help to discern between indolent vs. malignant renal masses, helping the urologist—in select cases—perform patient-tailored surveillance protocol or followup.15,16
AI and ML have shown promising results in improving surgical skill in urology (“surgical AI”).9 Current efforts in this area already include the auto-segmentation of surgical activity within a surgical video such that areas of interest can be readily identified for further investigation.17 Similarly, robust efforts have already been seen in the prediction of patient outcomes after surgery, utilizing both patient factors and surgeon metrics as predictors.18 Finally, the automation of surgeon technical skills assessment is an area ripe for progress. A recent National Cancer Institute R01 award to our institution will make this aspiration a reality (1R01CA251579; Principal Investigator: P. I. Hung). Future work in surgical AI may include semi-automation or even full automation of surgical tasks.
New technological frontiers inevitably open new ethical issues. In a similar technology-driven context it is natural to wonder about the pros and cons of having dedicated human and artificial resources in a clinical department. We recently established the new AI Center within the Department of Urology at University of Southern California (USC) (“UroAI”). To our knowledge, this is the first such center in a urology department in the country. UroAI adds a vibrant, futuristic dimension to USC Urology with the mandate to inspire surgical-related AI research by leveraging innovations in novel algorithms and their clinical application to advance the field of urology. Our USC Urology team has been working on AI initiatives for quite some time now, including spacing from surgical AI, radiomics in urologic oncology and automated image recognition for MRI and histology.3 All 3 domains are current, active areas of research. (Please follow our Twitter account @urology_AI to get updates.)
Endorsing AI in the clinical and surgical settings represents a unique opportunity for interdisciplinary collaborations between computational scientists and medical experts, who can bring different perspectives in a new era of patient care.
- Checcucci E, Amparore D, Fiori C et al: 3D imaging applications for robotic urologic surgery: an ESUT YAUWP review. World J Urol 2020; 38: 869.
- Checcucci E, Autorino R, Cacciamani GE et al: Artificial intelligence and neural networks in urology: current clinical applications. Minerva Urol Nefrol 2019; 72: 49.
- Hung AJ, Chen AB, Cacciamani GE et al: Artificial intelligence will (MAY) make doctors expendable (IN GOOD WAYS): pro. Eur Urol Focus 2021; doi: 10.1016/j.euf. 2021.03.011
- Veneziano D, Amparore D, Cacciamani G: Climbing over the barriers of current imaging technology in urology. Eur Urol 2019; 2: 142.
- Veneziano D, Cacciamani G, Rivas JG et al: VR and machine learning: novel pathways in surgical hands-on training. Curr Opin Urol 2020; 30: 817.
- Cacciamani GE, Okhunov Z, Meneses AD et al: Impact of three-dimensional printing in urology: state of the art and future perspectives. A systematic review by ESUT-YAUWP Group. Eur Urol 2019; 76: 209.
- Sugano D, Sanford D, Abreu A et al: Impact of radiomics on prostate cancer detection: a systematic review of clinical applications. Curr Opin Urol 2020; 30: 754.
- Cacciamani GE, Nassiri N, Varghese B et al: Radiomics and bladder cancer: current status. Bladder Cancer 2020; doi: 10.3233/BLC-200293.
- Cacciamani GE, Anvar A, Chen A et al: How the use of the artificial intelligence could improve surgical skills in urology: state of the art and future perspectives. Curr Opin Urol 2021; 31: 378.
- Chen J, Cheng N, Cacciamani G et al: Objective assessment of robotic surgical technical skill: a systematic review. J Urol 2019; 201: 461.
- Gupta R, Kurc T, Sharma A et al: The emergence of pathomics. Curr Pathobiol Rep 2019; 7: 73.
- Chen J, Remulla D, Nguyen JH et al: Current status of artificial intelligence applications in urology and their potential to influence clinical practice. BJU Int 2019; 124: 567.
- Penzkofer T, Padhani AR, Turkbey B et al: ESUR/ESUI position paper: developing artificial intelligence for precision diagnosis of prostate cancer using magnetic resonance imaging. Eur Radiol 2021; doi: 10.1007/s00330-021-08021-6
- Chan EO, Pradere B and Teoh JY: The use of artificial intelligence for the diagnosis of bladder cancer: a review and perspectives. Curr Opin Urol 2021; 31: 397.
- Suarez-Ibarrola R, Basulto-Martinez M, Heinze A et al: Radiomics applications in renal tumor assessment: a comprehensive review of the literature. Cancers 2020; 12: 1387.
- Varghese BA, Chen F, Hwang DH et al: Differentiating solid, non-macroscopic fat containing, enhancing renal masses using fast Fourier transform analysis of multiphase CT. Br J Radiol 2018; 91: 20170789.
- Luongo F, Hakim R, Nguyen JH et al: Deep learning-based computer vision to recognize and classify suturing gestures in robot-assisted surgery. Surgery 2021; 169: 1240.
- Hung AJ, Ma R, Cen S et al: Surgeon automated performance metrics as predictors of early urinary continence recovery after robotic radical prostatectomy—a prospective bi-institutional study. Eur Urol Open Sci 2021; 27: 65.