Attention: Restrictions on use of AUA, AUAER, and UCF content in third party applications, including artificial intelligence technologies, such as large language models and generative AI.
You are prohibited from using or uploading content you accessed through this website into external applications, bots, software, or websites, including those using artificial intelligence technologies and infrastructure, including deep learning, machine learning and large language models and generative AI.
UPJ INSIGHT: Analysis of the AUA Guidelines: Strength of Evidence Correlates With Recommendation Levels
By: Chris Du, MD, Stony Brook University Medical Center, New York; Arshia Aalami Harandi, MS, Albert Einstein College of Medicine, Bronx, New York; Kuemin Hwang, MD, Houston Methodist Hospital, Texas; John Hill, MD, Montefiore Medical Center, Bronx, New York; Howard L. Adler, MD, Stony Brook University Medical Center, New York | Posted on: 17 Mar 2023
Du C, Harandi AA, Hwang K, Hill J, Adler HL. Analysis of the AUA guidelines: strength of evidence correlates with recommendation levels. Urol Pract. 2023;10.1097/UPJ.0000000000000373.
Study Need and Importance
In 1989, the AUA established the Practice Guidelines Committee to publish evidence-based guidelines on various urological conditions to aid clinical decision-making. In 2008, the AUA mandated that guideline recommendations include a new evidence-rating system to indicate the level of literature backing each statement. There is a paucity of studies investigating the caliber of evidence used to create AUA guidelines. This study investigates the evidence grade of available AUA guideline statements, their association with oncology or benign conditions, and their association with stage of care.
What We Found
After reviewing 939 statements across 29 urological conditions, we found that most guideline statements are not backed by Grade A evidence. Less than 25% of statements were Grade A or Grade B. Statements for oncologic topics were more likely to have Grade A or Grade B evidence. Similarly, guidelines pertaining to treatment of a condition were more likely to be backed by Grade A or Grade B evidence than diagnostic or follow-up statements (see Table). These low evidence-grade statements may play a role in the low adherence of physicians to societal guidelines within urology.
Table. Evidence Strength of AUA Guideline Statements
Recommendation strength | ||||
---|---|---|---|---|
Strong (n = 169) | Moderate (n = 191) |
Conditional (n = 156) |
P value | |
Evidence level, No. (%) | ||||
A | 36 (21) | 2 (1) | 0 (0) | < .01 |
B | 103 (61) | 64 (34) | 19 (12) | < .01 |
C | 30 (18) | 126 (65) | 137 (88) | < .01 |
Oncology vs nononcology | ||||
Oncology (n = 298) |
Nononcology (n = 632) |
|||
Evidence level, No. (%) | ||||
A | 19 (6) | 20 (3) | .02 | |
B | 66 (22) | 122 (19) | .28 | |
C | 73 (24) | 222 (35) | < .01 | |
Clinical principle, No. (%) | 69 (23) | 116 (18) | .08 | |
Expert opinion, No. (%) | 71 (24) | 158 (25) | .76 | |
Recent vs older guideline | ||||
Last 3 years (n = 572) |
Greater than 3 years old (n = 328) | |||
Evidence level, No. (%) | ||||
A | 15 (3) | 24 (7) | < .01 | |
B | 110 (19) | 78 (24) | .21 | |
C | 183 (32) | 114 (35) | .70 | |
Clinical principle, No. (%) | 122 (21) | 63 (19) | .28 | |
Expert opinion, No. (%) | 157 (27) | 73 (22) | .04 | |
Pertaining to evaluation vs treatment vs follow-up | ||||
Evaluation/diagnosis (n = 303) | Treatment (n = 548) |
Follow-up (n = 87) |
||
Evidence level, No. (%) | ||||
A | 9 (3) | 27 (5) | 3 (3) | .37 |
B | 38 (13) | 140 (26) | 10 (11) | < .01 |
C | 90 (30) | 191 (35) | 15 (17) | < .01 |
Clinical principle, No. (%) | 95 (31) | 77 (14) | 13 (15) | < .01 |
Expert opinion, No. (%) | 71 (23) | 131 (24) | 46 (53) | < .01 |
Limitations
This was an observational study of the AUA guideline statements and their associated grade of evidence. We did not assess the accuracy of the grading system or compare these guidelines to other specialty guidelines.
Interpretation for Patient Care
Though the AUA has established a robust system for systematic review of the literature and a panel of experts to compose guidelines, most statements are not backed by high-grade evidence. Further research is necessary to provide evidence basis for these statements and to improve physician compliance with guidelines.
advertisement
advertisement