Attention: Restrictions on use of AUA, AUAER, and UCF content in third party applications, including artificial intelligence technologies, such as large language models and generative AI.
You are prohibited from using or uploading content you accessed through this website into external applications, bots, software, or websites, including those using artificial intelligence technologies and infrastructure, including deep learning, machine learning and large language models and generative AI.

AUA2022: BEST POSTERS Press Ganey Ratings in Urology: Who Is at Risk of Bias?

By: Connie N. Wang, MD; Jane T. Kurtzman, MD; Edwin Melendez, MBA; James M. McKiernan, MD; Julia B. Finkelstein, MD; Christina P. Carpenter, MD | Posted on: 01 Nov 2022

Patient satisfaction reports are increasingly used as quality-of-care metrics in hospital reimbursement structures and in physician compensation and promotion models. Therefore, it is important to evaluate these instruments for both validity and inherent bias. The Press Ganey (PG) survey is the most widely used patient satisfaction measurement tool and the only survey approved for outpatient use by the National Quality Forum.1 However, recent literature has suggested a bias against female physicians in patient satisfaction ratings across many subspecialties including general surgery, primary care, and gynecology.2-4 Bias against female providers is particularly concerning in medical fields that are historically dominated by male providers, such as urology. Given the predominance of both male patients and physicians in urology, we sought to study the impact of unmodifiable physician and patient demographics on patient-reported PG survey ratings for urologists in the outpatient setting.5

We retrospectively reviewed 4,155 PG surveys completed between February 2020 and August 2021 for all outpatient encounters performed by 20 attending urologists (12 male, 8 female) across all subspecialties at a single academic tertiary care institution. Our primary outcome was patient-reported “topbox” overall doctor rating (topbox-ODR) score of a 9 or 10 on a scale of 1-10. The Table displays patient and physician characteristics and the results of all analyses.

Table. Results of Univariate and Multivariate Analyses of the Relationship Between Patient- and Provider-Level Covariates and Topbox Overall Doctor Rating Score

No. OR 95% CI P value
Univariate analyses
Patient-level covariates
 Age (categorical)a 4,155 1.09 0.99-1.20 0.071
 Sexb
  Male 2,961 Reference Reference Reference
  Female 1079 0.27 0.20-0.35 <0.001
Provider-level covariates
 Sex
  Male (n = 12) 3,485 Reference Reference Reference
  Female (n = 8) 670 0.42 0.21-0.83 0.01
 Adult vs pediatrics
  Adult (n = 18) 93 Reference Reference Reference
  Pediatrics (n = 2) 3,672 1.06 0.61-1.82 0.84
 Years in practice
  ≤10 (n = 12) 1,469 Reference Reference Reference
  >10 (n = 8) 2,686 1.22 0.64-2.35 0.54
 Specialty
  Sex and infertility (n = 3) 271 2.11 0.68-6.65 0.20
  Oncology (n = 4) 1,137 3.37 1.35-8.40 0.009
  General adult (n = 3) 1,220 Reference Reference Reference
  Reconstructive adult (n = 3) 312 1.32 0.54-3.24 0.54
  Pediatrics (n = 2) 115 0.71 0.29-1.73 0.45
  Voiding dysfunction (n = 2) 721 0.93 0.41-2.11 0.87
  Adult stone disease (n = 3) 379 1.14 0.49-2.69 0.76
Patient/provider gender concordanceb
 Male patient–male provider 2,854 Reference Reference Reference
 Male patient–female provider 107 0.44 0.19-1.00 0.05
 Female patient–male provider 631 0.23 0.17-0.31 <0.001
 Female patient–female provider 448 0.27 0.14-0.51 <0.001
Multivariate analysesb
Patient agea 1.07 0.94-1.21 0.32
Provider specialty 1.08 0.91-1.28 0.36
Years in practice
 ≤10 (n = 12) Reference Reference Reference
 >10 (n = 8) 0.33 0.16-0.67 0.002
Patient/provider gender concordance
 Male patient–male provider Reference Reference Reference
 Male patient–female provider 0.32 0.12-0.84 0.02
 Female patient–male provider 0.24 0.17-0.32 <0.001
 Female patient–female provider 0.21 0.09-0.47 <0.001
Values in bold are statistically significant.
aCategories: 0-2 years, 3-6 years, 7-12 years, 13-18 years, 19-24 years, 25-34 years, 35-49 years, 50-64 years, 65+ years.
bModel excluded pediatric patients (n = 115; total N = 4,040).

Our data raise concern that the PG survey tool may be biased. We found that female urologists had a significantly lower mean overall doctor rating (ODR) score than male urologists. Female urologists were also 58% less likely to receive topbox-ODRs than male urologists. Interestingly, female patients were 73% less likely than male patients to give topbox-ODRs. While male patients were significantly more likely to give topbox-ODRs to male urologists than they were to female urologists, female patients were less likely to give topbox-ODRs to both male and female urologists. While we cannot speculate on why female patients provide lower survey scores than their male counterparts, our results suggest that urologists who primarily treat female patients are particularly at risk of bias. This includes female urologists, who see a higher proportion of female patients,6,7 and urological subspecialists in female pelvic medicine and reconstruction or voiding dysfunction.

We suspect that, in addition to gender-based biases, patient diagnosis and care expectations may also disproportionally skew physician scoring. Our data showed that oncologists were 3 times more likely to receive topbox-ODRs than urologists of any other subspecialty. Meanwhile, physicians who had been in practice for <10 years were more likely to receive better scores. One can imagine that patients are more likely to give higher PG survey ratings to urologic oncologists who inform them of no evidence of disease after oncologic surgery than they are to a voiding dysfunction specialist who counsels that the pain of interstitial cystitis can be managed but not cured. This discrepancy likely explains our finding that oncologists are more likely to receive higher scores.

Our results are the first of their kind in urology. We found that female, more experienced (>10 years in practice), and nononcologic urologists each had lower odds of achieving top PG physician ratings. We also found that female patients were less likely to give top PG ratings compared to male patients, regardless of the sex of the urology provider. Male urologists who care for male patients appear to be at the least risk of bias in PG physician ratings, while female urologists who care for female patients appear to be at the highest risk. While further multi-institutional studies are needed to confirm our findings, we believe that our results highlight the need to de-emphasize the impact of PG scores on physician compensation and promotion decisions until additional research is done.

  1. Press Ganey. First year of patient satisfaction measurement. Hosp Guest Relations Rep. 1986;1(11):4-5.
  2. Schmittdiel J, Grumbach K, Selby JV, Quesenberry CP. Effect of physician and patient gender concordance on patient satisfaction and preventive care practices. J Gen Intern Med. 2000;15(11):761-769.
  3. Nuyen B, Altamirano J, Fassiotto M, Alyono J. Effects of surgeon sociodemographics on patient-reported satisfaction. Surgery. 2021;169(6):1441-1445.
  4. Rogo-Gupta LJ, Haunschild C, Altamirano J, Maldonado YA, Fassiotto M. Physician gender is associated with Press Ganey patient satisfaction scores in outpatient gynecology. Womens Health Issues. 2018; 28:281-285.
  5. Wang CN, Kurtzman JT, Melendez E, McKiernan JM, Finkelstein JB, Carpenter CP. Press Ganey® ratings in urology: who is at risk of bias? Urology. Forthcoming 2022.
  6. Kim SO, Kang TW, Kwon D. Gender preferences for urologists: women prefer female urologists. Urol J. 2017;14(2):3018-3022.
  7. Oberlin DT, Vo AX, Bachrach L, Flury SC. The gender divide: the impact of surgeon gender on surgical practice patterns in urology. J Urol. 2016;196(5):1522-1526.

advertisement

advertisement