Attention: Restrictions on use of AUA, AUAER, and UCF content in third party applications, including artificial intelligence technologies, such as large language models and generative AI.
You are prohibited from using or uploading content you accessed through this website into external applications, bots, software, or websites, including those using artificial intelligence technologies and infrastructure, including deep learning, machine learning and large language models and generative AI.

AUA2023 BEST POSTERS Development of a Clinical-scholar Index Score for Measuring Academic Contributions in Urology

By: Peace Orji, MD, Case Western Reserve University School of Medicine, Cleveland, Ohio; Eric Klein, MD, Glickman Urological and Kidney Institute, Cleveland Clinic, Ohio; Hadley M. Wood, MD, Glickman Urological and Kidney Institute, Cleveland Clinic, Ohio | Posted on: 30 Aug 2023

The nonclinical activities of academic urologists are vital to career development of the individual and specialty-wide impact of the department. Presently, a robust mechanism for tracking and quantifying these contributions is not well established. Although some have recommended use of the academic revenue value unit and other scoring strategies,1-10 these mechanisms do not adequately capture the diversity of academic urologists’ contributions. This study aims to (1) develop a model that identifies academic activities that impact urological department reputation and have specialty impact, (2) define the relative value of these contributions, and (3) develop a scoring system that outputs an annual clinical scholar index score.

Fifteen broad activity categories were created and then fractioned into subcategories (Table 1). Activity categories were assigned weights 0-1 based on external recognition, work-effort, and expertise required by the activity. These insights were gleaned from the department chair, institute chair, and business intelligence team. A score of 0 was defined as an activity that provided little to no external recognition or was considered an expected activity of an individual at that career level. A weight of 1 was defined as an activity that was essential to the department’s mission, a significant time commitment for the individual, and provided external recognition.11 Faculty were designated as Early (0-7 years), Mid (8-16 years), and Senior (17+ years) career staff based on time in practice. A pathway approach was implemented because certain activities were no longer credited as individuals transitioned between the career milestones (Table 2).

Table 1. Examples of 4 Out of 15 Overarching Categories and Accompanying Subcategories

Category Weight
Book chapter
Campbell’s author (any) 0.75
First author 0.50
Senior author 0.50
Clinical care
Guidelines/WP development 0.50
Patient education materials development 0.25
Clinical research
Peer reviewed publication (first author) 0.80
Peer reviewed publication (senior author) 0.80
Peer reviewed publication (middle author) 0.40
Editorial duties
Book editor 1.00
Journal editor 1.00
Editorial board members (section) 0.75
Invited guest editorials 0.50
Reviewer 0.25
Abbreviations: WP, white paper.

Table 2. Examples of the Pathway Approach to Scholarly Index Developmenta

Activity category Early Mid-senior
Innovation: techniques and approach New techniquesb Patents
CME courses Faculty Organizer/program chair
Presentations at conferences Local/regional Invited distinguished speaker, visiting professor, national/international Plenary
Editorial accomplishments Reviewer Section editor, special publication, editor-in-chief
Clinical trials Participant Primary investigator, study section reviewer
Professional societies Committee participation Board member, president of a society or board
Residency/fellowships Milestones officer, mentor, associated program director Program director
Abbreviations: CME, continuing medical education.
aActivities listed in the “Early” column would be tracked and credited for individuals during the first 7 years of practice, and thereafter not included for mid- and senior career faculty, as they are considered stepping-stone activities in the scholarly pathway
bAny new service or device not previously offered by our department or by another provider. This would require backing by marketing materials, or lay press or academic publication.

Academic faculty submitted their updated curriculum vitae (CV). Activities were extracted from CVs and assigned to appropriate categories. Credit was not received for presentations that did not produce manuscripts, internal committees, personal hobbies, and contributions that were resourced by extramural funding or salary support. Annual contributions were tallied and normalized. The normalized weighted sum annually was the ASIV (Annual Scholarly Index Value).

Eighteen faculty submitted their CV for review (6 Early, 5 Mid, 7 Senior Career; see parts A-C of Figure). All Early Career faculty contributed peer-reviewed publications. Leadership, clinical trials, and external awards contributed more to the index score than peer-reviewed publications for Early Career faculty with scores that were above the median in their group.

image
Figure. Early Career (A), Mid-career (B), and Senior Career (C) annual index score values. Reprinted with permission from Orji et al, Urology. 2023;175:29-34.11 ASIV indicates Annual Scholarly Index Value.

As would be expected, the greatest velocity of growth in ASIV occurred during the Mid-career stage. In 2018, there was a noticeable decrease in the nonclinical contributions of Mid-career and Senior Career faculty. This was likely due to a shift in organizational values toward higher clinical output. Senior Career faculty had the most diverse nonclinical contributions.

This scoring system identifies and quantifies the value of nonclinical activities of academic urologists at our institution. It also demonstrates the annual trend of nonclinical contributions of our staff over time. Generalizability of this work is limited by low numbers of those who are underrepresented in medicine. Furthermore, data were collected by way of convenience sample, creating sampling bias. Future works should aim to simplify the model and assess how crediting activities differentially throughout the career milestones may promote preferential participation in some activities and disengagement in others.

  1. Dunn AN, Walsh RM, Lipman JM, et al. Can an academic RVU model balance the clinical and research challenges in surgery?. J Surg Educ. 2020;77(6):1473-1480.
  2. Backeris ME, Patel RM, Metro DG, Sakai T. Impact of a productivity-based compensation system on faculty clinical teaching scores, as evaluated by anesthesiology residents. J Clin Anesth. 2013;25(3):209-213.
  3. Reich DL, Galati M, Krol M, Bodian CA, Kahn RA. A mission-based productivity compensation model for an academic anesthesiology department. Anesth Analg. 2008;107(6):1981-1988.
  4. Berger TJ, Ander DS, Terrell ML, Berle DC. The impact of the demand for clinical productivity on student teaching in academic emergency departments. Acad Emerg Med. 2004;11(12):1364-1367.
  5. LeMaire SA, Trautner BW, Ramamurthy U, et al. An academic relative value unit system for incentivizing the academic productivity of surgery faculty members. Ann Surg. 2018;268(3):526-533.
  6. Schroen AT, Thielen MJ, Turrentine FE, Kron IL, Slingluff CL. Research incentive program for clinical surgical faculty associated with increases in research productivity. J Thorac Cardiovasc Surg. 2012;144(5):1003-1009.
  7. Weigel RJ, Dracon G, Radhakrishnan R, Rho Y, Sevgen F, Dafoe DC. Incentive systems for academic productivity in a department of surgery. J Am Coll Surg. 2004;199(2):300-307.
  8. Williams RG, Dunnington GL, Folse JR. The impact of a program for systematically recognizing and rewarding academic performance. Acad Med. 2003;78(2):156-166.
  9. Mehan WA, Schaefer PW, Hirsch JA. Academic performance–based compensation models. J Am Coll Radiol. 2019;16(11):1621-1627.
  10. Sakai T, Hudson M, Davis P, Williams J. Integration of academic and clinical performance-based faculty compensation plans: a system and its impact on an anaesthesiology department. Br J Anaesth. 2013;111(4) doi:10.1093/BJA/AET150
  11. Orji P, Kattan M, Klein E, Wood HM. Development of a clinical-scholar index score for measuring academic contributions in urology. Urology. 2023;175:29-34.

advertisement

advertisement