Attention: Restrictions on use of AUA, AUAER, and UCF content in third party applications, including artificial intelligence technologies, such as large language models and generative AI.
You are prohibited from using or uploading content you accessed through this website into external applications, bots, software, or websites, including those using artificial intelligence technologies and infrastructure, including deep learning, machine learning and large language models and generative AI.

OFFICE & SURGICAL TECHNOLOGIES: ChatGPT: A Time-saving Companion for Physicians

By: Andrew T. Gabrielson, MD, The James Buchanan Brady Urological Institute, Johns Hopkins University School of Medicine, Baltimore, Maryland; Anobel Y. Odisho, MD, MPH, Center for Digital Health Innovation, University of California San Francisco School of Medicine; David Canes, MD, Lahey Institute of Urology, Lahey Hospital & Medical Center, Beth Israel and Lahey Health, Burlington, Massachusetts | Posted on: 04 May 2023

Background

Over the last decade, there has been a growing interest in the use of artificial intelligence (AI) to streamline health care delivery and this technology is now being applied to areas that were previously thought to be only the jurisdiction of human experts. One AI technology that has caught the attention of the medical community and lay public alike is OpenAI’s large language model (LLM)-based chatbot ChatGPT (generative pretrained transformer). ChatGPT is a natural language processing technology that can generate conversational, human-like text using a deep learning machine learning algorithm that was trained on 175 billon tokens and has been heralded as the best AI chatbot ever released for public consumption (Figure 1).1-3 ChatGPT has garnered significant attention for its ability to provide articulate responses and carry out tasks with a wide range of sophistication.

Figure 1. Sample prompt to create an appeals letter in ChatGPT, with sample output.

ChatGPT and other LLM-based chat AI represent a promising time-saving tool for physicians in an era with increasing administrative burdens.4,5 A recent study using AUA Census data found that 37% of urologists report signs of burnout, with the highest workplace dissatisfiers being electronic health record tasks and limited personal/family time.6 Given that the preponderance of physician writing follows predictable and templated formats, natural language processing AI such as ChatGPT can make an immediate impact on physician workflow.

We describe the strengths and weaknesses of ChatGPT and encourage physicians to utilize this technology to free up more time for face-to-face interaction with patients and alleviate burnout by aiding in routine, low-stakes compositions.

ChatGPT in Practice

Physicians can sign up to use ChatGPT through OpenAI’s website (chat.openai.com) and submit requests through its user-friendly interface.

There are numerous applications for this technology along the care continuum (Figure 2). Some specific examples include drafting emails, letters to insurance companies, patient-facing discharge or medication instructions, brainstorming research ideas, event or appointment scheduling, and designing queries for research articles.7 These tasks have predictable outputs that can be quickly reviewed and fine-tuned, saving considerable time in the initial writing process. Additionally, ChatGPT can recall inputs from within the same session and thus one can ask the chatbot to rephrase, reconfigure, or expand upon previous inputs. ChatGPT has demonstrated that it is able to cope with ambiguity from requests. However, to get the most out of its time-saving capabilities, it is advantageous for physicians to become acquainted with the terminology and structure of requests to get a desired output. There are several repositories (eg, EmergentMind) in which users have published prompts (some serious, some comical) and resultant outputs to guide others.8 Furthermore, there are tools that utilize ChatGPT’s API (eg, Doximity’s DocsGPT) to provide doctors with premade prompts for clinical care purposes.9

Figure 2. The future of generative artificial intelligence in health care. EHR indicates electronic health record.

Limitations of ChatGPT

Physicians should be cognizant of ChatGPT’s numerous limitations. Since ChatGPT is trained using text obtained from the Internet, its outputs are prone to bias and inconsistencies.10 ChatGPT does not exhibit indecisiveness and may cite publications that do not exist or make factually inaccurate statements with certainty. As evidenced by events that have occurred following its beta integration with Bing, ChatGPT is also prone to hallucination—generation of meaningless (and sometimes unsettling) answers based on bugs in the algorithm.11 At best, it can function as a starting point for low-value written content from which one can revise.

ChatGPT currently does not scrape the Internet for new data, so any output that it provides will be based on information that it learned prior to 2021. ChatGPT and other LLMs are not HIPAA (Health Insurance Portability and Accountability Act of 1996) or GDPR (General Data Protection Regulation) compliant. Physicians should not enter protected health information.

ChatGPT is currently free to use during times of low traffic to their website with full capabilities. For some users, the $20 monthly subscription, which provides faster responses, availability during high traffic times, and earlier access to new features as they become available, may be a valuable investment.

Although ChatGPT is being used to streamline researcher workflows including the brainstorming of research ideas, literature review, and peer review, there has been increasing use of this technology in the drafting of manuscripts. JAMA Network, Science, Nature, the World Association of Medical Editors, and the Committee on Publication Ethics have issued statements prohibiting the listing of AI as an author because “AI cannot take responsibility for submitted work … or assert presence or absence of conflicts of interest.”12-14 Researchers who use AI tools in manuscript writing must disclose this in the methods or acknowledgments of the paper. Several groups have designed software that can detect AI-generated content, and in the future, there will likely be a watermark embedded in all AI-generated content to ensure transparency of its origin.

Conclusions

When taken together, ChatGPT can be an essential time-saving companion for physicians by streamlining low-complexity tasks. Although there are many limitations to ChatGPT and other LLMs, this technology is rapidly improving and will become increasingly utilized in the health care setting. In an era in which electronic health record tasks and administrative burdens are a lead driver of burnout, now is as good a time as any to embrace AI’s time-saving potential.

Funding: None.

Conflict of Interest: David Canes is the Founder of WellPrept, Inc. Anobel Odisho has received research support from the Microsoft Turing Academic Program. Andrew Gabrielson has no relevant relationships to disclose.

  1. Roose K. The brilliance and weirdness of ChatGPT. New York Times. December 5, 2022. https://www.nytimes.com/2022/12/05/technology/chatgpt-ai-twitter.html.
  2. Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. Adv Neural Inf Process Syst. 2017. https://papers.nips.cc/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html.
  3. Brown T, Mann B, Ryder N, et al. Language models are few-shot learners. Adv Neural Inf Process Syst. 2020;33:1877-1901.
  4. Gaffney A, Woolhandler S, Cai C, et al. Medical documentation burden among US office-based physicians in 2019: a national study. JAMA Intern Med. 2022;182(5):564-566.
  5. Downing NL, Bates DW, Longhurst CA. Physician burnout in the electronic health record era: are we ignoring the real cause?. Ann Intern Med. 2018;169(1):50-51.
  6. Harris AM, Teplitsky S, Kraft KH, Fang R, Meeks W, North A. Burnout: a call to action from the AUA workforce workgroup. J Urol. 2023;209(3):573-579.
  7. Gabrielson AT, Odisho AY, Canes D. Harnessing Generative AI to Improve Efficiency Among Urologists: Welcome ChatGPT. Wolters Kluwer; 2023.
  8. EmergentMind. Browse, Share, and Discuss ChatGPT Examples. 2023. https://www.emergentmind.com/.
  9. Doximity. DocsGPT. 2023. https://www.doximity.com/docs-gpt.
  10. Yang S. The Abilities and Limitations of ChatGPT. 2022. Accessed December 10th, 2022. https://www.anaconda.com/blog/the-abilities-and-limitations-of-chatgpt.
  11. Roose K. A conversation with Bing’s chatbot left me deeply unsettled. New York Times. February 16, 2023. https://www.nytimes.com/2023/02/16/technology/bing-chatbot-microsoft-chatgpt.html.
  12. Thorp HH. ChatGPT is fun, but not an author. Science. 2023;379(6630):313.
  13. Flanagin A, Bibbins-Domingo K, Berkwits M, Christiansen SL. Nonhuman “authors” and implications for the integrity of scientific publication and medical knowledge. JAMA. 2023;329(8):637.
  14. Committee on Publication Ethics. Authorship and AI Tools: COPE Position Statement. 2023. https://publicationethics.org/cope-position-statements/ai-author.

advertisement

advertisement