Skip to main navigation Skip to search Skip to main content

Identification of kidney-related medications using AI from self-captured pill images

  • Mohammad S. Sheikh
  • , Benjamin Dreesman
  • , Erin F. Barreto
  • , Charat Thongprayoon
  • , Jing Miao
  • , Supawadee Suppadungsuk
  • , Michael A. Mao
  • , Fawad Qureshi
  • , Justin H. Pham
  • , Iasmina M. Craici
  • , Kianoush B. Kashani
  • , Wisit Cheungpasitporn
  • Mayo Clinic
  • Mayo Clinic in Jacksonville, Florida

Research output: Contribution to journal › Article › peer-review

5 Citations (Scopus)

Abstract

Introduction: ChatGPT, a state-of-the-art large language model, has shown potential in analyzing images and providing accurate information. This study aimed to explore ChatGPT-4 as a tool for identifying commonly prescribed nephrology medications across different versions and testing dates. Methods: 25 nephrology medications were obtained from an institutional pharmacy. High-quality images of each medication were captured using an iPhone 13 Pro Max and uploaded to ChatGPT-4 with the query, ‘What is this medication?’ The accuracy of ChatGPT-4’s responses was assessed for medication name, dosage, and imprint. The process was repeated after 2 weeks to evaluate consistency across different versions, including GPT-4, GPT-4 Legacy, and GPT-4.Ø. Results: ChatGPT-4 correctly identified 22 out of 25 (88%) medications across all versions. However, it misidentified Hydrochlorothiazide, Nifedipine, and Spironolactone due to misreading imprints. For instance, Nifedipine ER 90 mg was mistaken for Metformin Hydrochloride ER 500 mg because ‘NF 06’ was misread as ‘NF 05’. Hydrochlorothiazide 50 mg was confused with the 25 mg version due to imprint errors, and Spironolactone 25 mg was misidentified as Naproxen Sodium or Diclofenac Sodium. Despite these errors, ChatGPT-4 showed 100% consistency when retested, correcting misidentifications after receiving feedback on the correct imprints. Conclusion: ChatGPT-4 shows strong potential in identifying nephrology medications from self-captured images, though challenges with difficult-to-read imprints remain. Providing feedback improved accuracy, suggesting ChatGPT-4 could be a valuable tool in digital health for medication identification. Future research should enhance the model’s ability to distinguish similar imprints and explore broader integration into digital health platforms.

Original languageEnglish
Article number2402075
JournalRenal Failure
Volume46
Issue number2
DOIs
Publication statusPublished - 2024

Keywords

  • AI
  • digital health
  • kidney
  • medication identification
  • nephrology
  • pill image analysis

Fingerprint

Dive into the research topics of 'Identification of kidney-related medications using AI from self-captured pill images'. Together they form a unique fingerprint.

Cite this