arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Artificial Intelligence

Transforming prostate cancer diagnostic pathway: clinical evaluation of an AI decision-support system for biopsy optimisation

Nikita Sushentsev, Nadia Moreira Da Silva, Paul R. Burn, Nikhil Vasdev, Alison Bradley, Adrian Andreou, Sidath Liyanage, Jonathan Aning, Alexander Ng, Aqua Asif, Veeru Kasivisvanathan, Tristan Barrett

· The Royal College of Radiologists Open

See on the map

Abstract

Category: Transforming practice and leadership: pilot or test data on implementation of AI into clinical practice, clinical feedback or patient perspectivesGenerative artificial intelligence (AI) is a rapidly advancing field capable of producing human-like output by learning from vast data sets.Large language models (LLMs) -including ChatGPT, Claude and Geminihave attracted considerable academic and clinical interest, yet their utility in emergency department (ED) triage remains uncertain.This systematic review and metaanalysis aimed to evaluate the triage accuracy of LLMs when interpreting clinical presentations in the ED.A systematic review was conducted in accordance with PRISMA guidelines, searching MEDLINE and Embase for studies evaluating LLM performance in ED triage.A pooled random-effects meta-analysis estimated overall triage accuracy.Risk of bias was assessed using the QUADAS-2 tool.Eighteen studies met inclusion criteria.Most studies evaluated GPT-4 across emergency and non-emergency presentations.Pooled triage accuracy was 70%, with LLMs outperforming physicians by 4% on average.Accuracy was 90% for both emergency and nonemergency cases but fell markedly to 23% for self-care presentations.Considerable heterogeneity and high or unclear risk of bias were present across most studies.LLMs show promise in augmenting ED triage workflows, matching or exceeding physician-level performance for emergency and non-emergency cases.However, accuracy for self-care cases is poor, and the current evidence base is limited by heterogeneity and bias.Large-scale prospective studies are needed to establish safety and efficacy before clinical deployment as tools for emergency triage.

More like this