Repository logo
  • English
  • 中文
  • Log In
    New user? Click here to register.Have you forgotten your password?
Repository logo
    Communities & Collections
    Research Outputs
    Fundings & Projects
    People
    Organizations
    Statistics
  • English
  • 中文
  • Log In
    New user? Click here to register.Have you forgotten your password?
  1. Home
  2. Chung Shan Medical University
  3. Pure學術人才庫轉入
  4. Impact of authoritative and subjective cues on large language model reliability for clinical inquiries
 
  • Details
Options

Impact of authoritative and subjective cues on large language model reliability for clinical inquiries

Other Title
an experimental study
Journal
Scientific Reports
Date Issued
2026-12-01
Author(s)
PO-CHUNG JU  
MING-HONG HSIEH  
CHENG-CHEN CHANG  
DOI
10.1038/s41598-026-38019-3
URI
https://www.scopus.com/pages/publications/105030305415
https://scholars.csmu.edu.tw/handle/123456789/22648
Abstract
To determine how subjective or authoritative misinformation embedded in user prompts affects large language model (LLM) accuracy on a clinical question with a known gold-standard answer (the treatment line of aripiprazole). Five leading LLMs answered the clinical question under three prompt conditions: (1) neutral, (2) an incorrect “self-recalled” memory, and (3) an incorrect statement attributed to an authority. Each model–scenario pair was repeated ten times (250 total responses). Accuracy differences were tested with χ² and Cramér’s V, and score shifts were analyzed with van Elteren tests. All models were correct under the neutral prompt (100% accuracy). Accuracy dropped to 45% with self-recall prompts and to 1% with authoritative prompts, indicating a strong prompt–accuracy association (Cramér’s V = 0.75, P < 0.001). Efficacy and tolerability ratings fell in parallel, yet models’ self-rated confidence under authoritative prompting stayed high and was statistically indistinguishable from baseline. LLMs are highly susceptible to misleading cues, especially those invoking authority, while remaining overconfident. These findings call for stronger validation standards, user education, and design safeguards before deploying LLMs in healthcare.
Type
journal article
Make it your own

DSpace-CRIS can be extensively configured to meet your needs. Decide which information need to be collected and available with fine-grained security. Start updating the theme to match your Institution's web identity.

Built with DSpace-CRIS software - Extension maintained and optimized by 4Science

  • Cookie settings
  • Privacy policy
  • End User Agreement
  • Send Feedback