Make Knowledge Veritable, Visible and Valuable.

Prompt style effects on large language model differential diagnosis output in adolescent catatonia and psychosis

Thomas F. Heston 1

  • 1. Department of Family Medicine, University of Washington, Seattle, Washington USA

Correspondence: tomhestonmd@gmail.com

DOI: https://doi.org/10.55976/jdh.5202616146-12

  • Received

    10 July 2026

  • Revised

    29 July 2026

  • Accepted

    03 September 2026

  • Published

    02 November 2026

Prompt engineering Large language model Differential diagnosis Clinical decision support Catatonia Ashwagandha

Show More

Abstract


References
V

[1]Gaebe K, van der Woerd B. Evaluation of large language models as a diagnostic tool for medical learners and clinicians using advanced prompting techniques. PLOS One. 2025;20(8):e0325803. doi:10.1371/journal.pone.0325803.

[2]Patil R, Heston TF, Bhuse V. Prompt Engineering in Healthcare. Electronics. 2024;13(15): 2961. doi:10.3390/electronics13152961.

[3]Sonoda Y, Kurokawa R, Hagiwara A, Asari Y, Fukushima T, Kanzawa J, et al. Structured clinical reasoning prompt enhances LLM’s diagnostic capabilities in diagnosis please quiz cases. Japanese Journal of Radiology. 2025;43(4):586–592. doi:10.1007/s11604-024-01712-2.

[4]Yao G, Zhang W, Zhu Y, Wong U, Zhang Y, Yang C, et al. Comparing the accuracy of large language models and prompt engineering in diagnosing realworld cases. International Journal of Medical Informatics. 2025;203:106026. doi:10.1016/j.ijmedinf.2025.106026.

[5]Heston TF, Khun C. Prompt Engineering in Medical Education. International Medical Education. 2023;2(3):198–205. doi:10.3390/ime2030019.

[6]Liu J, Liu F, Wang C, Liu S. Prompt engineering in clinical practice: tutorial for clinicians. Journal of Medical Internet Research. 2025;27:e72644. doi:10.2196/72644.

[7]Maaz S, Palaganas JC, Palaganas G, Bajwa M. A guide to prompt design: foundations and applications for healthcare simulationists. Frontiers in Medicine. 2025;11:1504532. doi:10.3389/fmed.2024.1504532.

[8]Sivarajkumar S, Kelley M, Samolyk-Mazzanti A, Visweswaran S, Wang Y. An empirical evaluation of prompting strategies for large language models in zero-shot clinical natural language processing: algorithm development and validation study. JMIR Medical Informatics. 2024;12:e55318. doi:10.2196/55318.

[9]Savage T, Nayak A, Gallo R, Rangan E, Chen JH. Diagnostic reasoning prompts reveal the potential for large language model interpretability in medicine. NPJ digital medicine. 2024;7(1):20. doi:10.1038/s41746-024-01010-1.

[10]Poulain R, Adiba FI, Fayyaz H, Beheshti R. Bias Patterns in the Application of LLMs for Clinical Decision Support: A Comprehensive Study. Delaware Journal of Public Health. 2026;12(1):54–67. doi:10.32481/djph.2026.03.10.

[11]Wang J, Redelmeier DA. Artificial intelligence chain-of-thought reasoning in nuanced medical scenarios: mitigation of cognitive biases through model intransigence. BMJ Quality & Safety. 2026;35(7):456–463. doi:10.1136/bmjqs-2025-019299.

[12]Grabb D. The impact of prompt engineering in large language model performance: a psychiatric example. Journal of Medical Artificial Intelligence. 2023;6:20. doi:10.21037/jmai-23-71.

[13]Rojo-Bofill LM, Ribes Jordán G, Monedero Carrasco L, Carrasco Picazo JP, Balanzá-Martínez V, Giner L, et al. Impact of the large language model and prompt specificity in generating psychiatric multiple-choice questions. Educación Médica. 2026;27(2):101161. doi:10.1016/j.edumed.2026.101161.

[14]Sarma KV, Hanss KE, Halls AJM, Krystal A, Becker DF, Glowinski AL, et al. Integrating expert knowledge into large language models improves performance for psychiatric reasoning and diagnosis. Psychiatry Research. 2026;355:116844. doi:10.1016/j.psychres.2025.116844.

[15]Callens S. Effective prompt design for large language models in clinical practice. Acta Clinica Belgica. 2026;81(2):118–129. doi:10.1080/17843286.2026.2613903.

[16]Ho A, Liwag T, Gonzalez J, Phan A, Wong D, Fu M. Mania with psychotic symptoms in an adolescent patient associated with ashwagandha use: Case report. Open Journal of Clinical & Medical Case Reports. 2026;12(1):2402.

[17]Gallifant J, Afshar M, Ameen S, Aphinyanaphongs Y, Chen S, Cacciamani G, et al. The TRIPOD-LLM reporting guideline for studies using large language models. Nature Medicine. 2025;31(1):60–69. doi:10.1038/s41591-024-03425-5.

[18]OpenAI. GPT-5.5 Model [Internet]. OpenAI Developers. 2026 [Accessed 2026 July 28]. Available from: https://developers.openai.com/api/docs/models/gpt-5.5.

[19]Kumar A, Sah BK, Ahmad F, Jamwal V, Sahu SK. Potential Adverse Effects of Ashwagandha: A Critical Review of Preclinical and Clinical Evidence. Phytotherapy Research. 2026;40(8):4913-4931. doi:10.1002/ptr.70158.

[20]Gibson LL, Pollak TA, Blackman G, Thornton M, Moran N, David AS. The Psychiatric Phenotype of Anti-NMDA Receptor Encephalitis. The Journal of Neuropsychiatry and Clinical Neurosciences. 2019;31(1):70–79. doi:10.1176/appi.neuropsych.17120343.

[21]Brownlee S, Chalkidou K, Doust J, Elshaug AG, Glasziou P, Heath I, et al. Evidence for overuse of medical services around the world. The Lancet. 2017;390(10090):156–168. doi:10.1016/S0140-6736(16)32585-5.

[22]Ott DE. Words Representing Numeric Probabilities in Medical Writing Are Ambiguous and Misinterpreted. JSLS : Journal of the Society of Laparoscopic & Robotic Surgeons. 2021;25(3):e2021.00034. doi:10.4293/JSLS.2021.00034.

[23]Jung Y, Sohn MK, Choi JY, Cho KH. A Hybrid Rule‐Based and Large Language Model Artificial Intelligence System for Electrodiagnostic Reporting: Two‐Center Retrospective Evaluation. Muscle & Nerve. 2026;74(2):390–396. doi:10.1002/mus.70280.

[24]Palm E, Manikantan A, Mahal H, Belwadi SS, Pepin ME. Assessing the quality of AI-generated clinical notes: validated evaluation of a large language model ambient scribe. Frontiers in Artificial Intelligence. 2025;8:1691499. doi:10.3389/frai.2025.1691499.

[25]Spitzer P, Hendriks D, Rudolph J, Schlaeger S, Ricke J, Kühl N, et al. The effect of medical explanations from large language models on diagnostic accuracy in radiology. npj Digital Medicine. 2026;9(1):333. doi:10.1038/s41746-026-02619-0.

[26]Harada Y. Decomposing Persona Prompts for Simulated Clinical Reasoning: A Two-by-Two Factorial In Silico Experiment of Time Pressure and Safety Prioritization. Cureus. 2026;18(3):e105796. doi:10.7759/cureus.105796.

[27]Neves B, Moreira JM, Gonçalves S, Cerejo J, Da Silva NA, Leite F, et al. Zero-shot learning for clinical phenotyping: Comparing LLMs and rule-based methods. Computers in Biology and Medicine. 2025;192:110181. doi:10.1016/j.compbiomed.2025.110181.

[28]Helmink FGL, Mesman E, Hillegers MHJ. Beyond the Window of Risk? The Dutch Bipolar Offspring Study: 22-Year Follow-Up. Journal of the American Academy of Child & Adolescent Psychiatry. 2025;64(5):593–601. doi:10.1016/j.jaac.2024.05.024.

[29]Martínez JA, Martínez L. Distinguishing anchoring from confirmation bias in diagnostic vignette studies: methodological implications for clinical decision-making. Frontiers in Public Health. 2026;14:1770198. doi:10.3389/fpubh.2026.1770198.

[30]Heston TF, Lewis LM. ChatGPT provides inconsistent risk-stratification of patients with atraumatic chest pain. PloS One. 2024;19(4):e0301854. doi:10.1371/journal.pone.0301854.

[31]Healy J, Kossoff J, Lee M, Hasford C. Human–AI collaboration in clinical reasoning: a UK replication and interaction analysis. Diagnosis. 2026. doi:10.1515/dx-2025-0176.

[32]Hopkins AM, Cornelisse E. AI can reason like a physician—what comes next? Science. 2026;392(6797):466–467. doi:10.1126/science.aeg8766.

How to Cite

Heston, T. “Prompt Style Effects on Large Language Model Differential Diagnosis Output in Adolescent Catatonia and Psychosis”. Journal of Digital Health, vol. 5, no. 1, Nov. 2026, pp. 6-12, doi:10.55976/jdh.5202616146-12.
X

Scan QR code to follow us by Wechat

扫码关注我们的微信公众号

Luminescience press is based in Hong Kong with offices in Wuhan, China.

E-mail: publisher@luminescience.cn

鄂公网安备 42018502004928号 网站备案号:鄂ICP备2020021880号-1