Have a personal or library account? Click to login
Assessing ChatGPT Ability to Answer Frequently Asked Questions About Essential Tremor Cover

Assessing ChatGPT Ability to Answer Frequently Asked Questions About Essential Tremor

Open Access
|Jul 2024

References

  1. 1Bhatia KP, Bain P, Bajaj N, Elble RJ, Hallett M, Louis ED, Raethjen J, Stamelou M, Testa CM, Deuschl G; Tremor Task Force of the International Parkinson and Movement Disorder Society. Consensus Statement on the classification of tremors. from the task force on tremor of the International Parkinson and Movement Disorder Society. Mov Disord. 2018 Jan; 33(1): 7587. DOI: 10.1002/mds.27121
  2. 2Erro R, Fasano A, Barone P, Bhatia KP. Milestones in Tremor Research: 10 Years Later. Mov Disord Clin Pract. 2022 Feb 26; 9(4): 429435. DOI: 10.1002/mdc3.13418
  3. 3Erro R, Pilotto A, Esposito M, Olivola E, Nicoletti A, Lazzeri G, Magistrelli L, Dallocchio C, Marchese R, Bologna M, Tessitore A, Misceo S, Gigante AF, Terranova C, Moschella V, di Biase L, Di Giacopo R, Morgante F, Valentino F, De Rosa A, Trinchillo A, Malaguti MC, Brusa L, Matinella A, Di Biasio F, Paparella G, De Micco R, Contaldi E, Modugno N, Di Fonzo A, Padovani A, Barone P; TITAN Study Group. The Italian tremor Network (TITAN): rationale, design and preliminary findings. Neurol Sci. 2022 Sep; 43(9): 53695376. DOI: 10.1007/s10072-022-06104-w
  4. 4Louis ED, McCreary M. How Common is Essential Tremor? Update on the Worldwide Prevalence of Essential Tremor. Tremor Other Hyperkinet Mov (N Y). 2021 Jul 9; 11: 28. DOI: 10.5334/tohm.632
  5. 5Amlang CJ, Trujillo Diaz D, Louis ED. Essential tremor as a “waste basket” diagnosis: diagnosing essential tremor remains a challenge. Front Neurol. 2020; 11: 172. DOI: 10.3389/fneur.2020.00172
  6. 6Shalaby S, Indes J, Keung B, et al. Public knowledge and attitude toward essential tremor: a questionnaire survey. Front Neurol. 2016; 7: 60. DOI: 10.3389/fneur.2016.00060
  7. 7Jain S, Lo SE, Louis ED. Common misdiagnosis of a common neurological disorder: how are we misdiagnosing essential tremor? Arch Neurol. 2006; 63: 11001104. DOI: 10.1001/archneur.63.8.1100
  8. 8Gupta HV, Pahwa R, Dowell P, Khosla S, Lyons KE. Exploring essential tremor: Results from a large online survey. Clin Park Relat Disord. 2021 Jun 25; 5: 100101. DOI: 10.1016/j.prdoa.2021.100101
  9. 9Brigo F, Erro R. Why do people google movement disorders? An infodemiological study of information seeking behaviors. Neurol Sci. 2016 May; 37(5): 7817. Epub 2016 Feb 4. PMID: 26846327. DOI: 10.1007/s10072-016-2501-5
  10. 10Pajo AT, Jamora RDG, Espiritu AI. Online Health Information-Seeking Behavior for Movement Disorders: An Infodemiologic Study. DOI: 10.2139/ssrn.4105828
  11. 11Brigo F, Erro R. The readability of the English Wikipedia article on Parkinson’s disease. Neurol Sci. 2015 Jun; 36(6): 10456. Epub 2015 Jan 18. PMID: 25596713. DOI: 10.1007/s10072-015-2077-5
  12. 12Daraz L, Morrow AS, Ponce OJ, Beuschel B, Farah MH, Katabi A, Alsawas M, Majzoub AM, Benkhadra R, Seisa MO, Ding JF, Prokop L, Murad MH. Can Patients Trust Online Health Information? A Meta-narrative Systematic Review Addressing the Quality of Health Information on the Internet. J Gen Intern Med. 2019 Sep; 34(9): 18841891. DOI: 10.1007/s11606-019-05109-0
  13. 13Murray E, Lo B, Pollack L, Donelan K, Catania J, Lee K, Zapert K, Turner R. The impact of health information on the internet on health care and the physician–patient relationship: national US survey among 1.050 US physicians. J Med Internet Res. 2003; 5: e17. DOI: 10.2196/jmir.5.3.e17
  14. 14Trethewey SP. ‘Cough CPR’: Misinformation perpetuated by social media. Resuscitation. 2018 Dec; 133: e7e8. Epub 2018 Oct 8. PMID: 30308229. DOI: 10.1016/j.resuscitation.2018.10.003
  15. 15OpenAI. ChatGPT: Optimizing language models for dialogue. OpenAI 2022. https://openai.com/blog/chatgpt/ (accessed 3 January 2023).
  16. 16https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01/.
  17. 17Singhal K, Azizi S, Tu T, et al. Large language models encode clinical knowledge. Nature. 2023; 620: 172180. DOI: 10.1038/s41586-023-06291-2
  18. 18Lim ZW, Pushpanathan K, Yew SME, Lai Y, Sun CH, Lam JSH, Chen DZ, Goh JHL, Tan MCJ, Sheng B, Cheng CY, Koh VTC, Tham YC. Benchmarking large language models’ performances for myopia care: a comparative analysis of ChatGPT-3.5, ChatGPT-4.0, and Google Bard. EBioMedicine. 2023 Sep; 95: 104770. DOI: 10.1016/j.ebiom.2023.104770
  19. 19Goodman RS, Patrinely JR, Stone CA, et al. Accuracy and Reliability of Chatbot Responses to Physician Questions. JAMA Netw Open. 2023; 6(10): e2336483. DOI: 10.1001/jamanetworkopen.2023.36483
  20. 20Scquizzato T, Semeraro F, Swindell P, Simpson R, Angelini M, Gazzato A, Sajjad U, Bignami EG, Landoni G, Keeble TR, Mion M. Testing ChatGPT ability to answer laypeople questions about cardiac arrest and cardiopulmonary resuscitation. Resuscitation. 2024 Jan; 194: 110077. Epub 2023 Dec 9. PMID: 38081504. DOI: 10.1016/j.resuscitation.2023.110077
  21. 21Stiennon N, et al. Learning to summarize from human feedback. In Proc. 34th International Conference on Neural Information Processing Systems, 3008–3021 (Curran Associates Inc., 2020).
  22. 22Gao L, Schulman J, Hilton J. Scaling laws for reward model overoptimization. PMLR. 2023; 202: 1083510866.
  23. 23DeVellis RF. Inter-Rater Reliability. In Kempf-Leonard K (ed.), Encyclopedia of Social Measurement, Elsevier; 2005. DOI: 10.1016/B0-12-369398-5/00095-5
  24. 24Flesch R. A new readability yardstick. J Appl Psychol. 1948 Jun; 32(3): 22133. PMID: 18867058. DOI: 10.1037/h0057532
  25. 25Mc Laughlin GH. “SMOG grading-a new readability formula.” Journal of reading. 1969; 12.8: 639646.
  26. 26Coleman M, Liau TL. “A computer readability formula designed for machine scoring.” Journal of Applied Psychology. 1975; 60(2): 283. DOI: 10.1037/h0076540
  27. 27Caylor JS, Sticht TG, Fox LC, Ford JP. Methodologies for Determining Reading Requirements of Military Occupational Specialties. Alexandria, VA: Human Resources Research Organization; 1973.
  28. 28Clusmann J, Kolbinger FR, Muti HS, et al. The future landscape of large language models in medicine. Commun Med. 2023; 3: 141. DOI: 10.1038/s43856-023-00370-1
  29. 29Jahan I, Laskar MTR, Peng C, Huang JX. A comprehensive evaluation of large Language models on benchmark biomedical text processing tasks. Comput Biol Med. 2024 Mar; 171: 108189. DOI: 10.1016/j.compbiomed.2024.108189
  30. 30Nori H, King N, McKinney SM, Carignan D, Horvitz E. Capabilities of GPT-4 on medical challenge problems. Preprint at arXiv; 2023. DOI: 10.48550/arXiv.2303.13375
  31. 31Walker HL, Ghani S, Kuemmerli C, Nebiker CA, Müller BP, Raptis DA, et al. Reliability of medical information provided by ChatGPT: Assessment against clinical guidelines and patient information quality instrument. J Med Internet Res. 2023; 25: e47479. DOI: 10.2196/47479
  32. 32Ayers JW, Poliak A, Dredze M, Leas EC, Zhu Z, Kelley JB, et al. Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA Intern Med. 2023; 183: 58996. DOI: 10.1001/jamainternmed.2023.1838
  33. 33Rahsepar AA, Tavakoli N, Kim GHJ, Hassani C, Abtin F, Bedayat A. How AI Responds to Common Lung Cancer Questions: ChatGPT vs Google Bard. Radiology. 2023 Jun; 307(5): e230922. DOI: 10.1148/radiol.230922
  34. 34Maida E, Moccia M, Palladino R, Borriello G, Affinito G, Clerico M, Repice AM, Di Sapio A, Iodice R, Spiezia AL, Sparaco M, Miele G, Bile F, Scandurra C, Ferraro D, Stromillo ML, Docimo R, De Martino A, Mancinelli L, Abbadessa G, Smolik K, Lorusso L, Leone M, Leveraro E, Lauro F, Trojsi F, Streito LM, Gabriele F, Marinelli F, Ianniello A, De Santis F, Foschi M, De Stefano N, Morra VB, Bisecco A, Coghe G, Cocco E, Romoli M, Corea F, Leocani L, Frau J, Sacco S, Inglese M, Carotenuto A, Lanzillo R, Padovani A, Triassi M, Bonavita S, Lavorgna L; Digital Technologies, Web, Social Media Study Group of the Italian Society of Neurology (SIN). ChatGPT vs. neurologists: a cross-sectional study investigating preference, satisfaction ratings and perceived empathy in responses among people living with multiple sclerosis. J Neurol. 2024 Apr 3; Epub ahead of print. PMID: 38568227. DOI: 10.1007/s00415-024-12328-x
  35. 35Espay AJ, Lang AE, Erro R, Merola A, Fasano A, Berardelli A, Bhatia KP. Essential pitfalls in “essential” tremor. Mov Disord. 2017 Mar; 32(3): 325331. DOI: 10.1002/mds.26919
  36. 36Lenka A, Louis ED. Do We Belittle Essential Tremor by Calling It a Syndrome Rather Than a Disease? Yes. Front Neurol. 2020 Oct 15; 11: 522687. DOI: 10.3389/fneur.2020.522687
  37. 37Erro R, Picillo M, Pellecchia MT, Barone P. Diagnosis Versus Classification of Essential Tremor: A Research Perspective. J Mov Disord. 2023 May; 16(2): 152157. DOI: 10.14802/jmd.23020
  38. 38Mac O, Ayre J, Bell K, McCaffery K, Muscat DM. Comparison of Readability Scores for Written Health Information Across Formulas Using Automated vs Manual Measures. JAMA Netw Open. 2022; 5(12): e2246051. DOI: 10.1001/jamanetworkopen.2022.46051
  39. 39Ji Z, Lee N, Frieske R, Yu T, Su D, Xu Y, et al. Survey of hallucination in natural language generation. ACM Comput Surv. 2022; 55(12): 138. DOI: 10.1145/3571730
  40. 40Venkit PN, Srinath M, Wilson S. A study of implicit bias in Pretrained language models against people with disabilities. In: Proceedings of the 29th international conference on computational linguistics [internet]. Gyeongju, Republic of Korea: International Committee on Computational Linguistics; 2022; p. 132432 [cited 2023]. Available from: https://aclanthology.org/2022.coling-1.113.
  41. 41O’Suilleabhain P, Berry DS, Lundervold DA, Turner TH, Tovar M, Louis ED. Stigma and Social Avoidance in Adults with Essential Tremor. Mov Disord Clin Pract. 2023 Jun 21; 10(9): 13171323. DOI: 10.1002/mdc3.13774
  42. 42Masters K. Ethical use of artificial intelligence in health professions education: AMEE Guide No.158. Med Teach; 2023 Mar 13 [Epub]. DOI: 10.1080/0142159X.2023.2186203
  43. 43Deik A. Potential Benefits and Perils of Incorporating ChatGPT to the Movement Disorders Clinic. J Mov Disord. 2023 May; 16(2): 158162. Epub 2023 May 24. PMID: 37258279; PMCID: PMC10236019. DOI: 10.14802/jmd.23072
DOI: https://doi.org/10.5334/tohm.917 | Journal eISSN: 2160-8288
Language: English
Submitted on: May 8, 2024
Accepted on: Jun 27, 2024
Published on: Jul 3, 2024
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2024 Cristiano Sorrentino, Vincenzo Canoro, Maria Russo, Caterina Giordano, Paolo Barone, Roberto Erro, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.