Table 1
Question comparison between professional healthcare and laypeople.
| QUESTION | QUALITY/CLARITY [MEDIAN, (IQR)] | RELEVANCE [MEDIAN, (IQR)] | ACCURACY [MEDIAN, (IQR)] | COMPREHENSIVENESS [MEDIAN, (IQR)] | OVERALL JUDGEMENT [MEDIAN, (IQR)] | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PROFESSIONAL (N = 5) | LAYPEOPLE (N = 15) | p | PROFESSIONAL (N = 5) | LAYPEOPLE (N = 15) | p | PROFESSIONAL (N = 5) | PROFESSIONAL (N = 5) | LAYPEOPLE (N = 15) | p | PROFESSIONAL (N = 5) | LAYPEOPLE (N = 15) | p | |
| What is essential tremor? | [5.0 (2.0)] | [4.0 (1.0)] | 0.866 | [5.0 (1.0)] | [5.0 (1.0)] | 0.866 | [5.0 (2.0)] | [5.0 (2.0)] | [5.0 (1.0)] | 0.800 | [4.0 (2.0)] | [4.0 (1.0)] | 1.000 |
| Is essential tremor like Parkinson’s disease? | [4.0 (2.0)] | [4.0 (1.0)] | 0.230 | [5.0 (3.0)] | [4.0 (1.0)] | 0.933 | [4.0 (3.0)] | [4.0 (2.0)] | [4.0 (1.0)] | 0.266 | [4.0 (3.0)] | [4.0 (1.0)] | 0.497 |
| I received a diagnosis of essential tremor. Will I get worse? | [5.0 (2.0)] | [4.0 (1.0)] | 0.933 | [5.0 (3.0)] | [4.0 (1.0)] | 0.800 | [5.0 (3.0)] | [4.0 (3.0)] | [5.0 (1.0)] | 0.266 | [5.0 (2.0)] | [5.0 (1.0)] | 0.800 |
| Can I do something to slow its progression? | [5.0 (1.0)] | [5.0 (1.0)] | 0.933 | [5.0 (1.0)] | [4.0 (3.0)] | 0.197 | [5.0 (3.0)] | [4.0 (3.0)] | [5.0 (0.0)] | 0.119 | [5.0 (3.0)] | [5.0 (0.0)] | 0.395 |
| I had a diagnosis of essential tremor. I am at risk of developing the disease Parkinson’s? | [4.0 (2.0)] | [4.0 (1.0)] | 0.672 | [5.0 (3.0)] | [4.0 (1.0)] | 0.800 | [5.0 (3.0)] | [4.0 (4.0)] | [4.0 (1.0)] | 0.612 | [5.0 (3.0)] | [4.0 (1.0)] | 0.933 |
| Will I have memory problems? | [5.0 (1.0)] | [4.0 (1.0)] | 0.349 | [4.0 (2.0)] | [4.0 (2.0)] | 1.000 | [4.0 (3.0)] | [4.0 (3.0)] | [4.0 (1.0)] | 0.445 | [4.0 (3.0)] | [4.0 (2.0)] | 0.800 |
| Drugs for essential tremor aren’t working. I can take something else? | [5.0 (1.0)] | [5.0 (1.0)] | 0.933 | [5.0 (2.0)] | [4.0 (1.0)] | 0.800 | [5.0 (3.0)] | [5.0 (3.0)] | [5.0 (1.0)] | 0.612 | [5.0 (3.0)] | [5.0 (1.0)] | 0.553 |
| Can cannabis be useful for Essential Tremor? | [5.0 (2.0)] | [4.0 (2.0)] | 0.445 | [4.0 (3.0)] | [4.0 (1.0)] | 0.800 | [4.0 (3.0)] | [4.0 (3.0)] | [4.0 (2.0)] | 0.800 | [4.0 (3.0)] | [4.0 (2.0)] | 0.445 |
| I have heard of ultrasound therapy for essential tremor. Can you tell me more? | [5.0 (1.0)] | [4.0 (1.0)] | 0.266 | [4.0 (1.0)] | [4.0 (1.0)] | 0.800 | [4.0 (2.0)] | [4.0 (2.0)] | [4.0 (1.0)] | 0.933 | [5.0 (2.0)] | [4.0 (2.0)] | 0.800 |
| Does ultrasound therapy have any side effects? | [5.0 (1.0)] | [4.0 (1.0)] | 0.497 | [5.0 (1.0)] | [4.0 (1.0)] | 0.349 | [5.0 (2.0)] | [4.0 (2.0)] | [5.0 (1.0)] | 0.445 | [4.0 (2.0)] | [4.0 (1.0)] | 0.612 |
Figure 1
Aggregate percentage agreement of ratings ≥4 for each parameter for each question in the group of professional (plain circles) and laypeople (dashed circles). Green circles indicate good agreement (≥75%) and yellow circles moderate agreement (≥60%).
Table 2
Readability metrics of the answers provided by ChatGPT.
| QUESTION | FLESCH READING EASE | SMOG INDEX | COLEMAN-LIAU INDEX | FORCAST GRADE LEVEL | READABILITY SCORE | REACH |
|---|---|---|---|---|---|---|
| What is Essential Tremor? | 32.0 | 15.1 | 13.9 | 12.1 | D | 59% |
| Is essential tremor like Parkinson’s disease? | 28.7 | 14.6 | 14.2 | 12.7 | D | 57% |
| I have been diagnosed with essential tremor. Do I carry a higher risk of developing Parkinson disease? | 8.1 | 18.5 | 17.2 | 13.2 | E | 25% |
| I have been diagnosed with ET? Will I get worse? | 35.6 | 14.3 | 14.9 | 12.4 | D | 68% |
| Is there anything I can do to slow its progression down? | 31.6 | 14.6 | 16.0 | 12.7 | D | 67% |
| Does ET affect memory? | 13.7 | 17.8 | 17.2 | 13.9 | E | 32% |
| Is cannabis useful for ET? | 20.0 | 17.0 | 15.2 | 12.4 | E | 42% |
| Prescribed drugs for essential tremor are not working. can I try something else? | 20.2 | 17.3 | 17.9 | 13.0 | E | 43% |
| I heard about ultrasound in essential tremor. can you tell me more? | 26.3 | 16.6 | 14.8 | 12.6 | E | 51% |
| Does ultrasound therapy have side effects? | 32.6 | 16.0 | 13.7 | 12.1 | D | 57% |