Table 1.
Error types revealed after cognitive testing of the PaRIS-PQ.
| Question content | Round 1 | Round 2 | Error Type | ||||
|---|---|---|---|---|---|---|---|
| N of tests | Tot. diff. score | Ratio | N of tests | Tot. diff. score | Ratio | ||
| Difficulties in breathing | 9 | 4 | 0.4 | 10 | 5 | 0.5 | Poor source question design. |
| Emotional problems (anxiety, depression, irritability) | 7 | 4 | 0.6 | 9 | 3 | 0.3 | Poor source question design. |
| Care for health and healthcare | 7 | 4 | 0.6 | 10 | 5 | 0.5 | Poor source question design. |
| Health professionals spoken about healthy eating | 8 | 4 | 0.5 | 10 | 5 | 0.5 | Poor source question design. |
| Information about health issues | 8 | 11 | 1.4 | / | / | / | Translation error. |
| Experience with healthcare | 9 | 6 | 0.7 | 9 | 5 | 0.6 | Cultural portability. |
| Consulted with a doctor | 8 | 4 | 0.5 | 9 | 5 | 0.6 | Poor source question design, Translation error. |
| Diagnosed with disease by a doctor | 7 | 4 | 0.6 | / | / | / | Poor source question design, Poor introduction / section design (text after diagnosed with disease by doctor). |
| Healthcare professional coordinating health services | 9 | 11 | 1.2 | 10 | 7 | 0.7 | Translation error / Cultural portability, Poor introduction / section design (Experience in family medicine practice, text after Diagnosed by doctor with disease). |
| Same health professional for most problems | 7 | 7 | 1.0 | / | / | / | Poor introduction / section design (Single healthcare professional for coordination, Experience with family medicine practice, text after Diagnosed with disease by doctor). |
| Who is this health worker? | 7 | 10 | 1.4 | 9 | 5 | 0.6 | Poor introduction / section design (Experience with care in family medicine practice, text after Diagnosed with disease by doctor, questions Is there a single professional responsible for coordinating care, Is it the same professional as for most health problems), Translation error (response option 3). |
| Health professional for most health problems | 8 | 4 | 0.5 | 10 | 6 | 0.6 | Cultural portability, Poor introduction / section design (Realationship with care in your family medicine practice, Diagnosed by doctor with any disease). |
| Setting health goals with health professionals | 8 | 7 | 0.9 | 10 | 6 | 0.6 | Poor section design, Poor source question design. * Firstly, question was without introduction. |
| Questions relate to treatment plan/Treatment plan for health needs | 8 | 10 | 1.3 | 10 | 10 | 1.0 | Poor introduction design, Poor source question design, Cultural portability. |
| Health care involves family, friends, caregivers | 8 | 1 | 0.1 | 8 | 7 | 0.9 | Poor source question design, Poor introduction / section design. |
| Reviewing all the medications | 7 | 4 | 0.6 | 10 | 2 | 0.2 | Poor source question design, Poor introduction / section design. |
| Last consultation/main purpose of consultation | 9 | 11 | 1.2 | 9 | 11 | 1.2 | Poor introduction design (Relate to last consultation in medical clinic), Poor source question design, Translation error, Cultural portability. |
| Most time spent with healthcare professionals | 9 | 5 | 0.6 | 7 | 8 | 1.1 | Poor introduction / section design, Cultural portability. |
| Employment of a health worker | 9 | 13 | 1.4 | 5 | 3 | 0.6 | Poor introduction/section design, Cultural portability. |
| Best describes the type of medical care | 8 | 6 | 0.8 | 6 | 4 | 0.7 | Poor introduction / section design, poor source question design. |
| How quickly you got the appointment for consultation | 8 | 2 | 0.3 | 7 | 6 | 0.9 | Poor introduction / section design, poor source question design. |
| Symptoms of COVID-19 in last two months | 8 | 2 | 0.3 | 8 | 7 | 0.9 | Translation error / Cultural portability. |
| Highest level of education | 10 | 6 | 0.6 | / | / | / | Translation error / Cultural portability. |
| Your sex | 7 | 7 | 1.0 | / | / | / | Cultural portability. |
| Your gender | 9 | 8 | 0.9 | / | / | / | Cultural portability. |
| Current employment status | 4 | 5 | 1.3 | / | / | / | Translation error / Cultural portability. |
| Enough money for healthy food | 8 | 5 | 0.6 | 4 | 1 | 0.3 | Poor source question design. |
| Need for emotional care | 9 | 7 | 0.8 | / | / | / | Poor source question design. |
| Agree or disagree that healthcare system can be trusted | 8 | 1 | 0.1 | 8 | 5 | 0.6 | Poor source question design. |
| Best describes the live in place | / | / | / | 6 | 5 | 0.8 | Poor source question design (difficult international comparability). |
Table 2.
Error types revealed after cognitive testing of the PaRIS-PCPQ.
| Question content | Round 1 | Round 2 | Error Type | ||||
|---|---|---|---|---|---|---|---|
| N of tests | Tot. diff. score | Ratio | N of tests | Tot. diff. score | Ratio | ||
| Type of practice | 3 | 5 | 1.7 | 5 | 7 | 1.4 | Cultural portability. |
| Practice offers services without an appointment/Which type of patients can come without an appointment | 3 | 2 | 0.7 | 5 | 6 | 1.2 | Poor source question design, Translation error, Cultural portability. |
| Which of the following out-of-hours options does your practice provide | 3 | 3 | 1.0 | 5 | 9 | 1.8 | Poor source question design, Cultural portability, Translation error. |
| Roles and functions of the nurses | 3 | 3 | 1.0 | 5 | 5 | 1.0 | Poor source question design, Cultural portability. |
| Scheduled time in practice | 3 | 3 | 1.0 | 5 | 5 | 1.0 | Poor source question design, Translation error, Cultural portability. |
| How prepared is a practice to manage care? | 3 | 3 | 1.0 | 5 | 7 | 1.4 | Poor source question design, Translation error, Cultural portability. |
| Access to equipment for managing chronic patients | 4 | 5 | 1.3 | / | / | / | Poor source question design. |
| Physicians paid in practice | 4 | 6 | 1.5 | / | / | / | Poor source question design, Cultural portability. |
| Practice receives dedicated payments | 4 | 5 | 1.3 | 5 | 10 | 2.0 | Cultural portability. |
| Types of medical record kept | 4 | 4 | 1.0 | 5 | 4 | 0.8 | Poor source question design, Translation error. |
| How are individual patient care plans developed at your practice? | 4 | 6 | 1.5 | 5 | 5 | 1.0 | Poor source question design, Cultural portability. |
| Practice produces information using computer system | 4 | 3 | 0.8 | 5 | 7 | 1.4 | Poor source question design, Translation error, Cultural portability. |
| Tasks routinely performed using computer system | 3 | 3 | 1.0 | 5 | 5 | 1.0 | Cultural portability, Translation error. |
| Review indicators | 3 | 4 | 1.3 | 5 | 6 | 1.2 | Poor source question design, Translation error, Cultural portability. |
| In charge of coordinating with chronic conditions | 3 | 5 | 1.7 | 5 | 10 | 2.0 | Poor source question design, Translation error. |
| Self-management support for patients with chronic conditions | 3 | 1 | 0.3 | 4 | 2 | 0.5 | Cultural portability. |
| Care in practice following chronic conditions | 3 | 4 | 1.3 | / | / | / | Poor source question design, Translation error. |
| Info about COVID-19 | 3 | 2 | 0.7 | / | / | / | Translation error. |
| Changes in practice due to COVID-19 | 2 | 1 | 0.5 | 3 | 2 | 0.7 | Poor source question design. |
| Salary in COVID-19 | 2 | 1 | 0.5 | / | / | / | Poor source question design. |
| Stressed when managing patients with covid-19 | 2 | 1 | 0.5 | 2 | 1 | 0.5 | Poor source question design. |
| Professional background | 4 | 5 | 1.3 | 3 | 2 | 0.7 | Cultural portability. |
| Does your practice offer video, phone, or other online techniques for consultations to patients? | 3 | 0 | 0.0 | 5 | 1 | 0.2 | No major difficulties detected in Slovenia. |