Have a personal or library account? Click to login
Evaluation is Key: Providing Appropriate Evaluation Measures for Participatory and User-Centred Design Processes of Healthcare IT Cover

Evaluation is Key: Providing Appropriate Evaluation Measures for Participatory and User-Centred Design Processes of Healthcare IT

Open Access
|Jun 2021

Figures & Tables

ijic-21-2-5529-g1.png
Figure 1

The phases of the generic blueprint for user-centred and participatory design processes.

Table 1

Applicability of methods for the different phases.

COGNITIVE WALKTHROUGHDESK RESEARCHDIRECT OBSERVATIONSEXPERT PANELSFIELD INTERVIEWSFIELD STUDIESFOCUS GROUPSHEURISTIC EVALUATIONSIN-DEPTH INTERVIEWSPAPER PROTOTYPINGPERSONASPROTOTYPINGQUANTITATIVE SURVEYSQUANTITATIVE SURVEYS [USABILITY QUESTIONNAIRES]SEMI-STRUCTURED INTERVIEWSSEVERITY RANKINGAPPLICATION SKETCHINGTHINK ALOUD STUDIESUSE CASESUSER PROFILESWORKSHOPS
0: State of the art researchx
1: Requirement analysisxxxxxxxxxxx
2: Conceptual prototypexxxxxxx
3: Preliminary prototypexxxxxx
4: Full prototypexxxx
5: Full applicationxxxx
ijic-21-2-5529-g2.png
Figure 2

Functionalities of Kir’App.

ijic-21-2-5529-g3.jpg
Figure 3

Start screen of the web application for suggesting need-based assistance systems inviting users to find the right solution for their Health Smart Home. In the lower part, information on health samrt homes can be procurred and different options for interacting with the system are offered.

ijic-21-2-5529-g4.png
Figure 4

Screen for starting with a pre-defined patient profile. Profiles to be chosen are dementia, diabtes geriatrics/multi-morbidity, stroke, and free selection of symptoms.

ijic-21-2-5529-g5.png
Figure 5

The suggested assistance concepts of the consultation web app are ranked according to their usefulness for the chosen profile.

ijic-21-2-5529-g6.png
Figure 6

At the end, assistance products are proposed for each suggested assistance concept.

Appendix 1

Allocation of Phases, suggested methods and the corresponding research items.

PHASESUGGESTED NAME OF PHASE/OBJECTIVESUITABLE METHODS OR INSTRUMENTS
0State of the art research, including theoretical foundations for user acceptance [35, 44]Desk research
1Analysing the user requirements [8, 32, 35, 37, 38, 86, 87, 88, 89, 90, 91] and the context of use [92, 93]Direct observations [32, 89]
Use cases [20, 35, 38]
Expert panels of patients and health care providers [90]
Workshops with patients [93]
Semi-structured and field interviews with patients [35, 37, 38, 88, 89, 90], their relatives, health care providers [32, 35, 37, 38] and hospital managers [37]
Quantitative surveys with patients [20, 91]
Focus groups with patients [32, 38, 87] and health care providers [87, 88, 93]
Personas and user profiles of patients [20, 32, 35, 86] and health care providers [35, 86]
Field studies [32, 88]
2Concept development [38] and deduction of characteristics of the prototype [37, 86, 87, 88, 89, 91, 92] based on an in-depth understanding of the user requirements [8, 32, 35, 86, 88, 90, 92, 93] and context of use [8, 90]Use cases [38]
Focus groups with patients [38] and health care providers [37]
Semi-structured interviews with patients [38, 88] and health care providers [38]
Paper Prototyping or Sketching of the intended applications [20, 35, 88, 90]
Personas of patients [90]
Prototyping [32, 35, 86, 87, 88, 89]
3Development [8, 32, 35, 38, 86, 87, 89, 90, 92, 93] and adaption [32, 86, 87] of the prototype based on a first evaluation [8, 20, 35, 37, 86, 87, 88, 89, 91, 92] of its usability in controlled environmentsCognitive walkthrough with health care providers [20]
Heuristic evaluation with non-users [20, 93]
Think aloud studies with health care providers [20, 88, 92], patients [88, 92, 93] and their relatives [89]
Interview [87, 89, 90]
Quantitative surveys with patients [20, 37, 88, 90, 91, 93] and health care providers [20, 87, 88], using usability questionnaires
4Evaluating [8, 32, 37, 38, 86, 89, 93] and adapting [37, 91, 93] the application in terms of usability and user acceptance under real-life conditionsField studies [88]
Focus groups with health care providers [37]
Quantitative surveys with patients [20, 37, 88, 90, 91, 93] and health care providers [20, 88], using usability questionnaires
5Implementation [32, 35, 37, 91, 92] of the full-scale application and long-term evaluation [35, 37, 90, 93]Semi-structured interview with patients [38, 92] and health care providers [92]
DOI: https://doi.org/10.5334/ijic.5529 | Journal eISSN: 1568-4156
Language: English
Submitted on: Apr 30, 2020
Accepted on: Mar 16, 2021
Published on: Jun 21, 2021
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2021 Lorenz Harst, Bastian Wollschlaeger, Jule Birnstein, Tina Fuchs, Patrick Timpel, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.