MULTIFILE
MULTIFILE
Background: In the past years, a mobile health (mHealth) app called the Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in The Netherlands. The aim of development was to enable Dutch physical therapy patients to autonomously complete a health-related questionnaire regardless of their level of literacy and digital skills. Objective: The aim of this study was to evaluate the usability (defined as the effectiveness, efficiency, and satisfaction) of the prototype of the DTTSQ for Dutch physical therapy patients with diverse levels of experience in using mobile technology. Methods: The qualitative Three-Step Test-Interview method, including both think-aloud and retrospective probing techniques, was used to gain insight into the usability of the DTTSQ. A total of 24 physical therapy patients were included. The interview data were analyzed using a thematic content analysis approach aimed at analyzing the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took the participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating that was used to provide a rough estimate of the need for additional usability efforts. Results: All participants within this study were very satisfied with the ease of use of the DTTSQ. Overall, 9 participants stated that the usability of the app exceeded their expectations. The group of 4 average-/high-experienced participants encountered only 1 problem in total, whereas the 11 little-experienced participants encountered an average of 2 problems per person and the 9 inexperienced participants an average of 3 problems per person. A total of 13 different kind of problems were found during this study. Of these problems, 4 need to be addressed before the DTTSQ will be released because they have the potential to negatively influence future usage of the tool. The other 9 problems were less likely to influence future usage of the tool substantially. Conclusions: The usability of the DTTSQ needs to be improved before it can be released. No problems were found with satisfaction or efficiency during the usability test. The effectiveness needs to be improved by (1) making it easier to navigate through screens without the possibility of accidentally skipping one, (2) enabling the possibility to insert an answer by tapping on the text underneath a photograph instead of just touching the photograph itself, and (3) making it easier to correct wrong answers. This study shows the importance of including less skilled participants in a usability study when striving for inclusive design and the importance of measuring not just satisfaction but also efficiency and effectiveness during such studies.
LINK
communicative participation, language disordersOBJECTIVE(S)/RESEARCH QUESTION(S) Speech and language therapists (SLTs) are the primary care professionals to treat language and communication disorders. Their treatment is informed by a variety of outcome measures. At present, diagnosis, monitoring of progress and evaluation are often based on performance-based and clinician-reported outcomes such as results of standardized speech, language, voice, or communication tests. These tests typically aim to capture how well the person can produce or understand language in a controlled situation, and therefore only provide limited insight in the person’s challenges in life. Performance measures do not incorporate the unobservable feelings such as a patient's effort, social embarrassment, difficulty, or confidence in communication. Nor do they address language and communication difficulties experienced by the person themselves, the impact on daily life or allow patients to set goals related to their own needs and wishes. The aim of our study is give our patients a voice and empower SLTs to incorporate their patient's perspective in planning therapy. We will Aangemaakt door ProjectNet / Generated by ProjectNet: 08-12-2020 12:072Subsidieaanvraag_digitaal / Grant Application_digitaalDossier nummer / Dossier number: 80-86900-98-041DEFINITIEFdevelop a valid and reliable patient-reported outcome measure that provides information on communicative participation of people with communication disorders and integrate this item bank in patient specific goal setting in speech and language therapy. Both the item bank and the goal setting method will be adapted in cocreation with patients to enable access for people with communication difficulties.STUDY DESIGN Mixed methods research design following the MRC guidance for process evaluation of complex interventions, using PROMIS methodology including psychometric evaluation and an iterative user-centered design with qualitative co-creation methods to develop accessible items and the goal setting method.RESEARCH POPULATION Children, adolescents and adults with speech, language, hearing, and voice disorders.OUTCOME MEASURES An online patient-reported outcome measure on communicative participation, the Communicative Participation Item Bank (CPIB), CPIB items that are accessible for people with language understanding difficulties, a communicative-participation person-specific goal setting method developed with speech and language therapists and patients and tested on usability and feasibility in clinical practice, and a course for SLTs explaining the use of the goal-setting method in their clinical reasoning process.RELEVANCE This study answers one of the prioritized questions in the call for SLTs to systematically and reliably incorporate the clients’ perspective in their daily practice to improve the quality of SLT services. At present patient reported outcomes play only a small role in speech and language therapy because 1) measures (PROMS) are often invalid, not implemented and unsuitable for clinical practice and 2) there is a knowledge gap in how to capture and interpret outcomes from persons with language disorders.
Het doel van dit project is het slimmer scoren in de fysiotherapeutische zorg door gebruik te maken van PROMIS Computer Adaptive Testing. De verschuiving van acute naar chronische zorg, de toename van evidence based handelen, het (h)erkennen van het belang van het perspectief van de patiënt en de opkomst van value based health care heeft geleid tot het meten van patiënt gerapporteerde uitkomsten, meestal in de vorm van vragenlijsten (Patient Reported Outcome Measures (PROMs). Fysiotherapeuten blijken het belang van de meetinstrumenten wel te (h)erkennen, maar met name de tijdsinvestering en de veelheid van vragenlijsten te groot vinden om de instrumenten consequent te gebruiken. Fysiotherapeuten vragen dan ook “Help ons met kortere en meer relevante vragenlijsten die klinisch inzetbaar en betekenisvol zijn in de praktijk en elkaar niet overlappen“. Het Patient-Reported Outcomes Measurement Information Systeem (PROMIS) is ontwikkeld om beperkingen van klassieke PROMs op te lossen door gebruik te maken van Item Response Theory en Computer Adaptive Testing en geldt als de nieuwe gouden standaard voor het (slimmer) meten en scoren van PROs in de zorg. Tot dusver blijken de Engelstalige PROMIS instrumenten meer valide, betrouwbaarder en responsiever is dan alle bestaande PROMs. Voor de Nederlandstalige versies zijn de betrouwbaarheid en responsiviteit van voor de fysiotherapie belangrijke PROMIS instrumenten nog niet bekend. Het is ook onbekend of fysiotherapeuten de PROMIS instrumenten beter hanteerbaar vinden dan de traditionele PROMs. Omdat betrouwbaarheid en responsiviteitsscores in belangrijke mate bijdragen aan de hanteerbaarheid en interpretatie van meetinstrumenten moeten deze eigenschappen eerst worden uitgezocht. Wij maken gebruik van 5 werkpakketten: WP1 is een test-hertest studie (betrouwbaarheid) van de PROMIS instrumenten, WP2 is een responsiviteit studie van de PROMIS instrumenten, WP3 is een feasibility studie van de PROMIS instrumenten, WP4 is ontwikkeling van scholing en WP5 is de evaluatie van de scholing.
