Abstract
To design and develop a smartphone application for a structured hand exercise programme for patients with rheumatoid arthritis (RA) in Turkey and to test its usability. We followed a two-stage process: (1) Design and Development and (2) Usability testing. In stage 1, we used a qualitative user-centered design approach. We conducted a focus group (8 therapists and people with RA) to discuss the content, features and design to produce a prototype of the application. In a second focus group session, the participants tested the prototype, provided feedback and further revisions were made. In stage 2, 17 participants with RA used the app for 4 to 6 weeks. The System Usability Scale and the adapted Usability, Satisfaction and Ease to Use Questionnaires were used to measure usability, ease of use. Semi-structured interviews were conducted to explore user experiences with the application with 17 participants. In stage 1, the following themes were identified from the focus groups (a) login techniques (b) self-monitoring (c) exercises, (d) exercise diary, (e) information, (f) behavioral change and encouragement (g) exercise adherence. In stage 2, 3 themes were determined from interviews: (a) learning and accuracy, (b) ease of use, (c) motivation and adherence. USE and SUS scores indicated that users reported a high level of usability, satisfaction and ease of use. A mobile app for hand exercise for people with RA was developed using a mixed-method and iterative design. Participants perceived the mobile app as easy to use with high levels of satisfaction.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Rheumatoid arthritis (RA) is a systemic inflammatory autoimmune disease that can affect a multiple synovial joint, especially the small joints of the hands and wrists [1, 2]. Hand function is considerably reduced due to pain, decreased grip strength, reduced joint range of motion and deformities [3, 4]. According to international clinical guidelines, structured hand exercise programmes are recommended for patients with RA affecting their hands [5]. One such programme is the Strengthening and Stretching for Rheumatoid Arthritis of the Hand (SARAH) program which has been shown to provide long term improvement in hand function for patients with RA [6]. The SARAH programme is delivered over 5 sessions with a hand therapist and the patient is asked to carry out exercises at home on a daily basis. To support the home exercises, to reduce the number of hand therapy sessions required and to make it easier for patients to access the SARAH programme, a web-based version of the programme (mySARAH) was developed for patients in english. Preliminary evaluation has found this is an acceptive and effective way to deliver the SARAH programme [7].
Digital health is the integration of digital technologies with health, life and society to increase the effectiveness of healthcare delivery and to provide personalised care [8]. Digital rehabilitation provides a rehabilitation service remotely via digital/telecommunication technology. It is a way to provide easy access to rehabilitation services for those that need them regularly with reduced burden of travel to appointments resulting in time, labour force and cost savings [10, 11]. Digital rehabilitation interventions have the potential to support patients by providing clinicians with a means of encouraging self-management and motivating patients to undertake home exercises [12, 13].
The widespread use of mobile devices, such as cell phones and tablets, has led to the creation of mobile health (mHealth) products to deliver digital health interventions. mhealth describes medical and public health interventions supported by mobile devices, such as cell phones and tablets. The popularity, portability, and technological features of mobile technology provide an advantageous basis for improving healthcare delivery processes [8, 9]. Mobile health apps technology can provide an easy, usable, and accessible platform for utilizing rehabilitation interventions. In the field of mobile applications, a new developing market has emerged that supports the rehabilitation of patients, especially regarding the adherence to home exercises [14, 15]. These systems focus on engagement with exercise interventions through personalized goal setting, exercise reminders, and motivational message notifications. In addition, the advanced monitoring, data collection and real-time notification features of mhealth apps are advantageous to both researchers and healthcare professionals [16]. Increasingly, research evidence supports the effectiveness of mHealth interventions for improved exercise adherence and motivation [17,18,19].
Numerous mHealth applications exist to support users in the self-management of the musculoskeletal disorders and arthritis [13, 17,18,19]. But most of these apps were not designed with input from both users and health professionals [20]. In a study which explored the benefits of smartphone applications for patients with RA and their perspectives about rehabilitation applications, 94% participants stated that these programmes have a crucial role for self-care, 86% were willing to use it, and 86% would like to buy these programmes [21].
In Turkey, the number of physiotherapists who work in rheumatology departments is considerably low. Therefore, there is an opportunity to use the mHealth app technologies for exercise prescription and patient monitoring. Majority of the Turkish population have access to a smartphone and internet services. A mobile app was therefore considered to deliver the hand exercises to people with RA in Turkey.
The aim was to develop a mHealth app using an iterative user-centred design approach to ensure the product met user needs, was easy to use and acceptable to both patients with RA and therapists [22, 23] and test its usability.
Methods
We followed a two-stage process: (a) Design and Development b) Usability (see Fig. 1). During the design and development stage, we produced the prototype and then revised it following feedback from a focus group (therapists and patients) before undertaking usability testing.
The study protocol was approved by the Clinical Research Ethics Committee of Marmara University Medical Faculty. All participants provided informed consent prior to participation.
Participants
-
(a)
Design and development stage: therapists (physiotherapists or hand therapists) with at least 5 years working experience in the field of rheumatology or hand therapy departments, and patients who had previously received hand therapy with the diagnosis of RA were invited to the focus groups. Focus group members took part in phase I and II. Quota sampling method was used to recruit focus group participants via personal network of researchers [24]. Participants were invited by email or phone call. The participants completed a brief demographic questionnaire before the first focus group session.
-
(b)
Usability: participants were recruited from Haydarpasa Numune Research and Education Hospital, Rheumatology Clinic. We aimed to recruit 20 volunteers with a diagnosis of RA who have hand involvement. Based on the existing evidence, 95% of usability problems can be identified with 20 users [25, 26]. Patients did not receive any other physiotherapy intervention or injections during the study period.
Design and development
This stage consisted of two phases:
Phase 1-development of hand exercise smartphone software for patients with RA (prototype version software/MarHand therapy app)
Focus groups were held to discuss the content, feature and design of the app. This information informed the production of the app prototype. Discussions were led by the lead author who presented an overview of hand therapy programs available in published literature and in clinical guidelines for patients with RA. An introduction to the SARAH hand exercises for adults with RA, as recommended in the guidelines, was provided. A series of open-ended questions (See Supplementary file 1) were asked and participants discussed a variety of topics including advantages/disadvantages of a mobile app, login parameters, self-monitoring, exercise content, video or animation types, exercise diary, reminders, ways to encourage and motivate the user to exercise and the type of advice to be included. The focus group sessions were audio-recorded and transcribed verbatim.
Phase 2-testing the app prototype (revised-MarHand therapy app)
Focus group members were asked to use the app for 1 week. They were asked to provide written feedback regarding the technical errors and faults encountered while using the different elements of the app including login, evaluation and questionnaires, videos, notifications and reminders. A second focus group (See question guide in Supplementary file 1) was held to discuss their experiences and possible modifications.
Usability testing
Participants attended an app demonstration session with the lead author in groups of five. The different elements of the application were demonstrated, and their use was explained. Each session took around 20 min. Participants were asked to open the app, follow the instructions and complete the exercise prescription form (choosing exercises and reminders, number of times/day and time of day). They were asked to use the app on their own for 4 to 6 weeks. During the 7th week, we conducted the usability tests and interviews.
Usability was tested in two ways:
(a) Quantitative data
Cloud MangoDB Atlas software, a user activation tracking system, was used to track interaction of participants with exercise videos measuring daily/weekly/total time (seconds) of interactions and number of interactions.
Users completed the System Usability Scale (SUS) [27, 28] which ranges from 0 to 100, with higher scores representing greater usability. For each participant, the mean SUS scores (0–100) were calculated and transformed into a usability score out of 100.
User also completed the adapted Usability, Satisfaction and Ease to Use (USE) Questionnaire [29, 30]. We adapted the USE questionnaire to assess usability specific to our application. The adapted questionnaire had 10 questions and each question was scored on a Likert scale (1/5) (supplementary file 1) with two domains (Ease of use and Satisfaction). The mean score for each domain of the USE questionnaire was calculated for each participant. The higher scores indicated greater usability for USE.
(b)Qualitative data
Individual semi-structured face-to-face interviews were conducted 6 weeks after introducing participants to the app. We used open-ended questions following an interview guide (Supplementary file 1). The interviews were audio-recorded and transcribed verbatim.
Analysis
The Qualitative Research Data Analysis Software QSR NVivo 11 was used to organize the qualitative data from the focus groups and interviews [31]. Thematic analysis was performed as described by Braun and Clarke [32]. Throughout the process, the research team met to discuss the data and alternative interpretations of the data. Data were assigned with codes, and codes with similar content were grouped into thematic categories. Quantitative data are presented descriptively. Categorical data are summarized as numbers of participants in each category. Continuous data are summarized as the mean (standard deviation) or median (inter-quartile range). We used Statistical Package for the Social Sciences software (SPSS, IBM, version 20.0; Armonk, NY, USA).
Results
Stage 1: design and development
Majority of the therapists were female (4/5), with age range between 30 and 40 years. All three patients in the focus group were women (age of patients (years): 36, 45, 65).
Phase 1 (prototyping)
Seven themes relating to user needs and requirements for the mobile app were identified from the focus group interviews. Participant quotes supporting each theme as well as solutions to address the identified needs and requirements are presented in Table 1.
-
Theme 1 Logging into app
Patients and therapists all agreed that the login methods must be easy to use. In response to this, we added a tab to the app that contains instructions on how to use the app with a notification to access this following the login stage. In addition, we recommended a brief (face to face or online, individual or group) training session be provided by therapists for patients who will use this app. When patients access the instruction tab, there is a recommendation that they see their therapist for a short training session if they have not done so already.
-
Theme 2 Self-monitoring
Patients wanted to track their pain intensity and hand function. All therapists remarked that hand pain, hand function and satisfaction levels are important assessments. They added the questionnaires used in the app should not be too long to ensure they were fully completed. So, it was agreed to use two short hand function questionnaires. The selected self-monitoring assessments are on Table 1. They also added that it would be helpful if the therapist could see the results of patient outcomes in a graph. To address this, the app was connected to Cloud MangoDB Atlas software that allows data to be exported into Microsoft word, Excel programs and visualization by graphs or tables.
-
Theme 3 Exercises
The therapists felt that the SARAH exercises were beneficial for their patients and felt they were appropriate to include in the app. For patients, not including too many exercises was important and some specific types of exercises (the SARAH exercises and additional tendon gliding exercises) they had previously benefited from were mentioned. Patients recommended a maximum of eight exercises be prescribed at one time, as more exercises may make people reluctant to do them regularly. Consequently, seven hand exercises were chosen from the eleven SARAH programme exercises with a few adaptations (see Table 1). All focus group members recommended including exercise demonstration videos with clear instructions.
-
Theme 4 Exercise diary
Therapists recommended that patient should do the exercises 3 days a week (5–8 repetitions), they also suggested that patients should choose the days and time when they would do the exercises. To accommodate this, we designed the exercise diary allowing patients to choose their schedule (days of the week, and the time) for doing the exercises. The software sends notifications to remind the user to do their exercises 1 h before the selected time. There are four reminders.
-
Theme 5 Information
All therapists discussed the possible content related to patient education. All of them agreed that the focus was on exercise rather than patient education. One patient suggested that patient education in RA in the form of podcast would be helpful. We added a tab for a podcast which is currently not active but could be developed in the future.
-
Theme 6 Behavior change and encouragement
Patients wanted exercise reminders and push-up notifications for encouragement, and to be able to chat with an expert if needed. We recommend to HPs who plan to use the app with their patients offer support phone calls when required. Three of the five therapists suggested the addition of push-up notifications as a way to encourage patients to exercise. Short motivational messages about doing regular exercise have been prepared and included as push notifications (see Table 3).
-
Theme 7 Exercise adherence
Therapists agreed that the app would help patients adhere to their home exercises. They agreed it would be helpful to monitor the adherence using a user activation tracking system. They indicated that in this way, they could follow their patients' engagement with the programme. Based on this discussion, new features were created including a tracking system to assess the frequency and duration of usage of the app (see Table 3).
Initial build of the app
The resulting app had the following sections.
Instructions
Brief instructions on how to use the app.
Outcome measures
Hand pain, hand fatigue, hand function (see Table 1).
Exercise diary
Patients are asked to choose the days and times on which they plan to do their exercises.
Exercises
Seven hand exercises were chosen from the SARAH programme exercises with a few adaptations (see Table 1).
The prototype application was built in June 2019. It is a native app that can be used on both Google Android and Apple IOS operating systems.
Phase 2
The participants who tested the app interface owned different brands of smartphones. Focus group members and volunteer users found some problems and errors. The font size of the text was too small. Users also received error messages. Notifications came up at the wrong time. An option tab to allow the user to play the videos one by one or at all at once was suggested.
Based on therapist feedback, patients had to complete the exercise diary to move onto the next exercise. A Therapist said “In my opinion, filling the exercise diary should be obligatory for using the app, otherwise patients don’t care about it and we may not see the data”. Visual and sound effects of push-up notifications were changed as recommended by the patients.
Changes to the app in response to feedback
Technical errors identified during phase 2 were fixed by software developers. We added a tab for the exercise videos with two options to the app as follows: ‘start selected exercise’, ‘start all exercises one after the other’. Visual and sound effects were upgraded. Screenshots from app is in Fig. 2.
Stage 2: usability
Twenty participants were recruited for the usability testing. Three participants withdrew due to lack of time. Seventeen participants (males/females: 1/16) used the app. The duration of RA varied among participants ranging from some diagnosed recently to those with longstanding RA. Ten of the 17 patients had previously received a home exercise program. Nearly 40% of the participants had high school level of education, and 65% were not working (Table 2).
Usage status of the app was determined by activation tracking system. Participants were asked to use the app over 6-week period. Total usage status (count of interaction to app, count of participated sessions, usage times) for every individual and average usage (median/IQR) were reported in Table 3. Three participants used the app for the full 6 weeks. Some of the participants (n = 7) completed more than 9 sessions over 4 weeks, while some of them had very low usage with under 3 sessions (n = 4). The median number of sessions was 7 (IQR 2.5–12), the median number of uses per/week was 3.5 (IQR 1.5–3), the median total number of interactions with the exercise section of the app was 45 (IQR 22.5–89) and the median total usage time was 70 minute (IQR 19-216).
We reported weekly usage changes over time in Table 4. The number of sessions and usage time of participants decreased over the 6-week period. During the first week, 17 participants used the app with only three still using during the 6th week.
Quantitative and qualitative usability test results at below.
Quantitative data: the median score of the SUS was 100 (IQR 100–100) representing good usability [22]. Participants agreed that the application was easy to use (USE/median easy to use score: 5.00, IQR 4.55–5.00) and would recommend the app to others. All participants agreed that the app was useful and satisfactory (USE/median satisfaction score: 4.88, IQR 4.95–5.0).
Qualitative data: during the face-to-face interviews, participants’ experience with the app during the 4–6-week period was discussed. All the participants reported that the app was very useful for hand rehabilitation. Three themes were identified from the narratives.
a) Learning and accuracy
Ten out of 17 participants perceived that the app was useful when it comes to learning the exercises and ensuring they were done correctly. Five individuals stated that after 2 weeks of using the app, they were able to perform the exercises without looking at the videos and only watched them if they forgot the movement or starting position. They felt that the videos helped them to do the exercises correctly with instructions that were easily understood.
One participant said ‘videos were so clear that I could distinguish the speed of movement and the direction of joint movement very well. Movement direction animations on the videos were also very convenient when making motion.’
Eight participants compared the benefits of using the app to traditional exercise leaflet and felt the application was very useful in learning the exercises. One participant said, “I received a physiotherapy home programme many times. I understood after my therapist showed me the exercises but then I forgot it. It was not possible to learn the exercise from the brochure, the app allowed me to both learn the exercises and do them safely.”
b) Ease of use
All participants reported that the application was easy to use in terms of the design and interface they stated that it was very easy to use from the first day and would be useful to other patients with hand RA.
c) Motivation and adherence: ten participants stated that the smartphone app intervention increased their motivation to exercise their hands. One participant advised, ‘I started to do regularly exercise thanks to the application. I want to continue this habit. I would like to use the app if there are exercises for my other joints too.’
They reported that exercise videos, reminders and notifications were their favorite features of the application. One participant said, ‘I get the warning that my exercise time is approaching before my training time, this is very useful for me, I do not have to plan or forget it at all.’
Another participant said, ‘Reminders and notifications are my favorite, I love that some notifications motivate me by saying ‘how about moving? have a nice day!’.
Discussion
The aim of our study is to develop a smartphone application for hand exercises for patients in Turkey with RA and to test its usability. A usable application has emerged with the two-stage process as design/development and usability stages. The design and development stage consisted of two phases. In the first phase, we conducted focus group interview to discuss the content, feature and design of the prototype app. Prototype app consisted of consent, outcome measures, exercise diary and hand exercises. We chose the exercises from the evidence-based SARAH hand exercise programme and adapted them for the mobile application. In phase 2, some notifications were added or modified in the revised version app. A short educational presentation which consisted of steps for using the app was added. Users with RA gave the app high usability scores. The application was found to be easy to use, useful and satisfactory. Our interviews showed that that the app was acceptable to people with hand RA. The app was particularly helpful in teaching patients could learn how to do the exercises correctly. Reminders, notifications, and videos were listed as the favorite features of the app. Participants used the app for different period of time. Some of them only used it for a week or two while others used it for a more extended period. Some of the participants stated that after 2 weeks of using the app, they learned the exercises and felt no need to look to the app. However, these participants still benefited from push-up notifications for reminding them to do their exercises. Use of the app decreased over time.
Previous studies
There are many apps available but few apps for arthritis have been designed by health professionals and patients using an iterative design and development method. Disease-specific applications which are easy to use can support the provision of rehabilitation for patients with long term conditions, such as RA. There are some latest well-designed smartphone applications for assessment of disease-related symptoms and functions [17,18,19]. However, to date, there are no smartphone exercise apps developed for adults with hand arthritis.
The present project was informed by the results of our previous study [7]. A web-based version of the SARAH programme had been developed previously (mySARAH) to support the performance of the home exercises and to reduce the number of hand therapy sessions. Seven out of eleven SARAH exercises were chosen from the evidence-based SARAH hand exercise programme with a few adaptations for the mobile app.
Strengths and limitations
We have conducted comprehensive testing with input from both therapists and patients unlike many apps that are developed for patients. Testing was over 4–6 weeks of use allowing users time to test it thoroughly. We also tested it across a range of different devices including both IOS ad Android systems. We included participants with a range of different education levels and age groups to ensure it was applicable to a diverse range of patients. A limitation of this study is that we did not assess performance of the exercises to check patients were performing them correctly and we do not know if including modifying the SARAH programme exercises for the mobile app results in the same clinical outcomes as the full SARAH programme. We think that it is very unlikely to affect clinical outcomes, since the change in the adapted exercise program is minimal. Another limitation of this study is that we had hoped to be able to monitor exercise adherence using user activation tracking system, but this would only be possible if patients continued to use the app. Although therapists find the user activation tracking system as beneficial to follow up their patients, it could be also helpful to use patient-reported exercise adherence outcome. Hence, we plan to add a tab to assess the adherence by patient-reported outcome.
Future studies
We have planned a randomized controlled trial which aims to determine the effectiveness of mobile app-based hand exercises for patients with hand RA. During the qualitative interviews, the participants were asked for their recommendations, and many participants suggested an application that included exercises for other joints as well (not just the hand). We plan to add exercises for other joints in our future study. Furthermore, it may be useful to compare web-based and mobile app-based exercise applications in future studies.
Conclusion
A hand exercise mobile app for people with RA was developed using mixed-method and iterative design. The high level of usability and user satisfaction supports the application’s utility. It has the potential to be used by health professionals to provide their patients with a personalized home-based exercise regimen, remote monitoring and support exercise adherence.
References
McInnes IB, Schett G (2011) The pathogenesis of rheumatoid arthritis. N Engl J Med 365(23):2205–2219. https://doi.org/10.1056/NEJMra1004965
Arab Alkabeya H, Hughes AM, Adams J (2019) Factors associated with hand and upper arm functional disability in people with rheumatoid arthritis: a systematic review. Arthritis Care Res (Hoboken) 71(11):1473–1481. https://doi.org/10.1002/acr.23784
Vliet Vlieland TP, van der Wijk TP, Jolie IM, Zwinderman AH, Hazes JM (1996) Determinants of hand function in patients with rheumatoid arthritis. J Rheumatol 23:835–840
Bodur H, Yilmaz O, Keskin D (2006) Hand disability and related variables in patients with rheumatoid arthritis. Rheumatol Int 26(6):541–544. https://doi.org/10.1007/s00296-005-0023-1
National Institute for Health and Clinical Excellence (NICE) (2018) Rheumatoid arthritis in adults: management. NICE Guideline 100. Available at: www.nice.org.uk/ng100. Accessed 20 Aug 2020
Lamb SE, Williamson EM, Heine PJ, Adams J, Dosanjh S, Dritsaki M, Glover MJ, Lord J, McConkey C, Nichols V, Rahman A (2015) Exercises to improve function of the rheumatoid hand (SARAH): a randomised controlled trial. Lancet 385(9966):421–429. https://doi.org/10.1016/S0140-6736(14)60998-3
Srikesavan C, Williamson E, Cranston T, Hunter J, Adams J, Lamb SE (2018) An online hand exercise intervention for adults with rheumatoid arthritis (mySARAH): design, development, and usability testing. J Med Internet Res 20(6):e10457. https://doi.org/10.2196/10457
WHO guideline: recommendations on digital interventions for health system strengthening. Geneva: World Health Organization; 2019. Licence: CC BY-NC-SA 3.0 IGO.
WHO Global Observatory for eHealth. (2011). mHealth: new horizons for health through mobile technologies: second global survey on eHealth. World Health Organization. https://apps.who.int/iris/handle/10665/44607. Accessed 20 Aug 2020
Peretti A, Amenta F, Tayebati SK, Nittari G, Mahdi SS (2017) Telerehabilitation: review of the state of the art and areas of application. JMIR Rehabil Assist Technol 4(2):e7. https://doi.org/10.2196/rehab.7511
Rogante M, Grigioni M, Cordella D, Giacomozzi C (2010) Ten years of telerehabilitation: a literatüre overview of technologies and clinical applications. Neurorehabilitation 27(4):287–304. https://doi.org/10.3233/NRE-2010-0612
Emmerson KB, Harding KE, Fong C, Taylor NF (2019) A resource analysis of the use of the video function of electronic devices for home exercise instruction in rehabilitation. Disabil Rehabil 17:1–5. https://doi.org/10.1080/09638288.2019.1663281
Maurits MP, Yuminaga H, Huizinga TWJ, Knevel R (2019) Mobile health applications in rheumatology: could they improve our care and research? Int J Clin Rheumatol 14(1):44–49. https://doi.org/10.4172/1758-4272.1000223
Argent R, Daly A, Caulfield B (2018) Patient involvement with home-based exercise programs: can connected health interventions influence adherence? JMIR Mhealth Uhealth 6(3):e47. https://doi.org/10.2196/mhealth.8518
Dicianno BE, Parmanto B, Fairman AD, Crytzer TM, Yu DX, Pramana G, Coughenour D, Petrazzi AA (2015) Perspectives on the evolution of mobile (mHealth) technologies and application to rehabilitation. Phys Ther 95(3):397–405. https://doi.org/10.2522/ptj.20130534
Rowland SP, Fitzgerald JE, Holme T, Powell J, McGregor A (2020) What is the clinical value of mHealth for patients? NPJ Digit Med 3:4. https://doi.org/10.1038/s41746-019-0206-x
Romeo A, Edney S, Plotnikoff R, Curtis R, Ryan J, Sanders I, Crozier A, Maher C (2019) Can smartphone apps increase physical activity? systematic review and meta-analysis. J Med Internet Res 21(3):e12053. https://doi.org/10.2196/12053
Machado GC, Pinheiro MB, Lee H, Ahmed OH, Hendrick P, Williams C, Kamper SJ (2016) Smartphone apps for the self-management of low back pain: a systematic review. Best Pract Res Clin Rheumatol 30(6):1098–1109. https://doi.org/10.1016/j.berh.2017.04.002
Schafer AGM, Zalpour C, von Piekartz H, Hall TM, Paelke V (2018) The efficacy of electronic health-supported home exercise interventions for patients with osteoarthritis of the knee: systematic review. J Med Internet Res 20(4):e152. https://doi.org/10.2196/jmir.9465
Voth EC, Oelke ND, Jung ME (2016) A theory-based exercise app to enhance exercise adherence: a pilot study. JMIR Mhealth Uhealth 4(2):e62. https://doi.org/10.2196/mhealth.4997
Azevedo R, Bernardes M, Fonseca J, Lima A (2015) Smartphone application for rheumatoid arthritis self-management: cross-sectional study revealed the usefulness, willingness to use and patients’ needs. Rheumatol Int 35(10):1675–1685. https://doi.org/10.1007/s00296-015-3270-9
Schnall R, Rojas M, Bakken S, Brown W, Carballo-Dieguez A, Carry M, Gelaude D, Mosley JP, Travers J (2016) A user-centered model for designing consumer mobile health (mHealth) applications (apps). J Biomed Inform 60:243–251. https://doi.org/10.1016/j.jbi.2016.02.002
Alwashmi MF, Hawboldt J, Davis E, Fetters MD (2019) The iterative convergent design for mobile health usability testing: mixed methods approach. JMIR Mhealth Uhealth 7(4):e11656. https://doi.org/10.2196/11656
Trotter RT 2nd (2012) Qualitative research sample design and sample size: resolving and unresolved issues and inferential imperatives. Prev Med 55(5):398–400. https://doi.org/10.1016/j.ypmed.2012.07.003
Faulkner L (2003) Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behav Res Methods Instrum Comput 35(3):379–383. https://doi.org/10.3758/bf03195514
Stonbraker S, Cho H, Hermosi G, Pichon A, Schnall R (2018) Usability testing of a mhealth app to support self-management of HIV-associated non-AIDS related symptoms. Stud Health Technol Inform 250:106–110
Usability.gov. Reporting usability test results URL:https://www.usability.gov/how-to-and-tools/methods/ reporting-usability-test-results.html [accessed 2018–07–29] [Website Cache ID 71HbqLiLc]
Broekhuis M, Velsen LV, Hermens H (2019) Assessing usability of eHealth technology: a comparison of usability benchmarking instruments. Int J Med Infor 128:4–31. https://doi.org/10.1016/j.ijmedinf.2019.05.001
Gao M, Kortum P, Oswald F (2018) Psychometric evaluation of the USE (usefulness, satisfaction, and ease of use) questionnaire for reliability and validity. Proc Hum Factors Ergon Soc Annu Meet 62(1):1414–1418. https://doi.org/10.1177/1541931218621322
Cai RA, Beste D, Chaplin H, Varakliotis S, Suffield L, Josephs F, Sen D, Wedderburn LR, Ioannou Y, Hailes S, Eleftheriou D (2017) Developing and evaluating jiapp: acceptability and usability of a smartphone app system to improve self-management in young people with juvenile idiopathic arthritis. JMIR Mhealth Uhealth 5(8):e121. https://doi.org/10.2196/mhealth.7229
QSR International (1999) NVivo Qualitative Data Analysis Software [Software]. Available from https://qsrinternational.com/nvivo/nvivo-products/
Braun V, Clarke V, Terry G (2014) Thematic analysis. In: Rohleder P, Lyons A (eds) Qualitative research in clinical and health psychology. Palgrave MacMillan, Basingstoke
Acknowledgements
We would like to thank the health professionals and study participants who contributed to this work.
Funding
This research was funded by The Scientific and Technological Research Council of Turkey, the SE2020 Translational Fund for Social Impact at the University of Oxford and the National Institute for Health Research Applied Research Collaboration Oxford and Thames Valley at Oxford Health NHS Foundation Trust and supported by the NIHR Biomedical Research Unit, Oxford. Marmara University, Scientific Research Projects Committee supported the study. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.
Author information
Authors and Affiliations
Contributions
ET, SL and EW conceived funding for the study. ET led the study team. SL was the senior author. ET, EW, CS, and SL contributed to the study design, and drafted and revised the manuscript. FS was involved in study recruitment and ethics approval process. TB and FS assisted in data collection, analysis, and technical works. All authors reviewed and approved the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
There are no conflicts of interest to declare.
Ethical approval
The study protocol was approved by the Clinical Research Ethics Committee of Marmara University Medical Faculty, Turkey (Number: 06.2019.577).
Informed consent
Informed consent was obtained from all participants.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Tonga, E., Williamson, E., Srikesavan, C. et al. A hand exercise mobile app for people with rheumatoid arthritis in Turkey: design, development and usability study. Rheumatol Int 41, 1151–1160 (2021). https://doi.org/10.1007/s00296-021-04860-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00296-021-04860-0