Spanish Version of the System Usability Scale for the Assessment of Electronic Tools: Development and Validation

Magdalena Del Rocio Sevilla-Gonzalez, Lizbeth Moreno Loaeza, Laura Sofia Lazaro-Carrera, Brigette Bourguet Ramirez, Anabel Vázquez Rodríguez, María Luisa Peralta-Pedrero, Paloma Almeda-Valdes, Magdalena Del Rocio Sevilla-Gonzalez, Lizbeth Moreno Loaeza, Laura Sofia Lazaro-Carrera, Brigette Bourguet Ramirez, Anabel Vázquez Rodríguez, María Luisa Peralta-Pedrero, Paloma Almeda-Valdes

Abstract

Background: The System Usability Scale (SUS) is a common metric used to assess the usability of a system, and it was initially developed in English. The implementation of electronic systems for clinical counseling (eHealth and mobile health) is increasing worldwide. Therefore, tools are needed to evaluate these applications in the languages and regional contexts in which the electronic tools are developed.

Objective: This study aims to translate, culturally adapt, and validate the original English version of the SUS into a Spanish version.

Methods: The translation process included forward and backward translation. Forward translations were made by 2 native Spanish speakers who spoke English as their second language, and a backward translation was made by a native English speaker. The Spanish SUS questionnaire was validated by 10 experts in mobile app development. The face validity of the questionnaire was tested with 10 mobile phone users, and the reliability testing was conducted among 88 electronic application users.

Results: The content validity index of the new Spanish SUS was good, as indicated by a rating of 0.92 for the relevance of the items. The questionnaire was easy to understand, based on a face validity index of 0.94. The Cronbach α was .812 (95% CI 0.748-0.866; P<.001).

Conclusions: The new Spanish SUS questionnaire is a valid and reliable tool to assess the usability of electronic tools among Spanish-speaking users.

Keywords: Spanish; System Usability Scale; mHealth; usability; validation.

Conflict of interest statement

Conflicts of Interest: None declared.

©Magdalena Del Rocio Sevilla-Gonzalez, Lizbeth Moreno Loaeza, Laura Sofia Lazaro-Carrera, Brigette Bourguet Ramirez, Anabel Vázquez Rodríguez, María Luisa Peralta-Pedrero, Paloma Almeda-Valdes. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 16.12.2020.

References

    1. World Health Organization. Geneva, Switzerland: WHO Press; 2011. [2020-12-08]. mHealth: New horizons for health through mobile technologies. Global Observatory for eHealth series - Volume 3. .
    1. Maramba I, Chatterjee A, Newman C. Methods of usability testing in the development of eHealth applications: A scoping review. Int J Med Inform. 2019 Jun;126:95–104. doi: 10.1016/j.ijmedinf.2019.03.018.
    1. Ramírez L, Guillen E, Cifuentes Y. Estrategia de validación para aplicaciones móviles de salud. Validation strategy to mobile health applications. Actas de Ingeniería. 2016;2:325–333.
    1. Vera F, Noël R, Taramasco C. Studies in Health Technology and Informatics. Vol 26. Amsterdam, Netherlands: IOS Press; 2019. Standards, processes and instruments for assessing usability of health mobile apps: A systematic literature review; pp. 1767–1798.
    1. Process of translation and adaptation of instruments. World Health Organization. [2020-12-04].
    1. Barajas-Bustillos MA, Maldonado-Macías A, Reyes-Martinez RM, García-Alcaraz JL, Hernández Arellano JL, Avelar Sosa L. Design and validation of a questionnaire in Spanish language for software usability evaluation. Work. 2019;64(3):453–459. doi: 10.3233/WOR-193007.
    1. International standards for HCI and usability. UsabilityNet. 2018. [2020-03-18]. .
    1. Zhou L, Bao J, Setiawan IMA, Saptono A, Parmanto B. The mHealth App Usability Questionnaire (MAUQ): Development and Validation Study. JMIR Mhealth Uhealth. 2019 Apr 11;7(4):e11500. doi: 10.2196/11500.
    1. Brooke J. SUS - A quick and dirty usability scale. Usability Eval Ind. 1996;189(194):4–7.
    1. Martins AI, Rosa AF, Queirós A, Silva A, Rocha NP. European Portuguese Validation of the System Usability Scale (SUS) Procedia Comput Sci. 2015;67:293–300. doi: 10.1016/j.procs.2015.09.273.
    1. Sharfina Z, Santoso H. An Indonesian adaptation of the System Usability Scale (SUS). 2016 International Conference on Advanced Computer Science and Information Systems (ICACSIS); Oct 15-16, 2016; Malang, Indonesia. 2016.
    1. Mohamad Marzuki MF, Yaacob NA, Yaacob NM. Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps. JMIR Hum Factors. 2018 May 14;5(2):e10308. doi: 10.2196/10308.
    1. System Usability Scale (SUS) . 2020. [2020-09-11]. .
    1. Brooke J. SUS : A Retrospective. J Usability Stud. 2013;8(2):29–40. doi: 10.5555/2817912.2817913.
    1. Bangor A, Kortum PT, Miller JT. An Empirical Evaluation of the System Usability Scale. Int J Human Comput Interact. 2008 Jul 30;24(6):574–594. doi: 10.1080/10447310802205776.
    1. Lewis JR, Sauro J. The Factor Structure of the System Usability Scale. In: Kurosu M, editor. Human Centered Design: Lecture Notes in Computer Science. Vol 5619. Berlin, Germany: Springer; 2009. pp. 94–103.
    1. Ortiz-Gutiérrez S, Cruz-Avelar A. Translation and Cross-Cultural Adaptation of Health Assessment Tools. Actas Dermo-Sifiliográficas. 2018 Apr;109(3):202–206. doi: 10.1016/j.ad.2017.09.012.
    1. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007 Aug;30(4):459–67. doi: 10.1002/nur.20199.
    1. Bonett DG. Sample Size Requirements for Testing and Estimating Coefficient Alpha. J Educ Behav Stat. 2016 Nov 23;27(4):335–340. doi: 10.3102/10769986027004335.
    1. Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, Bouter LM, de Vet HCW. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007 Jan;60(1):34–42. doi: 10.1016/j.jclinepi.2006.03.012.

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera