Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps

Muhamad Fadhil Mohamad Marzuki, Nor Azwany Yaacob, Najib Majdi Yaacob, Muhamad Fadhil Mohamad Marzuki, Nor Azwany Yaacob, Najib Majdi Yaacob

Abstract

Background: A mobile app is a programmed system designed to be used by a target user on a mobile device. The usability of such a system refers not only to the extent to which product can be used to achieve the task that it was designed for, but also its effectiveness and efficiency, as well as user satisfaction. The System Usability Scale is one of the most commonly used questionnaires used to assess the usability of a system. The original 10-item version of System Usability Scale was developed in English and thus needs to be adapted into local languages to assess the usability of a mobile apps developed in other languages.

Objective: The aim of this study is to translate and validate (with cross-cultural adaptation) the English System Usability Scale questionnaire into Malay, the main language spoken in Malaysia. The development of a translated version will allow the usability of mobile apps to be assessed in Malay.

Methods: Forward and backward translation of the questionnaire was conducted by groups of Malay native speakers who spoke English as their second language. The final version was obtained after reconciliation and cross-cultural adaptation. The content of the Malay System Usability Scale questionnaire for mobile apps was validated by 10 experts in mobile app development. The efficacy of the questionnaire was further probed by testing the face validity on 10 mobile phone users, followed by reliability testing involving 54 mobile phone users.

Results: The content validity index was determined to be 0.91, indicating good relevancy of the 10 items used to assess the usability of a mobile app. Calculation of the face validity index resulted in a value of 0.94, therefore indicating that the questionnaire was easily understood by the users. Reliability testing showed a Cronbach alpha value of .85 (95% CI 0.79-0.91) indicating that the translated System Usability Scale questionnaire is a reliable tool for the assessment of usability of a mobile app.

Conclusions: The Malay System Usability Scale questionnaire is a valid and reliable tool to assess the usability of mobile app in Malaysia.

Keywords: Malay; System Usability Scale; mobile app; questionnaire translation; questionnaire validation; usability.

Conflict of interest statement

Conflicts of Interest: None declared.

©Muhamad Fadhil Mohamad Marzuki, Nor Azwany Yaacob, Najib Majdi Yaacob. Originally published in JMIR Human Factors (http://humanfactors.jmir.org), 14.05.2018.

Figures

Figure 1
Figure 1
Flowchart of the validation process.

References

    1. Bert Fabrizio, Giacometti Marika, Gualano Maria Rosaria, Siliquini Roberta. Smartphones and health promotion: a review of the evidence. J Med Syst. 2014 Jan;38(1):9995–7. doi: 10.1007/s10916-013-9995-7.
    1. Usability Net. 1998. Jan 16, [2018-04-30]. Guidance on Usability .
    1. Martins A.I., Rosa A.F., Queirós A., Silva A., Rocha N.P. European Portuguese Validation of the System Usability Scale (SUS) Procedia Computer Science. 2015;67:293–300.
    1. Nielsen J. Nielsen Norman Group. 2012. Jan 16, [2018-04-30]. Usability 101: Introduction to Usability
    1. Lang T., Zrobok M. PeakXD. 2016. Dec 7, [2018-04-30]. Usability testing versus expert views: a comparison of usability evaluation methods .
    1. Bangor A., Kortum P.T., Miller J.T. An Empirical Evaluation of the System Usability Scale. International Journal of Human. 2008;24(6):574–594.
    1. Mifsud J. Usabilitygeek. 2016. Mar 21, [2018-04-30]. Usability Testing of Mobile Applications: A Step-By-Step Guide
    1. Spool J. User Interface Engineering. 2006. Mar 23, [2018-04-30]. Two Simple Post-Test Questions
    1. Brooke J. Journal of Usability Studies. Journal of Usability Studies; 2013. [2018-04-30]. SUS: A Retrospective
    1. Brooke J. SUS-A quick and dirty usability scale. Usability evaluation in industry. 1996;189(194):4–7.
    1. Zahra S., Budi S.H. An Indonesian adaptation of the System Usability Scale (SUS). International Conference in Advanced Computer Science and Information Systems (ICACSIS); 2016; Malang, Indonesia. IEEE; 2016.
    1. Sousa V.D., Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. Journal of Evaluation in Clinical Practice. 2011;17(2)
    1. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007 Aug;30(4):459–67. doi: 10.1002/nur.20199.
    1. Wan Nor Arifin. 2017. [2018-04-30]. Sample size calculator (Version 2)
    1. Davis L. Instrument review: Getting the most from a panel of experts. Applied Nursing Research. 1992;5(4):194–197.
    1. DeVon H.A., Block M.E., Moyle-Wright P., Ernst D.M., Hayden S.J., Lazzara D.J., Savoy S.M., Kostas-Polston E. A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh. 2007;39(2):155–64. doi: 10.1111/j.1547-5069.2007.00161.x.
    1. van Kuijk J., van Driel L., van Eijk D. Usability in product development practice; an exploratory case study comparing four markets. Appl Ergon. 2015 Mar;47:308–23. doi: 10.1016/j.apergo.2014.10.007.
    1. U.S. Department of Health & Human Services. Usability Evaluation Basic .
    1. Ivory M.Y., Marti A.H. The state of the art in automating usability evaluation of user interfaces. ACM Comput. Surv. ACM Computing Surveys. 2001 Dec;33(4):470–516.
    1. Epstein J., Santo R.M., Guillemin F. A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. J Clin Epidemiol. 2015 Apr;68(4):435–41. doi: 10.1016/j.jclinepi.2014.11.021.
    1. Bolarinwa O.A. Principles methods of validity reliability testing of questionnaires used in social health science researches. Niger Postgrad Med J. 2015;22(4):195–201.

Source: PubMed

Patrocinadores e Colaboradores

Condições médicas

Intervenções de drogas

3
Se inscrever