Validity and reliability of a performance evaluation tool based on the modified Barthel Index for stroke patients

Tomoko Ohura, Kimitaka Hase, Yoshie Nakajima, Takeo Nakayama, Tomoko Ohura, Kimitaka Hase, Yoshie Nakajima, Takeo Nakayama

Abstract

Background: The Barthel Index (BI) is a measure of independence in activities of daily living (ADL). In the modified Barthel Index (MBI), a five-point system replaced the original two or three or four point rating system. Based on this modified measure, the performance evaluation tool MBI (PET-MBI) was developed in Japan. Although the reliability and validity of PET-MBI have been verified for older people, the use of this tool in stroke patients has not been evaluated. This study investigated the validity and reliability of PET-MBI for stroke patients.

Methods: Ten raters independently determined the BI and PET-MBI scores of stroke patients by direct observation. These patients' ADL were videotaped, and 10 other raters then evaluated the videos privately and assigned PET-MBI scores twice, one month apart. The criterion-related validity of the PET-MBI against the BI was evaluated using the correlation coefficients for their total scores. Furthermore, to assess inter- and intra-rater reliabilities from the results of the first and second sessions, Fleiss' intraclass correlation coefficients (ICCs) were calculated for the total scores, with the lower limits of the 95% confidence interval (95%CI), along with weighted kappa (κw) coefficients for agreement in individual tasks of this evaluation tool. ICC and κw coefficients of 0.81-1.00 were considered to be "almost perfect" agreement.

Results: The mean age of the 30 patients (23 men, 7 women) was 71.9 (standard deviation 10.5) years. One patient had diplegia, 14 had right hemiplegia, and 15 had left hemiplegia. For the total scores obtained by direct evaluation, Pearson's and Spearman's correlation coefficients of the BI versus the PET-MBI were both 0.95 (lower limit of the 95%CI, 0.90). The ICC representing inter-rater reliability for the first session was 0.99 (lower limit of the 95%CI, 0.98]. For intra-rater reliability, the mean value of the ICCs was 0.99 (range, 0.99-1.00). For individual tasks of the PET-MBI, inter-rater κw coefficients for the first session ranged from 0.77 to 0.94, with intra-rater κw coefficients from 0.85 to 0.96.

Conclusions: PET-MBI showed strong criterion-related validity against the BI, with high reliabilities. This scoring system may become a convenient tool allowing anyone to assess ADL.

Keywords: Activities of daily living; Reliability; Stroke; Validity.

Conflict of interest statement

Ethics approval and consent to participate

Approval was obtained from the Ethics Committees of Seijoh University (Approval number: 2013C0018), the affiliated institutions of all authors, and the hospitals where video recording was conducted. All patients provided their informed consent.

Consent for publication

Not applicable.

Competing interests

This study was supported by Asahi Kasei Pharma Corporation.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

    1. Langhorne P, Bernhardt J, Kwakkel G. Stroke rehabilitation. Lancet. 2011;377:1693–1702. doi: 10.1016/S0140-6736(11)60325-5.
    1. Barnes MP, Ward AB. Oxford Handbook of Rehabilitation Medicine. Oxford: Oxford University Press; 2005.
    1. The Japan Stroke Society. The Joint Committee on Guidelines for the Management of Stroke . Japanese Guidelines for the Management of Stroke 2015. Tokyo: Kyowa Kikaku Ltd.; 2015.
    1. Mahoney FI, Barthel DW. Functional evaluation: the Barthel Index. Md State Med J. 1965;14:61–65.
    1. Shah S, Vanclay F, Cooper B. Improving the sensitivity of the Barthel Index for stroke rehabilitation. J Clin Epidemiol. 1989;42:703–709. doi: 10.1016/0895-4356(89)90065-6.
    1. Collin C, Wade DT, Davies S, Horne V. The Barthel ADL Index: a reliability study. Int Disabil Stud. 1988;10:61–63. doi: 10.3109/09638288809164103.
    1. Granger CV, Albrecht GL, Hamilton BB. Outcome of comprehensive medical rehabilitation: measurement by PULSES profile and the Barthel Index. Arch Phys Med Rehabil. 1979;60:145–154.
    1. Fortinsky RH, Granger CV, Seltzer GB. The use of functional assessment in understanding home care needs. Med Care. 1981;19:489–497. doi: 10.1097/00005650-198105000-00002.
    1. Granger CV, Hamilton BB, Keith RA, Zielezny M, Sherwin FS. Advances in functional assessment for medical rehabilitation. Top Geriatr Rehabil. 1986;1:59–74. doi: 10.1097/00013614-198604000-00007.
    1. Granger CV, Cotter AC, Hamilton BB, Fiedler RC, Hens MM. Functional assessment scales: a study of persons with multiple sclerosis. Arch Phys Med Rehabil. 1990;71:870–875.
    1. Chino N, Sonoda S, Domen K, Saitoh E, Kimura A. Stroke Impairment Assessment Set (SIAS): A new evaluation instrument for stroke patients. Japn J Rehabil Med. 1994;31:119–125. doi: 10.2490/jjrm1963.31.119.
    1. van Swieten JC, Koudstaal PJ, Visser MC, Schouten HJ, van Gijn J. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1988;19:604–607. doi: 10.1161/01.STR.19.5.604.
    1. Ohura T, Ishizaki T, Higashi T, Konishi K, Ishiguro R, Nakanishi K, et al. Reliability and validity tests of an evaluation tool based on the modified Barthel Index. Int J Ther Rehabil. 2011;18:422–428. doi: 10.12968/ijtr.2011.18.8.422.
    1. Ohura T, Higashi T, Ishizaki T, Nakayama T. Assessment of the validity and internal consistency of a performance evaluation tool based on the modified Barthel Index Japanese version for elderly people living at home. J Phys Ther Sci. 2014;26:1971–1974. doi: 10.1589/jpts.26.1971.
    1. National Institute of Neurological Disorders and Stroke Ad Hoc Committee. Whisnant JP, Basford JR, Bernstein EF, et al. Classification of cerebrovascular diseases III. Stroke. 1990;21:637–676. doi: 10.1161/01.STR.21.4.637.
    1. Ohta T, Waga S, Handa H, et al. New grading of level of disordered consciousness. No Shinkei Geka. 1974;2:623–627.
    1. Folstein MF, Folstein SE, McHugh PR. ‘Mini-mental state’. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189–198. doi: 10.1016/0022-3956(75)90026-6.
    1. Folstein MF, et al. (translated by M. Sugishita) Mini mental state examination – Japanese. Tokyo: Nihon Bunka Kagakusha Co., Ltd; 2012.
    1. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. doi: 10.2307/2529310.
    1. Goldstein LB, Samsa GP. Reliability of the National Institutes of Health Stroke Scale. Extension to non-neurologists in the context of a clinical trial. Stroke. 1997;28:307–310. doi: 10.1161/01.STR.28.2.307.
    1. Shinohara Y, Minematsu K, Amano T, Ohashi Y. Modified Rankin scale with expanded guidance scheme and interview questionnaire: interrater agreement and reproducibility of assessment. Cerebrovasc Dis. 2006;21:271–278. doi: 10.1159/000091226.
    1. Fricke J, Unsworth CA. Inter-rater reliability of the original and modified Barthel Index, and a comparison with the Functional Independence Measure. Aust Occup Ther J. 1996;43:22–29.
    1. Duncan PW, Jorgensen HS, Wade DT. Outcome measures in acute stroke trials: a systematic review and some recommendations to improve practice. Stroke. 2000;31:1429–1438. doi: 10.1161/01.STR.31.6.1429.

Source: PubMed

Sponsor e collaboratori

Condizioni mediche

Interventi farmacologici

3
Sottoscrivi