Evaluator Training and Reliability for SMA Global Nusinersen Trials1

Allan M Glanzman, Elena S Mazzone, Sally Dunaway Young, Richard Gee, Kristy Rose, Anna Mayhew, Leslie Nelson, Chris Yun, Katie Alexander, Basil T Darras, Zarazuela Zolkipli-Cunningham, Gihan Tennekoon, John W Day, Richard S Finkel, Eugenio Mercuri, Darryl C De Vivo, Ron Baldwin, Kathie M Bishop, Jacqueline Montes, Allan M Glanzman, Elena S Mazzone, Sally Dunaway Young, Richard Gee, Kristy Rose, Anna Mayhew, Leslie Nelson, Chris Yun, Katie Alexander, Basil T Darras, Zarazuela Zolkipli-Cunningham, Gihan Tennekoon, John W Day, Richard S Finkel, Eugenio Mercuri, Darryl C De Vivo, Ron Baldwin, Kathie M Bishop, Jacqueline Montes

Abstract

Background: Training methodology was established to optimize reliability of outcome measures in the nusinersen clinical trials. The Children's Hospital of Philadelphia Infant Test of Neuromuscular Disorders (CHOP INTEND), Hammersmith Functional Motor Scale Expanded (HFMSE), and Revised Upper Limb (RULM) were primary or secondary outcomes.

Methods: Video review, quarterly conference calls, and item scoring checks supported evaluator competence. Baseline and screening along with video review established intra and inter-rater reliability.

Results: Inter and intra-rater reliability were both excellent. Intraclass correlation coefficients (ICC) ranged between 0.906-0.994 across initial training meetings and 0.824-0.996 across annual retraining meetings. This was similar for CHOP INTEND (ICC = 0.824-0.951), HFMSE (ICC = 0.981-0.996), and RULM (ICC = 0.966-0.990). Intra-rater reliability for the CHOP INTEND, HFMSE, and RULM were ICC = 0.895 (95% CI: 0.852-0.926; n = 116), ICC = 0.959 (95% CI: 0.942-0.971; n = 125), and ICC = 0.948 (95% CI: 0.927-0.963; n = 126) respectively.

Conclusions: Rigorous evaluator training ensures reliability of assessment of subjects with spinal muscular atrophy (SMA) in multicenter international trials.

Keywords: SMA; multicenter; nusinersen; outcome assessment; outcome measures; reliability of results; spinal muscular atrophy; studies.

Figures

Fig.1
Fig.1
Training Methodology.

References

    1. Finkel RS, McDermott MP, Kaufmann P, Darras BT, Chung WK, Sproule DM, et al. Observational study of spinal muscular atrophy type I and implications for clinical trials. Neurology. 2014;83(9):810–7.
    1. Kaufmann P, McDermott MP, Darras BT, Finkel RS, Sproule DM, Kang PB, et al. Prospective cohort study of spinalmuscular atrophy types 2 and 3. Neurology. 2012;79(18):1889–97.
    1. Darras BTSpinal muscular atrophies. Pediatr Clin North Am. 2015;62(3):743–66.
    1. Glanzman AM, O’Hagen JM, McDermott MP, Martens WB, Flickinger J, Riley S, et al. Validation of the Expanded Hammersmith Functional Motor Scale in spinal muscular atrophy type II and III. J Child Neurol. 2011;26(12):1499–507.
    1. Mazzone ES, Mayhew A, Montes J, Ramsey D, Fanelli L, Dunaway Young S, et al. Revised upper limb module for spinal muscular atrophy: Development of a new module. Muscle Nerve 2016.
    1. Weir JPQuantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19(1):231–40.
    1. Rigo F, Hua Y, Krainer AR, Bennett CFAntisense-based therapy for the treatment of spinal muscular atrophy. J Cell Biol. 2012;199(1):21–5.
    1. Finkel RS, Mercuri E, Darras BT, Connolly AM, Kuntz NL, Kirschner J, et al. Nusinersen versus Sham Control in Infantile-Onset Spinal Muscular Atrophy. N Engl J Med. 2017;377(18):1723–32.
    1. Chiriboga CA, Swoboda KJ, Darras BT, Iannaccone ST, Montes J, De Vivo DC, et al. Results from a phase 1 study of nusinersen (ISIS-SMN(Rx)) in children with spinal muscular atrophy. Neurology. 2016;86(10):890–7.
    1. [cited 2018 April 12].
    1. Accessed: May 19, 2017.
    1. Accessed: May 19, 2017.
    1. Finkel R, Chiriboga C, Vajsar J, Day J, Montes J, De Vivo D, et al. Interim Results of a Phase 2 Clinical Study of Nusinersen (ISIS-SMNRx) in Patients with Infantile-Onset Spinal Muscular Atrophy. Annals Of Neurology. 2016;80(20):S370–S1.
    1. Glanzman AM, Mazzone E, Main M, Pelliccioni M, Wood J, Swoboda KJ, et al. The Children’s Hospital of Philadelphia Infant Test of Neuromuscular Disorders (CHOP INTEND): Test development and reliability. Neuromuscul Disord. 2010;20(3):155–61.
    1. O’Hagen JM, Glanzman AM, McDermott MP, Ryan PA, Flickinger J, Quigley J, et al. An expanded version of the Hammersmith Functional Motor Scale for SMA II and III patients. Neuromuscul Disord. 2007;17(9-10):693–7.

Source: PubMed

スポンサーと協力者

医学的状態

薬物療法

3
購読する