The intra- and inter-rater reliability of five clinical muscle performance tests in patients with and without neck pain

Tina Juul, Henning Langberg, Flemming Enoch, Karen Søgaard, Tina Juul, Henning Langberg, Flemming Enoch, Karen Søgaard

Abstract

Background: This study investigates the reliability of muscle performance tests using cost- and time-effective methods similar to those used in clinical practice. When conducting reliability studies, great effort goes into standardising test procedures to facilitate a stable outcome. Therefore, several test trials are often performed. However, when muscle performance tests are applied in the clinical setting, clinicians often only conduct a muscle performance test once as repeated testing may produce fatigue and pain, thus variation in test results. We aimed to investigate whether cervical muscle performance tests, which have shown promising psychometric properties, would remain reliable when examined under conditions similar to those of daily clinical practice.

Methods: The intra-rater (between-day) and inter-rater (within-day) reliability was assessed for five cervical muscle performance tests in patients with (n = 33) and without neck pain (n = 30). The five tests were joint position error, the cranio-cervical flexion test, the neck flexor muscle endurance test performed in supine and in a 45°-upright position and a new neck extensor test.

Results: Intra-rater reliability ranged from moderate to almost perfect agreement for joint position error (ICC ≥ 0.48-0.82), the cranio-cervical flexion test (ICC ≥ 0.69), the neck flexor muscle endurance test performed in supine (ICC ≥ 0.68) and in a 45°-upright position (ICC ≥ 0.41) with the exception of a new test (neck extensor test), which ranged from slight to moderate agreement (ICC = 0.14-0.41). Likewise, inter-rater reliability ranged from moderate to almost perfect agreement for joint position error (ICC ≥ 0.51-0.75), the cranio-cervical flexion test (ICC ≥ 0.85), the neck flexor muscle endurance test performed in supine (ICC ≥ 0.70) and in a 45°-upright position (ICC ≥ 0.56). However, only slight to fair agreement was found for the neck extensor test (ICC = 0.19-0.25).

Conclusions: Intra- and inter-rater reliability ranged from moderate to almost perfect agreement with the exception of a new test (neck extensor test), which ranged from slight to moderate agreement. The significant variability observed suggests that tests like the neck extensor test and the neck flexor muscle endurance test performed in a 45°-upright position are too unstable to be used when evaluating neck muscle performance.

Figures

Figure 1
Figure 1
Start position for the joint position sense test.
Figure 2
Figure 2
The cranio-cervical flexion test.
Figure 3
Figure 3
The neck muscle endurance test performed in supine.
Figure 4
Figure 4
The neck muscle endurance test performed in 45°-upright position (A) and (B).
Figure 5
Figure 5
The neck extensor test.

References

    1. Hogg-Johnson S, van der Velde G, Carroll LJ, Holm LW, Cassidy JD, Guzman J, Cote P, Haldeman S, Ammendolia C, Carragee E. The burden and determinants of neck pain in the general population: results of the bone and joint decade 2000–2010 task force on neck pain and its associated disorders. Spine (Phila Pa 1976) 2008;33:S39–S51. doi: 10.1097/BRS.0b013e31816454c8.
    1. Ihlebaek C, Brage S, Eriksen HR. Health complaints and sickness absence in Norway, 1996–2003. Occup Med (Lond) 2007;57:43–49.
    1. Nakamura M, Nishiwaki Y, Ushida T, Toyama Y. Prevalence and characteristics of chronic musculoskeletal pain in Japan. J Orthop Sci. 2011;16:424–432. doi: 10.1007/s00776-011-0102-y.
    1. Lotters F, Burdorf A. Prognostic factors for duration of sickness absence due to musculoskeletal disorders. Clin J Pain. 2006;22:212–221. doi: 10.1097/01.ajp.0000154047.30155.72.
    1. IJ W, Burdorf A. Risk factors for musculoskeletal symptoms and ensuing health care use and sick leave. Spine (Phila Pa 1976) 2005;30:1550–1556. doi: 10.1097/01.brs.0000167533.83154.28.
    1. Hansson EK, Hansson TH. The costs for persons sick-listed more than one month because of low back or neck problems. A two-year prospective study of Swedish patients. Eur Spine J. 2005;14:337–345. doi: 10.1007/s00586-004-0731-3.
    1. Daffner SD, Hilibrand AS, Hanscom BS, Brislin BT, Vaccaro AR, Albert TJ. Impact of neck and arm pain on overall health status. Spine (Phila Pa 1976) 2003;28:2030–2035. doi: 10.1097/01.BRS.0000083325.27357.39.
    1. Wallin MK, Raak RI. Quality of life in subgroups of individuals with whiplash-associated disorders. Eur J Pain. 2008;12:842–849. doi: 10.1016/j.ejpain.2007.12.008.
    1. Barton PM, Hayes KC. Neck flexor muscle strength, efficiency, and relaxation times in normal subjects and subjects with unilateral neck pain and headache. Arch Phys Med Rehabil. 1996;77:680–687. doi: 10.1016/S0003-9993(96)90008-8.
    1. Chiu TT, Sing KL. Evaluation of cervical range of motion and isometric neck muscle strength: reliability and validity. Clin Rehabil. 2002;16:851–858. doi: 10.1191/0269215502cr550oa.
    1. Falla D, Farina D. Neural and muscular factors associated with motor impairment in neck pain. Curr Rheumatol Rep. 2007;9:497–502. doi: 10.1007/s11926-007-0080-4.
    1. Falla DL, Jull GA, Hodges PW. Patients with neck pain demonstrate reduced electromyographic activity of the deep cervical flexor muscles during performance of the craniocervical flexion test. Spine (Phila Pa 1976) 2004;29:2108–2114. doi: 10.1097/01.brs.0000141170.89317.0e.
    1. Ylinen J, Salo P, Nykanen M, Kautiainen H, Hakkinen A. Decreased isometric neck strength in women with chronic neck pain and the repeatability of neck strength measurements. Arch Phys Med Rehabil. 2004;85:1303–1308. doi: 10.1016/j.apmr.2003.09.018.
    1. Lee H, Nicholson LL, Adams RD, Bae SS. Proprioception and rotation range sensitization associated with subclinical neck pain. Spine (Phila Pa 1976) 2005;30:E60–E67. doi: 10.1097/01.brs.0000152160.28052.a2.
    1. Sjolander P, Michaelson P, Jaric S, Djupsjobacka M. Sensorimotor disturbances in chronic neck pain–range of motion, peak velocity, smoothness of movement, and repositioning acuity. Man Ther. 2008;13:122–131. doi: 10.1016/j.math.2006.10.002.
    1. Sterling M, Jull G, Vicenzino B, Kenardy J, Darnell R. Development of motor system dysfunction following whiplash injury. Pain. 2003;103:65–73. doi: 10.1016/S0304-3959(02)00420-7.
    1. Treleaven J, Jull G, Sterling M. Dizziness and unsteadiness following whiplash injury: characteristic features and relationship with cervical joint position error. J Rehabil Med. 2003;35:36–43. doi: 10.1080/16501970306109.
    1. Falla D, Jull G, Russell T, Vicenzino B, Hodges P. Effect of neck exercise on sitting posture in patients with chronic neck pain. Phys Ther. 2007;87:408–417. doi: 10.2522/ptj.20060009.
    1. Hurwitz EL, Carragee EJ, van der Velde G, Carroll LJ, Nordin M, Guzman J, Peloso PM, Holm LW, Cote P, Hogg-Johnson S. Treatment of neck pain: noninvasive interventions: results of the bone and joint decade 2000–2010 task force on neck pain and its associated disorders. Spine (Phila Pa 1976) 2008;33:S123–S152. doi: 10.1097/BRS.0b013e3181644b1d.
    1. Jull G, Falla D, Treleaven J, Hodges P, Vicenzino B. Retraining cervical joint position sense: the effect of two exercise regimes. J Orthop Res. 2007;25:404–412. doi: 10.1002/jor.20220.
    1. Jull GA, Falla D, Vicenzino B, Hodges PW. The effect of therapeutic exercise on activation of the deep cervical flexor muscles in people with chronic neck pain. Man Ther. 2009;14:696–701. doi: 10.1016/j.math.2009.05.004.
    1. Viljanen M, Malmivaara A, Uitti J, Rinne M, Palmroos P, Laippala P. Effectiveness of dynamic muscle training, relaxation training, or ordinary activity for chronic neck pain: randomised controlled trial. BMJ. 2003;327:475. doi: 10.1136/bmj.327.7413.475.
    1. Ylinen J, Hakkinen A, Nykanen M, Kautiainen H, Takala EP. Neck muscle training in the treatment of chronic neck pain: a three-year follow-up study. Eura Medicophys. 2007;43:161–169.
    1. De Koning CH, van den Heuvel SP, Staal JB, Smits-Engelsman BC, Hendriks EJ. Clinimetric evaluation of methods to measure muscle functioning in patients with non-specific neck pain: a systematic review. BMC Musculoskelet Disord. 2008;9:142. doi: 10.1186/1471-2474-9-142.
    1. Edmondston SJ, Wallumrod ME, Macleid F, Kvamme LS, Joebges S, Brabham GC. Reliability of isometric muscle endurance tests in subjects with postural neck pain. J Manipulative Physiol Ther. 2008;31:348–354. doi: 10.1016/j.jmpt.2008.04.010.
    1. Grimmer K. Measuring endurance capacity of the cervical short flexor muscle group. Aust J Physiother. 1994;40:251–254.
    1. Harris KD, Heer DM, Roy TC, Santos DM, Whitman JM, Wainner RS. Reliability of a measurement of neck flexor muscle endurance. Phys Ther. 2005;85:1349–1355.
    1. Jull G. Deep cervical flexor muscle dysfunction in whiplash. J Muscoskel Pain. 2000;8:12.
    1. Jull G, Barrett C, Magee R, Ho P. Further clinical clarification of the muscle dysfunction in cervical headache. Cephalalgia. 1999;19:179–185. doi: 10.1046/j.1468-2982.1999.1903179.x.
    1. Jull GA, O’Leary SP, Falla DL. Clinical assessment of the deep cervical flexor muscles: the craniocervical flexion test. J Manipulative Physiol Ther. 2008;31:525–533. doi: 10.1016/j.jmpt.2008.08.003.
    1. Kristjansson E, Hardardottir L, Asmundardottir M, Gudmundsson K. A new clinical test for cervicocephalic kinesthetic sensibility: “the fly”. Arch Phys Med Rehabil. 2004;85:490–495. doi: 10.1016/S0003-9993(03)00619-1.
    1. Revel M, Andre-Deshays C, Minguet M. Cervicocephalic kinesthetic sensibility in patients with cervical pain. Arch Phys Med Rehabil. 1991;72:288–291.
    1. Rix GD, Bagust J. Cervicocephalic kinesthetic sensibility in patients with chronic, nontraumatic cervical spine pain. Arch Phys Med Rehabil. 2001;82:911–919. doi: 10.1053/apmr.2001.23300.
    1. Arumugam A, Mani R, Raja K. Interrater reliability of the craniocervical flexion test in asymptomatic individuals–a cross-sectional study. J Manipulative Physiol Ther. 2011;34:247–253. doi: 10.1016/j.jmpt.2011.04.011.
    1. Chiu TT, Law EY, Chiu TH. Performance of the craniocervical flexion test in subjects with and without chronic neck pain. J Orthop Sports Phys Ther. 2005;35:567–571. doi: 10.2519/jospt.2005.35.9.567.
    1. Hudswell SVMM, Lucas N. The cranio-cervical flexion test using pressure biofeedback : a useful measure of cervical dysfunction in the clinical setting? Int J Osteopath Med. 2005;8:98–105. doi: 10.1016/j.ijosm.2005.07.003.
    1. James G, Doe T. The craniocervical flexion test: intra-tester reliability in asymptomatic subjects. Physiother Res Int. 2010;15:144–149. doi: 10.1002/pri.456.
    1. Blizzard L, Grimmer KA, Dwyer T. Validity of a measure of the frequency of headaches with overt neck involvement, and reliability of measurement of cervical spine anthropometric and muscle performance factors. Arch Phys Med Rehabil. 2000;81:1204–1210. doi: 10.1053/apmr.2000.7168.
    1. Horneij E, Holmström E, Hemborg B, Isberg P, Ekdahl C. Inter-rater reliability and between-days repeatability of eight physical performance tests. Adv Physiol Educ. 2002;4:146–160.
    1. Olson LE, Millar AL, Dunker J, Hicks J, Glanz D. Reliability of a clinical test for deep cervical flexor endurance. J Manipulative Physiol Ther. 2006;29:134–138. doi: 10.1016/j.jmpt.2005.12.009.
    1. Wang WT, Olson SL, Campbell AH, Hanten WP, Gleeson PB. Effectiveness of physical therapy for patients with neck pain: an individualized approach using a clinical decision-making algorithm. Am J Phys Med Rehabil. 2003;82:203–218. quiz 219–221.
    1. Cleland JA, Childs JD, Fritz JM, Whitman JM. Interrater reliability of the history and physical examination in patients with mechanical neck pain. Arch Phys Med Rehabil. 2006;87:1388–1395. doi: 10.1016/j.apmr.2006.06.011.
    1. Domenech MA, Sizer PS, Dedrick GS, McGalliard MK, Brismee JM. The deep neck flexor endurance test: normative data scores in healthy adults. PMR. 2011;3:105–110.
    1. Kumbhare DA, Balsor B, Parkinson WL, Harding Bsckin P, Bedard M, Papaioannou A, Adachi JD. Measurement of cervical flexor endurance following whiplash. Disabil Rehabil. 2005;27:801–807. doi: 10.1080/09638280400020615.
    1. Heikkila HV, Wenngren BI. Cervicocephalic kinesthetic sensibility, active range of cervical motion, and oculomotor function in patients with whiplash injury. Arch Phys Med Rehabil. 1998;79:1089–1094. doi: 10.1016/S0003-9993(98)90176-9.
    1. Lee HY, Wang JD, Yao G, Wang SF. Association between cervicocephalic kinesthetic sensibility and frequency of subclinical neck pain. Man Ther. 2008;13:419–425. doi: 10.1016/j.math.2007.04.001.
    1. Roren A, Mayoux-Benhamou MA, Fayad F, Poiraudeau S, Lantz D, Revel M. Comparison of visual and ultrasound based techniques to measure head repositioning in healthy and neck-pain subjects. Man Ther. 2009;14:270–277. doi: 10.1016/j.math.2008.03.002.
    1. Treleaven J, LowChoy N, Darnell R, Panizza B, Brown-Rothwell D, Jull G. Comparison of sensorimotor disturbance between subjects with persistent whiplash-associated disorder and subjects with vestibular pathology associated with acoustic neuroma. Arch Phys Med Rehabil. 2008;89:522–530. doi: 10.1016/j.apmr.2007.11.002.
    1. Kristjansson E, Dall’Alba P, Jull G. Cervicocephalic kinaesthesia: reliability of a new test approach. Physiother Res Int. 2001;6:224–235. doi: 10.1002/pri.230.
    1. Pinsault N, Fleury A, Virone G, Bouvier B, Vaillant J, Vuillerme N. Test-retest reliability of cervicocephalic relocation test to neutral head position. Physiother Theory Pract. 2008;24:380–391. doi: 10.1080/09593980701884824.
    1. Swait G, Rushton AB, Miall RC, Newell D. Evaluation of cervical proprioceptive function: optimizing protocols and comparison between tests in normal subjects. Spine (Phila Pa 1976) 2007;32:E692–E701. doi: 10.1097/BRS.0b013e31815a5a1b.
    1. Kramer M, Honold M, Hohl K, Bockholt U, Rettig A, Elbel M, Dehner C. Reliability of a new virtual reality test to measure cervicocephalic kinaesthesia. J Electromyogr Kinesiol. 2009;19:e353–e361. doi: 10.1016/j.jelekin.2008.05.005.
    1. Strimpakos N, Sakellari V, Gioftsos G, Kapreli E, Oldham J. Cervical joint position sense: an intra- and inter-examiner reliability study. Gait Posture. 2006;23:22–31. doi: 10.1016/j.gaitpost.2004.11.019.
    1. Humphreys BK. Cervical outcome measures: testing for postural stability and balance. J Manipulative Physiol Ther. 2008;31:540–546. doi: 10.1016/j.jmpt.2008.08.007.
    1. Falla D, Jull G, Hodges PW. Feedforward activity of the cervical flexor muscles during voluntary arm movements is delayed in chronic neck pain. Exp Brain Res. 2004;157:43–48. doi: 10.1007/s00221-003-1814-9.
    1. Ljungquist T, Harms-Ringdahl K, Nygren A, Jensen I. Intra- and inter-rater reliability of an 11-test package for assessing dysfunction due to back or neck pain. Physiother Res Int. 1999;4:214–232. doi: 10.1002/pri.167.
    1. Elliott J, Jull G, Noteboom JT, Darnell R, Galloway G, Gibbon WW. Fatty infiltration in the cervical extensor muscles in persistent whiplash-associated disorders: a magnetic resonance imaging analysis. Spine (Phila Pa 1976) 2006;31:E847–E855. doi: 10.1097/01.brs.0000240841.07050.34.
    1. Kahkeshani K, Ward PJ. Connection between the spinal dura mater and suboccipital musculature: evidence for the myodural bridge and a route for its dissection–a review. Clin Anat. 2012;25:415–422. doi: 10.1002/ca.21261.
    1. McPartland J, Brodeur RR, Hallgren RC. Chronic neck pain, standing balance, and suboccipital muscle atrophy–a pilot study. J Manipulative Physiol Ther. 2005;20:24–29.
    1. Rezasoltani A, Ali-Reza A, Khosro KK, Abbass R. Preliminary study of neck muscle size and strength measurements in females with chronic non-specific neck pain and healthy control subjects. Man Ther. 2010;15:400–403. doi: 10.1016/j.math.2010.02.010.
    1. De Vet HC, Terwee CB, Knol DL, Bouter LM. When to use agreement versus reliability measures. J Clin Epidemiol. 2006;59:1033–1039. doi: 10.1016/j.jclinepi.2005.10.015.
    1. Enoch F, Kjaer P, Elkjaer A, Remvig L, Juul-Kristensen B. Inter-examiner reproducibility of tests for lumbar motor control. BMC Musculoskelet Disord. 2011;12:114. doi: 10.1186/1471-2474-12-114.
    1. Protocol Formats for Diagnostic Procedures in Manual/Musculoskeletal Medicine. .
    1. Rubinstein SM, Pool JJ, Van Tulder MW, Riphagen II, de Vet HC II. A systematic review of the diagnostic accuracy of provocative tests of the neck for diagnosing cervical radiculopathy. Eur Spine J. 2007;16:307–319. doi: 10.1007/s00586-006-0225-6.
    1. Rubinstein SM, Van Tulder M. A best-evidence review of diagnostic procedures for neck and low-back pain. Best Pract Res Clin Rheumatol. 2008;22:471–482. doi: 10.1016/j.berh.2007.12.003.
    1. Vernon H, Mior S. The neck disability index: a study of reliability and validity. J Manipulative Physiol Ther. 1991;14:409–415.
    1. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, De Vet HC. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19:539–549. doi: 10.1007/s11136-010-9606-8.
    1. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–310.
    1. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. doi: 10.2307/2529310.
    1. Terwee CB, Bot SD, De Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, De Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42. doi: 10.1016/j.jclinepi.2006.03.012.
    1. Teng CC, Chai H, Lai DM, Wang SF. Cervicocephalic kinesthetic sensibility in young and middle-aged adults with or without a history of mild neck pain. Man Ther. 2007;12:22–28. doi: 10.1016/j.math.2006.02.003.
    1. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, De Vet HC. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63:737–745. doi: 10.1016/j.jclinepi.2010.02.006.
    1. Hamberg-van Reenen HH, van der Beek AJ, Blatter BM, Van Mechelen W, Bongers PM. Age-related differences in muscular capacity among workers. Int Arch Occup Environ Health. 2009;82:1115–1121. doi: 10.1007/s00420-009-0407-8.
    1. Falla D, O’Leary S, Farina D, Jull G. The change in deep cervical flexor activity after training is associated with the degree of pain reduction in patients with chronic neck pain. Clin J Pain. 2012;28:628–634. doi: 10.1097/AJP.0b013e31823e9378.
    1. Lindstrom R, Schomacher J, Farina D, Rechter L, Falla D. Association between neck muscle coactivation, pain, and strength in women with neck pain. Man Ther. 2011;16:80–86. doi: 10.1016/j.math.2010.07.006.
    1. Falla D, Jull G, Hodges P, Vicenzino B. An endurance-strength training regime is effective in reducing myoelectric manifestations of cervical flexor muscle fatigue in females with chronic neck pain. Clin Neurophysiol. 2006;117:828–837. doi: 10.1016/j.clinph.2005.12.025.
    1. Strimpakos N. The assessment of the cervical spine. Part 1: range of motion and proprioception. J Bodyw Mov Ther. 2011;15:114–124. doi: 10.1016/j.jbmt.2009.06.003.

Source: PubMed

3
購読する