Minimal important difference and patient acceptable symptom state for pain, Constant-Murley score and Simple Shoulder Test in patients with subacromial pain syndrome

Kari Kanto, Tuomas Lähdeoja, Mika Paavola, Pasi Aronen, Teppo L N Järvinen, Jarkko Jokihaara, Clare L Ardern, Teemu V Karjalainen, Simo Taimela, Kari Kanto, Tuomas Lähdeoja, Mika Paavola, Pasi Aronen, Teppo L N Järvinen, Jarkko Jokihaara, Clare L Ardern, Teemu V Karjalainen, Simo Taimela

Abstract

Background: The results of clinical trials should be assessed for both statistical significance and importance of observed effects to patients. Minimal important difference (MID) is a threshold denoting a difference that is important to patients. Patient acceptable symptom state (PASS) is a threshold above which patients feel well.

Objective: To determine MID and PASS for common outcome instruments in patients with subacromial pain syndrome (SAPS).

Methods: We used data from the FIMPACT trial, a randomised controlled trial of treatment for SAPS that included 193 patients. The outcomes were shoulder pain at rest and on arm activity, both measured with the 0-100 mm visual analogue scale (VAS), the Constant-Murley score (CS), and the Simple Shoulder Test (SST). The transition question was a five-point global rating of change. We used three anchor-based methods to determine the MID for improvement: the receiver operating characteristic (ROC) curve, the mean difference of change and the mean change methods. For the PASS, we used the ROC and 75th percentile methods and calculated estimates using two different anchor question thresholds.

Results: Different MID methods yielded different estimates. The ROC method yielded the smallest estimates for MID: 20 mm for shoulder pain on arm activity, 10 points for CS and 1.5 points for SST, with good to excellent discrimination (areas under curve (AUCs) from 0.86 to 0.94). We could not establish a reliable MID for pain at rest. The PASS estimates were consistent between methods. The ROC method PASS thresholds using a conservative anchor question threshold were 2 mm for pain at rest, 9 mm for pain on activity, 80 points for CS and 11 points for SST, with AUCs from 0.74 to 0.83.

Conclusion: We recommend the smallest estimate from different methods as the MID, because it is very unlikely that changes smaller than the smallest MID estimate are important to patients: 20 mm for pain VAS on arm activity, 10 points for CS and 1.5 points for SST. We recommend PASS estimates of 9 mm for pain on arm activity, 80 points for CS, and 11 points for SST.

Trial registration: ClinicalTrials.gov NCT00428870 (first registered January 29, 2007).

Keywords: Clinimetrics, minimal important change, MID, MCID, patient accepted symptom state, PASS, responsiveness; Constant-Murley score; Outcome measures; Pain; Simple shoulder test; Subacromial pain; Visual analogue scale (VAS).

Conflict of interest statement

All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: no support from any organisation for the submitted work other than those described above; All authors declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.

References

    1. Jaeschke R, Singer J, Guyatt GH. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials. 1989;10(4):407–415. doi: 10.1016/0197-2456(89)90005-6.
    1. Schunemann HJ, Puhan M, Goldstein R, Jaeschke R, Guyatt GH. Measurement properties and interpretability of the chronic respiratory disease questionnaire (CRQ) COPD. 2005;2(1):81–89. doi: 10.1081/COPD-200050651.
    1. Terwee CB, Roorda LD, Dekker J, Bierma-Zeinstra SM, Peat G, Jordan KP, et al. Mind the MIC: large variation among populations and methods. J Clin Epidemiol. 2010;63(5):524–534. doi: 10.1016/j.jclinepi.2009.08.010.
    1. Mills KA, Naylor JM, Eyles JP, Roos EM, Hunter DJ. Examining the minimal important difference of patient-reported outcome measures for individuals with knee osteoarthritis: a model using the knee injury and osteoarthritis outcome score. J Rheumatol. 2016;43(2):395–404. doi: 10.3899/jrheum.150398.
    1. Devji T, Carrasco-Labra A, Guyatt G. Mind the methods of determining minimal important differences: three critical issues to consider. Evid Based Ment Health. 2020 Aug 24:ebmental-2020-300164. 10.1136/ebmental-2020-300164. Epub ahead of print. PMID: 32839275.
    1. Devji T, Guyatt GH, Lytvyn L, Brignardello-Petersen R, Foroutan F, Sadeghirad B, et al. Application of minimal important differences in degenerative knee disease outcomes: a systematic review and case study to inform BMJ rapid recommendations. BMJ Open. 2017;7(5):e015587. doi: 10.1136/bmjopen-2016-015587.
    1. Kvien TK, Heiberg T, Hagen KB. Minimal clinically important improvement/difference (MCII/MCID) and patient acceptable symptom state (PASS): what do these concepts mean? Ann Rheum Dis. 2007;66(Suppl 3):iii40–iii41.
    1. Mitchell C, Adebajo A, Hay E, Carr A. Shoulder pain: diagnosis and management in primary care. BMJ. 2005;331(7525):1124–1128. doi: 10.1136/bmj.331.7525.1124.
    1. Harkness EF, Macfarlane GJ, Nahit ES, Silman AJ, McBeth J. Mechanical and psychosocial factors predict new onset shoulder pain: a prospective cohort study of newly employed workers. Occup Environ Med. 2003;60(11):850–857. doi: 10.1136/oem.60.11.850.
    1. van der Windt DA, Thomas E, Pope DP, de Winter AF, Macfarlane GJ, Bouter LM, et al. Occupational risk factors for shoulder pain: a systematic review. Occup Environ Med. 2000;57(7):433–442. doi: 10.1136/oem.57.7.433.
    1. Hao Q, Devji T, Zeraatkar D, Wang Y, Qasim A, Siemieniuk RAC, et al. Minimal important differences for improvement in shoulder condition patient-reported outcomes: a systematic review to inform a BMJ rapid recommendation. BMJ Open. 2019;9(2):e028777. doi: 10.1136/bmjopen-2018-028777.
    1. Tubach F, Dougados M, Falissard B, Baron G, Logeart I, Ravaud P. Feeling good rather than feeling better matters more to patients. Arthritis Rheum. 2006;55(4):526–530. doi: 10.1002/art.22110.
    1. Tashjian RZ, Deloach J, Porucznik CA, Powell AP. Minimal clinically important differences (MCID) and patient acceptable symptomatic state (PASS) for visual analog scales (VAS) measuring pain in patients treated for rotator cuff disease. J Shoulder Elb Surg. 2009;18(6):927–932. doi: 10.1016/j.jse.2009.03.021.
    1. Tashjian RZ, Hung M, Keener JD, Bowen RC, McAllister J, Chen W, et al. Determining the minimal clinically important difference for the American shoulder and elbow surgeons score, simple shoulder test, and visual analog scale (VAS) measuring pain after shoulder arthroplasty. J Shoulder Elb Surg. 2017;26(1):144–148. doi: 10.1016/j.jse.2016.06.007.
    1. Christie A, Dagfinrud H, Garratt AM, Ringen Osnes H, Hagen KB. Identification of shoulder-specific patient acceptable symptom state in patients with rheumatic diseases undergoing shoulder surgery. J Hand Ther. 2011;24(1):53–60. doi: 10.1016/j.jht.2010.10.006.
    1. Paavola M, Malmivaara A, Taimela S, Kanto K, Inkinen J, Kalske J, et al. Subacromial decompression versus diagnostic arthroscopy for shoulder impingement: randomised, placebo surgery controlled clinical trial. BMJ. 2018;362:k2860. doi: 10.1136/bmj.k2860.
    1. Matsen FA, 3rd, Ziegler DW, DeBartolo SE. Patient self-assessment of health status and function in glenohumeral degenerative joint disease. J Shoulder Elb Surg. 1995;4(5):345–351. doi: 10.1016/S1058-2746(95)80018-2.
    1. Constant CR, Murley AH. A clinical method of functional assessment of the shoulder. Clin Orthop Relat Res. 1987;214:160–164.
    1. Paavola M, Malmivaara A, Taimela S, Kanto K, Jarvinen TL, Investigators F. Finnish subacromial impingement arthroscopy controlled trial (FIMPACT): a protocol for a randomised trial comparing arthroscopic subacromial decompression and diagnostic arthroscopy (placebo control), with an exercise therapy control, in the treatment of shoulder impingement syndrome. BMJ Open. 2017;7(5):e014087. doi: 10.1136/bmjopen-2016-014087.
    1. Huang H, Grant JA, Miller BS, Mirza FM, Gagnier JJ. A systematic review of the psychometric properties of patient-reported outcome instruments for use in patients with rotator cuff disease. Am J Sports Med. 2015;43(10):2572–2582. doi: 10.1177/0363546514565096.
    1. Guyatt GH, Norman GR, Juniper EF, Griffith LE. A critical look at transition ratings. J Clin Epidemiol. 2002;55(9):900–908. doi: 10.1016/S0895-4356(02)00435-3.
    1. Devji T, Carrasco-Labra A, Qasim A, Phillips M, Johnston BC, Devasenapathy N, et al. Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study. Bmj. 2020;369:m1714. doi: 10.1136/bmj.m1714.
    1. Hanley JA. Receiver operating characteristic (ROC) methodology: the state of the art. Crit Rev Diagn Imaging. 1989;29(3):307–335.
    1. Turner D, Schunemann HJ, Griffith LE, Beaton DE, Griffiths AM, Critch JN, et al. Using the entire cohort in the receiver operating characteristic analysis maximizes precision of the minimal important difference. J Clin Epidemiol. 2009;62(4):374–379. doi: 10.1016/j.jclinepi.2008.07.009.
    1. Froud R, Abel G. Using ROC curves to choose minimally important change thresholds when sensitivity and specificity are valued equally: the forgotten lesson of pythagoras. theoretical considerations and an example application of change in health status. PLoS One. 2014;9(12):e114468. doi: 10.1371/journal.pone.0114468.
    1. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837–845. doi: 10.2307/2531595.
    1. Hanley JA, McNeil BJ. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 1983;148(3):839–843. doi: 10.1148/radiology.148.3.6878708.
    1. Liang MH. Evaluating measurement responsiveness. J Rheumatol. 1995;22(6):1191–1192.
    1. Wright AA, Cook CE, Baxter GD, Dockerty JD, Abbott JH. A comparison of 3 methodological approaches to defining major clinically important improvement of 4 performance measures in patients with hip osteoarthritis. J Orthop Sports Phys Ther. 2011;41(5):319–327. doi: 10.2519/jospt.2011.3515.
    1. Tubach F, Ravaud P, Baron G, Falissard B, Logeart I, Bellamy N, et al. Evaluation of clinically relevant changes in patient reported outcomes in knee and hip osteoarthritis: the minimal clinically important improvement. Ann Rheum Dis. 2005;64(1):29–33. doi: 10.1136/ard.2004.022905.
    1. Tubach F, Ravaud P, Beaton D, Boers M, Bombardier C, Felson DT, et al. Minimal clinically important improvement and patient acceptable symptom state for subjective outcome measures in rheumatic disorders. J Rheumatol. 2007;34(5):1188–1193.
    1. Dabija DI, Jain NB. Minimal clinically important difference of shoulder outcome measures and diagnoses: a systematic review. Am J Phys Med Rehabil. 2019;98(8):671–676. doi: 10.1097/PHM.0000000000001169.
    1. Katz NP, Paillard FC, Ekman E. Determining the clinical importance of treatment benefits for interventions for painful orthopedic conditions. J Orthop Surg Res. 2015;10:24. doi: 10.1186/s13018-014-0144-x.
    1. Farrar JT, Young JP, Jr, LaMoreaux L, Werth JL, Poole RM. Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale. Pain. 2001;94(2):149–158. doi: 10.1016/S0304-3959(01)00349-9.
    1. Staunton H, Willgoss T, Nelsen L, Burbridge C, Sully K, Rofail D, et al. An overview of using qualitative techniques to explore and define estimates of clinically important change on clinical outcome assessments. J Patient Rep Outcomes. 2019;3(1):16. doi: 10.1186/s41687-019-0100-y.

Source: PubMed

3
S'abonner