Predicted and actual 2-year structural and pain progression in the IMI-APPROACH knee osteoarthritis cohort

Eefje M van Helvoort, Mylène P Jansen, Anne C A Marijnissen, Margreet Kloppenburg, Francisco J Blanco, Ida K Haugen, Francis Berenbaum, Anne-Christine C Bay-Jensen, Christoph Ladel, Agnes Lalande, Jonathan Larkin, John Loughlin, Ali Mobasheri, Harrie H Weinans, Pawel Widera, Jaume Bacardit, Paco M J Welsing, Floris P J G Lafeber, Eefje M van Helvoort, Mylène P Jansen, Anne C A Marijnissen, Margreet Kloppenburg, Francisco J Blanco, Ida K Haugen, Francis Berenbaum, Anne-Christine C Bay-Jensen, Christoph Ladel, Agnes Lalande, Jonathan Larkin, John Loughlin, Ali Mobasheri, Harrie H Weinans, Pawel Widera, Jaume Bacardit, Paco M J Welsing, Floris P J G Lafeber

Abstract

Objectives: The IMI-APPROACH knee osteoarthritis study used machine learning (ML) to predict structural and/or pain progression, expressed by a structural (S) and pain (P) predicted-progression score, to select patients from existing cohorts. This study evaluates the actual 2-year progression within the IMI-APPROACH, in relation to the predicted-progression scores.

Methods: Actual structural progression was measured using minimum joint space width (minJSW). Actual pain (progression) was evaluated using the Knee injury and Osteoarthritis Outcomes Score (KOOS) pain questionnaire. Progression was presented as actual change (Δ) after 2 years, and as progression over 2 years based on a per patient fitted regression line using 0, 0.5, 1 and 2-year values. Differences in predicted-progression scores between actual progressors and non-progressors were evaluated. Receiver operating characteristic (ROC) curves were constructed and corresponding area under the curve (AUC) reported. Using Youden's index, optimal cut-offs were chosen to enable evaluation of both predicted-progression scores to identify actual progressors.

Results: Actual structural progressors were initially assigned higher S predicted-progression scores compared with structural non-progressors. Likewise, actual pain progressors were assigned higher P predicted-progression scores compared with pain non-progressors. The AUC-ROC for the S predicted-progression score to identify actual structural progressors was poor (0.612 and 0.599 for Δ and regression minJSW, respectively). The AUC-ROC for the P predicted-progression score to identify actual pain progressors were good (0.817 and 0.830 for Δ and regression KOOS pain, respectively).

Conclusion: The S and P predicted-progression scores as provided by the ML models developed and used for the selection of IMI-APPROACH patients were to some degree able to distinguish between actual progressors and non-progressors.

Trial registration: ClinicalTrials.gov, https://ichgcp.net/clinical-trials-registry/NCT03883568" title="See in ClinicalTrials.gov">NCT03883568.

Keywords: Knee osteoarthritis; biomarkers; clinical trials and methods; study design.

© The Author(s) 2022. Published by Oxford University Press on behalf of the British Society for Rheumatology.

Figures

Fig. 1
Fig. 1
S predicted-progression score of actual radiographic progressors and non-progressors (A) S predicted-progression scores for actual radiographic progressors (absolute decrease in 2 years ≥0.6 mm, n = 41) and non-progressors (n = 183). (B) S predicted-progression scores for actual radiographic progressors (regression of each patient ≥0.6 mm/2 years, n = 63) and non-progressors (n = 203). minJSW: minimum joint space width.
Fig. 2
Fig. 2
P predicted-progression score of actual pain progressors and non-progressors (A) P predicted-progression scores for actual pain progressors (n = 65; black) and non-progressors (n = 181; grey), as well as for patients with pain increase (n = 25; dotted) and patients with stable significant pain (n = 40; dashed) using the absolute decrease during the 2-year follow-up period. (B) P predicted-progression scores for actual pain progressors (n = 67; black) and non-progressors (n = 179; grey), as well as for patients with pain increase (n = 28; dotted line) and patients with stable significant pain (n = 39; dashed line) using the regression over 2 years of each individual patient. KOOS: Knee injury and Osteoarthritis Outcomes Score.
Fig. 3
Fig. 3
ROC-curves S predicted-progression score ROC curves for ΔminJSW (A) and regression minJSW (B). AUC: area under the curve; minJSW: minimum joint space width; ROC: receiver operating characteristic; Sen: sensitivity; Spec: specificity.
Fig. 4
Fig. 4
ROC curves P predicted-progression score ROC curves for ΔKOOS pain and regression KOOS pain for total progressors (A, B), patients with pain increase (C, D), and patients with stable significant pain (E, F). AUC: area under the curve; KOOS: Knee injury and Osteoarthritis Outcomes Score; ROC: receiver operating characteristic; Sen: sensitivity; Spec: specificity.

References

    1. Felson D, Niu J, Sack B. et al. Progression of osteoarthritis as a state of inertia. Ann Rheum Dis 2013;72:924–9.
    1. Taylor J, Dekker S, Jurg D. et al.; APPROACH research consortium and APPROACH Principal Investigators. Making the patient voice heard in a research consortium: experiences from an EU project (IMI-APPROACH). Res Involv Engagem 2021;7:24.
    1. Wesseling J, Boers M, Viergever MA. et al. Cohort profile: Cohort Hip and Cohort Knee (CHECK) study. Int J Epidemiol 2016;45:36–44.
    1. Damman W, Liu R, Kroon FPB. et al. Do comorbidities play a role in hand osteoarthritis disease burden? Data from the hand osteoarthritis in secondary care cohort. J Rheumatol 2017;44:1659–66.
    1. Magnusson K, Hagen KB, Osteras N. et al. Diabetes is associated with increased hand pain in erosive hand osteoarthritis: data from a population-based study. Arthritis Care Res 2015;67:187–95.
    1. Oreiro-Villar N, Raga AC, Rego-Pérez I. et al. PROCOAC (PROspective COhort of A Coruña) description: Spanish prospective cohort to study osteoarthritis. Reumatol Clin (Engl Ed) 2020, doi: 10.1016/j.reuma.2020.08.010.
    1. Sellam J, Maheu E, Crema MD. et al. The DIGICOD cohort: a hospital-based observational prospective cohort of patients with hand osteoarthritis – methodology and baseline characteristics of the population. Joint Bone Spine 2021;88:105171.
    1. Widera P, Welsing PMJ, Ladel C. et al. Multi-classifier prediction of knee osteoarthritis progression from incomplete imbalanced longitudinal data. Sci Rep 2020;10:8427.
    1. van Helvoort EM, van Spil WE, Jansen MP. et al. Cohort profile: the Applied Public-Private Research enabling OsteoArthritis Clinical Headway (IMI-APPROACH) study: a 2-year, European, cohort study to describe, validate and predict phenotypes of osteoarthritis using clinical, imaging and biochemical markers. BMJ Open 2020;10:e035101.
    1. van Helvoort EM, Ladel C, Mastbergen S. et al. Baseline clinical characteristics of predicted structural and pain progressors in the IMI-APPROACH knee OA cohort. RMD Open 2021;7:e001759.
    1. Altman R, Asch E, Bloch D. et al. Development of criteria for the classification and reporting of osteoarthritis: Classification of osteoarthritis of the knee. Arthritis Rheum 1986;29:1039–49.
    1. Buckland-Wright JC, Ward RJ, Peterfy C, Mojcik CF, Leff RL.. Reproducibility of the semiflexed (metatarsophalangeal) radiographic knee position and automated measurements of medial tibiofemoral joint space width in a multicenter clinical trial of knee osteoarthritis. J Rheumatol 2004;31:1588–97.
    1. Marijnissen AC, Vincken KL, Vos PA. et al. Knee Images Digital Analysis (KIDA): a novel method to quantify individual radiographic features of knee osteoarthritis in detail. Osteoarthritis Cartilage 2008;16:234–43.
    1. Roos EM, Roos HP, Lohmander LS, Ekdahl C, Beynnon BD.. Knee Injury and Osteoarthritis Outcome Score (KOOS)—development of a self-administered outcome measure. J Orthopaedic Sports Phys Ther 1998;28:88–96.
    1. Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW.. Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol 1988;15:1833–40.
    1. Kinds MB, Vincken KL, Hoppinga TN. et al. Influence of variation in semiflexed knee positioning during image acquisition on separate quantitative radiographic parameters of osteoarthritis, measured by Knee Images Digital Analysis. Osteoarthritis Cartilage 2012;20:997–1003.
    1. Ornetti P, Brandt K, Hellio-Le Graverand MP. et al. OARSI-OMERACT definition of relevant radiological progression in hip/knee osteoarthritis. Osteoarthritis Cartilage 2009;17:856–63.
    1. Angst F, Benz T, Lehmann S, Aeschlimann A, Angst J.. Multidimensional minimal clinically important differences in knee osteoarthritis after comprehensive rehabilitation: a prospective evaluation from the Bad Zurzach Osteoarthritis Study. RMD Open 2018;4:e000685.

Source: PubMed

3
Iratkozz fel