Evaluation of content validity and feasibility of the eVISualisation of physical activity and pain (eVIS) intervention for patients with chronic pain participating in interdisciplinary pain rehabilitation programs

Elena Tseli, Veronica Sjöberg, Mathilda Björk, Björn O Äng, Linda Vixner, Elena Tseli, Veronica Sjöberg, Mathilda Björk, Björn O Äng, Linda Vixner

Abstract

Background: Chronic pain negatively influences most aspects of life, including aerobic capacity and physical function. The "eVISualisation of physical activity and pain" (eVIS) intervention was developed to facilitate individualized physical activity for treatment in interdisciplinary pain rehabilitation programs (IPRPs). The objective of this study was to evaluate the content validity and feasibility of the eVIS intervention prior to an effectiveness trial.

Methods: In order to determine pre-clinical content validity, experts (n = 10) (patients, caregivers, researchers) participated in three assessment rounds using a Likert-scale survey where relevance, simplicity, and safety were rated, whereafter the intervention was revised. Item-content validity index (I-CVI), average, and overall CVI were used to quantify ratings. To determine content validity and feasibility in the clinical context, experts (n = 8) (patients and physiotherapists) assessed eVIS after a 2-3-week test trial, with the feasibility aspects acceptability, demand, implementation, limited efficacy-testing, and practicality in focus. Additional expert interviews (with physiotherapists, physicians) were conducted on two incomplete areas.

Results: The intervention was iteratively revised and refined throughout the study. After three assessment and revision rounds, the I-CVI ratings for relevance, simplicity, and safety ranged between 0.88 and 1.00 (≥0.78) in most items, giving eVIS "excellent" content validity. In the IPRP context, the intervention emerged as valid and feasible. Additional interviews further contributed to its content validity and clinical feasibility.

Conclusions: The proposed domains and features of the eVIS intervention are deemed valid in its content and feasible in the IPRP context. The consecutive step-by-step evaluation process enabled careful intervention development with revisions to be made in close collaboration with stakeholders. Findings implicate a robust base ahead of the forthcoming effectiveness trial.

Conflict of interest statement

The authors have declared that no competing interests exist.

Copyright: © 2023 Tseli et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Figures

Fig 1. Development, content validity, and feasibility…
Fig 1. Development, content validity, and feasibility evaluation stages of the eVIS intervention according to the updated Framework for Developing and Evaluating Complex Interventions.
* [35] Broken lines illustrate the subsequent phases with effectiveness evaluation and potential implementation.
Fig 2. Schematic overview of the eVIS…
Fig 2. Schematic overview of the eVIS intervention’s elements.
Copied from study protocol by Sjöberg et al. [20]. Attribution CC BY-NC 4.0.
Fig 3. Evaluation of feasibility in a…
Fig 3. Evaluation of feasibility in a clinical context.
Ratings post IPRP by patients (n = 5). Domain-specific explications of grades 1: Not at all, 2: To some extent, 3: To a rather large extent, 4: To a large extent. Item P-F17 was rated as extent of agreement with a statement from 1: Strongly disagree to 4: Strongly agree. Ratings ≥ 3 = satisfactory feasibility. Abbreviations: IPRP = Interdisciplinary pain rehabilitation program, P = Practicality, I = Implementation, A = Acceptability, L = Limited Efficacy testing, D = Demand.
Fig 4. Evaluation of feasibility in a…
Fig 4. Evaluation of feasibility in a clinical context.
Ratings post IPRP by physiotherapists (n = 3). Domain-specific explications of grades 1: Not at all, 2: To some extent, 3: To a rather large extent, 4: To a large extent. Item PT-F23 was rated as extent of agreement with a statement from 1: Strongly disagree to 4: Strongly agree. Ratings ≥ 3 = satisfactory feasibility. Abbreviations: IPRP = Interdisciplinary pain rehabilitation program, P = Practicality, I = Implementation, A = Acceptability, L = Limited Efficacy testing, D = Demand. * PT-F15, one physiotherapist follow up was not possible, due to other non-related events.

References

    1. Treede RD, Rief W, Barke A, Aziz Q, Bennett MI, Benoliel R, et al.. Chronic pain as a symptom or a disease: the IASP Classification of Chronic Pain for the International Classification of Diseases (ICD-11). Pain. 2019;160(1):19–27. Epub 2018/12/27. doi: 10.1097/j.pain.0000000000001384 .
    1. Breivik H, Collett B, Ventafridda V, Cohen R, Gallacher D. Survey of chronic pain in Europe: prevalence, impact on daily life, and treatment. Eur J Pain. 2006;10(4):287–333. Epub 2005/08/13. doi: 10.1016/j.ejpain.2005.06.009 [pii] .
    1. Cohen SP, Vase L, Hooten WM. Chronic pain: an update on burden, best practices, and new advances. The Lancet. 2021;397(10289):2082–97. doi: 10.1016/S0140-6736(21)00393-7
    1. Leadley RM, Armstrong N, Lee YC, Allen A, Kleijnen J. Chronic diseases in the European Union: the prevalence and health cost implications of chronic pain. J Pain Palliat Care Pharmacother. 2012;26(4):310–25. doi: 10.3109/15360288.2012.736933 .
    1. Vetter TR. A primer on health-related quality of life in chronic pain medicine. Anesthesia & Analgesia. 2007;104(3):703–18.
    1. Geneen LJ, Moore RA, Clarke C, Martin D, Colvin LA, Smith BH. Physical activity and exercise for chronic pain in adults: an overview of Cochrane Reviews. Cochrane Database Syst Rev. 2017;4(4):Cd011279. Epub 2017/04/25. doi: 10.1002/14651858.CD011279.pub3 ; PubMed Central PMCID: PMC5461882.
    1. Nicholas M, Ushida T, Wallace M, Williams A, Wittink H, Edwards R, et al. Task force on multimodal pain treatment defines terms for chronic pain care: International Association for the Study of Pain Washington, DC; 2017. Available from: .
    1. SBU SCoHTAiHC. Methods of treating chronic pain. SBU report; 2006.
    1. Tseli E, LoMartire R, Vixner L, Grooten WJ, Gerdle B, Äng BO. What Is the Effectiveness of Different Duration Interdisciplinary Treatment Programs in Patients with Chronic Pain? A Large-Scale Longitudinal Register Study. Journal of Clinical Medicine. 2020;9(9). doi: 10.3390/jcm9092788
    1. Ambrose KR, Golightly YM. Physical exercise as non-pharmacological treatment of chronic pain: why and when. Best practice & research Clinical rheumatology. 2015;29(1):120–30.
    1. García-Correa HR, Sánchez-Montoya LJ, Daza-Arana JE, Ordoñez-Mora LT. Aerobic Physical Exercise for Pain Intensity, Aerobic Capacity, and Quality of Life in Patients With Chronic Pain: A Systematic Review and Meta-Analysis. J Phys Act Health. 2021:1–17. Epub 2021/08/06. doi: 10.1123/jpah.2020-0806 .
    1. Huijnen IP, Verbunt JA, Peters ML, Delespaul P, Kindermans HP, Roelofs J, et al.. Do depression and pain intensity interfere with physical activity in daily life in patients with Chronic Low Back Pain? Pain. 2010;150(1):161–6. doi: 10.1016/j.pain.2010.04.021
    1. Leeuw M, Goossens M, Linton SJ, Crombez G, Boersma K, Vlaeyen JWS. The fear-avoidance model of musculoskeletal pain: Current state of scientific evidence. Journal of Behavioral Medicine. 2007;30(1):77–94. doi: 10.1007/s10865-006-9085-0 WOS:000243906000008.
    1. Vlaeyen JWS, Linton SJ. Fear-avoidance and its consequences in chronic musculoskeletal pain: a state of the art. Pain. 2000;85(3):317–32. doi: 10.1016/S0304-3959(99)00242-0 WOS:000086745500002.
    1. Bandura A. Social cognitive theory: An agentic perspective. Annual review of psychology. 2001;52(1):1–26. doi: 10.1146/annurev.psych.52.1.1
    1. Bandura A. Health promotion by social cognitive means. Health education & behavior. 2004;31(2):143–64.
    1. Brickwood K-J, Watson G, O’Brien J, Williams AD. Consumer-based wearable activity trackers increase physical activity participation: systematic review and meta-analysis. JMIR mHealth and uHealth. 2019;7(4):e11819.
    1. Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health psychology. 2009;28(6):690.
    1. Carey RN, Connell LE, Johnston M, Rothman AJ, de Bruin M, Kelly MP, et al.. Behavior Change Techniques and Their Mechanisms of Action: A Synthesis of Links Described in Published Intervention Literature. Ann Behav Med. 2019;53(8):693–707. Epub 2018/10/12. doi: 10.1093/abm/kay078 ; PubMed Central PMCID: PMC6636886.
    1. Sjöberg V, Tseli E, Monnier A, Westergren J, LoMartire R, Äng BO, et al.. Effectiveness of the eVISualisation of physical activity and pain intervention (eVIS) in Swedish Interdisciplinary Pain Rehabilitation Programmes: study protocol for a registry-based randomised controlled clinical trial. BMJ open. 2022;12(4). doi: 10.1136/bmjopen-2021-055071
    1. Dale LPea. The effectiveness of mobile-health behaviour change interventions for cardiovascular disease self-management: A systematic review. Eur J Prev Cardiol 2016.
    1. Jordan JL, Holden MA, Mason EE, Foster NE. Interventions to improve adherence to exercise for chronic musculoskeletal pain in adults. Cochrane Database Syst Rev. 2010;2010(1):Cd005956. Epub 2010/01/22. doi: 10.1002/14651858.CD005956.pub2 ; PubMed Central PMCID: PMC6769154.
    1. Suso-Ribera C, Mesas Á, Medel J, Server A, Márquez E, Castilla D, et al.. Improving pain treatment with a smartphone app: study protocol for a randomized controlled trial. Trials. 2018;19(1):145. Epub 2018/02/28. doi: 10.1186/s13063-018-2539-1 ; PubMed Central PMCID: PMC6389085.
    1. Thurnheer SE, Gravestock I, Pichierri G, Steurer J, Burgstaller JM. Benefits of Mobile Apps in Pain Management: Systematic Review. JMIR Mhealth Uhealth. 2018;6(10):e11231. Epub 2018/10/24. doi: 10.2196/11231 ; PubMed Central PMCID: PMC6231845.
    1. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al.. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. Epub 2008/10/01. doi: 10.1136/bmj.a1655 ; PubMed Central PMCID: PMC2769032.
    1. Eldridge SM, Lancaster GA, Campbell MJ, Thabane L, Hopewell S, Coleman CL, et al.. Defining Feasibility and Pilot Studies in Preparation for Randomised Controlled Trials: Development of a Conceptual Framework. PLoS One. 2016;11(3):e0150205. Epub 2016/03/16. doi: 10.1371/journal.pone.0150205 ; PubMed Central PMCID: PMC4792418.
    1. DA Richards IR-H. Complex Interventions in Health. An overview of research methods. New York: Routledge; 2015.
    1. Kassam-Adams N, Marsac ML, Kohser KL, Kenardy JA, March S, Winston FK. A New Method for Assessing Content Validity in Model-Based Creation and Iteration of eHealth Interventions. J Med Internet Res. 2015;17(4):e95. Epub 15.04.2015. doi: 10.2196/jmir.3811 .
    1. Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, et al.. How we design feasibility studies. Am J Prev Med. 2009;36(5):452–7. Epub 2009/04/14. doi: 10.1016/j.amepre.2009.02.002 ; PubMed Central PMCID: PMC2859314.
    1. Sjöberg V, Westergren J, Monnier A, Lo Martire R, Hagströmer M, Äng BO, et al.. Wrist-Worn Activity Trackers in Laboratory and Free-Living Settings for Patients With Chronic Pain: Criterion Validity Study. JMIR Mhealth Uhealth. 2021;9(1):e24806. doi: 10.2196/24806
    1. Lynn MR. Determination and quantification of content validity. Nursing research. 1986.
    1. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459–67. Epub 2007/07/27. doi: 10.1002/nur.20199 .
    1. Westman A, Ang BO. Validation of a free fall acrobatics intervention protocol to reduce neck loads during parachute opening shock. BMJ Open Sport Exerc Med. 2015;1(1). Epub 2016/12/03. doi: 10.1136/bmjsem-2015-000045 ; PubMed Central PMCID: PMC5117032.
    1. Lo Martire R, de Alwis MP, Ang BO, Garme K. Construction of a web-based questionnaire for longitudinal investigation of work exposure, musculoskeletal pain and performance impairments in high-performance marine craft populations. BMJ open. 2017;7(7):e016006. Epub 2017/07/22. doi: 10.1136/bmjopen-2017-016006 ; PubMed Central PMCID: PMC5642765.
    1. Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM, et al.. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021;374:n2061. Epub 2021/10/02. doi: 10.1136/bmj.n2061 .
    1. Dworkin RH, Turk DC, Farrar JT, Haythornthwaite JA, Jensen MP, Katz NP, et al.. Core outcome measures for chronic pain clinical trials: IMMPACT recommendations. Pain. 2005;113(1–2):9–19. Epub 2004/12/29. doi: 10.1016/j.pain.2004.09.012 [pii] .
    1. Kaiser U, Kopkow C, Deckert S, Neustadt K, Jacobi L, Cameron P, et al.. Developing a core outcome domain set to assessing effectiveness of interdisciplinary multimodal pain therapy: The VAPAIN consensus statement on core outcome domains. Pain. 2018;159(4):673–83. doi: 10.1097/j.pain.0000000000001129
    1. Chien C-W, Bagraith KS, Khan A, Deen M, Strong J. Comparative responsiveness of verbal and numerical rating scales to measure pain intensity in patients with chronic pain. J Pain. 2013;14(12):1653–62. doi: 10.1016/j.jpain.2013.08.006
    1. Bergström G, Jensen IB, Bodin L, Linton SJ, Nygren ÅL, Carlsson SG. Reliability and factor structure of the Multidimensional Pain Inventory–Swedish Language version (MPI-S). Pain. 1998;75(1):101–10. doi: 10.1016/S0304-3959(97)00210-8
    1. Nicholas MK, McGuire BE, Asghari A. A 2-item short form of the Pain Self-efficacy Questionnaire: development and psychometric evaluation of PSEQ-2. J Pain. 2015;16(2):153–63. Epub 2014/12/03. doi: 10.1016/j.jpain.2014.11.002 .
    1. Grant JS, Davis LL. Selection and use of content experts for instrument development. Research in nursing & health. 1997;20(3):269–74. doi: 10.1002/(sici)1098-240x(199706)20:3<269::aid-nur9>;2-g
    1. de Alwis MP, Lo Martire R, Ang BO, Garme K. Development and validation of a web-based questionnaire for surveying the health and working conditions of high-performance marine craft populations. BMJ open. 2016;6(6):e011681. Epub 2016/06/22. doi: 10.1136/bmjopen-2016-011681 ; PubMed Central PMCID: PMC4916626.
    1. Polit DF, Beck CT. The content validity index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health. 2006;29(5):489–97. Epub 2006/09/16. doi: 10.1002/nur.20147 .
    1. Beckstead JW. Content validity is naught. Int J Nurs Stud. 2009;46(9):1274–83. Epub 2009/06/03. doi: 10.1016/j.ijnurstu.2009.04.014 .
    1. Heapy A, Dziura J, Buta E, Goulet J, Kulas JF, Kerns RD. Using multiple daily pain ratings to improve reliability and assay sensitivity: how many is enough? J Pain. 2014;15(12):1360–5. doi: 10.1016/j.jpain.2014.09.012
    1. Broderick JE, Vikingstad G. Frequent assessment of negative symptoms does not induce depressed mood. Journal of clinical psychology in medical settings. 2008;15(4):296–300. doi: 10.1007/s10880-008-9127-6
    1. Bostrom K, Borosund E, Varsi C, Eide H, Flakk Nordang E, Schreurs KM, et al.. Digital Self-Management in Support of Patients Living With Chronic Pain: Feasibility Pilot Study. JMIR Form Res. 2020;4(10):e23893. Epub 2020/10/24. doi: 10.2196/23893 ; PubMed Central PMCID: PMC7647816.
    1. Huygens MW, Vermeulen J, Swinkels IC, Friele RD, van Schayck OC, de Witte LP. Expectations and needs of patients with a chronic disease toward self-management and eHealth for self-management purposes. BMC Health Serv Res. 2016;16:232. Epub 2016/07/09. doi: 10.1186/s12913-016-1484-5 ; PubMed Central PMCID: PMC4938915.
    1. Licciardone JC, Pandya V. Feasibility Trial of an eHealth Intervention for Health-Related Quality of Life: Implications for Managing Patients with Chronic Pain during the COVID-19 Pandemic. Healthcare (Basel). 2020;8(4). Epub 2020/10/07. doi: 10.3390/healthcare8040381 ; PubMed Central PMCID: PMC7712291.
    1. Karlsson L, Gerdle B, Takala EP, Andersson G, Larsson B. Experiences and attitudes about physical activity and exercise in patients with chronic pain: a qualitative interview study. J Pain Res. 2018;11:133–44. Epub 2018/01/31. doi: 10.2147/JPR.S149826 ; PubMed Central PMCID: PMC5759850.

Source: PubMed

3
Předplatit