Development and validation of the symptom burden questionnaire for long covid (SBQ-LC): Rasch analysis

Sarah E Hughes, Shamil Haroon, Anuradhaa Subramanian, Christel McMullan, Olalekan L Aiyegbusi, Grace M Turner, Louise Jackson, Elin Haf Davies, Chris Frost, Gary McNamara, Gary Price, Karen Matthews, Jennifer Camaradou, Jane Ormerod, Anita Walker, Melanie J Calvert, Sarah E Hughes, Shamil Haroon, Anuradhaa Subramanian, Christel McMullan, Olalekan L Aiyegbusi, Grace M Turner, Louise Jackson, Elin Haf Davies, Chris Frost, Gary McNamara, Gary Price, Karen Matthews, Jennifer Camaradou, Jane Ormerod, Anita Walker, Melanie J Calvert

Abstract

Objective: To describe the development and validation of a novel patient reported outcome measure for symptom burden from long covid, the symptom burden questionnaire for long covid (SBQ-LC).

Design: Multiphase, prospective mixed methods study.

Setting: Remote data collection and social media channels in the United Kingdom, 14 April to 1 August 2021.

Participants: 13 adults (aged ≥18 years) with self-reported long covid and 10 clinicians evaluated content validity. 274 adults with long covid field tested the draft questionnaire.

Main outcome measures: Published systematic reviews informed development of SBQ-LC's conceptual framework and initial item pool. Thematic analysis of transcripts from cognitive debriefing interviews and online clinician surveys established content validity. Consensus discussions with the patient and public involvement group of the Therapies for Long COVID in non-hospitalised individuals: From symptoms, patient reported outcomes and immunology to targeted therapies (TLC Study) confirmed face validity. Rasch analysis of field test data guided item and scale refinement and provided initial evidence of the SBQ-LC's measurement properties.

Results: SBQ-LC (version 1.0) is a modular instrument measuring patient reported outcomes and is composed of 17 independent scales with promising psychometric properties. Respondents rate their symptom burden during the past seven days using a dichotomous response or 4 point rating scale. Each scale provides coverage of a different symptom domain and returns a summed raw score that can be transformed to a linear (0-100) score. Higher scores represent higher symptom burden. After rating scale refinement and item reduction, all scales satisfied the Rasch model requirements for unidimensionality (principal component analysis of residuals: first residual contrast values <2.00 eigenvalue units) and item fit (outfit mean square values within 0.5 -1.5 logits). Rating scale categories were ordered with acceptable category fit statistics (outfit mean square values <2.0 logits). 14 item pairs had evidence of local dependency (residual correlation values >0.4). Across the 17 scales, person reliability ranged from 0.34 to 0.87, person separation ranged from 0.71 to 2.56, item separation ranged from 1.34 to 13.86, and internal consistency reliability (Cronbach's alpha) ranged from 0.56 to 0.91.

Conclusions: SBQ-LC (version 1.0) is a comprehensive patient reported outcome instrument developed using modern psychometric methods. It measures symptoms of long covid important to people with lived experience of the condition and may be used to evaluate the impact of interventions and inform best practice in clinical management.

Conflict of interest statement

Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: SEH receives funding from the National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) West Midlands and UK Research and Innovation (UKRI) and declares personal fees from Aparito and Cochlear outside the submitted work. MJC is director of the Birmingham Health Partners Centre for Regulatory Science and Innovation and director of the Centre for Patient Reported Outcomes Research and is an NIHR senior investigator. MJC receives funding from the NIHR, UKRI, NIHR Birmingham Biomedical Research Centre, NIHR Surgical Reconstruction and Microbiology Research Centre, NIHR ARC West Midlands, UK SPINE, European Regional Development Fund-Demand Hub and Health Data Research UK at the University of Birmingham and University Hospitals Birmingham NHS Foundation Trust, Innovate UK (part of UKRI), Macmillan Cancer Support, UCB Pharma, Janssen, GlaxoSmithKline, and Gilead. MJC has received personal fees from Astellas, Aparito, CIS Oncology, Takeda, Merck, Daiichi Sankyo, Glaukos, GlaxoSmithKline, and the Patient-Centered Outcomes Research Institute outside the submitted work. In addition, a family member owns shares in GlaxoSmithKline. OLA receives funding from the NIHR Birmingham Biomedical Research Centre, NIHR ARC West Midlands, UKRI, Health Foundation, Janssen, Gilead, and GlaxoSmithKline. He declares personal fees from Gilead Sciences, Merck, and GlaxoSmithKline outside the submitted work. JC is a lay member on the UK National Institute for Health and Care Excellence COVID expert panel, a citizen partner to the COVID-END Evidence Synthesis Network, patient and public involvement lead on the NIHR CICADA ME Study, patient representative at the EAN European Neurology Autonomic Nervous Systems Disorders Working Group, a member of the Medical Research Council/UKRI Advanced Pain Discovery Platform, and external board member of Plymouth Institute of Health. She also reports contracts with GlaxoSmithKline and Medable. CM receives funding from NIHR Surgical Reconstruction and Microbiology Research Centre, UKRI, and declares personal fees from Aparito. KM is employed by the NIHR. SH receives funding from NIHR and UKRI.

© Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY. No commercial re-use. See rights and permissions. Published by BMJ.

Figures

Fig 1
Fig 1
Development of symptom burden questionnaire for long covid (SBQ-LC)
Fig 2
Fig 2
Conceptual framework showing scales (domains) of symptom burden questionnaire for long covid (SBQ-LC, version 1.0)

References

    1. COVID-19 situation update worldwide, as of week 44, updated 11 November 2021. .
    1. National Institute for Health and Care Excellence. COVID-19 rapid guideline: managing the long-term effects of COVID-19. .
    1. World Health Organization. A clinical case definition of post COVID-19 condition by a Delphi consensus. 2021. .
    1. Gapstur RL. Symptom burden: a concept analysis and implications for oncology nurses. Oncol Nurs Forum 2007;34:673-80. 10.1188/07.ONF.673-680.
    1. Aiyegbusi OL, Hughes SE, Turner G, et al. TLC Study Group . Symptoms, complications and management of long COVID: a review. J R Soc Med 2021;114:428-42. 10.1177/01410768211032850.
    1. Cabrera Martimbianco AL, Pacheco RL, Bagattini ÂM, Riera R. Frequency, signs and symptoms, and criteria adopted for long COVID-19: A systematic review. Int J Clin Pract 2021;75:e14357. 10.1111/ijcp.14357.
    1. Centers for Disease Control and Prevention. Post-COVID Conditions. 2020. .
    1. Amin-Chowdhury Z, Harris RJ, Aiano F, et al. . Characterising post-COVID syndrome more than 6 months after acute infection in adults; prospective longitudinal cohort study, England. medRxiv 2021;2021.03.18.21253633. 10.1101/2021.03.18.21253633
    1. Parker AM, Brigham E, Connolly B, et al. . Addressing the post-acute sequelae of SARS-CoV-2 infection: a multidisciplinary model of care. Lancet Respir Med 2021;9:1328-41. 10.1016/S2213-2600(21)00385-4.
    1. Ladds E, Rushforth A, Wieringa S, et al. . Persistent symptoms after Covid-19: qualitative study of 114 “long Covid” patients and draft quality principles for services. BMC Health Serv Res 2020;20:1144. 10.1186/s12913-020-06001-y.
    1. Taquet M, Dercon Q, Luciano S, Geddes JR, Husain M, Harrison PJ. Incidence, co-occurrence, and evolution of long-COVID features: A 6-month retrospective cohort study of 273,618 survivors of COVID-19. PLoS Med 2021;18:e1003773. 10.1371/journal.pmed.1003773.
    1. Sudre CH, Murray B, Varsavsky T, et al. . Attributes and predictors of long COVID [Erratum in: Nat Med. 2021;27:1116. PMID: 33692530]. Nat Med 2021;27:626-31. 10.1038/s41591-021-01292-y.
    1. Nasserie T, Hittle M, Goodman SN. Assessment of the frequency and variety of persistent symptoms among patients with covid-19: a systematic review. JAMA Netw Open 2021;4:e2111417. 10.1001/jamanetworkopen.2021.11417.
    1. Sivan M, Wright S, Hughes S, Calvert M. Using condition specific patient reported outcome measures for long covid. BMJ 2022;376:o257. 10.1136/bmj.o257.
    1. US Food and Drug Administration . Guidance for industry: Patient-reported outcome measures: Use in medical product development to support labeling claims. 2009:1-39. .
    1. Aiyegbusi OL, Calvert MJ. Patient-reported outcomes: central to the management of COVID-19. Lancet 2020;396:531. 10.1016/S0140-6736(20)31724-4.
    1. Berry P. Use patient reported outcome measures (PROMs) in treatment of long covid. BMJ 2021;373:n1260. 10.1136/bmj.n1260.
    1. Calvert M, Brundage M, Jacobsen PB, Schünemann HJ, Efficace F. The CONSORT Patient-Reported Outcome (PRO) extension: implications for clinical trials and practice. Health Qual Life Outcomes 2013;11:184. 10.1186/1477-7525-11-184.
    1. Tran V-T, Riveros C, Clepier B, et al. . Development and validation of the Long Coronavirus Disease (COVID) Symptom and Impact Tools: a set of patient-reported instruments constructed from patients’ lived experience. Clin Infect Dis 2022;74:278-87. 10.1093/cid/ciab352.
    1. O’Connor RJ, Preston N, Parkin A, et al. . The COVID-19 Yorkshire Rehabilitation Scale (C19-YRS): Application and psychometric analysis in a post-COVID-19 syndrome cohort. J Med Virol 2021. 10.1002/jmv.27415.
    1. Alwan NA. The teachings of Long COVID. Commun Med 2021;1:1-3. 10.1038/s43856-021-00016-0.
    1. Callard F, Perego E. How and why patients made Long Covid. Soc Sci Med 2021;268:113426. 10.1016/j.socscimed.2020.113426.
    1. US Food and Drug Administration. Principles for selecting, developing, modifying, and adapting patient-reported outcome instruments for use in medical device evaluation: draft guidance for industry and food and drug administration staff, and other stakeholders. 2020.
    1. Haroon S, Nirantharakumar K, Hughes SE, et al. . Therapies for Long COVID in non-hospitalised individuals - from symptoms, patient-reported outcomes, and immunology to targeted therapies (The TLC Study): study protocol. medRxiv 2021;2021.12.20.21268098. 10.1101/2021.12.20.21268098
    1. Linacre JM. Sample Size and Item Calibration or Person Measure Stability. Rasch Meas Trans 1994;7:328.
    1. Lopez-Leon S, Wegman-Ostrosky T, Perelman C, et al. . More than 50 long-term effects of COVID-19: a systematic review and meta-analysis. Sci Rep 2021;11:16144. 10.1038/s41598-021-95565-8.
    1. Evans RA, McAuley H, Harrison EM, et al. PHOSP-COVID Collaborative Group . Physical, cognitive, and mental health impacts of COVID-19 after hospitalisation (PHOSP-COVID): a UK multicentre, prospective cohort study [Erratum in: Lancet Respir Med 2022;10:e9. PMID: 34627560]. Lancet Respir Med 2021;9:1275-87. 10.1016/S2213-2600(21)00383-0.
    1. de Haes JC, van Knippenberg FCE, Neijt JP. Measuring psychological and physical distress in cancer patients: structure and application of the Rotterdam Symptom Checklist. Br J Cancer 1990;62:1034-8. 10.1038/bjc.1990.434.
    1. Cleeland CS, Mendoza TR, Wang XS, et al. . Assessing symptom distress in cancer patients: the M.D. Anderson Symptom Inventory. Cancer 2000;89:1634-46. 10.1002/1097-0142(20001001)89:7<1634::AID-CNCR29>;2-V.
    1. Powers JH, Guerrero ML, Leidy NK, et al. . Development of the Flu-PRO: a patient-reported outcome (PRO) instrument to evaluate symptoms of influenza. BMC Infect Dis 2016;16:1. 10.1186/s12879-015-1330-0.
    1. Basch E, Reeve BB, Mitchell SA, et al. . Development of the National Cancer Institute’s patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). J Natl Cancer Inst 2014;106:dju244. 10.1093/jnci/dju244.
    1. Smart Survey.
    1. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health 2007;30:459-67. 10.1002/nur.20199.
    1. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006;3:77-101 10.1191/1478088706qp063oa.
    1. Willis GB. Analysis of the Cognitive Interview in Questionnaire Design. Oxford University Press, 2015.
    1. Aparito Limited .
    1. Herdman M, Gudex C, Lloyd A, et al. . Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res 2011;20:1727-36. 10.1007/s11136-011-9903-x.
    1. EuroQol Group . EuroQol--a new facility for the measurement of health-related quality of life. Health Policy 1990;16:199-208. 10.1016/0168-8510(90)90421-9.
    1. Rasch G. Probabilistic Models for Some Intelligence and Attainment Tests. Nielson and Lydiche, 1960, 10.1016/S0019-9958(61)80061-2.
    1. Bond TG, Yan Z, Heene M. Applying the Rasch Model: Fundamental Measurement in the Human Sciences. 4th ed. Routledge, 2020. 10.4324/9780429030499.
    1. Hobart J, Cano S. Improving the evaluation of therapeutic interventions in multiple sclerosis: the role of new psychometric methods. Health Technol Assess 2009;13:iii , ix-x, 1-177. 10.3310/hta13120.
    1. Tennant A, McKenna SP, Hagell P. Application of Rasch analysis in the development and application of quality of life instruments. Value Health 2004;7(Suppl 1):S22-6. 10.1111/j.1524-4733.2004.7s106.x.
    1. Linacre JM. A User’s Guide to WINSTEPS MINISTEPS Rasch-Model Computer Programs. 2020.
    1. Mousavi A, Cui Y. The effect of person misfit on item parameter estimation and classification accuracy: a simulation study. Educ Sci (Basel) 2020;10:324. 10.3390/educsci10110324.
    1. Tennant A, Conaghan PG. The Rasch measurement model in rheumatology: what is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis Rheum 2007;57:1358-62. 10.1002/art.23108.
    1. Linacre JM. Optimizing rating scale category effectiveness. J Appl Meas 2002;3:85-106.
    1. Duncan PW, Bode RK, Min Lai S, Perera S, Glycine Antagonist in Neuroprotection Americans Investigators . Rasch analysis of a new stroke-specific outcome scale: the Stroke Impact Scale. Arch Phys Med Rehabil 2003;84:950-63. 10.1016/S0003-9993(03)00035-2.
    1. Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A practical guide to their development and use. Oxford University Press, 2015. 10.1093/med/9780199685219.001.0001.
    1. Position statement on use of the EQ-5D-5L value set for England (updated October 2019). .
    1. van Hout B, Janssen MF, Feng YS, et al. . Interim scoring for the EQ-5D-5L: mapping the EQ-5D-5L to EQ-5D-3L value sets. Value Health 2012;15:708-15. 10.1016/j.jval.2012.02.008.
    1. National Institute for Health Research. Improving inclusion of under-served groups in clinical research: guidance from the NIHR-INCLUDE project. UK: National Institute for Health Research. 2020. .
    1. Krosnick JA, Presser S. Question and Questionnaire Design. Handbook of Survey Research 2010;94305:886. 10.1111/j.1432-1033.1976.tb10115.x
    1. Readable . .
    1. Flesch R. A new readability yardstick. J Appl Psychol 1948;32:221-33. 10.1037/h0057532.
    1. McLaughlin GH. SMOG grading: a new readability formula. J Read 1969;12:639-46.
    1. Weiss BD. Help patients understand: manual for clinicians. American Medical Association Foundation and American Medical Association, 2007.
    1. NHS Digital Service Manual. Use a readability tool to prioritise content - NHS digital service manual. . 2019. .
    1. Office for National Statistics. Coronavirus (COVID-19) Infection Survey technical article: waves and lags of COVID-19 in England, June 2021.
    1. Janssen MF, Szende A, Cabases J, Ramos-Goñi JM, Vilagut G, König HH. Population norms for the EQ-5D-3L: a cross-country analysis of population surveys for 20 countries. Eur J Health Econ 2019;20:205-16. 10.1007/s10198-018-0955-5.
    1. Local Dependency and Rasch Measures . .
    1. Mokkink LB, Prinsen AC, Patrick DL, et al. COSMIN manual for systematic reviews of PROMs COSMIN methodology for systematic reviews of Patient-Reported Outcome Measures (PROMs) user manual. 2018. .
    1. Separation, Reliability and skewed distributions: statistically different levels of performance. .
    1. Anselmi P, Colledani D, Robusto E. A comparison of classical and modern measures of internal consistency. Front Psychol 2019;10:2714. 10.3389/fpsyg.2019.02714.
    1. Harrison CJ, Geerards D, Ottenhof MJ, et al. . Computerised adaptive testing accurately predicts CLEFT-Q scores by selecting fewer, more patient-focused questions. J Plast Reconstr Aesthet Surg 2019;72:1819-24. 10.1016/j.bjps.2019.05.039.
    1. Menges D, Ballouz T, Anagnostopoulos A, et al. . Burden of post-COVID-19 syndrome and implications for healthcare service planning: A population-based cohort study. PLoS One 2021;16:e0254523. 10.1371/journal.pone.0254523.
    1. Basch E, Deal AM, Kris MG, et al. . Symptom monitoring with patient-reported outcomes during routine cancer treatment: a randomized controlled trial. J Clin Oncol 2016;34:557-65. 10.1200/JCO.2015.63.0830.
    1. Greenhalgh J, Gooding K, Gibbons E, et al. . How do patient reported outcome measures (PROMs) support clinician-patient communication and patient care? A realist synthesis. J Patient Rep Outcomes 2018;2:42. 10.1186/s41687-018-0061-6.
    1. Calvert M, Kyte D, Price G, Valderas JM, Hjollund NH. Maximising the impact of patient reported outcome assessment for patients and society. BMJ 2019;364:k5267. 10.1136/bmj.k5267.
    1. Turner GM, Litchfield I, Finnikin S, Aiyegbusi OL, Calvert M. General practitioners’ views on use of patient reported outcome measures in primary care: a cross-sectional survey and qualitative study. BMC Fam Pract 2020;21:14. 10.1186/s12875-019-1077-6.
    1. Office for National Statistics. Technical article: Updated estimates of the prevalence of post-acute symptoms among people with coronavirus (COVID-19) in the UK: 26 April 2020 to 1 August 2021.
    1. Whitaker M, Elliott J. Persistent symptoms following SARS-CoV-2 infection in a random community sample of 508,707 people | medRxiv. 10.1101/2021.06.28.21259452.
    1. Menon V, Muraleedharan A. Internet-based surveys: relevance, methodological considerations and troubleshooting strategies. Gen Psychiatr 2020;33:e100264. 10.1136/gpsych-2020-100264.
    1. Hughes S, Aiyegbusi OL, Lasserson D, Collis P, Glasby J, Calvert M. Patient-reported outcome measurement: a bridge between health and social care? J R Soc Med 2021;114:381-8. 10.1177/01410768211014048.

Source: PubMed

3
Iratkozz fel