Validation of a diagnosis-agnostic symptom questionnaire for asthma and/or COPD

Niklas Karlsson, Mark J Atkinson, Hana Müllerová, Marianna Alacqua, Christina Keen, Rod Hughes, Christer Janson, Barry Make, David Price, Helen K Reddel, NOVELTY study investigators, Niklas Karlsson, Mark J Atkinson, Hana Müllerová, Marianna Alacqua, Christina Keen, Rod Hughes, Christer Janson, Barry Make, David Price, Helen K Reddel, NOVELTY study investigators

Abstract

Background: The Respiratory Symptoms Questionnaire (RSQ) is a novel, four-item patient-reported diagnosis-agnostic tool designed to assess the frequency of respiratory symptoms and their impact on activity, without specifying a particular diagnosis. Our objective was to examine its validity in patients with asthma and/or chronic obstructive pulmonary disease (COPD).

Methods: Baseline data were randomly sampled from patients who completed the RSQ in the NOVELTY study (ClinicalTrials.gov: NCT02760329). The total sample (n=1530) comprised three randomly selected samples (n=510 each) from each physician-assigned diagnostic group (asthma, asthma+COPD and COPD). The internal consistency and structural validity of the RSQ were evaluated using exploratory and confirmatory factor analyses; psychometric performance was observed using Classical Test Theory and Item Response Theory analyses.

Results: For the total sample, the mean±sd RSQ score was 5.6±4.3 (range 0-16). Irrespective of diagnosis, the internal consistency of items was uniformly adequate (Cronbach's α=0.76-0.80). All items had high factor loadings and structural characteristics of the measure were invariant across groups. Using the total sample, RSQ items informatively covered the θ score range of -2.0 to 2.8, with discrimination coefficients for individual items being high to very high (1.7-2.6). Strong convergent correlations were observed between the RSQ and the St George's Respiratory Questionnaire (0.77, p<0.001).

Conclusions: The RSQ is a valid, brief, patient-reported tool for assessing respiratory symptoms in patients across the whole spectrum of asthma and/or COPD, rather than using different questionnaires for each diagnosis. It can be used for monitoring respiratory symptoms in clinical practice, clinical trials and real-world studies.

Conflict of interest statement

Conflict of interest: N. Karlsson is an employee of AstraZeneca. Conflict of interest: M.J. Atkinson reports payment as an independent consultant to Evidera for activities contracted by AstraZeneca associated with the psychometric evaluation of the Respiratory Symptoms Questionnaire; he has provided analytic direction and unbiased interpretation of the RSQ findings. Conflict of interest: H. Müllerová is an employee of AstraZeneca. Conflict of interest: M. Alacqua is an employee of AstraZeneca. Conflict of interest: C. Keen is an employee of AstraZeneca. Conflict of interest: R. Hughes is an employee of AstraZeneca. Conflict of interest: C. Janson reports personal fees from AstraZeneca, Boehringer Ingelheim, Chiesi, GlaxoSmithKline, Novartis and Teva Pharmaceuticals, outside the submitted work. Conflict of interest: B. Make reports grants (with funds provided to, and controlled by, National Jewish Health) from AstraZeneca, GlaxoSmithKline, National Heart, Lung, and Blood Institute, Pearl Research and Sunovion; personal fees from Takeda and Third Pole; nonfinancial support from AstraZeneca, Circassia, GlaxoSmithKline, Phillips, Shire, Spiration, Sunovion and Third Pole; and other support from Academy Continued Health Care Learning, American College of Chest Physicians, AstraZeneca, Boehringer Ingelheim, Catamount Medical, Circassia, Eastern Pulmonary Society, Eastern VA Medical Center, GlaxoSmithKline, Hybrid Communications, Medscape, Mount Sinai Medical Center, National Jewish Health, Novartis, Phillips, Projects in Knowledge, Science 24/7, Shire, Sunovion, Theravance, Ultimate Medical Academy, Verona, WebMD and Wolters Kluwer Health, all outside the submitted work. Conflict of interest: D. Price received funding for the conduct of this study from AstraZeneca and discloses board membership with Amgen, AstraZeneca, Boehringer Ingelheim, Chiesi, Circassia, Mundipharma, Mylan, Novartis, Regeneron Pharmaceuticals, Sanofi Genzyme, Teva Pharmaceuticals and Thermofisher; consultancy agreements with Amgen, AstraZeneca, Boehringer Ingelheim, Chiesi, GlaxoSmithKline, Mundipharma, Mylan, Novartis, Pfizer, Teva Pharmaceuticals and Theravance; grants and unrestricted funding for investigator-initiated studies (conducted through Observational and Pragmatic Research Institute Pte Ltd) from AstraZeneca, Boehringer Ingelheim, Chiesi, Circassia, Mundipharma, Mylan, Novartis, Pfizer, Regeneron Pharmaceuticals, Respiratory Effectiveness Group, Sanofi Genzyme, Teva Pharmaceuticals, Theravance and the UK National Health Service; payment for lectures/speaking engagements from AstraZeneca, Boehringer Ingelheim, Chiesi, Cipla, GlaxoSmithKline, Kyorin, Mundipharma, Mylan, Novartis, Regeneron Pharmaceuticals, Sanofi Genzyme and Teva Pharmaceuticals; payment for the development of educational materials from Mundipharma and Novartis; payment for travel/accommodation/meeting expenses from AstraZeneca, Boehringer Ingelheim, Mundipharma, Mylan, Novartis and Thermofisher; funding for patient enrolment or completion of research from Novartis; stock/stock options from AKL Research and Development Ltd, which produces phytopharmaceuticals; owns 74% of the social enterprise Optimum Patient Care Ltd (Australia and UK) and 74% of Observational and Pragmatic Research Institute Pte Ltd (Singapore); 5% shareholding in Timestamp, which develops adherence monitoring technology; is peer reviewer for grant committees of the Efficacy and Mechanism Evaluation programme and Health Technology Assessment; and was an expert witness for GlaxoSmithKline. Conflict of interest: H.K. Reddel reports that this study is funded by AstraZeneca. She received reimbursement from AstraZeneca for time spent working on the study but not for manuscript preparation. She also reports advisory boards for AstraZeneca, Boehringer Ingelheim, Chiesi, GlaxoSmithKline, Novartis and Sanofi-Genzyme; data and safety monitoring boards for AstraZeneca, GlaxoSmithKline, Merck and Novartis; honoraria from AstraZeneca, Boehringer Ingelheim, GlaxoSmithKline and Teva Pharmaceuticals for independent medical educational presentations; and independent research funding from AstraZeneca, GlaxoSmithKline and Novartis, all outside the submitted work.

Copyright ©ERS 2021.

Figures

FIGURE 1
FIGURE 1
The Respiratory Symptoms Questionnaire (RSQ), response options and scoring. Responses to each of the four RSQ questions (items 1–4) are scored 0–4, with higher scores indicative of more frequent or worse symptoms. Total score ranges from 0 to 16. The RSQ is available for free use for legitimate scientific and clinical care reasons; AstraZeneca retains licensing rights through RWS Life Sciences (for further details, contact: astrazeneca@rws.com).
FIGURE 2
FIGURE 2
Distribution of physician-assessed severity (mild, moderate or severe) in the total sample for Respiratory Symptoms Questionnaire (RSQ) items, by response score: a) item 1 (frequency of daytime symptoms), b) item 2 (frequency of rescue inhaler use), c) item 3 (degree of activity limitation) and d) item 4 (frequency of night-time awakenings due to symptoms). The total sample (n=1530) comprised patients with physician-assigned diagnoses of asthma (n=510), asthma+COPD (n=510) and COPD (n=510). See figure 1 for full details of the RSQ questions and response options. Physicians were not aware of a patient's RSQ responses when they assigned the severity category. Percentages within columns may not total 100% due to rounding.
FIGURE 3
FIGURE 3
Distribution of physician-assessed severity (mild, moderate or severe) in the total sample, by Respiratory Symptoms Questionnaire (RSQ) score. The total sample (n=1530) comprised patients with physician-assigned diagnoses of asthma (n=510), asthma+COPD (n=510) and COPD (n=510). Percentages within columns may not total 100% due to rounding.

References

    1. Global Initiative for Asthma. Global Strategy for Asthma Management and Prevention. 2020. Date last accessed: August 12, 2020.
    1. Global Initiative for Chronic Obstructive Lung Disease. Global Strategy for the Diagnosis, Management, and Prevention of Chronic Obstructive Pulmonary Disease. 2020. Date last accessed: August 12, 2020.
    1. Woodruff PG, Barr RG, Bleecker E, et al. . Clinical significance of symptoms in smokers with preserved pulmonary function. N Engl J Med 2016; 374: 1811–1821. doi:10.1056/NEJMoa1505971
    1. Cloutier MM, Schatz M, Castro M, et al. . Asthma outcomes: composite scores of asthma control. J Allergy Clin Immunol 2012; 129: S24–S33. doi:10.1016/j.jaci.2011.12.980
    1. Juniper EF, O'Byrne PM, Guyatt GH, et al. . Development and validation of a questionnaire to measure asthma control. Eur Respir J 1999; 14: 902–907. doi:10.1034/j.1399-3003.1999.14d29.x
    1. Nathan RA, Sorkness CA, Kosinski M, et al. . Development of the asthma control test: a survey for assessing asthma control. J Allergy Clin Immunol 2004; 113: 59–65. doi:10.1016/j.jaci.2003.09.008
    1. Gater A, Nelsen L, Fleming S, et al. . Assessing asthma symptoms in adolescents and adults: qualitative research supporting development of the asthma daily symptom diary. Value Health 2016; 19: 440–450. doi:10.1016/j.jval.2016.01.007
    1. Leidy NK, Murray LT, Monz BU, et al. . Measuring respiratory symptoms of COPD: performance of the EXACT – Respiratory Symptoms Tool (E-RS) in three clinical trials. Respir Res 2014; 15: 124. doi:10.1186/s12931-014-0124-z
    1. Leidy NK, Wilcox TK, Jones PW, et al. . Development of the EXAcerbations of Chronic obstructive pulmonary disease Tool (EXACT): a patient-reported outcome (PRO) measure. Value Health 2010; 13: 965–975. doi:10.1111/j.1524-4733.2010.00772.x
    1. Juniper EF, Guyatt GH, Epstein RS, et al. . Evaluation of impairment of health related quality of life in asthma: development of a questionnaire for use in clinical trials. Thorax 1992; 47: 76–83. doi:10.1136/thx.47.2.76
    1. Wilson SR, Rand CS, Cabana MD, et al. . Asthma outcomes: quality of life. J Allergy Clin Immunol 2012; 129: S88–S123. doi:10.1016/j.jaci.2011.12.988
    1. van der Molen T, Willemse BWM, Schokker S, et al. . Development, validity and responsiveness of the Clinical COPD Questionnaire. Health Qual Life Outcomes 2003; 1: 13. doi:10.1186/1477-7525-1-13
    1. Jones PW, Harding G, Berry P, et al. . Development and first validation of the COPD Assessment Test. Eur Respir J 2009; 34: 648–654. doi:10.1183/09031936.00102509
    1. Hajiro T, Nishimura K, Jones PW, et al. . A novel, short, and simple questionnaire to measure health-related quality of life in patients with chronic obstructive pulmonary disease. Am J Respir Crit Care Med 1999; 159: 1874–1878. doi:10.1164/ajrccm.159.6.9807097
    1. Barley EA, Quirk FH, Jones PW. Asthma health status measurement in clinical practice: validity of a new short and simple instrument. Respir Med 1998; 92: 1207–1214. doi:10.1016/S0954-6111(98)90423-1
    1. Cazzola M, MacNee W, Martinez FJ, et al. . Outcomes for COPD pharmacological trials: from lung function to biomarkers. Eur Respir J 2008; 31: 416–469. doi:10.1183/09031936.00099306
    1. Sin DD, Miravitlles M, Mannino DM, et al. . What is asthma–COPD overlap syndrome? Towards a consensus definition from a round table discussion. Eur Respir J 2016; 48: 664–673. doi:10.1183/13993003.00436-2016
    1. Pavord ID, Beasley R, Agustí A, et al. . After asthma: redefining airways diseases. Lancet 2018; 391: 350–400. doi:10.1016/S0140-6736(17)30879-6
    1. Reddel HK, Gerhardsson de Verdier M, Agustí A, et al. . Prospective observational study in patients with obstructive lung disease: NOVELTY design. ERJ Open Res 2019; 5: 00036-2018. doi:10.1183/23120541.00036-2018
    1. Samejima F. Estimation of latent ability using a response pattern of graded scores. Psychometrika 1969; 34: 1–97. doi:10.1007/BF03372160
    1. Baker FB. The Basics of Item Response Theory. 2nd Edn. College Park, ERIC Clearinghouse on Assessment and Evaluation, 2001.
    1. Green BF, Bock RD, Humphreys LG, et al. . Technical guidelines for assessing computerized adaptive tests. J Educ Meas 1984; 21: 347–360. doi:10.1111/j.1745-3984.1984.tb01039.x
    1. Zhang J, Yu C, Holgate ST, et al. . Variability and lack of predictive ability of asthma end-points in clinical trials. Eur Respir J 2002; 20: 1102–1109. doi:10.1183/09031936.02.02402001
    1. Jenkins CR, Thien FCK, Wheatley JR, et al. . Traditional and patient-centred outcomes with three classes of asthma medication. Eur Respir J 2005; 26: 36–44. doi:10.1183/09031936.05.00144704
    1. Celli BR, Cote CG, Marin JM, et al. . The body-mass index, airflow obstruction, dyspnea, and exercise capacity index in chronic obstructive pulmonary disease. N Engl J Med 2004; 350: 1005–1012. doi:10.1056/NEJMoa021322
    1. Wolkove N, Dajczman E, Colacone A, et al. . The relationship between pulmonary function and dyspnea in obstructive lung disease. Chest 1989; 96: 1247–1251. doi:10.1378/chest.96.6.1247
    1. Vestbo J, Reddel HK, Agustí A, et al. . Characteristics by physician-assigned severity of asthma, asthma+COPD and COPD patients in the NOVELTY study. Eur Respir J 2019; 54: PA5029. doi:10.1183/13993003.congress-2019.PA5029
    1. Hardie G, Liu R, Darden J, et al. . Ethnic differences in methacholine responsiveness and word descriptors in African Americans, Hispanic-Mexican Americans, Asian-Pacific Islanders, and Whites with mild asthma. J Asthma 2010; 47: 388–396. doi:10.3109/02770903.2010.481341
    1. Reddel HK, Vestbo J, Agustí A, et al. . Characterization of patients with obstructive lung disease in the NOVEL observational longiTudinal studY, NOVELTY. Am J Respir Crit Care Med 2019: 199: A7394. doi:10.1164/ajrccm-conference.2019.199.1_MeetingAbstracts.A7394

Source: PubMed

3
Tilaa