Development and validation of combined symptom-medication scores for allergic rhinitis

Bernardo Sousa-Pinto, Luís Filipe Azevedo, Marek Jutel, Ioana Agache, G Walter Canonica, Wienczyslawa Czarlewski, Nikolaos G Papadopoulos, Karl-Christian Bergmann, Philippe Devillier, Daniel Laune, Ludger Klimek, Aram Anto, Josep M Anto, Patrik Eklund, Rute Almeida, Anna Bedbrook, Sinthia Bosnic-Anticevich, Helen A Brough, Luisa Brussino, Victoria Cardona, Thomas Casale, Lorenzo Cecchi, Denis Charpin, Tomás Chivato, Elisio M Costa, Alvaro A Cruz, Stephanie Dramburg, Stephen R Durham, Giulia De Feo, Roy Gerth van Wijk, Wystke J Fokkens, Bilun Gemicioglu, Tari Haahtela, Maddalena Illario, Juan Carlos Ivancevich, Violeta Kvedariene, Piotr Kuna, Désirée E Larenas-Linnemann, Michael Makris, Eve Mathieu-Dupas, Erik Melén, Mario Morais-Almeida, Ralph Mösges, Joaquim Mullol, Kari C Nadeau, Nhân Pham-Thi, Robyn O'Hehir, Frederico S Regateiro, Sietze Reitsma, Boleslaw Samolinski, Aziz Sheikh, Cristiana Stellato, Ana Todo-Bom, Peter Valentin Tomazic, Sanna Toppila-Salmi, Antonio Valero, Arunas Valiulis, Maria Teresa Ventura, Dana Wallace, Susan Waserman, Arzu Yorgancioglu, Govert De Vries, Michiel van Eerd, Petra Zieglmayer, Torsten Zuberbier, Oliver Pfaar, João Almeida Fonseca, Jean Bousquet, Bernardo Sousa-Pinto, Luís Filipe Azevedo, Marek Jutel, Ioana Agache, G Walter Canonica, Wienczyslawa Czarlewski, Nikolaos G Papadopoulos, Karl-Christian Bergmann, Philippe Devillier, Daniel Laune, Ludger Klimek, Aram Anto, Josep M Anto, Patrik Eklund, Rute Almeida, Anna Bedbrook, Sinthia Bosnic-Anticevich, Helen A Brough, Luisa Brussino, Victoria Cardona, Thomas Casale, Lorenzo Cecchi, Denis Charpin, Tomás Chivato, Elisio M Costa, Alvaro A Cruz, Stephanie Dramburg, Stephen R Durham, Giulia De Feo, Roy Gerth van Wijk, Wystke J Fokkens, Bilun Gemicioglu, Tari Haahtela, Maddalena Illario, Juan Carlos Ivancevich, Violeta Kvedariene, Piotr Kuna, Désirée E Larenas-Linnemann, Michael Makris, Eve Mathieu-Dupas, Erik Melén, Mario Morais-Almeida, Ralph Mösges, Joaquim Mullol, Kari C Nadeau, Nhân Pham-Thi, Robyn O'Hehir, Frederico S Regateiro, Sietze Reitsma, Boleslaw Samolinski, Aziz Sheikh, Cristiana Stellato, Ana Todo-Bom, Peter Valentin Tomazic, Sanna Toppila-Salmi, Antonio Valero, Arunas Valiulis, Maria Teresa Ventura, Dana Wallace, Susan Waserman, Arzu Yorgancioglu, Govert De Vries, Michiel van Eerd, Petra Zieglmayer, Torsten Zuberbier, Oliver Pfaar, João Almeida Fonseca, Jean Bousquet

Abstract

Background: Validated combined symptom-medication scores (CSMSs) are needed to investigate the effects of allergic rhinitis treatments. This study aimed to use real-life data from the MASK-air® app to generate and validate hypothesis- and data-driven CSMSs.

Methods: We used MASK-air® data to assess the concurrent validity, test-retest reliability and responsiveness of one hypothesis-driven CSMS (modified CSMS: mCSMS), one mixed hypothesis- and data-driven score (mixed score), and several data-driven CSMSs. The latter were generated with MASK-air® data following cluster analysis and regression models or factor analysis. These CSMSs were compared with scales measuring (i) the impact of rhinitis on work productivity (visual analogue scale [VAS] of work of MASK-air® , and Work Productivity and Activity Impairment: Allergy Specific [WPAI-AS]), (ii) quality-of-life (EQ-5D VAS) and (iii) control of allergic diseases (Control of Allergic Rhinitis and Asthma Test [CARAT]).

Results: We assessed 317,176 days of MASK-air® use from 17,780 users aged 16-90 years, in 25 countries. The mCSMS and the factor analyses-based CSMSs displayed poorer validity and responsiveness compared to the remaining CSMSs. The latter displayed moderate-to-strong correlations with the tested comparators, high test-retest reliability and moderate-to-large responsiveness. Among data-driven CSMSs, a better performance was observed for cluster analyses-based CSMSs. High accuracy (capacity of discriminating different levels of rhinitis control) was observed for the latter (AUC-ROC = 0.904) and for the mixed CSMS (AUC-ROC = 0.820).

Conclusion: The mixed CSMS and the cluster-based CSMSs presented medium-high validity, reliability and accuracy, rendering them as candidates for primary endpoints in future rhinitis trials.

Keywords: medication score; quality-of-life; rhinitis; symptom score; work.

© 2022 The Authors. Allergy published by European Academy of Allergy and Clinical Immunology and John Wiley & Sons Ltd.

References

REFERENCES

    1. Godicke V, Hundt F. Registration trials for specific immunotherapy in Europe: advanced guidance from the new European Medical Agency guideline. Allergy. 2010;65(12):1499-1505.
    1. Bousquet J, Pfaar O, Togias A, et al. 2019 ARIA Care pathways for allergen immunotherapy. Allergy. 2019;74(11):2087-2102.
    1. Pfaar O, Demoly P, Gerth van Wijk R, et al. Recommendations for the standardization of clinical outcomes used in allergen immunotherapy trials for allergic rhinoconjunctivitis: an EAACI Position Paper. Allergy. 2014;69(7):854-867.
    1. Pfaar O, Agache I, Blay F, et al. Perspectives in allergen immunotherapy: 2019 and beyond. Allergy. 2019;74(Suppl 108):3-25.
    1. Bousquet JJ, Schünemann HJ, Togias A, et al. Next-generation ARIA care pathways for rhinitis and asthma: a model for multimorbid chronic diseases. Clin Transl Allergy. 2019;9:44.
    1. Bousquet J, Anto JM, Haahtela T, et al. Digital transformation of health and care to sustain Planetary Health: The MASK proof-of-concept for airway diseases-POLLAR symposium under the auspices of Finland's Presidency of the EU, 2019 and MACVIA-France, Global Alliance against Chronic Respiratory Diseases (GARD, WH0) demonstration project, Reference Site Collaborative Network of the European Innovation Partnership on Active and Healthy Ageing. Clin Transl Allergy. 2020;10:24.
    1. Bousquet J, Anto JM, Bachert C, et al. ARIA digital anamorphosis: digital transformation of health and care in airway diseases from research to practice. Allergy. 2021;76(1):168-190.
    1. Bedard A, Anto JM, Fonseca JA, et al. Correlation between work impairment, scores of rhinitis severity and asthma using the MASK-air((R)) App. Allergy. 2020;75(7):1672-1688.
    1. Poole CD, Bannister CA, Andreasen JN, Andersen JS, Currie CJ. Estimation of health-related utility (EQ-5D index) in subjects with seasonal allergic rhinoconjunctivitis to evaluate health gain associated with sublingual grass allergen immunotherapy. Health Qual Life Outcomes. 2014;12:99.
    1. Remenschneider AK, Scangas G, Meier JC, et al. EQ-5D-derived health utility values in patients undergoing surgery for chronic rhinosinusitis. Laryngoscope. 2015;125(5):1056-1061.
    1. Di Fraia M, Tripodi S, Arasi S, et al. Adherence to prescribed E-Diary recording by patients with seasonal allergic rhinitis: observational study. J Med Internet Res. 2020;22(3):e16642.
    1. Tripodi S, Giannone A, Sfika I, et al. Digital technologies for an improved management of respiratory allergic diseases: 10 years of clinical studies using an online platform for patients and physicians. Ital J Pediatr. 2020;46(1):105.
    1. Bastl K, Bastl M, Bergmann KC, Berger M, Berger U. Translating the burden of pollen allergy into numbers using electronically generated symptom data from the patient's Hayfever diary in Austria and Germany: 10-year Observational Study. J Med Internet Res. 2020;22(2):e16767.
    1. Mokkink LB, Boers M, van der Vleuten CPM, et al. COSMIN Risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments: a Delphi study. BMC Med Res Methodol. 2020;20(1):293.
    1. Bousquet J, Bewick M, Arnavielhe S, et al. Work productivity in rhinitis using cell phones: the MASK pilot study. Allergy. 2017;72(10):1475-1484.
    1. Bousquet J, VandenPlas O, Bewick M, et al. The Work Productivity and Activity Impairment Allergic Specific (WPAI-AS) Questionnaire Using Mobile Technology: the MASK Study. J Investig Allergol Clin Immunol. 2018;28(1):42-44.
    1. Bousquet J, Devillier P, Arnavielhe S, et al. Treatment of allergic rhinitis using mobile technology with real-world data: the MASK observational pilot study. Allergy. 2018;73(9):1763-1774.
    1. Sousa-Pinto B, Eklund P, Pfaar O, et al. Validity, reliability and responsiveness of daily monitoring visual analogue scales in MASK-air®. Clin Transl Allergy. 2021;11(7):e12062.
    1. Devlin NJ, Brooks R. EQ-5D and the EuroQol Group: past, present and future. Appl Health Econ Health Policy. 2017;15(2):127-137.
    1. Janssen MF, Birnie E, Haagsma JA, Bonsel GJ. Comparing the standard EQ-5D three-level system with a five-level version. Value Health. 2008;11(2):275-284.
    1. Fonseca JA, Nogueira-Silva L, Morais-Almeida M, et al. Validation of a questionnaire (CARAT10) to assess rhinitis and asthma in patients with asthma. Allergy. 2010;65(8):1042-1048.
    1. Fonseca JA, Nogueira-Silva L, Morais-Almeida M, et al. Control of Allergic Rhinitis and Asthma Test (CARAT) can be used to assess individual patients over time. Clin Transl Allergy. 2012;2(1):16.
    1. van der Leeuw S, van der Molen T, Dekhuijzen PNR, et al. The minimal clinically important difference of the control of allergic rhinitis and asthma test (CARAT): cross-cultural validation and relation with pollen counts. NPJ Prim Care Respir Med. 2015;25:14107.
    1. Harbiyeli DO, Gemicioglu B, Vehid HE, Bousquet J, Fonseca JA. Turkish language validity and reliability of the Control of Allergic Rhinitis and Asthma Test and its comparison with other scales. Clin Respir J. 2021;15(11):1210-1218.
    1. Prasad M, Wahlqvist P, Shikiar R, Shih YC. A review of self-report instruments measuring health-related work productivity: a patient-reported outcomes perspective. Pharmacoeconomics. 2004;22(4):225-244.
    1. Bousquet J, Neukirch F, Bousquet P, et al. Severity and impairment of allergic rhinitis in patients consulting in primary care. J Allergy Clin Immunol. 2006;117(1):158-162.
    1. Reilly MC, Zbrozek AS, Dukes EM. The validity and reproducibility of a work productivity and activity impairment instrument. Pharmacoeconomics. 1983;4(5):353-365.
    1. Bedard A, Basagana X, Anto JM, et al. Mobile technology offers novel insights into the control and treatment of allergic rhinitis: the MASK study. J Allergy Clin Immunol. 2019;144(1):135-143.e136.
    1. Bedard A, Basagana X, Anto JM, et al. Treatment of allergic rhinitis during and outside the pollen season using mobile technology. A MASK Study. Clin Transl Allergy. 2020;10(1):62.
    1. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155-163.
    1. Husted JA, Cook RJ, Farewell VT, Gladman DD. Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol. 2000;53(5):459-468.
    1. Caimmi D, Neukirch C, Louis R, Malard O, Thabut G, Demoly P. Effect of the use of intranasal spray of essential oils in patients with perennial allergic rhinitis: a prospective study. Int Arch Allergy Immunol. 2021;182:182-189.
    1. Meltzer EO, Schatz M, Nathan R, Garris C, Stanford RH, Kosinski M. Reliability, validity, and responsiveness of the Rhinitis Control Assessment Test in patients with rhinitis. J Allergy Clin Immunol. 2013;131(2):379-386.
    1. Justicia JL, Cardona V, Guardia P, et al. Validation of the first treatment-specific questionnaire for the assessment of patient satisfaction with allergen-specific immunotherapy in allergic patients: the ESPIA questionnaire. J Allergy Clin Immunol. 2013;131(6):1539-1546.

Source: PubMed

3
Prenumerera