Validity and test retest reliability of the vascular quality of life Questionnaire-6: a short form of a disease-specific health-related quality of life instrument for patients with peripheral arterial disease

Christine Kumlien, Joakim Nordanstig, Mats Lundström, Monica Pettersson, Christine Kumlien, Joakim Nordanstig, Mats Lundström, Monica Pettersson

Abstract

Background: Many existing patient-reported outcome measures are extensive regarding both patient burden and administration, and in terms of analysing and reporting results. The VascuQoL-6 (VQ6) - a short version of the original Vascular Quality of Life Questionnaire (VascuQoL), a disease-specific instrument for peripheral arterial disease - was recently developed. However, the VQ6 has not yet been empirical tested with regard to content validity, construct validity and test retest reliability. Our aim was, therefore, to explore both the validity and the reliability of the VQ-6 in a target population with established peripheral arterial disease.

Methods: Two hundred patients treated at two vascular centres were consecutively recruited for the survey. Administered questionnaires included VQ6 and the Short Form Health Survey-36 (SF-36). Out of the 200 patients, 150 also received a second VQ6 questionnaire for a test-retest assessment. Further, a purposive sample of 22 patients consented to participate in cognitive interviews. All included patients suffer from peripheral arterial disease. The questionnaire data was tested by both Rasch analysis and traditional psychometric methods, while the cognitive interviews were analysed descriptively.

Results: The validity and reliability of the VQ6, as tested in a target population without the surrounding 19 items from the original VascuQoL, was high, in general, and a good fit to the Rasch model was observed. Further, an excellent internal consistency and significant correlations between comparable dimensions in SF-36 were demonstrated. In the test-retest analysis, the percentage agreement was somewhat poor (<70%) in the six items. However, no systematic disagreements between the two assessments were seen in any of the six items, and the test-retest assessment for the VQ6 sum score showed an acceptable intraclass correlation coefficient (0.86). Finally, all items in the VQ6 were considered as both understandable and relevant by the interviewed patients.

Conclusions: The VQ6 has acceptable to good psychometric properties with regard to data quality, scale assumptions, targeting, validity and reliability. Further, VQ6 seems to be easy to use and comprehend within the target population of patients with PAD.

Keywords: Cognitive interviews; Health-related quality of life; Peripheral arterial disease; Rasch analysis; VascuQoL; VascuQoL-6.

Conflict of interest statement

Ethics approval and consent to participate

All patients were informed that participation was voluntary, and written informed consent forms for participation were collected from each patient. The study was approved by the Regional Ethical Review Board at Lund University (no 315/2008 and no 750/2013).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Figures

Fig. 1
Fig. 1
Category thresholds between the four response options in category probability curves for the six items in VQ6
Fig. 2
Fig. 2
Person-item map for the six items in VQ6 showing the ability of the patients to the left and the difficulty of the items (VQ1-VQ6) to the right of a linear scale (from −6 to +6 logits). The measure (logit) shows the logarithm of the odds ratio for being able to perform an item activity successfully. The distance between a respondent and an item shows the probability of the respondents to perform successfully the item activity. Preferable, person and item should center on the same mean value. M, S and T represent mean, 1SD and 2SD, respectively. Each # is 2 persons. The instrument is well targeted because the item means and person means were separated by only 0.48 logits
Fig. 3
Fig. 3
The contingency table (a) (T1 vertical = first measurement, T2 horizontal = second measurement) and the ROC curve (b) show no systematic disagree in concentration between the two assessments of item 4. ROC, relative operating characteristic
Fig. 4
Fig. 4
The contingency table (a) (T1 vertical = first measurement, T2 horizontal = second measurement) and the ROC curve (b) show no systematic disagree in concentration between the two assessments of item 3. ROC, relative operating characteristic
Fig. 5
Fig. 5
The Bland-Altman plot display the differences plotted against the averages of the two measurements of VQ6 sum score. The limits of agreement are defined as the mean difference ± 1.96SD of differences
Fig. 6
Fig. 6
Cognitive interviews with patients (n = 22)

References

    1. Moons P, Budts W, De Geest S. Critique on the conceptualisation of quality of life: A review and evaluation of different conceptual approaches. Int J of Nurs Stud. 2006;43:891–901. doi: 10.1016/j.ijnurstu.2006.03.015.
    1. Layden J, Michaels J, Bermingham S, Higgins B, Guideline Development Group Diagnosis and management of lower limb peripheral arterial disease: summary of NICE guidance. BMJ. 2012;8(345):e4947. doi: 10.1136/bmj.e4947.
    1. Peach G, Griffin M, Jones KG, Thompson MM, Hinchliffe RJ. Diagnosis and management of peripheral arterial disease. BMJ. 2012;14(345):e5208. doi: 10.1136/bmj.e5208.
    1. European Stroke Organisation. Tendera M, Aboyans V, Bartelink ML, Baumgartner I, Clément D, Collet JP, Cremonesi A, De Carlo M, Erbel R, Fowkes FG, Heras M, Kownator S, Minar E, Ostergren J, Poldermans D, Riambau V, Roffi M, Röther J, Sievert H, van Sambeek M, Zeller T, ESC Committee for Practice Guidelines ESC Guidelines on the diagnosis and treatment of peripheral artery diseases: Document covering atherosclerotic disease of extracranial carotid and vertebral, mesenteric, renal, upper and lower extremity arteries: the Task Force on the Diagnosis and Treatment of Peripheral Artery Diseases of the European Society of Cardiology (ESC) Eur Heart J. 2011;32(22):2851–2906. doi: 10.1093/eurheartj/ehr211.
    1. Maksimovic M, Vlajinac H, Marinkovic J, Kocev N, Voskresenski T, Radak D. Health-related quality of life among patients with peripheral arterial disease. Angiology. 2014;65(6):501–506. doi: 10.1177/0003319713488640.
    1. Marrett E, daCosta DiBonaventura M, Zhang O. Burden of peripheral arterial disease in Europe and the United States: a patient survey. Health and Quality of Life Outcomes. 2013;11:175. doi: 10.1186/1477-7525-11-175.
    1. van Hattum ES, Tangelder MJD, Lawson JA, Moll FL, Algra A. The quality of life in patients after peripheral bypass surgery deteriorates at long-term follow-up. J Vasc Surg. 2011;53:643–650. doi: 10.1016/j.jvs.2010.09.021.
    1. Lindgren H, Gottsäter A, Qvarfordt P, Bergman S. All cause chronic widespread pain is common in patients with symptomatic peripheral arterial disease and is associated with reduced health related quality of life. Eur J Vasc Endovasc Surg. 2016;52:205–210. doi: 10.1016/j.ejvs.2016.05.004.
    1. Ware JE, Donald Sherbourne C. The MOS 36-item Short-Form Health survey (SF-36) Med Care. 1992;30:473–483. doi: 10.1097/00005650-199206000-00002.
    1. Lach B, Hedman M, Schiaffino A. Determining correspondence between scores on the EQ-5D “thermometer” and 5-point categorical scale. Med Care. 1999;37:671–677. doi: 10.1097/00005650-199907000-00007.
    1. Forbes JF, Adam DJ, Bell J, Fowkes FGR, Gillespie I, Raab GM, Ruckley CV, Bradbury AW, on behalf of the BASIL trial Participants Bypass versus Angioplasty in Severe Ischaemia of the Leg (BASIL) trial: Health-related quality of life outcomes, resource utilization, and costeffectiveness analysis. J Vasc Surg. 2010;51:43S–51S. doi: 10.1016/j.jvs.2010.01.076.
    1. Vlajinac H, Marinkovic J, Tanaskovic S, Kocev N, Radak D, Davidovic D, Maksimovic M. Quality of life after peripheral bypass surgery: a 1 year follow-up. Wien Klin Wochenschr. 2015;127:210–217. doi: 10.1007/s00508-014-0663-9.
    1. Morgan MB, Crayford T, Murrin B, Fraser SC. Developing the Vascular Quality of Life Questionnaire: a new disease-specific quality of life measure for use in lower limb ischemia. J Vasc Surg. 2001;33(4):679–687. doi: 10.1067/mva.2001.112326.
    1. de Vries M, Ouwendijk R, Kessels AG, de Haan MW, Flobbe K, Hunink MG, et al. Comparison of generic and disease-specific questionnaires for the assessment of quality of life in patients with peripheral arterial disease. J Vasc Surg. 2005;41(2):261–268. doi: 10.1016/j.jvs.2004.11.022.
    1. Metha T, Venkata Subramaniam A, Chetter I, McCollumet P. Assessing the Validity and Responsiveness of Disease-specific Quality of Life Instruments in Intermittent Claudication. Eur J Vasc Endovasc Surg. 2006;31:46–52. doi: 10.1016/j.ejvs.2005.08.028.
    1. Frans FA, van Wijngaarden SE, Met R, Koelemay MJW. Validation of the Dutch version of the VascuQol questionnaire and the Amsterdam linear disability score in patients with intermittent claudication. Qual Life Res. 2012;21:1487–1493. doi: 10.1007/s11136-011-0060-z.
    1. Nordanstig J, Karlsson J, Pettersson M, Wann-Hansson C. Psychometric properties of the disease-specific health-related quality of life instrument VascuQoL in a Swedish setting. Health Qual Life Outcomes. 2012;10:45. doi: 10.1186/1477-7525-10-45.
    1. Conijn AP, Jens S, Terwee CB, Breek JC, Koelemay MJW. Assessing the quality of available patient reported outcome measures for intermittent claudication: A systematic review using the COSMIN checklist. Eur J Vasc Endovasc Surg. 2015;49:316–334. doi: 10.1016/j.ejvs.2014.12.002.
    1. Nordanstig J, Wann-Hansson C, Karlsson J, Lundström M, Pettersson M, Morgan M. Vascular Quality of Life Questionnaire-6 facilitates health-related quality of life assessment in peripheral arterial disease. J Vasc Surg. 2014;59:700–707. doi: 10.1016/j.jvs.2013.08.099.
    1. Hobart J, Cano S. Improving the evaluation of therapeutic interventions in multiple sclerosis: the role of new psychometric methods. Health Technol Assess. 2009;13 (12): iii, ix-x, 1–177.
    1. Collins D. Pretesting survey instruments: An overview of cognitive methods. Qual Life Res. 2003;12:229–238. doi: 10.1023/A:1023254226592.
    1. Knafl K, Deatrick J, Gallo A, et al. The analysis and interpretation of cognitive interviews for instrument development. Research in Nursing & Health. 2007;30:224–234. doi: 10.1002/nur.20195.
    1. Taft C, Karlsson J, Sullivan M. Do SF-36 component summary scores accurately summarize subscale scores? Qual Life Res. 2001;10:405–413. doi: 10.1023/A:1012552211996.
    1. Rasch G. Probabilistic models for some intelligence and attainment tests. Expanded ed. Chicago; Uiversity of Chicago Press; 1980 xxiii, p 199.
    1. Andrich D, Sheridan B, Luo G. Interpreting RUMM2030. Perth: RUMM Laboratory Pty Ltd.; 2013.
    1. Svensson E. Different ranking approaches defining association and agreement measures of paired ordinal data. Stat Med. 2012;31:3104–3117. doi: 10.1002/sim.5382.
    1. Avdic, A., & Svensson, E. Svenssons method (Version 1.1), Örebro 2010. . (Retrieved on 2017.02.10).
    1. Fayers P, Machin D. Quality of life. The assessment, analysis and reporting of patient-reported outcomes. 3. UK: John Wiley & Sons, Ltd; 2016.
    1. Giavarina D. Understanding Bland Altman analysis. Biochemia Medica. 2015;25(2):141–151. doi: 10.11613/BM.2015.015.
    1. Fayers PM, Hand DJ, Bjordal K, Groenvold M. Causal indicators in quality of life research. Quality of Life Research. 1997;6:393–406. doi: 10.1023/A:1018491512095.
    1. Merbitz C, Morris J, Grip JC. Ordinal scales and foundations of misinference. Arch Phys Med Rehabil. 1989;70:308–312.
    1. Food and Drug Administration: Patient-Reported Outcome measures: Use in Medicinal Product Development to Support Labelling Claims. Washington D.C. 2009 []. (Retrieved on 2017.02.10).
    1. Knutsson I, Rydstrom H, Reimer J, Nyberg P, Hagell P. Interpretation of response categories in patient-reported rating scales: a controlled study among people with Parkinson’s disease. Health Qual Life Outcomes. 2010;8:61. doi: 10.1186/1477-7525-8-61.
    1. Hagell P. Testing Rating Scale Unidimensionality Using the Principal Component Analysis (PCA)/t-Test Protocol with the Rasch Model: The Primacy of Theory over Statistics. Open Journal of Statistics. 2014;4:456–465. doi: 10.4236/ojs.2014.46044.
    1. Bernhardsson S, Larsson MEH. Measuring evidence-based practice in physical therapy: translation, adaptation, further development, validation, and reliability test of a questionnaire. Phys Ther. 2013;93:819–832. doi: 10.2522/ptj.20120270.
    1. Hallgren KA. Computing inter-rater reliability for observational data: an overview and tutorial. Tutor Quant Methods Psychol. 2012;8(1):23–34. doi: 10.20982/tqmp.08.1.p023.
    1. Svensson E. Teaching: A way of implementing novel statistical methods for ordinal data to researchers. In C. Reading (Ed.), Data and context in statistics education: Towards an evidence-based society. Proceedings of the Eighth International Conference on Teaching Statistics (ICOTS8, July, 2010), Ljubljana, Slovenia. Voorburg, The Netherlands: International Statistical Institute. [© 2010 ISI/IASE] . (Retrieved on 2017.02.10).
    1. Wann-Hansson C, Rahm Hallberg I, Klevsgård R, Andersson E. The long-term experience of living with peripheral arterial disease and the recovery following revascularisation: A qualitative study. Int J of Nurs Stud. 2008;45:552–561. doi: 10.1016/j.ijnurstu.2006.11.006.
    1. Marx RG, Menezes A, Horovitz L, Jones EC, Warren RF. A comparison of two time intervals for test-retest reliability of health status instruments. J of Clin Epidemiol. 2003;56:730–735. doi: 10.1016/S0895-4356(03)00084-2.
    1. Streiner DL, Norman GR: Health Measurement Scales. A practical guide to their development and use 3d ed Oxford: Oxford University Press; 2003.

Source: PubMed

3
Abonneren