Psychometric validation of three new condition-specific questionnaires to assess quality of life, symptoms and treatment satisfaction of patients with aortic aneurysm

Jacquelyn Romaine, George Peach, Matt Thompson, Robert J Hinchliffe, Clare Bradley, Jacquelyn Romaine, George Peach, Matt Thompson, Robert J Hinchliffe, Clare Bradley

Abstract

Background: To evaluate the psychometric properties of three new condition-specific questionnaires designed to assess outcomes amongst patients under pre-operative surveillance for a small abdominal aortic aneurysm (AAA) or who have undergone aneurysm repair. These tools are the Aneurysm-Dependent Quality of Life measure (AneurysmDQoL), the Aneurysm Symptom Rating Questionnaire (AneurysmSRQ) and the Aneurysm Treatment Satisfaction Questionnaire (AneurysmTSQ).

Results: The questionnaires were sent to 297 patients with abdominal aortic aneurysm (AAA) or who had undergone AAA repair (using open or endovascular technique) sampled from five UK NHS Trusts. Exploratory Factor Analysis was used to examine factor structure together with reliability analysis. A subset of 65 patients completed the questionnaires a second time four months later. One hundred and ninety-seven patients (178 men; 18 women) provided data for analysis (69% response rate): mean age was 75 years (range 60-95). Nineteen were under pre-operative surveillance for AAA and 178 had undergone AAA repair (70 open repair; 104 endovascular repair; 4 uncertain). Exploratory Factor Analysis of the AneurysmDQoL and the AneurysmTSQ each demonstrated a one-factor structure. The AneurysmSRQ demonstrated a six-factor structure (emotional, weight loss, lower limb, cognitive, general malaise and gastrointestinal symptoms) and a one-factor composite symptom scale. All scales have clean factor structures: item loadings above 0.40, no cross-loadings, and no factors with fewer than three items. Internal consistency reliability was excellent (α = 0.869-0.959) and test-retest reliability good (Intraclass correlation coefficient = 0.70-0.88).

Conclusions: The three new questionnaires have a clear structure and strong reliability and are now ready for use in clinical trials and routine practice, which will allow evaluation of responsiveness to change.

Keywords: Abdominal aortic aneurysm; PROMs; Psychometric development; Quality of life; Symptoms; Treatment satisfaction.

Conflict of interest statement

Professor Clare Bradley is the copyright owner of the three new Aneurysm-specific questionnaires which are licensed by her company, Health Psychology Research (HPR) Ltd., for others to use. CB is a director and majority shareholder of HPR Ltd. and receives royalties when her questionnaires are licenced to commercial companies.

Figures

Fig. 1
Fig. 1
Example item from the AneurysmDQoL (numbers indicate score assigned to each rating)

References

    1. Kent KC. Abdominal aortic aneurysms. N Engl J Med. 2014;371:2101–2108. doi: 10.1056/NEJMcp1401430.
    1. Office for National Statistics. Mortality Statistics – underlying cause, sex and age 2016 Accessed 28.03.2018.
    1. Davis M, Harris M, Earnshaw JJ. Implementation of the National Health Service Abdominal Aortic Aneurysm Screening Program in England. J Vasc Surg. 2013;57(5):1440–1445. doi: 10.1016/j.jvs.2012.10.114.
    1. Public Health England (2018) Abdominal aortic aneurysm (AAA) screening: A free check for men aged 65 and over. Accessed 28.03.18.
    1. EVAR Trial Participants (2005) Endovascular aneurysm repair versus open repair in patients with abdominal aortic aneurysm (EVAR trial 1): randomised controlled trial. 365 (9478): 2179–2186. doi: 10.1016/S0140-6736(05)66627-5.
    1. Rabin R, de Charro F. EQ-5D: A measure of health status from the EuroQol group. Ann Med. 2001;33(5):337–343. doi: 10.3109/07853890109002087.
    1. Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30(6):473–483. doi: 10.1097/00005650-199206000-00002.
    1. Peach, G., Holt, P., Loftus, I., Thompson, M. M., & Hinchliffe, R. (2012). Questions remain about quality of life after abdominal aortic aneurysm repair. J Vasc Surg, 520–527 e1.
    1. Peach G, Romaine J, Wilson A, Holt PJE, Thompson MM, Hinchliffe RJ, Bradley C. Design of new patient-reported outcome measures to assess quality of life, symptoms and treatment satisfaction in patients with abdominal aortic aneurysm. Br J Surg. 2016;103(8):1003–1011. doi: 10.1002/bjs.10181.
    1. Bradley C, Todd C, Gorton T, Symonds E, Martin A, Plowright R. The development of an individualized questionnaire measure of perceived impact of diabetes on quality of life: The ADDQoL. Qual Life Res. 1999;8(1–2):79–91. doi: 10.1023/A:1026485130100.
    1. Bradley C, Speight J. Patient perceptions of diabetes and diabetes therapy: Assessing quality of life. Diabetes Metab Res Rev Suppl. 2002;3:64–69. doi: 10.1002/dmrr.279.
    1. Bradley C. Advances in peritoneal dialysis. Conference on peritoneal Dialysis. 1997. Design of a renal-dependent individualized quality of life questionnaire; pp. 116–120.
    1. Mitchell J, Bradley C. Design of an individualised measure of the impact of macular disease on quality of life (the MacDQoL) Qual Life Res. 2004;13(6):1163–1175. doi: 10.1023/B:QURE.0000031348.51292.4a.
    1. Woodcock A, Bradley C, Plowright R, Ffytche T, Kennedy-Martin T, Hirsch A. The influence of diabetic retinopathy on quality of life. interviews to guide the design of a condition-specific, individualised questionnaire: the RetDQoL Patient Educ Couns. 2004;53(3):365–383. doi: 10.1016/j.pec.2003.10.007.
    1. McMillan CV, Bradley C, Woodcock A, Razvi S, Weaver JU. Design of new questionnaires to measure quality of life and treatment satisfaction in hypothyroidism. Thyroid. 2004;14(11):916–925. doi: 10.1089/thy.2004.14.916.
    1. McMillan CV, Bradley C, Gibney J, Russell-Jones DL, Sönksen PH. Preliminary development of the new individualized HDQoL questionnaire measuring quality of life in adult hypopituitarism. J Eval Clin Pract. 2006;12(5):501–514. doi: 10.1111/j.1365-2753.2006.00659.x.
    1. McGee HM, O’Boyle CA, Hickey A, O’Malley K, Joyce CR. Assessing the quality of life of the individual: the SEIQoL with a healthy and a gastroenterology unit population. Psychol Med. 1991;21(3):749–759. doi: 10.1017/S0033291700022388.
    1. McMillan C, Bradley C, Razvi S, Weaver J. Evaluation of new measures of the impact of hypothyroidism on quality of life and symptoms: The ThyDQoL and ThySRQ. Value Health. 2008;11(2):285–294. doi: 10.1111/j.1524-4733.2007.00232.x.
    1. Taylor MD, Han TS, Ward H, McBride J, Yap I, Bradley C. Evaluation of the hypoglycaemia symptom rating questionnaire (HypoSRQ) and its relationship with hypoglycaemic episodes measured using continuous glucose monitoring. Diabetes Technol Ther. 2013;15(Suppl 1):0–65. doi: 10.1089/dia.2012.1221.
    1. Bradley C. Handbook of Psychology and Diabetes: a guide to psychological measurement in diabetes research and practice Abingdon: Routledge. 1994. The diabetes treatment satisfaction questionnaire: DTSQ.
    1. Mitchell J, Brose L, Bradley C (2007) Design of a measure of satisfaction with treatment for Macular Degeneration (MacTSQ). International Society for Quality of Life Research meeting. Qual Life Res: A-120, Abstract #1150. Available:
    1. Woodcock A, Bradley C. Validation of the HIV treatment satisfaction questionnaire (HIVTSQ) Qual Life Res. 2001;10(6):517–531. doi: 10.1023/A:1013050904635.
    1. Romaine, J., Murray, M., & Bradley, C. (2016). Psychometric evaluation of the revised HIV treatment satisfaction questionnaire (HIVTSQ). Value Health, 19(7) Abstract PIN76: a420). 10.1016/j.val.2016.09.426.
    1. Brose LS, Bradley C. Psychometric development of the retinopathy treatment satisfaction questionnaire (RetTSQ) Psychol Health Med. 2009;14(6):740–754. doi: 10.1080/13548500903431485.
    1. Kaiser HF. A second generation little jiffy. Psychometrika. 1970;35:401–415. doi: 10.1007/BF02291817.
    1. Kaiser HF. An index of factorial simplicity. Psychometrika. 1974;39:32–36. doi: 10.1007/BF02291575.
    1. Bartlett MS. A note on the multiplying factors for various chi square approximations. Journal of the Royal Statistical Society. 1954;16(Series B):296–298.
    1. Horn JL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30:179–185. doi: 10.1007/BF02289447.
    1. Costello, A., & Osborne, J. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pract Assess Res Eval, 10(7). Available online: Accessed 3rd July 2008.
    1. Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psycho Methods. 1999;4:272–299. doi: 10.1037/1082-989X.4.3.272.
    1. Iacobucci D. Factor analysis. Journal of Consumer Psychology: Special issue on methodological and statistical concerns of the experimental behavioural researcher. 2001;10(1&2):81.
    1. Comrey A, Lee H. A first course in factor analysis. NJ: Lawrence Erlbaum; 1992.
    1. Mitchell J, Bradley C. Psychometric evaluation of the 12-item well-being questionnaire for use with people with macular disease. Qual Life Res. 2001;10:465. doi: 10.1023/A:1012540100613.
    1. Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, Bouter LM, de Vet HCW. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epideml. 2007;60(1):34–42. doi: 10.1016/j.jclinepi.2006.03.012.
    1. Bradley C, Lewis KS. Measures of psychological well-being and treatment satisfaction developed from the responses of people with tablet-treated diabetes. Diabet Med. 1990;7(5):445–451. doi: 10.1111/j.1464-5491.1990.tb01421.x.
    1. Brose L, Dawczynski J, Menon G, Bradley C. Development of the individualised eye-dependent quality of life questionnaire: EyeDQoL. Qual Life Res. 2010;19(Suppl 1):1883.
    1. McMillan C, Bradley C, Gibney J, Russell-Jones DL, Sonksen PH. Preliminary development of the new individualised HDQoL questionnaire measuring quality of life in adult hypopituitarism. J Eval Clin Pract. 2006;12(5):501–514. doi: 10.1111/j.1365-2753.2006.00659.x.
    1. McMillan C, Bradley C, Razvi S, Weaver J. Psychometric evaluation of a new questionnaire measuring treatment satisfaction in hypothyroidism: The ThyTSQ. Value Health. 2006;9(2):132–139. doi: 10.1111/j.1524-4733.2006.00091.x.
    1. Mitchell J, Wolffsohn JS, Woodcock A, Anderson SJ, McMillan CV, Ffytche T, Rubinstein M, Amoaku W, Bradley C. +psychometric evaluation of the MacDQoL individualised measure of the impact of macular degeneration on quality of life. Health Qual Life Outcomes. 2005;3:25. doi: 10.1186/1477-7525-3-25.
    1. Romaine J, Bayfield J, Plowright R, Murray M, Bradley C. Design of the HIV Dependent Quality of Life (HIVDQoL) questionnaire and HIV Symptom Rating Questionnaire (HIVSRQ) Qual Life Res (2015) 2015;24(Suppl 1):3035.
    1. Scott RA, Bridgewater SG, Ashton HA. Randomised clinical trial of screening for abdominal aortic aneurysm in women. Br J Surg. 2002;89(3):283–285. doi: 10.1046/j.0007-1323.2001.02014.x.
    1. Participants USAT. Mortality results for randomised controlled trials of early elective surgery or ultraonographic surveillance for small abdominal aortic aneurysms. The UK Small Aneurysm Trial Participants Lancet. 1998;352(9141):1649–1655.
    1. Trial Participants EVAR. Endovascular aneurysm repair and outcome in patients unfit for open repair of abdominal aortic aneurysm (EVAR trial 2): Randomised controlled trial. Lancet. 2005;365(9478):2187–2192. doi: 10.1016/S0140-6736(05)66628-7.
    1. Greenhalgh RM, Brown LC, Kwong GPS, Powell JT, Thompson SG. Comparison of endovascular aneurysm repair with open repair in patients with abdominal aortic aneurysm (EVAR trial 1), 30-day operative mortality results: Randomised controlled trial. Lancet. 2004;364(9437):843–848. doi: 10.1016/S0140-6736(04)16979-1.
    1. Peach G, Romaine J, Holt PJE, Thompson MM, Bradley C, Hinchliffe RJ. Quality of life, symptoms and treatment satisfaction in patients with aortic aneurysm using new abdominal aortic aneurysm-specific patient-reported outcome measures. Br J Surg. 2016;103(8):1020–1029. doi: 10.1002/bjs.10144.

Source: PubMed

3
Prenumerera