The Anti-Clot Treatment Scale (ACTS) in clinical trials: cross-cultural validation in venous thromboembolism patients

Stefan J Cano, Donna L Lamping, Luke Bamber, Sarah Smith, Stefan J Cano, Donna L Lamping, Luke Bamber, Sarah Smith

Abstract

Background: The Anti-Clot Treatment Scale (ACTS) is a 15-item patient-reported instrument of satisfaction with anticoagulant treatment. It includes a 12-item ACTS Burdens scale and a 3-item ACTS Benefits scale. Its role in clinical trials and other settings should be supported by evidence that it is both clinically meaningful and scientifically sound. The aim of the study was to evaluate the measurement performance of the ACTS (Dutch, Italian, French, German and English language versions) in patients with venous thromboembolism based on traditional psychometric methods.

Methods: ACTS Burdens and Benefits scale data from a large clinical trial (EINSTEIN DVT) involving 1336 people with venous thromboembolism were analysed at both the scale and item level. Five key psychometric properties were examined using traditional psychometric methods: acceptability, scaling assumptions, reliability (including internal consistency reliability, test-retest reproducibility); validity (including known groups and discriminant validity); and responsiveness. These methods of examination underpin the US Food and Drug Administration recommendations for patient-reported outcome instrument evaluation.

Results: Overall, the 12-item ACTS Burdens scale and 3-item ACTS Benefits scale met the psychometric criteria evaluated at both item and scale levels, with the exception of some relatively minor issues in the Dutch language version, which were just below reliability criteria (i.e. alpha = 0.72, test-retest intraclass correlation = 0.79). A consistent finding from item-level evaluations of aggregate endorsement frequencies and skewness suggested that response scales may be improved by reducing the number of response options from five to four.

Conclusions: Both the ACTS Burdens and ACTS Benefits scales consistently satisfied traditional reliability and validity criteria across multiple language datasets, supporting it as a clinically useful patient-reported instrument of satisfaction with anticoagulant treatment in clinical trials.

Trial registration number: NCT00440193.

References

    1. Revicki DA. FDA draft guidance and health-outcomes research. Lancet. 2007;369:540–542. doi: 10.1016/S0140-6736(07)60250-5.
    1. Cano SJ, Hobart JC. Watch out, watch out, the FDA are about. Dev Med Child Neurol. 2008;50:408–409. doi: 10.1111/j.1469-8749.2008.00408.x.
    1. Scientific Advisory Committee of the Medical Outcomes Trust. Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002;11:193–205. doi: 10.1023/A:1015291021312.
    1. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19:539–549. doi: 10.1007/s11136-010-9606-8.
    1. Food and Drug Administration. Guidance for industry: Patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes. 2006;4:79.
    1. Heit JA. Venous thromboembolism: disease burden, outcomes and risk factors. J Thromb Haemost. 2005;3:1611–1617. doi: 10.1111/j.1538-7836.2005.01415.x.
    1. White RH. The epidemiology of venous thromboembolism. Circulation. 2003;107:14–18. doi: 10.1161/01.CIR.0000042764.06760.B9.
    1. Petersen P. New approaches to anticoagulation in atrial fibrillation. Curr Cardiol Rep. 2004;6:354–364. doi: 10.1007/s11886-004-0038-3.
    1. Ansell J, Hirsh J, Hylek E, Jacobson A, Crowther M, Palareti G. Pharmacology and management of the vitamin K antagonists: American College of Chest Physicians evidence-based clinical practice guidelines (8th Edition) Chest. 2008;133:160S–198S. doi: 10.1378/chest.08-0670.
    1. Wild D, Murray M, Donatti C. Patient perspectives on taking vitamin K antagonists: a qualitative study in the UK, USA and Spain. Expert Rev Pharmacoecon Outcomes Res. 2009;9:467–474. doi: 10.1586/erp.09.48.
    1. Wild D, Murray M, Shakespeare A, Reaney M, von Maltzahn R. Patient-reported treatment satisfaction measures for long-term anticoagulant therapy. Expert Rev Pharmacoecon Outcomes Res. 2008;8:291–299. doi: 10.1586/14737167.8.3.291.
    1. Samsa G, Matchar DB, Dolor RJ, Wiklund I, Hedner E, Wygant G, Hauch O, Marple CB, Edwards R. A new instrument for measuring anticoagulation-related quality of life: development and preliminary validation. Health Qual Life Outcomes. 2004;2:22. doi: 10.1186/1477-7525-2-22.
    1. The EINSTEIN Investigators. Oral rivaroxaban for symptomatic venous thromboembolism. N Engl J Med. 2010;363:2499–2510.
    1. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR Task Force for translation and cultural adaptation. Value Health. 2005;8:94–104. doi: 10.1111/j.1524-4733.2005.04054.x.
    1. Atkinson MJ, Kumar R, Cappelleri JC, Hass SL. Hierarchical construct validity of the treatment satisfaction questionnaire for medication (TSQM version II) among outpatient pharmacy consumers. Value Health. 2005;8(Suppl 1):S9–S24.
    1. Novich M. The axioms and principal results of classical test theory. J Math Psychol. 1966;3:1–18. doi: 10.1016/0022-2496(66)90002-2.
    1. World Health Organization Quality of Life Group. The World Health Organization Quality of Life Assessment (WHOQOL): development and general psychometric properties. Soc Sci Med. 1998;46:1569–1585. doi: 10.1016/S0277-9536(98)00009-4.
    1. Streiner DL. Health Measurement Scales: A Practical Guide to Their Development and Use. New York: Oxford University Press; 2008.
    1. Ware JE, Jr, Harris WJ, Gandek B, Rogers BW, Reese PR. MAP-R for Windows: Multitrait/Multi-Item Analysis Program—Revised User’s Guide. Boston, MA: Health Assessment Lab; 1997.
    1. Ware JE, Jr, Snow K, Kosinski M, Gandek B. Medical Outcome Short Form Health Survey manual and interpretation guide. .
    1. Cano SJ, Browne JP, Lamping DL, Roberts AH, McGrouther DA, Black NA. The Patient Outcomes of Surgery-Hand/Arm (POS-Hand/Arm): a new patient-based outcome measure. J Hand Surg Br. 2004;29:477–485. doi: 10.1016/j.jhsb.2004.06.002.
    1. Cano SJ, Warner TT, Thompson AJ, Bhatia KP, Fitzpatrick R, Hobart JC. The cervical dystonia impact profile (CDIP-58): can a Rasch developed patient reported outcome measure satisfy traditional psychometric criteria? Health Qual Life Outcomes. 2008;6:58. doi: 10.1186/1477-7525-6-58.
    1. Lamping DL, Schroter S, Marquis P, Marrel A, Duprat-Lomon I, Sagnier PP. The community-acquired pneumonia symptom questionnaire: a new, patient-based outcome measure to evaluate symptoms in patients with community-acquired pneumonia. Chest. 2002;122:920–929. doi: 10.1378/chest.122.3.920.
    1. Lamping DL, Schroter S, Kurz X, Kahn SR, Abenhaim L. Evaluation of outcomes in chronic venous disorders of the leg: development of a scientifically rigorous, patient-reported measure of symptoms and quality of life. J Vasc Surg. 2003;37:410–419. doi: 10.1067/mva.2003.152.
    1. Bamber L, Cano SJ, Lamping DL, Wang MY, Prins MH, Bauersachs R, Gallus AS, Lensing AWA. Patient-reported treatment satisfaction with oral rivaroxaban vs. standard therapy in the treatment of symptomatic deep vein thrombosis (DVT) J Thromb Haemost. 2011;9:859. doi: 10.1111/j.1538-7836.2011.04197.x. Abstract P-TH-284.
    1. Sitzia J, Wood N. Patient satisfaction: a review of issues and concepts. Soc Sci Med. 1997;45:1829–1843. doi: 10.1016/S0277-9536(97)00128-7.
    1. Cano SJ, Barrett LE, Zajicek JP, Hobart JC. Beyond the reach of traditional analyses: using Rasch to evaluate the DASH in people with multiple sclerosis. Mult Scler. 2011;17:214–222. doi: 10.1177/1352458510385269.
    1. Hobart J, Cano S. Improving the evaluation of therapeutic interventions in multiple sclerosis: the role of new psychometric methods. Health Technol Assess. 2009;13:iii, ix–iii,177.
    1. Cano SJ, O'Connor RJ, Thompson AJ, Hobart JC. Exploring disability rating scale responsiveness II: do more response options help? Neurology. 2006;67:2056–2059. doi: 10.1212/01.wnl.0000247664.97643.e8.
    1. O'Connor RJ, Cano SJ, Thompson AJ, Hobart JC. Exploring rating scale responsiveness: does the total score reflect the sum of its parts? Neurology. 2004;62:1842–1844. doi: 10.1212/01.WNL.0000116136.22922.D6.
    1. Fitzpatrick R, Morris R, Hajat S, Reeves B, Murray DW, Hannen D, Rigge M, Williams O, Gregg P. The value of short and simple measures to assess outcomes for patients of total hip replacement surgery. Qual Health Care. 2000;9:146–150. doi: 10.1136/qhc.9.3.146.
    1. Dias JJ, Bhowal B, Wildin CJ, Thompson JR. Carpal tunnel decompression. Is lengthening of the flexor retinaculum better than simple division? J Hand Surg Br. 2004;29:269–274.
    1. Hobart JC, Cano SJ, Thompson AJ. Effect sizes can be misleading: is it time to change the way we measure change? J Neurol Neurosurg Psychiatry. 2010;81:1044–1048. doi: 10.1136/jnnp.2009.201392.
    1. Andrich D. Rating scales and Rasch measurement. Expert Rev Pharmacoecon Outcomes Res. 2011;11:571–585. doi: 10.1586/erp.11.59.
    1. Hays RD, Anderson R, Revicki D. Psychometric considerations in evaluating health-related quality of life measures. Qual Life Res. 1993;2:441–449. doi: 10.1007/BF00422218.
    1. Holmes W, Bix B, Shea J. SF-20 score and item distributions in a human immunodeficiency virus-seropositive sample. Med Care. 1996;34:562–569. doi: 10.1097/00005650-199606000-00006.
    1. McHorney CA, Ware JE Jr, Lu JF, Sherbourne CD. The MOS 36-item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care. 1994;32:40–66. doi: 10.1097/00005650-199401000-00004.
    1. Eisen M, Ware JE Jr, Donald CA, Brook RH. Measuring components of children's health status. Med Care. 1979;17:902–921. doi: 10.1097/00005650-197909000-00003.
    1. Brook RH, Ware JE Jr, Davies-Avery A, Stewart AL, Donald CA, Rogers WH, Williams KN, Johnston SA. Overview of adult health measures fielded in Rand's health insurance study. Med Care. 1979;17:iii–131.
    1. Nunnally JC, Bernstein I. Psychometric Theory. New York: McGraw-Hill; 1994.
    1. Cronbach L. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334. doi: 10.1007/BF02310555.
    1. Stevens SS. Mathematics, Measurement, and Psychophysics. Handbook of Experimental Psychology. Oxford: Wiley; 1951.
    1. Duruoz MT, Poiraudeau S, Fermanian J, Menkes CJ, Amor B, Dougados M, Revel M. Development and validation of a rheumatoid hand functional disability scale that assesses functional handicap. J Rheumatol. 1996;23:1167–1172.
    1. Cohen J. Statistical Power Analysis for the Behavioral Sciences. New York: Academic Press; 1977.
    1. Kazis LE, Anderson JJ, Meenan RF. Effect sizes for interpreting changes in health status. Med Care. 1989;27:S178–S189. doi: 10.1097/00005650-198903001-00015.

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe