Measuring decision quality: psychometric evaluation of a new instrument for breast cancer chemotherapy

Clara N Lee, Matthew H Wetschler, Yuchiao Chang, Jeffrey K Belkora, Beverly Moy, Ann Partridge, Karen R Sepucha, Clara N Lee, Matthew H Wetschler, Yuchiao Chang, Jeffrey K Belkora, Beverly Moy, Ann Partridge, Karen R Sepucha

Abstract

Background: Women diagnosed with early stage (I or II) breast cancer face a highly challenging decision - whether or not to undergo adjuvant chemotherapy. We developed a decision quality instrument for chemotherapy for early stage breast cancer and sought to evaluate its performance.

Methods: Cross-sectional, mailed survey of recent breast cancer survivors, providers, and healthy controls and a retest survey of survivors. The decision quality instrument includes questions on knowledge and personal goals. It results in a knowledge score and concordance score, which reflects the percentage of patients who received treatments that match their goals. Hypotheses related to acceptability, feasibility, validity, and reliability of the survey instrument were examined.

Results: Responses were received from 352 patients, 89 providers and 35 healthy controls. The decision quality instrument was feasible to implement with few missing data. The knowledge scores had good retest reliability (intraclass correlation coefficient (ICC) =0.75). Knowledge scores discriminated between providers and patients (mean difference 31.1%, 95% CI 26.9, 35.3) and between patients and healthy controls (mean difference 11.2, 95% CI 5.4, 17.1). Most providers reported that the knowledge items covered essential content. Two of the five goal items had a ceiling effect, and one goal had low content validity. The goal items had moderate retest reliability (ICC's 0.57 to 0.78). In the multivariable model of treatment, none of the patient goals was associated with receipt of chemotherapy. Age and hormone receptor status were the only variables independently associated with chemotherapy. Most patients (77.6%) had treatment concordant with that predicted by the model. Patients who had concordant treatment had similar levels of confidence and regret as those who did not.

Conclusions: The Decision Quality Instrument is a reliable and valid measure of patient knowledge about chemotherapy, but its ability to measure concordance with patient goals is limited. In this sample, patient goals were not associated with treatment, and most patients reported they were not asked their preference, suggesting that goals were not adequately considered in decision making.

References

    1. Carlson RW, Allred DC, Anderson BO, Burstein HJ, Carter WB, Edge SB, Erban JK, Farrar WB, Goldstein LJ, Gradishar WJ, Hayes DF, Hudis CA, Jahanzeb M, Keil K, Ljung BM, Marcom PK, Mayer IA, McCormick B, Nabell LM, Pierce LJ, Reed EC, Smith ML, Somlo G, Theriault RL, Topham NS, Ward JH, Winer EP, Wolff AC. Breast cancer: clinical practice guidelines in oncology. J Natl Compr Canc Netw. 2009;7(2):122–192.
    1. Theriault RL, Carlson RW, Allred C, Anderson BO, Burstein HJ, Edge SB, Farrar WB, Forero A, Giordano SH, Goldstein LJ, Gradishar WJ, Hayes DF, Hudis CA, Isakoff SJ, Ljung BM, Mankoff DA, Marcom PK, Mayer IA, McCormick B, Pierce LJ, Reed EC, Schwartzberg LS, Smith ML, Soliman H, Somlo G, Ward JH, Wolff AC, Zellars R, Shead DA, Kumar R. Breast cancer, version 3.2013: featured updates to the NCCN guidelines. J Natl Compr Canc Netw. 2013;11(7):753–760.
    1. Berry DA, Cirrincione C, Henderson IC, Citron ML, Budman DR, Goldstein LJ, Martino S, Perez EA, Muss HB, Norton L, Hudis C, Winer EP. Estrogen-receptor status and outcomes of modern chemotherapy for patients with node-positive breast cancer. JAMA. 2006;295(14):1658–1667. doi: 10.1001/jama.295.14.1658.
    1. Berry DA, Cronin KA, Plevritis SK, Fryback DG, Clarke L, Zelen M, Mandelblatt JS, Yakovlev AY, Habbema JD, Feuer EJ. Cancer intervention and surveillance modeling network collaborators. Effect of screening and adjuvant therapy on mortality from breast cancer. N Engl J Med. 2005;353(17):1784–1792. doi: 10.1056/NEJMoa050518.
    1. Peto R, Davies C, Godwin J, Gray R, Pan HC, Clarke M, Cutter D, Darby S, McGale P, Taylor C, Wang YC, Bergh J, Di Leo A, Albain K, Swain S, Piccart M, Pritchard K. Early Breast Cancer Trialists’ Collaborative G. Comparisons between different polychemotherapy regimens for early breast cancer: meta-analyses of long-term outcome among 100,000 women in 123 randomised trials. Lancet. 2012;379(9814):432–444.
    1. Elwyn G, O’Connor A, Stacey D, Volk R, Edwards A, Coulter A, Thomson R, Barratt A, Barry M, Bernstein S, Butow P, Clarke A, Entwistle V, Feldman-Stewart D, Holmes-Rovner M, Llewellyn-Thomas H, Moumjid N, Mulley A, Ruland C, Sepucha K, Whelan T. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006;333(7565):417. doi: 10.1136/.
    1. Degner L, Kristijanson L, Bowman D, Sloan J, Carriere K, O’Neil J, Bilodeau B, Watson P, Mueller B. Information needs and decisional preferences in women with breast cancer. JAMA. 1997;277(18):1485–1492. doi: 10.1001/jama.1997.03540420081039.
    1. Ravdin PM, Siminoff IA, Harvey JA. Survey of breast cancer patients concerning their knowledge and expectations of adjuvant therapy. J Clin Oncol. 1998;16(2):515–521.
    1. Belkora JK, Hutton DW, Moore DH, Siminoff LA. Does use of the adjuvant! model influence use of adjuvant therapy through better risk communication? J Natl Compr Canc Netw. 2011;9(7):707–712.
    1. Hutton DW, Belkora JK, Shachter RD, Moore DH. Are patients getting the “gist” in risk communication? Patient understanding of prognosis in breast cancer treatment. J Cancer Educ. 2009;24(3):194–199. doi: 10.1080/08858190902876452.
    1. Belkora JK, Rugo HS, Moore DH, Hutton DW, Chen DF, Esserman LJ. Oncologist use of the Adjuvant! model for risk communication: a pilot study examining patient knowledge of 10-year prognosis. BMC Cancer. 2009;9:127. doi: 10.1186/1471-2407-9-127.
    1. Belkora JK, Rugo HS, Moore DH, Hutton D, Esserman LJ. Risk communication with breast cancer patients: a cautionary note about printing adjuvant! Screenshots. Lancet Oncol. 2008. In Press.
    1. Siminoff LA, Fetting JH, Abeloff MD. Doctor-patient communication about breast cancer adjuvant therapy. J Clin Oncol. 1989;7(9):1192–1200.
    1. Bruera E, Willey JS, Palmer JL, Rosales M. Treatment decisions for breast carcinoma: patient preferences and physician perceptions. Cancer. 2002;94(7):2076–2080. doi: 10.1002/cncr.10393.
    1. Siminoff LA. Improving communication with cancer patients. Oncology. 1992;6(10):83–87. discussion 87–89.
    1. Siminoff L, Ravdin P, Colabianchi N, Sturm C. Doctor-patient communication patterns in breast cancer adjuvant therapy discussions. Health Expect. 2000;3(1):26–36. doi: 10.1046/j.1369-6513.2000.00074.x.
    1. Ravdin PM, Siminoff LA, Davis GJ, Mercer MB, Hewlett J, Gerson N, Parker HL. Computer program to assist in making decisions about adjuvant therapy for women with early breast cancer. J Clin Oncol. 2001;19(4):980–991.
    1. Simes RJ, Coates AS. Patient preferences for adjuvant chemotherapy of early breast cancer: how much benefit is needed? J Natl Cancer Inst Monogr. 2001;30:146–152.
    1. Duric VM, Stockler MR, Heritier S, Boyle F, Beith J, Sullivan A, Wilcken N, Coates AS, Simes RJ. Patients’ preferences for adjuvant chemotherapy in early breast cancer: what makes AC and CMF worthwhile now? Ann Oncol. 2005;16(11):1786–1794. doi: 10.1093/annonc/mdi370.
    1. Mulley AG. Assessing patients’ utilities: can the ends justify the means? Med Care. 1989;27(3 Suppl):S269–S281.
    1. Sepucha K, Mulley A. A perspective on the patient’s role in treatment decisions. Med Care Res Rev. 2008. in press.
    1. Fowler F. Improving Survey Questions. Vol. 38. Thousand Paks, CA: Sage Publiations, Inc.; 2002.
    1. Fowler F. Survey Research Methods. Vol. 1. Thousand Oaks, CA: Sage Publications, Inc; 1993.
    1. DeVellis R. Scale Development Theory and Applications. 2. Vol. 26. Thousand Oaks: Sage Publications; 2003.
    1. Sepucha KR, Levin CA, Uzogara EE, Barry MJ, O’Connor AM, Mulley AG. Developing instruments to measure the quality of decisions: early results for a set of symptom-driven decisions. Patient Educ Couns. 2008;73(3):504–510. doi: 10.1016/j.pec.2008.07.009.
    1. Lee CN, Dominik R, Levin CA, Barry MJ, Cosenza C, O’Connor AM, Mulley AG, Sepucha K. Development of instruments to measure the quality of breast cancer treatment decisions. Health Expect. 2010;13(3):258–272.
    1. Singer E, Couper MP, Fagerlin A, Fowler FJ, Levin CA, Ubel PA, Van Hoewyk J, Zikmund-Fisher BJ. The role of perceived benefits and costs in patients’ medical decisions. Health Expect. 2014;17(1):4–14. doi: 10.1111/j.1369-7625.2011.00739.x.
    1. Zikmund-Fisher BJ, Couper MP, Singer E, Levin CA, Fowler FJ Jr, Ziniel S, Ubel PA, Fagerlin A. The DECISIONS study: a nationwide survey of United States adults regarding 9 common medical decisions. Med Decis Making. 2010;30(5 Suppl):20S–34S. doi: 10.1177/0272989X09353792.
    1. Fowler FJ Jr, Gallagher PM, Drake KM, Sepucha KR. Decision dissonance: evaluating an approach to measuring the quality of surgical decision making. Jt Comm J Qual Patient Saf. 2013;39(3):136–144.
    1. Malin JL, Weeks JC, Potosky AL, Hornbrook MC, Keating NL. Medical oncologists’ perceptions of financial incentives in cancer care. J Clin Oncol. 2013;31(5):530–535. doi: 10.1200/JCO.2012.43.6063.
    1. Whelan T, Sawka C, Levine M, Gafni A, Reyno L, Willan A, Julian J, Dent S, Abu-Zahra H, Chouinard E, Tozer R, Pritchard K, Bodendorfer I. Helping patients make informed choices: a randomized trial of a decision aid for adjuvant chemotherapy in lymph node-negative breast cancer. J Natl Cancer Inst. 2003;95(8):581–587. doi: 10.1093/jnci/95.8.581.
    1. Whelan TJ, Levine MN, Gafni A, Lukka H, Mohide E, Patel M, Streiner D. Breast irradiation post lumpectomy: development and evaluation of a decision instrument. J Clin Oncol. 1995;13:847–853.
    1. Whelan T, Levine M, Gafni A, Sanders K, Willan A, Mirsky D, Schnider D, McCready D, Reid S, Kobylecky A, Reed K. Mastectomy or lumpectomy? Helping women make informed choices. J Clin Oncol. 1999;17(6):1727–1735.
    1. Thewes B, Meiser B, Duric VM, Stockler MR, Taylor A, Stuart-Harris R, Links M, Wilcken N, McLachlan SA, Phillips KA, Beith J, Boyle F, Friedlander ML. What survival benefits do premenopausal patients with early breast cancer need to make endocrine therapy worthwhile? Lancet Oncol. 2005;6(8):581–588. doi: 10.1016/S1470-2045(05)70254-0.
    1. Lee CN, Chang Y, Adimorah N, Belkora JK, Moy B, Partridge AH, Ollila DW, Sepucha KR. Decision making about surgery for early-stage breast cancer. J Am Coll Surg. 2012;214(1):1–10. doi: 10.1016/j.jamcollsurg.2011.09.017.

Source: PubMed

Sponzoři a spolupracovníci

Zdravotní podmínky

Drogové intervence

3
Předplatit