The psychometric properties of CollaboRATE: a fast and frugal patient-reported measure of the shared decision-making process

Paul James Barr, Rachel Thompson, Thom Walsh, Stuart W Grande, Elissa M Ozanne, Glyn Elwyn, Paul James Barr, Rachel Thompson, Thom Walsh, Stuart W Grande, Elissa M Ozanne, Glyn Elwyn

Abstract

Background: Patient-centered health care is a central component of current health policy agendas. Shared decision making (SDM) is considered to be the pinnacle of patient engagement and methods to promote this are becoming commonplace. However, the measurement of SDM continues to prove challenging. Reviews have highlighted the need for a patient-reported measure of SDM that is practical, valid, and reliable to assist implementation efforts. In consultation with patients, we developed CollaboRATE, a 3-item measure of the SDM process.

Objective: There is a need for scalable patient-reported measure of the SDM process. In the current project, we assessed the psychometric properties of CollaboRATE.

Methods: A representative sample of the US population were recruited online and were randomly allocated to view 1 of 6 simulated doctor-patient encounters in January 2013. Three dimensions of SDM were manipulated in the encounters: (1) explanation of the health issue, (2) elicitation of patient preferences, and (3) integration of patient preferences. Participants then completed CollaboRATE (possible scores 0-100) in addition to 2 other patient-reported measures of SDM: the 9-item Shared Decision Decision Making Questionnaire (SDM-Q-9) and the Doctor Facilitation subscale of the Patient's Perceived Involvement in Care Scale (PICS). A subsample of participants was resurveyed between 7 and 14 days after the initial survey. We assessed CollaboRATE's discriminative, concurrent, and divergent validity, intrarater reliability, and sensitivity to change.

Results: The final sample consisted of 1341 participants. CollaboRATE demonstrated discriminative validity, with a significant increase in CollaboRATE score as the number of core dimensions of SDM increased from zero (mean score: 46.0, 95% CI 42.4-49.6) to 3 (mean score 85.8, 95% CI 83.2-88.4). CollaboRATE also demonstrated concurrent validity with other measures of SDM, excellent intrarater reliability, and sensitivity to change; however, divergent validity was not demonstrated.

Conclusions: The fast and frugal nature of CollaboRATE lends itself to routine clinical use. Further assessment of CollaboRATE in real-world settings is required.

Keywords: Internet; decision making; patient participation; physician-patient relations; psychometrics/Instrumentation; questionnaires.

Conflict of interest statement

Glyn Elwyn has received funding from the Informed Medical Decisions Foundation, Boston, MA, USA, and provides ad hoc consulting to Emmi Solutions. No other authors have conflicts of interests to report.

Figures

Figure 1
Figure 1
Independent observer ratings (n=7) of the simulated clinical encounters using the observer OPTION Scale and Rochester Participatory Decision-Making Scale.

References

    1. Coulter A, Edwards A, Elwyn G, Thomson R. Implementing shared decision making in the UK. Z Evid Fortbild Qual Gesundhwes. 2011 Jan;105(4):300–4. doi: 10.1016/j.zefq.2011.04.014.
    1. Frosch DL, Moulton BW, Wexler RM, Holmes-Rovner M, Volk RJ, Levin CA. Shared decision making in the United States: policy and implementation activity on multiple fronts. Z Evid Fortbild Qual Gesundhwes. 2011;105(4):305–12. doi: 10.1016/j.zefq.2011.04.004.
    1. Härter M, van der Weijden T, Elwyn G. Policy and practice developments in the implementation of shared decision making: an international perspective. Z Evid Fortbild Qual Gesundhwes. 2011 Jan;105(4):229–33. doi: 10.1016/j.zefq.2011.04.018.
    1. Barry MJ, Edgman-Levitan S. Shared decision making--pinnacle of patient-centered care. N Engl J Med. 2012 Mar 1;366(9):780–1. doi: 10.1056/NEJMp1109283.
    1. Gravel K, Légaré F, Graham ID. Barriers and facilitators to implementing shared decision-making in clinical practice: a systematic review of health professionals' perceptions. Implement Sci. 2006 Jan;1:16. doi: 10.1186/1748-5908-1-16.
    1. Simon D, Loh A, Härter M. Measuring (shared) decision-making--a review of psychometric instruments. Z Arztl Fortbild Qualitatssich. 2007 May;101(4):259–67.
    1. Scholl I, Koelewijn-van Loon M, Sepucha K, Elwyn G, Légaré F, Härter M, Dirmaier J. Measurement of shared decision making - a review of instruments. Z Evid Fortbild Qual Gesundhwes. 2011 Jan;105(4):313–24. doi: 10.1016/j.zefq.2011.04.012.
    1. Légaré F, Witteman HO. Shared decision making: examining key elements and barriers to adoption into routine clinical practice. Health Aff (Millwood) 2013 Feb;32(2):276–84. doi: 10.1377/hlthaff.2012.1078.
    1. Elwyn G, Scholl I, Tietbohl C, Mann M, Edwards A, Clay K, Légaré F, Weijden TVD, Lewis CL, Wexler RM, Frosch DL. “Many miles to go …”: a systematic review of the implementation of patient decision support interventions into routine clinical practice. BMC Med Inform Decis Mak. 2013;13(Suppl 2):S14. doi: 10.1186/1472-6947-13-S2-S14.
    1. Melbourne E, Sinclair K, Durand MA, Légaré F, Elwyn G. Developing a dyadic OPTION scale to measure perceptions of shared decision making. Patient Educ Couns. 2010 Feb;78(2):177–83. doi: 10.1016/j.pec.2009.07.009.
    1. Martin LR, DiMatteo MR, Lepper HS. Facilitation of patient involvement in care: development and validation of a scale. Behav Med. 2001 Jan;27(3):111–20. doi: 10.1080/08964280109595777.
    1. Lerman CE, Brody DS, Caputo GC, Smith DG, Lazaro CG, Wolfson HG. Patients' Perceived Involvement in Care Scale: relationship to attitudes about illness and medical care. J Gen Intern Med. 1990;5(1):29–33.
    1. Kriston L, Scholl I, Hölzel L, Simon D, Loh A, Härter M. The 9-item Shared Decision Making Questionnaire (SDM-Q-9). Development and psychometric properties in a primary care sample. Patient Educ Couns. 2010 Jul;80(1):94–9. doi: 10.1016/j.pec.2009.09.034.
    1. Degner LF, Kristjanson LJ, Bowman D, Sloan JA, Carriere KC, O'Neil J, Bilodeau B, Watson P, Mueller B. Information needs and decisional preferences in women with breast cancer. JAMA. 1997 May 14;277(18):1485–92.
    1. Entwistle VA, Skea ZC, O'Donnell MT. Decisions about treatment: interpretations of two measures of control by women having a hysterectomy. Soc Sci Med. 2001 Sep;53(6):721–32.
    1. Entwistle VA, Watt IS, Gilhooly K, Bugge C, Haites N, Walker AE. Assessing patients' participation and quality of decision-making: insights from a study of routine practice in diverse settings. Patient Educ Couns. 2004 Oct;55(1):105–13. doi: 10.1016/j.pec.2003.08.005.
    1. Hauer KE, Fernandez A, Teherani A, Boscardin CK, Saba GW. Assessment of medical students' shared decision-making in standardized patient encounters. J Gen Intern Med. 2011 Apr;26(4):367–72. doi: 10.1007/s11606-010-1567-7.
    1. Weiss MC, Peters TJ. Measuring shared decision making in the consultation: a comparison of the OPTION and Informed Decision Making instruments. Patient Educ Couns. 2008 Jan;70(1):79–86. doi: 10.1016/j.pec.2007.09.001.
    1. de Boer AG, van Lanschot JJ, Stalmeier PF, van Sandick JW, Hulscher JB, de Haes JC, Sprangers MA. Is a single-item visual analogue scale as valid, reliable and responsive as multi-item scales in measuring quality of life? Qual Life Res. 2004 Mar;13(2):311–20.
    1. Bowling A. Just one question: If one question works, why ask several? J Epidemiol Community Health. 2005 May;59(5):342–5. doi: 10.1136/jech.2004.021204.
    1. Littman AJ, White E, Satia JA, Bowen DJ, Kristal AR. Reliability and validity of 2 single-item measures of psychosocial stress. Epidemiology. 2006 Jul;17(4):398–403. doi: 10.1097/01.ede.0000219721.89552.51.
    1. Lindberg P, Josephson M, Alfredsson L, Vingård E. Comparisons between five self-administered instruments predicting sick leaves in a 4-year follow-up. Int Arch Occup Environ Health. 2009 Jan;82(2):227–34. doi: 10.1007/s00420-008-0326-0.
    1. DeSalvo KB, Jones TM, Peabody J, McDonald J, Fihn S, Fan V, He J, Muntner P. Health care expenditure prediction with a single item, self-rated health measure. Med Care. 2009 Apr;47(4):440–7. doi: 10.1097/MLR.0b013e318190b716.
    1. Elwyn G, Barr PJ, Grande SW, Thompson R, Walsh T, Ozanne EM. Developing CollaboRATE: a fast and frugal patient-reported measure of shared decision making in clinical encounters. Patient Educ Couns. 2013 Oct;93(1):102–7. doi: 10.1016/j.pec.2013.05.009.
    1. CollaboRATE. [2013-12-18]. .
    1. File T. Computer and Internet use in the United States: Population characteristics. Washington, DC: US Census Bureau; 2013. May, [2013-11-04]. .
    1. Liu H, Cella D, Gershon R, Shen J, Morales LS, Riley W, Hays RD. Representativeness of the Patient-Reported Outcomes Measurement Information System Internet panel. J Clin Epidemiol. 2010 Nov;63(11):1169–78. doi: 10.1016/j.jclinepi.2009.11.021.
    1. Elwyn G, Hutchings H, Edwards A, Rapport F, Wensing M, Cheung WY, Grol R. The OPTION scale: measuring the extent that clinicians involve patients in decision-making tasks. Health Expect. 2005 Mar;8(1):34–42. doi: 10.1111/j.1369-7625.2004.00311.x.
    1. Shields CG, Franks P, Fiscella K, Meldrum S, Epstein RM. Rochester Participatory Decision-Making Scale (RPAD): reliability and validity. Ann Fam Med. 2005;3(5):436–42. doi: 10.1370/afm.305.
    1. Rubin HR, Gandek B, Rogers WH, Kosinski M, McHorney CA, Ware JE. Patients' ratings of outpatient visits in different practice settings. Results from the Medical Outcomes Study. JAMA. 1993 Aug 18;270(7):835–40.
    1. US Census Bureau. 2012. [2013-11-04]. Annual social and economic supplement
    1. Office of Management and Budget . Federal Register Notice. Washington, DC: The White House; 1997. Oct 30, [2013-11-04]. Revisions to the Standards for the Classification of Federal Data on Race and Ethnicity .
    1. Shin HB, Kominski RA. Language Use in the United States: 2007. Washington, DC: US Census Bureau; 2010. Apr, [2013-11-04]. .
    1. CAHPS Clinician & Group Surveys: Supplemental Items for the Adult Surveys 2.0. 2012. May 01, [2013-12-20]. .
    1. Walker A, Maher J, Coulthard M, Goddard E, Thomas M. Living in Britain: Results from the 2000/01 General Household Survey. London: Office for National Statistics; 2001. [2013-12-20]. .
    1. Degner LF, Sloan JA, Venkatesh P. The Control Preferences Scale. Can J Nurs Res. 1997;29(3):21–43.
    1. Streiner DL, Norman GR. Health Measurement Scales: A Practical Guide to Their Development and Use. Oxford: Oxford University Press; 2008.
    1. Cohen J. A power primer. Psychol Bull. 1992 Jul;112(1):155–9.
    1. Acock A. A Gentle Introduction to Stata, Revised Third Edition. College Station, TX: Stata Press; 2012.
    1. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159–74.
    1. Liang MH. Longitudinal construct validity: establishment of clinical meaning in patient evaluative instruments. Med Care. 2000 Sep;38(9 Suppl):II84–90.
    1. Howden L, Meyer J. Age and Sex Composition: 2010. Washington, DC: US Census Bureau; 2011. May, [2013-11-04]. .
    1. Humes K, Jones N, Ramirez R. Overview of Race and Hispanic Origin: 2010. Washington, DC: US Census Bureau; 2011. Mar, [2013-11-04]. .
    1. Schnabl GK, Hassard TH, Kopelow ML. The assessment of interpersonal skills using standardized patients. Acad Med. 1991 Sep;66(9 Suppl):S34–6.
    1. Cohen DS, Colliver JA, Marcy MS, Fried ED, Swartz MH. Psychometric properties of a standardized-patient checklist and rating-scale form used to assess interpersonal and communication skills. Acad Med. 1996 Jan;71(1 Suppl):S87–9.
    1. van Zanten M, Boulet JR, McKinley D. Using standardized patients to assess the interpersonal skills of physicians: six years' experience with a high-stakes certification examination. Health Commun. 2007 Jan;22(3):195–205. doi: 10.1080/10410230701626562.
    1. Winterbottom AE, Bekker HL, Conner M, Mooney AF. Patient stories about their dialysis experience biases others' choices regardless of doctor's advice: an experimental study. Nephrol Dial Transplant. 2012 Jan;27(1):325–31. doi: 10.1093/ndt/gfr266.
    1. DeSalvo KB, Jones TM, Peabody J, McDonald J, Fihn S, Fan V, He J, Muntner P. Health care expenditure prediction with a single item, self-rated health measure. Med Care. 2009 Apr;47(4):440–7. doi: 10.1097/MLR.0b013e318190b716.
    1. Littman AJ, White E, Satia JA, Bowen DJ, Kristal AR. Reliability and validity of 2 single-item measures of psychosocial stress. Epidemiology. 2006 Jul;17(4):398–403. doi: 10.1097/01.ede.0000219721.89552.51.
    1. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O'Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012 Jan;6:CD000259. doi: 10.1002/14651858.CD000259.pub3.
    1. Griffin SJ, Kinmonth AL, Veltman MW, Gillard S, Grant J, Stewart M. Effect on health-related outcomes of interventions to alter the interaction between patients and practitioners: a systematic review of trials. Ann Fam Med. 2004;2(6):595–608. doi: 10.1370/afm.142.

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe