Measuring the quality of patients' goals and action plans: development and validation of a novel tool

Cayla R Teal, Paul Haidet, Ajay S Balasubramanyam, Elisa Rodriguez, Aanand D Naik, Cayla R Teal, Paul Haidet, Ajay S Balasubramanyam, Elisa Rodriguez, Aanand D Naik

Abstract

Background: The purpose of this study is to develop and test reliability, validity, and utility of the Goal-Setting Evaluation Tool for Diabetes (GET-D). The effectiveness of diabetes self-management is predicated on goal-setting and action planning strategies. Evaluation of self-management interventions is hampered by the absence of tools to assess quality of goals and action plans. To address this gap, we developed the GET-D, a criteria-based, observer rating scale that measures the quality of patients' diabetes goals and action plans.

Methods: We conducted 3-stage development of GET-D, including identification of criteria for observer ratings of goals and action plans, rater training and pilot testing; and then performed psychometric testing of the GET-D.

Results: Trained raters could effectively rate the quality of patient-generated goals and action plans using the GET-D. Ratings performed by trained evaluators demonstrated good raw agreement (94.4%) and inter-rater reliability (Kappa = 0.66). Scores on the GET-D correlated well with measures theoretically associated with goal-setting, including patient activation (r=.252, P<.05), diabetes specific self-efficacy (r=.376, P<.001) and inverse relationship with depression (r= -.376, P<.01). Significant between group differences (P<.01) in GET-D scores between goal-setting intervention (mean = 7.33, standard deviation = 4.4) and education groups (mean = 4.93, standard deviation = 3.9) confirmed construct validity of the GET-D.

Conclusions: The GET-D can reliably and validly rate the quality of goals and action plans. It holds promise as a measure of intervention fidelity for clinical interventions that promote diabetes self-management behaviors to improve clinical outcomes.

Trial registration: Clinicaltrials.gov Identifier: NCT00481286.

Figures

Figure 1
Figure 1
Final Goal-Setting Evaluation Tool (GET-D).

References

    1. Wagner EH, Austin BT, Von KM. Organizing care for patients with chronic illness. Milbank Q. 1996;74:511–544. doi: 10.2307/3350391.
    1. Von Korff M, Gruman J, Schaefer J. et al.Collaborative management of chronic illness. Ann Intern Med. 1997;127:1097–1102.
    1. Estabrooks PA, Nelson CC, Xu S. et al.The frequency and behavioral outcomes of goal choices in the self-management of diabetes. Diabetes Educ. 2005;31:391–400. doi: 10.1177/0145721705276578.
    1. Lorig KR, Holman H. Self-management education: history, definition, outcomes, and mechanisms. Ann Behav Med. 2003;26:1–7. doi: 10.1207/S15324796ABM2601_01.
    1. Lorig K. Action planning: a call to action. J Am Board Fam Med. 2006;19:324–325. doi: 10.3122/jabfm.19.3.324.
    1. MacGregor K, Wong S, Sharifi C. et al.The action plan project: discussing behavior change in the primary care visit. Ann Fam Med. 2005;3(Suppl 2):S39–S40.
    1. Bodenheimer T, Handley MA. Goal-setting for behavior change in primary care: an exploration and status report. Patient Educ Couns. 2009;76:174–180. doi: 10.1016/j.pec.2009.06.001.
    1. Glasgow RE, Whitesides H, Nelson CC. et al.Use of the patient assessment of chronic illness care (PACIC) with diabetic patients: relationship to patient characteristics, receipt of care, and self-management. Diabetes Care. 2005;28:2655–2661. doi: 10.2337/diacare.28.11.2655.
    1. Locke EA, Latham GP. A theory of goal setting and task performance. Englewood, NJ: Prentice Hall; 1990.
    1. Strecher VJ, Seijts GH, Kok GJ. et al.Goal setting as a strategy for health behavior change. Health Educ Behav. 1995;22:190–200. doi: 10.1177/109019819502200207.
    1. Locke EA, Latham GP. Building a practically useful theory of goal setting and task motivation: A 35-year odyssey. Am Psychol. 2002;57:705–17.
    1. Schwarzer R. In: Self-efficacy: thought control of action. 1. Schwarzer R, editor. Washington DC: Hemisphere Publishing Corp; 1992. Self-efficacy in the adoption and maintenance of health behaviours: theoretical approaches and a new model; pp. 217–38.
    1. Scobbie L, Wyke S, Dixon D. Identifying and applying psychological theory to setting and achieving rehabilitation goals. Clin Rehabil. 2009;23:321–333. doi: 10.1177/0269215509102981.
    1. Bovend'Eerdt TJ, Botell RE, Wade DT. Writing SMART rehabilitation goals and achieving goal attainment scaling: a practical guide. Clin Rehabil. 2009;23:352–361. doi: 10.1177/0269215508101741.
    1. DeWalt DA, Davis TC, Wallace AS. et al.Goal setting in diabetes self-management: taking the baby steps to success. Patient Educ Couns. 2009;77:218–223. doi: 10.1016/j.pec.2009.03.012.
    1. Langford AT, Sawyer DR, Gioimo S, Brownson CA, O'Toole ML. Patient-centered goal setting as a tool to improve diabetes self-management. Diabetes Educ. 2007;33(Suppl 6):139S–144S.
    1. Handley M, MacGregor K, Schillinger D, Sharifi C, Wong S, Bodenheimer T. Using action plans to help primary care patients adopt healthy behaviors: a descriptive study. J Am Board Fam Med. 2006;19:224–231. doi: 10.3122/jabfm.19.3.224.
    1. Navicharern R, Aungsuroch Y, Thanasilp S. Effects of multifaceted nurse-coaching intervention on diabetic complications and satisfaction of persons with type 2 diabetes. J Med Assoc Thai. 2009;92:1102–1112.
    1. Naik AD, Palmer N, Petersen NJ. et al.Comparative effectiveness of goal-setting in diabetes group clinics: Randomized clinical trial. Archives Intern Med. 2011;171:453–459. doi: 10.1001/archinternmed.2011.70.
    1. Brennan RL, Prediger DJ. Coefficient Kappa: Some uses, misuses, and alternatives. Educ Psychol Meas. 1981;41:687–699. doi: 10.1177/001316448104100307.
    1. Viswanathan M. Measurement error and research design. Thousand Oaks: Sage Publications; 2005.
    1. Polonsky WH, Fisher L, Earles J. et al.Assessing psychosocial distress in diabetes: development of the diabetes distress scale. Diabetes Care. 2005;28:626–631. doi: 10.2337/diacare.28.3.626.
    1. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46. doi: 10.1177/001316446002000104.
    1. Lorig KR, Ritter P, Stewart AL. et al.Chronic disease self-management program: 2-year health status and health care utilization outcomes. Med Care. 2001;39:1217–1223. doi: 10.1097/00005650-200111000-00008.
    1. Glasgow RE, Wagner EH, Schaefer J. et al.Development and validation of the patient assessment of chronic illness care (PACIC) Med Care. 2005;43:436–444. doi: 10.1097/01.mlr.0000160375.47920.8c.
    1. Lovibond PF, Lovibond SH. The structure of negative emotional states: comparison of the depression anxiety stress scales (DASS) with the beck depression and anxiety inventories. Behav Res Ther. 1995;33:335–343. doi: 10.1016/0005-7967(94)00075-U.
    1. Altman DG. Practical statistics for medical research. London: Chapman and Hall; 1991.

Source: PubMed

赞助者和合作者

医疗条件

药物干预

3
订阅