Treatment fidelity in the Camden Weight Loss (CAMWEL) intervention assessed from recordings of advisor-participant consultations

Lorraine M Noble, Emma Godfrey, Liane Al-Baba, Gabriella Baez, Nicki Thorogood, Kiran Nanchahal, Lorraine M Noble, Emma Godfrey, Liane Al-Baba, Gabriella Baez, Nicki Thorogood, Kiran Nanchahal

Abstract

Background: Variations in the delivery of content and process can alter the effectiveness of complex interventions. This study examined the fidelity of a weight loss intervention (Camden Weight Loss) from recorded consultations by assessing advisors' delivery of content, use of motivational interviewing approach and therapeutic alliance.

Methods: A process evaluation was conducted of advisor-participant consultations in a 12-month randomised controlled trial of an intervention for adult volunteers with a body mass index categorised as overweight or obese. A convenience sample of 22 consultations (12% of 191 participants) recorded at the intervention mid-point were available for analysis. Consultations were independently rated by two observers independent of intervention or study delivery, using: a fidelity scale, the Motivational Interviewing Treatment Integrity Scale and the Primary Care Therapy Process Rating Scale. Raters were blind to participants' responses to the intervention and weight outcomes. Half the participants (N = 11) achieved significant weight loss (≥ 5% of baseline weight).

Results: A mean of 41% of prescribed content was delivered, with a range covered per session of 8-98%, falling below the 100% content expected per session. Tasks included most frequently were: taking weight and waist measurements (98%), scheduling next appointment (86%), review of general progress (85%) and reviewing weight change (84%). Individual items most frequently addressed were 'giving encouragement' and 'showing appreciation of participant's efforts' (95 and 88% respectively). Consultation length (mean 19 min, range 9-30) was shorter than the 30-min allocation. Quantity of content correlated with consultation length (p < 0.01). Advisors' use of motivational interviewing was rated at 'beginner proficiency' for Global Clinician Rating, Reflection to Question Ratio and Percent Open Questions. Therapeutic alliance scores were moderate. Affective aspects were rated highly (e.g. supportive encouragement, involvement and warmth).

Conclusions: Intervention fidelity varied in both content and process, emphasising the importance of ongoing fidelity checks in a complex intervention. Advisors focused on certain practical aspects of the intervention and providing an encouraging interpersonal climate. This concurs with other research findings, which have revealed the value participants in a weight loss intervention place on an empathic advisor-participant relationship.

Clinical trials registration: Registered with Clinicaltrials.gov, number NCT00891943, on 1 May 2009.

Keywords: Communication; Fidelity; Intervention; Motivational interviewing; Obesity; Overweight; Therapeutic alliance; Trial; Weight loss.

Conflict of interest statement

The project was approved by the London School of Hygiene and Tropical Medicine Observational/Interventions Research Ethics Committee, reference number 6356. Written consent was obtained from all participants.Not applicable.The authors declare they have no competing interests.Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

    1. The LancetUrgently needed: a framework convention for obesity control. Lancet. 2011;378(9793):741.
    1. World Health Organization. Global Health Observatory (GHO) data: Obesity; 2016 http://#. Accessed 17 Jan 2017.
    1. Health and Social Care Information Centre. Statistics on obesity, physical activity and diet, England; 2016. ISBN 978-1-78386-698-4.
    1. Department of Health. Policy paper. 2010 to 2015 government policy: obesity and healthy eating; 2015. . Accessed 17 Jan 2017.
    1. NICE National Institute for Health and Social Care Excellence. Weight management: lifestyle services for overweight or obese adults. NICE public health guidance 53; 2014. . Accessed 17 Jan 2017.
    1. Buckroyd J. Psychological interventions for people with a BMI ≥ 35. In: Obesity in the UK: a psychological perspective. Obesity Working Group, Professional Practice Board, The British Psychological Society; 2011. . Accessed 17 Jan 2017.
    1. Hartmann-Boyce J, Johns D, Aveyard P, Onakpoya I, Jebb S, Phillips D et al. Managing overweight and obese adults: update review. The clinical effectiveness of long-term weight management schemes for adults. Review 1a. University of Oxford; 2013a. . Accessed 17 Jan 2017.
    1. Hartmann-Boyce J, Johns D, Aveyard P, Onakpoya I, Jebb SA, Phillips D et al. How components of behavioural weight management programmes affect weight change. Review 1b. University of Oxford; 2013b. . Accessed 17 Jan 2017.
    1. Johns D, Hartmann-Boyce J, Aveyard P, Onakpoya I, Jebb S, Phillips D et al. Weight regain after behavioural weight management programmes. Review 1c. University of Oxford; 2013a. . Accessed 17 Jan 2017.
    1. Johns D, Hartmann-Boyce J, Aveyard P, Lewis A, Jebb SA, Phillips D et al. Managing overweight and obese adults: evidence review. Review 2. University of Oxford; 2013b. . Accessed 17 Jan 2017.
    1. Marchant D. Exercise for obese individuals. In obesity in the UK: a psychological perspective. Obesity working group, professional practice board, the British psychological Society; 2011. . Accessed 17 Jan 2017.
    1. Sniehotta FF, Simpson SA, Greaves CJ. Weight loss maintenance: an agenda for health psychology. Br J Health Psychol. 2014;19(3):459–464. doi: 10.1111/bjhp.12107.
    1. Jeffery RW, Epstein LH, Wilson GT, Drewnowski A, Stunkard AJ, Wing RR. Long-term maintenance of weight loss: current status. Health Psychol. 2000;19(1S):5–16. doi: 10.1037/0278-6133.19.Suppl1.5.
    1. Miller W, Rollnick S. Motivational interviewing: preparing people for change. 2. New York: Guilford Press; 2002.
    1. Burke BL, Arkowitz H, Menchola M. The efficacy of motivational interviewing: a meta-analysis of controlled clinical trials. J Consult Clin Psychol. 2003;71(5):843–861. doi: 10.1037/0022-006X.71.5.843.
    1. Armstrong MJ, Mottershead TA, Ronksley PE, Sigal RJ, Campbell TS, Hemmelgarn BR. Motivational interviewing to improve weight loss in overweight and/or obese patients: a systematic review and meta-analysis of randomized controlled trials. Obes Rev. 2011;12(9):709–723.
    1. van Dorsten B. The use of motivational interviewing in weight loss. Current Diabetes Reports. 2007;7(5):386–390. doi: 10.1007/s11892-007-0063-x.
    1. Cox ME, Yancy WS, Coffman CJ, Østbye T, Tulsky JA, Alexander SC, et al. Effects of counseling techniques on patients’ weight-related attitudes and behaviors in a primary care clinic. Patient Educ Couns. 2011;85(3):363–368. doi: 10.1016/j.pec.2011.01.024.
    1. Wampold BE. How important are the common factors in psychotherapy? An update. World Psychiatry. 2015;14(3):270–277. doi: 10.1002/wps.20238.
    1. Baldwin SA, Wampold BE, Imel ZE. Untangling the alliance-outcome correlation: exploring the relative importance of therapist and patient variability in the alliance. J Consult Clin Psychol. 2007;75(6):842–852. doi: 10.1037/0022-006X.75.6.842.
    1. Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998;18(1):23–45. doi: 10.1016/S0272-7358(97)00043-3.
    1. Sánchez V, Steckler A, Nitirat P, Hallfors D, Cho H, Brodish P. Fidelity of implementation in a treatment effectiveness trial of reconnecting youth. Health Educ Res. 2007;22(1):95–107. doi: 10.1093/her/cyl052.
    1. Appel LJ, Clark JM, Yeh HC, Wang NY, Coughlin JW, Daumit G, et al. Comparative effectiveness of weight-loss interventions in clinical practice. N Engl J Med. 2011;365(21):1959–1968. doi: 10.1056/NEJMoa1108660.
    1. van Eijk-Hustings YJ, Daemen L, Schaper NC, Vrijhoef HJ. Implementation of motivational interviewing in a diabetes care management initiative in the Netherlands. Patient Educ Couns. 2011;84(1):10–15. doi: 10.1016/j.pec.2010.06.016.
    1. Nanchahal K, Power T, Holdsworth E, Hession M, Sorhaindo A, Griffiths U, et al. A pragmatic randomised controlled trial in primary care of the Camden weight loss (CAMWEL) programme. BMJ Open. 2012;2(3):e000793. doi: 10.1136/bmjopen-2011-000793.
    1. Michie S, Rumsey N, Fussell A, Hardeman W, Johnston M, Newman S et al. Improving health: changing behaviour. NHS health trainer handbook. London: Department of Health Publications (Best Practice Guidance: Gateway Ref 9721); 2008. . Accessed 17 Jan 2017.
    1. NICE National Institute for Health and Social Care Excellence. Obesity prevention. Clinical guideline CG43; 2006. . Accessed 17 Jan 2017.
    1. Bandura A. Social foundations of thought and action: a social cognitive theory. Englewood Cliffs, NJ: Prentice-Hall; 1986.
    1. Locke EA. Latham GP. A theory of goal setting and task performance. Englewood Cliffs, NJ: Prentice-Hall; 1990.
    1. Alemi F, Neuhauser D, Ardito S, Headrick L, Moore S, Hekelman F, et al. Continuous self-improvement: systems thinking in a personal context. Jt Comm J Quality and Patient Saf. 2000;26(2):74–86.
    1. Moyers TB, Martin T, Manuel JK, Miller WR, Ernst D. Revised global scales: Motivational interviewing treatment integrity 3.1. 1 (MITI 3.1. 1). Unpublished manuscript, University of New Mexico, Albuquerque, NM; 2010. . Accessed 17 Jan 2017.
    1. Moyers TB, Martin T, Manuel JK, Hendrickson SM, Miller WR. Assessing competence in the use of motivational interviewing. J Subst Abus Treat. 2005;28(1):19–26. doi: 10.1016/j.jsat.2004.11.001.
    1. Carels RA, Darby L, Cacciapaglia HM, Konrad K, Coit C, Harper J, et al. Using motivational interviewing as a supplement to obesity treatment: a stepped-care approach. Health Psychol. 2007;26(3):369–374. doi: 10.1037/0278-6133.26.3.369.
    1. Godfrey E, Chalder T, Ridsdale L, Seed P, Ogden J. Investigating the active ingredients of cognitive behaviour therapy and counselling for patients with chronic fatigue in primary care: developing a new process measure to assess treatment fidelity and predict outcome. Br J Clin Psychol. 2007;46(3):253–272. doi: 10.1348/014466506X147420.
    1. Fleiss JL, Levin, Paik MC. The measure of inter-rater agreement. In: Fleiss JL, Levin B, Paik MC, Statistical methods for rates and proportions, New Jersey: John Wiley & Sons; 2013. p. 598–626.
    1. Uebersax J. Raw agreement indices; 2014. . Accessed 17 Jan 2017.
    1. Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;(4):284–90.
    1. Holdsworth E, Thorogood N, Sorhaindo A, Nanchahal K. A qualitative study of participant engagement with a weight loss intervention. Health Promot Pract. 2016;1524839916659847
    1. Landers R. Computing intra-class correlations as estimates of inter-rater reliability in SPSS. The Winnower, 2015;3:e143518.81744. .

Source: PubMed

3
Subskrybuj