Development of the eTAP: A brief measure of attitudes and process in e-interventions for mental health
Bonnie A Clough, Jessica A Eigeland, Imogen R Madden, Dale Rowland, Leanne M Casey, Bonnie A Clough, Jessica A Eigeland, Imogen R Madden, Dale Rowland, Leanne M Casey
Abstract
Background: Considerable evidence supports the efficacy of e-interventions for mental health treatment and support. However, client engagement and adherence to these interventions are less than optimal and remain poorly understood.
Objective: The aim of the current study was to develop and investigate the psychometric properties of the e-Therapy Attitudes and Process questionnaire (eTAP). Based on the Theory of Planned Behaviour (TPB), the eTAP was designed to measure factors related to client engagement in e-interventions for mental health.
Methods: Participants were 220 adults who reported current use of an e-intervention for mental health support. Participants completed the eTAP and related measures, with a subsample of 49 participants completing a one-week follow up assessment.
Results: A 16-item version of the eTAP produced a clear four-factor structure, explaining 70.25% of variance. The factors were consistent with the TPB, namely, Intention, Subjective Norm, Attitudes, and Perceived Behavioural Control. Internal consistency of the total and subscales was high, and adequate to good one-week test retest reliability was found. Convergent and divergent validity of the total and subscales was supported, as was the predictive validity. Specifically, eTAP Intentions correctly predicted engagement in e-interventions with 84% accuracy and non-engagement with 74% accuracy.
Conclusions: The eTAP was developed as a measure of factors related to engagement and adherence with e-interventions for mental health. Psychometric investigation supported the validity and reliability of the eTAP. The eTAP may be a valuable tool to understand, predict, and guide interventions to increase engagement and adherence to e-interventions for mental health.
Keywords: Adherence; Digital interventions; Dropout; E-mental health; Engagement; Theory of Planned Behaviour.
© 2019 Published by Elsevier B.V.
Figures
References
- Ajzen I. From intentions to actions: a theory of planned behavior. In: Kuhl J., Beckmann J., editors. Action-Control: From Cognition to Behavior. Springer; Heidelberg: 1985. pp. 11–39.
- Ajzen I. The theory of planned behavior. Organ. Behav. Hum. Decis. Process. 1991;50(2):179–211.
- Ajzen I. Perceived behavioral control, self-efficacy, locus of control, and the theory of planned behavior. J. Appl. Soc. Psychol. 2002;32(4):665–683.
- Ajzen I. 2006. Constructing a Theory of Planned Behavior Questionnaire.
- Albarracin D. Theories of reasoned action and planned behavior as models of condom use: a meta-analysis. Psychol. Bull. 2001;127(1):142–161.
- Apolinário-Hagen J., Vehreschild V., Alkoudmani R.M. Current views and perspectives on E-mental health: an exploratory survey study for understanding public attitudes toward internet-based psychotherapy in Germany. JMIR Ment. Health. 2017;4(1)
- Armitage C.J., Conner M. Efficacy of the theory of planned behaviour: a meta-analytic review. Br. J. Soc. Psychol. 2001;40(4):471–499.
- Beatty L., Binnion C. A systematic review of predictors of and reasons for adherence to online psychological interventions. Int. J. Behav. Med. 2016;23(6):776–794.
- Casey L.M., Clough B.A. Making and keeping the connection: improving consumer attitudes and engagement in e-mental health interventions. In: Riva G., Wiederhold W., Cipresso P., editors. The Psychology of Social Networking: Communication, Presence, Identity and Relationships in Online Communities. Versita: Open Access; 2016.
- Casey L.M., Wright M.-A., Clough B.A. Comparison of perceived barriers and treatment preferences associated with internet-based and face-to-face psychological treatment of depression. Int. J. Cyber Behav. Psychol. Learn. 2014;4(4):16–22.
- Catell R.B. The scree test for number of factors. Multivar. Behav. Res. 1966;1:245–276.
- Chrisler J.C., McCreary D.R. In: Handbook of Gender Research in Psychology Gender Research in General and Experimental Psychology. SpringerLink, editor. Springer New York; New York, NY: 2010.
- Christensen H., Griffiths K.M., Korten A. Web-based cognitive behavior therapy: analysis of site usage and changes in depression and anxiety scores. J. Med. Internet Res. 2002;4(1)
- Clough B.A., Casey L.M. Technological adjuncts to enhance current psychotherapy practices: a review. Clin. Psychol. Rev. 2011;31(3):279–292.
- Clough B.A., Casey L.M. Technological adjuncts to increase adherence to therapy: a review. Clin. Psychol. Rev. 2011;31:697–710.
- Clough B.A., Casey L.M. The smart therapist: a look to the future of smartphones and mHealth technologies in psychotherapy. Professional Psychology: Research and Practice. 2015;46(3):147. p. No Pagination Specified.
- Clough B.A., Casey L.M. Smart designs for smart technologies: research challenges and emerging solutions for scientist-practitioners within e-mental health. Prof. Psychol. Res. Pract. 2015;46(6):429.
- Clough B.A., Nazareth S.M., Casey L.M. The therapy attitudes and process questionnaire: a brief measure of factors related to psychotherapy appointment attendance. Patient Patient Cent. Outcomes Res. 2016;10(2):237–250.
- Clough B.A. Going global: do consumer preferences, attitudes, and barriers to using e-mental health services differ across countries? J. Ment. Health. 2017:1–8.
- Clough B.A., Nazareth S.M., Casey L.M. The Therapy Attitudes and Process Questionnaire: a brief measure of factors related to psychotherapy appointment attendance. Patient Patient Cent. Outcomes Res. 2017;10(2):237–250.
- Crisp D.A., Griffiths K.M. Participating in online mental health interventions: who is most likely to sign up and why? Depression Research and Treatment. 2014;2014:e790457.
- De Vivo M. Examining exercise intention and behaviour during pregnancy using the Theory of Planned Behaviour: a meta-analysis. J. Reprod. Infant Psychol. 2016;34(2):122–138.
- Donkin L. A systematic review of the impact of adherence on the effectiveness of e-therapies. J. Med. Internet Res. 2011;13(3):e52.
- Dorsey E.R. The use of smartphones for health research. Acad. Med. 2017;92(2):157–160.
- Erdem A., Bardakci S., Erdem Ş. Receiving online psychological counseling and its causes: a structural equation model. Curr. Psychol. 2016;2016:1–11.
- Fabrigar L.R. Evaluating the use of exploratory factor analysis in psychological research. Psychol. Methods. 1999;4(3):272–299.
- Fishbein M., Ajzen I. Psychology Press; New York: 2010. Predicting and Changing Behavior: The Reasoned Action Approach.
- Ghaderi A. Attrition and outcome in self-help treatment for bulimia nervosa and binge eating disorder: a constructive replication. Eat. Behav. 2006;7(4):300–308.
- Green S.B. Type I and type II error rates and overall accuracy of the revised parallel analysis method for determining the number of factors. Educ. Psychol. Meas. 2015;75(3):428–457.
- Hebert E.A. Attrition and adherence in the online treatment of chronic insomnia. Behav. Sleep Med. 2010;8(3):141–150.
- Joyce D., Weibelzahl S. Student counseling services: using text messaging to lower barriers to help seeking. Innov. Educ. Teach. Int. 2011;48(3):287–299.
- Kim Y., Glassman M. Beyond search and communication: development and validation of the Internet Self-efficacy Scale (ISS) Comput. Hum. Behav. 2013;29(4):1421–1429.
- Klein B., Cook S. Preferences for e-mental health services amongst an online Australian sample? Sensoria: A Journal of Mind, Brain & Culture. 2010;6(1):28–39.
- Kopelowicz A. Using the theory of planned behavior to improve treatment adherence in Mexican Americans with schizophrenia. J. Consult. Clin. Psychol. 2015;83(5):985.
- Kristjansson A. Self-generated identification codes in longitudinal prevention research with adolescents: a pilot study of matched and unmatched subjects. Prev. Sci. 2014;15(2):205–212.
- Mathieson K. Predicting user intentions: comparing the technology acceptance model with the theory of planned behavior. Inf. Syst. Res. 1991;2(3):173–191.
- McEachan R.R.C. Prospective prediction of health-related behaviours with the theory of planned behaviour: a meta-analysis. Health Psychol. Rev. 2011;5(2):97–144.
- Melville K.M., Casey L.M., Kavanagh D.J. Dropout from Internet-based treatment for psychological disorders. Br. J. Clin. Psychol. 2010;49(4):455–471.
- Meurk C. Establishing and governing e-mental health care in Australia: a systematic review of challenges and a call for policy-focussed research. J. Med. Internet Res. 2016;18(1)
- Mokkink L.B. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med. Res. Methodol. 2010;10(1):22.
- Pallant J. 4th ed. Open University Press; Maidenhead, Berkshire: 2010. SPSS Survival Manual: A Step by Step Guide to Data Analysis Using SPSS.
- Pett M.A., Lackey N.R., Sullivan J.J. Sage Publications, Inc.; USA: 2003. Making Sense of Factor Analysis: The Use of Factor Analysis for Instrument Development in Health Care Research.
- Prinsen C.A., Mokkink L.B., Bouter L.M., Alonso J., Patrick D.L., De Vet H.C., Terwee C.B. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual. Life Res. 2018;27(5):1147–1157.
- Rotter J.B. Generalized expectancies for internal versus external control of reinforcement. Psychol. Monogr. 1966;80(1)
- Schneider J. Acceptability of online self-help to people with depression: users' views of MoodGYM versus informational websites. J. Med. Internet Res. 2014;16(3)
- Schröder J. Development of a questionnaire measuring Attitudes towards Psychological Online Interventions–the APOI. J. Affect. Disord. 2015;187:136–141.
- Sheeran P., Aubrey R., Kellett S. Increasing attendance for psychotherapy: implementation intentions and the self-regulation of attendance-related negative affect. J. Consult. Clin. Psychol. 2007;75(6):853–863.
- Slade T. 2007 national survey of mental health and wellbeing: methods and key findings. Aust. N. Z. J. Psychiatry. 2009;43(7):594–605.
- Tabachnick B.G., Fidell L.S., Osterlind S.J. 6th ed. Pearson Education; Boston, MA: 2013. Using Multivariate Statistics.
- Vogel D.L., Wade N.G., Haake S. Measuring the self-stigma associated with seeking psychological help. J. Couns. Psychol. 2006;53(3):325.
- White K.M. Predicting the consumption of foods low in saturated fats among people diagnosed with type 2 diabetes and cardiovascular disease. The role of planning in the theory of planned behaviour. Appetite. 2010;55(2):348–354.
- White M.M., Clough B.A., Casey L.M. What do help-seeking measures assess? Building a conceptualization framework for help-seeking intentions through a systematic review of measure content. Clin. Psychol. Rev. 2017;59:61–71.
- Wilson C.J. Measuring help-seeking intentions: properties of the general help-seeking questionnaire. Can. J. Couns. 2005;39(1):15.
- Wojtowicz M., Day V., McGrath P.J. Predictors of participant retention in a guided online self-help program for university students: prospective cohort study. J. Med. Internet Res. 2013;15(5)
- Zemore S.E., Kaskutas L.A. Development and validation of the alcoholics anonymous intention measure (AAIM) Drug Alcohol Depend. 2009;104(3):204–211.
- Zimet G.D. The multidimensional scale of perceived social support. J. Pers. Assess. 1988;52(1):30–41.
Source: PubMed