Validation of the theoretical domains framework for use in behaviour change and implementation research

James Cane, Denise O'Connor, Susan Michie, James Cane, Denise O'Connor, Susan Michie

Abstract

Background: An integrative theoretical framework, developed for cross-disciplinary implementation and other behaviour change research, has been applied across a wide range of clinical situations. This study tests the validity of this framework.

Methods: Validity was investigated by behavioural experts sorting 112 unique theoretical constructs using closed and open sort tasks. The extent of replication was tested by Discriminant Content Validation and Fuzzy Cluster Analysis.

Results: There was good support for a refinement of the framework comprising 14 domains of theoretical constructs (average silhouette value 0.29): 'Knowledge', 'Skills', 'Social/Professional Role and Identity', 'Beliefs about Capabilities', 'Optimism', 'Beliefs about Consequences', 'Reinforcement', 'Intentions', 'Goals', 'Memory, Attention and Decision Processes', 'Environmental Context and Resources', 'Social Influences', 'Emotions', and 'Behavioural Regulation'.

Conclusions: The refined Theoretical Domains Framework has a strengthened empirical base and provides a method for theoretically assessing implementation problems, as well as professional and other health-related behaviours as a basis for intervention development.

Figures

Figure 1
Figure 1
Steps taken to validate the Theoretical Domains Framework.
Figure 2
Figure 2
Comparison of fit across 2–18 cluster solutions.

References

    1. Clinical Effectiveness Research Agenda Group (CERAG) An Implementation Research Agenda: A report prepared for the High Level Group on Clinical Effectiveness. CERAG, London; 2008.
    1. World Health Authority (WHA) World Health Assembly Resolution 51.12: Health Promotion. 2010. Accessed from [ ], 27th July 2010.
    1. Newman M, Papadopoulous L, Sigsworth J. Barriers to evidence-based practice. Clin Eff Nurs. 1998;2:11–18. doi: 10.1016/S1361-9004(98)80080-0.
    1. McKenna H, Ashton S, Keeney S. Barriers to evidence based practice in primary care: a review of the literature. Int J Nurs Stud. 2004;41:369–378. doi: 10.1016/j.ijnurstu.2003.10.008.
    1. Grol R, Grimshaw J. From evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362:1225–1230. doi: 10.1016/S0140-6736(03)14546-1.
    1. Abraham C, Kelly MP, West R, Michie S. The UK national institute for health and clinical excellence public health guidance on behavior change: a brief introduction. Psychology Health Med. 2009;14:1–8. doi: 10.1080/13548500802537903.
    1. Albarracin D, Gillette JG, Earl AN, Glasman LR, Durantini MR, Ho MH. A test of major assumptions about behavior change: a comprehensive look at the effects of passive and active HIV-prevention interventions since the beginning of the epidemic. Psychol Bull. 2005;131:856–897.
    1. Noar SM, Zimmerman RS. Health behavior theory and cumulative knowledge regarding health behaviours: are we moving in the right direction? Health Ed Res: Theory Pract. 2005;20:275–290.
    1. Michie S, Prestwich A. Are interventions theory-based? Development of a theory coding scheme. Heal Psychol. 2010;29:1–8.
    1. Davies P, Walker AE, Grimshaw J. A systematic review of the use of theory in the design and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010;5:1–6. doi: 10.1186/1748-5908-5-1.
    1. Weinstein N. Testing four competing theories of health-protective behaviour. Heal Psychol. 1993;12:324–333.
    1. Nigg CR, Allegrante JP, Ory M. Theory-comparison and multiple-behaviour research: common themes advancing health behaviour research. Health Ed Res: Theory Prac. 2002;17:670–679.
    1. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. on behalf of the ‘Psychological Theory’ Group. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14:26–33. doi: 10.1136/qshc.2004.011155.
    1. McKenzie JE, French SD, O’Connor DA, Grimshaw J, Mortimer D, Michie S, Francis J, Spike N, Schattner P, Kent PM. et al.Implementing a clinical practice guideline for acute low back pain evidence-based management in general practice (IMPLEMENT): cluster randomised controlled trial study protocol. Implement Sci. 2008;3:11. doi: 10.1186/1748-5908-3-11.
    1. McKenzie JE, O’Connor DA, Page MJ, Mortimer D, French SD, Walker BF, Keating JL, Grimshaw JM, Michie S, Francis JJ, Green SE. Improving the care for people with acute low-back pain by allied health professionals (the ALIGN trial): a cluster randomised trial protocol. Implement Sci. 2010;5:86. doi: 10.1186/1748-5908-5-86.
    1. French SD, Green SE, O’Connor D, McKenzie SD, Francis JJ, Michie S, Buchbinder R, Schattner P, Spike N, Grimshaw JM. 2011. For submission to Implementation Science in this series.
    1. Dyson J, Lawton R, Jackson C, Cheater F. Does the use of a theoretical approach tell us more about hand hygiene behaviour? The barriers and levers to hand hygiene. J Infection Prev. 2010;12:17.
    1. Francis J, Stockton C, Eccles MP, Johnston M, Cuthbertson BH, Grimshaw JM, Hyde C, Tinmouth A, Stanworth SJ. Evidence-based selection of theories for designing behaviour change interventions: Using methods based on theoretical construct domains to understand clinicians’ blood transfusion behaviour. Br J Heal Psychol. 2009;14:625–646. doi: 10.1348/135910708X397025.
    1. Francis J, Tinmouth A, Stanworth SJ. Using theories of behaviour change to understand transfusion prescribing three clinical contexts in two countries: development work for and implementation trial. Implement Sci. 2009;4:70. doi: 10.1186/1748-5908-4-70.
    1. Michie S, Pilling S, Garety P, Whitty P, Eccles MP, Johnston M, Simmons J. Difficulties implementing a mental health guideline: an exploratory investigation using psychological theory. Implement Sci. 2007;2:8. doi: 10.1186/1748-5908-2-8.
    1. Amemori M, Korhonen T, Kinnunen T, Michie S, Murtomaa H. Enhancing implementation of tobacco use prevention and cessation counselling guideline among dental providers: a cluster randomised controlled trial. Implement Sci. 2011;6:13. doi: 10.1186/1748-5908-6-13.
    1. Paul CL. A modified approach to a new card sorting methodology. J Usability Stud. 2008;4:7–30.
    1. Whaley AL, Longoria RA. Preparing card sort data for multidimensional scaling analysis in social psychological research: a methodological approach. J Soc Psychol. 2009;149:105–115. doi: 10.3200/SOCP.149.1.105-115.
    1. Trochim WMK, Cook JA, Setze RJ. Using concept mapping to develop a conceptual framework of staff's views of a supported employment program for individuals with severe mental illness. J Consult Clin Psychol. 1994;62:766–775.
    1. Morrow D, Leirer V, Altieri P, Tanke E. Elders’ schema for taking medication: implications for instruction design. J Gerontol. 1991;46:378–385.
    1. Niven K, Totterdell P, Holman D. A classification of controlled interpersonal affect regulation strategies. Emotion. 2009;9:498–509.
    1. Chollet S, Lelièvre M, Abdi H, Valentin D. Sort and Beer: Everything you wanted to know about the sorting task but did not dare to ask. Food Quality and Preference. 2011;22:507–520. doi: 10.1016/j.foodqual.2011.02.004.
    1. Reed CL, McGoldrick JE, Shackelford R, Fidopiastis CM. Are human bodies represented differently from other objects? Experience shapes object representations. Vis Cogn. 2004;11:523–550. doi: 10.1080/13506280344000428.
    1. Dixon D, Pollard B, Johnston M. What does the chronic pain grade questionnaire measure? Pain. 2007;130:249–253. doi: 10.1016/j.pain.2006.12.004.
    1. Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35:382.
    1. Waltz CW, Strickland OL, Lenz ER. Measurement in nursing research. F.A. Davis Co, Philadelphia, PA; 1991.
    1. Dixon D, Johnston M, McQueen M, Court-Brown C. The Disabilities of the Arm, Shoulder and Hand Questionnaire (DASH) can measure the impairment, activity limitations and participation restriction constructs from the International Classification of Functioning, Disability, and Health (ICF) BMC Musculoskelet Disord. 2008;9:114. doi: 10.1186/1471-2474-9-114.
    1. Carmines EG, Zeller RA. Reliability and Validity Assessment. Sage Publications, Newbury Park, CA; 1979.
    1. Kaufman L, Rousseeuw PJ. Finding groups in data: an introduction to data analysis. Wiley, New York; 1990.
    1. Pollard B, Johnston M, Dieppe P. What do osteoarthritis heath outcome instruments measure? Impairment, activity limitation or participation restriction? J Rheumatol. 2006;33:757–63.
    1. American Psychological Association (APA) APA Dictionary of Psychology. American Psychological Association, Washington, DC; 2007.
    1. Kendall MG, Babington Smith B. The Problem of m Rankings. Ann Math Stat. 2009;10:275–287.
    1. Paradis E, Bolker B, Claude J, Sien Cuong H, Desper R, Durand B, Durand B, Dutheil J, Gascuel O, Heilbl C, Lawson D, Lawson D, Lefort V, Legrande, Lemon J, Noel Y, Nylander J, Opgen-Rhein R, Popescu A A, Schliep K, Strimmer K, de Vienne D. Package ‘ape’: Analysis of Phylogenetics and Evolution. 2011. URL [ ].2011, 1-222.
    1. R Development Core Team. A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria; 2011. ISBN 3-900051-07-0; URL [ ]
    1. Legendre P. In: Package ‘ape’: Analysis of Phylogenetics and Evolution. Paradis E, Bolker B, Claude J, SienCuong H, Desper R, Durand B, Dutheil J, Gascuel O, Heilbl C, Lawson D, Lefort V, Legrande , Lemon J, Noel Y, Nylander J, Opgen Rhein R, Popescu AA, Schliep K, Strimmer K, Vienne D, editor. 2011. CADM.global: Congruence among distance matrices; pp. 1–222. URL [ ]
    1. Maechler M. Package ‘cluster’: Cluster Analysis Extended Rousseeuwet al. Version 1.14.0. 2011. URL [ ]
    1. Rousseeuw PJ. Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J Comput Appl Math. 1987;20:53–65.
    1. McGraw K, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychological Methods. 1996;1:30–46.
    1. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. doi: 10.2307/2529310.
    1. Hochberg Y. A sharper Bonferroni procedure for multiple tests of significance. Biometrika. 1988;75:800–802. doi: 10.1093/biomet/75.4.800.
    1. Michie S, van Stralen M, West R. The Behaviour Change Wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42. doi: 10.1186/1748-5908-6-42.
    1. Kenkel DS. Health behaviour, health knowledge, and schooling. J Polit Econ. 1991;99:287–305. doi: 10.1086/261751.
    1. Klesges RC, Somes G, Pascale RW, Klesges LM, Murphy M, Brown K, Williams E. Knowledge and beliefs regarding the consequences of cigarette smoking and their relationships to smoking status in a biracial sample. Heal Psychol. 1988;7:387–401.
    1. Eckhardt L, Woodruff SI, Elder JP. A longitudinal analysis of adolescent smoking and its correlates. J Sch Heal. 1994;64:67–72. doi: 10.1111/j.1746-1561.1994.tb06181.x.
    1. Dishman RK, Sallis JF, Orenstein DR. The determinants of physical activity and exercise. Public health reports. 1985;100:158–171.
    1. Baranowski T, Cullen KW, Baranowski J. Psychosocial correlates of dietary intake: advancing dietary intervention. Annu Rev Nutr. 1999;19:17–40. doi: 10.1146/annurev.nutr.19.1.17.
    1. Shapiro J, Radecki S, Charchian AS, Josephson V. Sexual behavior and AIDS-related knowledge among community college students in Orange County, California. J Community Health. 1999;24:29–43. doi: 10.1023/A:1018713231400.
    1. Haynes SN, Richard DCS, Kubany ES. Content validity in psychological assessment: a functional approach to concepts and methods. Psychol Assess. 1995;7:238–247.
    1. Hobbs L, Campbell R, Hildon Z, Michie S. Behaviour change theories across Psychology, Sociology, Anthropology and Economics: A Systematic Review. Psychology and Health. 2011;26(Supplement 1)
    1. Taylor SE. Health Psychology (5th Edition) MacGraw-Hill, Boston; 2003.
    1. Sutherland S. The Macmillan Dictionary of Psychology (2nd Edition) Palgrave Macmillan, London; 1995.
    1. WordNet. .
    1. Oxford English Dictionary Online. .
    1. Wikipedia. .
    1. Ajzen I. The Theory of Planned Behavior. Organizational Behavior and Human Decision Processes. 1991;50:179–211. doi: 10.1016/0749-5978(91)90020-T.
    1. Ogden J. Health Psychology: a textbook (2nd Edition) Open University Press, Buckingham; 2000.
    1. World Health Organization (WHO)
    1. .
    1. Forsyth DR. Group Dynamics (5th Edition) Wadsworth, Cengage Learning; 2006.
    1. Alicke MD. In: Handbook of Social Comparison: Theory and Research. Suls JM, Wheeler L, editor. Plenum Publishing, New York; 2000. Evaluating social comparison targets; pp. 271–293.
    1. .
    1. The Free Dictionary.
    1. Proschaska JO, DiClemente CC. The Transtheoretical Approach: Crossing Traditional Boundaries of Change. J.Irwin, Homewood IL;

Source: PubMed

Patrocinadores e Colaboradores

Condições médicas

Intervenções de drogas

3
Se inscrever