Good soldiers in implementation: validation of the Implementation Citizenship Behavior Scale and its relation to implementation leadership and intentions to use evidence-based practices

Randi Hovden Borge, Ane-Marthe Solheim Skar, Mathilde Endsjø, Karina M Egeland, Randi Hovden Borge, Ane-Marthe Solheim Skar, Mathilde Endsjø, Karina M Egeland

Abstract

Background: Implementation citizenship behavior (ICB) describes extra-role behaviors performed by employees to support evidence-based practice (EBP) implementation. Such behaviors can be measured using the Implementation Citizenship Behavior Scale (ICBS), which divides ICB into two dimensions, namely helping others and keeping informed. The current study extends the use of the ICBS to a context outside the USA and adds to the literature by investigating how leader-perceived ICB relates to practitioner-perceived implementation leadership and practitioners' intentions to use EBPs.

Methods: Participants were 42 leaders and 152 practitioners in Norwegian mental health services implementing EBPs for post-traumatic stress disorder. Leaders rated each practitioner on ICB, and each practitioner rated their leader on implementation leadership and reported on their own intentions to use EBPs. The psychometric properties of the ICBS were assessed using confirmatory factor analysis and internal consistency reliabilities. The relationships between ICB, implementation leadership and intentions to use EBPs, were investigated through a series of bivariate correlation analyses and a path analysis of the total scales.

Results: The ICBS showed excellent psychometric properties. The hypothesized two-factor model provided an excellent fit to the data, and both subscales and the total scale were internally reliable. Leader-perceived ICB was positively and significantly correlated with both practitioner-perceived implementation leadership and practitioners' intentions to use EBPs. Correlations with intentions to use EBPs were stronger for the subscale of keeping informed than for the subscale of helping others.

Conclusions: Results indicated that practitioners who rated their leader higher on implementation leadership received higher ICB ratings from their leader and reported higher intentions to use EBPs. The results provide evidence of a reciprocal social exchange relationship between leaders and practitioners during EBP implementation and a link to an important proximal implementation outcome (i.e., intentions to use EBPs). Results also suggest cultural differences in how ICB is perceived and relates to other phenomena. Scientific and practical implications are discussed.

Trial registration: Retrospectively registered in ClinicalTrials with ID NCT03719651 .

Keywords: Evidence-based practice; Implementation citizenship behavior; Implementation leadership; Mental health services.

Conflict of interest statement

The authors declare that they have no competing interests.

© 2021. The Author(s).

Figures

Fig. 1
Fig. 1
Path analysis. Note. N=109. **p < .01; *p < .05; †p < .10

References

    1. Organ DW. Organizational citizenship behavior: the good soldier syndrome. Lexington: Lexington Books; 1988.
    1. Smith CA, Organ DW, Near JP. Organizational citizenship behavior: its nature and antecedents. J Appl Psychol. 1983;68(4):653–663. doi: 10.1037/0021-9010.68.4.653.
    1. Podsakoff PM, MacKenzie SB, Paine JB, Bachrach DG. Organizational citizenship behaviors: a critical review of the theoretical and empirical literature and suggestions for future research. J Manag. 2000;26(3):513–563.
    1. Podsakoff NP, Podsakoff PM, MacKenzie SB, Maynes TD, Spoelma TM. Consequences of unit-level organizational citizenship behaviors: a review and recommendations for future research. J Organ Behav. 2014;35(S1):S87–S119. doi: 10.1002/job.1911.
    1. Aarons GA, Ehrhart MG, Moullin JC, Torres EM, Green AE. Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: a cluster randomized trial study protocol. Implement Sci. 2017;12(1):29. doi: 10.1186/s13012-017-0562-3.
    1. Powell BJ, Haley AD, Patel SV, Amaya-Jackson L, Glienke B, Blythe M, et al. Improving the implementation and sustainment of evidence-based practices in community mental health organizations: a study protocol for a matched-pair cluster randomized pilot study of the Collaborative Organizational Approach to Selecting and Tailoring Implementation Strategies (COAST-IS) Implement Sci Commun. 2020;1(1):9. doi: 10.1186/s43058-020-00009-5.
    1. Stahmer AC, Suhrheinrich J, Schetter PL, McGee Hassrick E. Exploring multi-level system factors facilitating educator training and implementation of evidence-based practices (EBP): a study protocol. Implement Sci. 2018;13(1):3. doi: 10.1186/s13012-017-0698-1.
    1. Haider S, Fernandez-Ortiz A, de Pablos Heredero C. Organizational citizenship behavior and implementation of evidence-based practice: moderating role of senior management’s support. Health Syst. 2017;6(3):226–241. doi: 10.1057/s41306-017-0026-7.
    1. Ehrhart M, Aarons G, Farahnak L. Going above and beyond for implementation: The development and validity testing of the Implementation Citizenship Behavior Scale (ICBS) Implement Sci. 2015;10:65. doi: 10.1186/s13012-015-0255-8.
    1. Lyon A, Cook C, Brown E, Locke J, Davis C, Ehrhart M, et al. Assessing organizational implementation context in the education sector: confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implement Sci. 2018;13:1–14.
    1. Torres E, Seijo C, Ehrhart M, Aarons G. Validation of a pragmatic measure of implementation citizenship behavior in substance use disorder treatment agencies. J Subst Abus Treat. 2020;111:47–53. doi: 10.1016/j.jsat.2020.01.002.
    1. Paine JB, Organ DW. The cultural matrix of organizational citizenship behavior: some preliminary conceptual and empirical observations. Hum Resour Manag Rev. 2000;10(1):45–59.
    1. Gelfand MJ, Erez M, Aycan Z. Cross-cultural organizational behavior. Annu Rev Psychol. 2007;58(1):479–514. doi: 10.1146/annurev.psych.58.110405.085559.
    1. Gustavsen B. Work organization and ‘the Scandinavian model’. Econ Ind Democr. 2007;28(4):650–671. doi: 10.1177/0143831X07082218.
    1. Aarons GA, Ehrhart MG, Farahnak LR. The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014;9(1):45. doi: 10.1186/1748-5908-9-45.
    1. Blau P. Exchange and power in social life. New York: Wiley; 1964.
    1. Cropanzano R, Mitchell MS. Social exchange theory: an interdisciplinary review. J Manag. 2005;31(6):874–900.
    1. Nohe C, Hertel G. Transformational leadership and organizational citizenship behavior: a meta-analytic test of underlying mechanisms. Front Psychol. 2017;8:1364. doi: 10.3389/fpsyg.2017.01364.
    1. Wang G, Oh I-S, Courtright SH, Colbert AE. Transformational leadership and performance across criteria and levels: a meta-analytic review of 25 years of research. Group Org Manag. 2011;36(2):223–270. doi: 10.1177/1059601111401017.
    1. Egeland KM, Skar A-MS, Endsjø M, Laukvik EH, Bækkelund H, Babaii A, et al. Testing the leadership and organizational change for implementation (LOCI) intervention in Norwegian mental health clinics: a stepped-wedge cluster randomized design study protocol. Implement Sci. 2019;14(1):28. doi: 10.1186/s13012-019-0873-7.
    1. Cohen JA, Mannarino AP, Deblinger E. Treating trauma and traumatic grief in children and adolescents. 2. New York: Guilford Press; 2017.
    1. Shapiro F. Eye movement desensitization: a new treatment for post-traumatic stress disorder. J Behav Ther Exp Psychiatry. 1989;20(3):211–217. doi: 10.1016/0005-7916(89)90025-6.
    1. Ehlers A, Clark DM. A cognitive model of posttraumatic stress disorder. Behav Res Ther. 2000;38(4):319–345. doi: 10.1016/S0005-7967(99)00123-0.
    1. Aarons GA, Ehrhart MG, Farahnak LR, Hurlburt MS. Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implement Sci. 2015;10(1):11. doi: 10.1186/s13012-014-0192-y.
    1. 08063: Specialist health service. Man-years and employed persons, by education, type of service, sex, age and health region 2008-2020. . Accessed 8 Oct 2021.
    1. Braathu N, Laukvik EH, Egeland KM, Skar A-MS. Validation of the implementation leadership scale (ILS) and the multifactor leadership questionnaire (MLQ) in a mental health care setting. Manuscript submitted for publication. 2021.
    1. Moullin JC, Ehrhart MG, Aarons GA. Development and testing of the Measure of Innovation-Specific Implementation Intentions (MISII) using Rasch measurement theory. Implement Sci. 2018;13(1):89. doi: 10.1186/s13012-018-0782-1.
    1. Muthén LK, Muthén BO. Mplus user’s guide. 8. Los Angeles: Muthén & Muthén; 2017.
    1. Hu Lt, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55. doi: 10.1080/10705519909540118.
    1. Eccles MP, Hrisos S, Francis J, Kaner EF, Dickinson HO, Beyer F, et al. Do self- reported intentions predict clinicians’ behaviour: a systematic review. Implement Sci. 2006;1(1):28. doi: 10.1186/1748-5908-1-28.
    1. Hofstede G, Hofstede GJ, Minkov M. Cultures and organizations: software of the mind. New York: Mcgraw-hill; 2010.

Source: PubMed

3
S'abonner