An Evaluation of a Train-the-Trainer Workshop for Social Service Workers to Develop Community-Based Family Interventions

Agnes Y Lai, Sunita M Stewart, Moses W Mui, Alice Wan, Carol Yew, Tai Hing Lam, Sophia S Chan, Agnes Y Lai, Sunita M Stewart, Moses W Mui, Alice Wan, Carol Yew, Tai Hing Lam, Sophia S Chan

Abstract

Introduction: Evaluation studies on train-the-trainer workshops (TTTs) to develop family well-being interventions are limited in the literature. The Logic Model offers a framework to place some important concepts and tools of intervention science in the hands of frontline service providers. This paper reports on the evaluation of a TTT for a large community-based program to enhance family well-being in Hong Kong.

Methods: The 2-day TTT introduced positive psychology themes (relevant to the programs that the trainees would deliver) and the Logic Model (which provides a framework to guide intervention development and evaluation) for social service workers to guide their community-based family interventions. The effectiveness of the TTT was examined by self-administered questionnaires that assessed trainees' changes in learning (perceived knowledge, self-efficacy, attitude, and intention), trainees' reactions to training content, knowledge sharing, and benefits to their service organizations before and after the training and then 6 months and 1 year later. Missing data were replaced by baseline values in an intention-to-treat analysis. Focus group interviews were conducted approximately 6 months after training.

Results: Fifty-six trainees (79% women) joined the TTT. Forty-four and 31 trainees completed the 6-month and 1-year questionnaires, respectively. The trainees indicated that the workshop was informative and well organized. The TTT-enhanced trainees' perceived knowledge, self-efficacy, and attitudes toward the application of the Logic Model and positive psychology constructs in program design. These changes were present with small to large effect size that persisted to the 1 year follow-up. The skills learned were used to develop 31 family interventions that were delivered to about 1,000 families. Qualitative feedback supported the quantitative results.

Conclusion: This TTT offers a practical example of academic-community partnerships that promote capacity among community social service workers. Goals included sharing basic tools of intervention development and evaluation, and the TTT offered, therefore, the potential of learning skills that extended beyond the lifetime of a single program.

Clinical trial registration: The research protocol was registered at the National Institutes of Health (identifier number: NCT01796275).

Keywords: Logic Model; family intervention; positive psychology; train-the-trainer; training program.

Figures

Figure 1
Figure 1
The Logic Model for the Happy Family Kitchen II Project.
Figure 2
Figure 2
CONSORT diagram for the train-the-trainer workshop.

References

    1. W. K. Kellogg Foundation. Logic Model Development Guide. Michigan: W. K. Kellogg Foundation; (2004).
    1. Harris M, Chan B, Laws R, Williams A, Davies G, Jayasinghe U, et al. The impact of a brief lifestyle intervention delivered by generalist community nurses (CN SNAP trial). BMC Public Health (2013) 22(13):375.10.1186/1471-2458-13-375
    1. Brody G, Murry V, Gerrard M, Gibbons F, Molgaard V, McNair L, et al. The strong African American families program: translating research into prevention programming. Child Dev (2004) 75(3):900–17.10.1111/j.1467-8624.2004.00713.x
    1. McCawley P. Logic Model for Program Planning and Evaluation. Idaho: University of Idaho; (2001).
    1. Savaya R, Waysman M. The logic model: a tool for incorporating theory in development and evaluation of programs. Adm Soc Work (2005) 29(2):85–103.10.1300/J147v29n02_06
    1. Morzinski J, Montagnini M. Logic modeling: a tool for improving educational programs. J Palliat Med (2002) 5(4):566–70.10.1089/109662102760269841
    1. Levin T, Weiner J, Saravay S, Deakins S. Two-year evaluation of the logic model for developing a psycho-oncology service. Psychiatr Serv (2004) 55(4):427–33.10.1176/appi.ps.55.4.427
    1. Guo R, Bain B, Willer J. Application of a logic model to an evidence-based practice training program for speech-language pathologists and audiologists. J Allied Health (2011) 40(1):e23–8.
    1. Armstrong EG, Barsion SJ. Using an outcomes-logic-model approach to evaluate a faculty development program for medical educators. Acad Med (2006) 81(5):483–8.10.1097/01.ACM.0000222259.62890.71
    1. West J. Public health program planning logic model for community engaged type 2 diabetes management and prevention. Eval Program Plann (2014) 42:43–9.10.1016/j.evalprogplan.2013.09.001
    1. Nutbeam D, Padmadas SS, Maslovskaya O, Wu Z. A health promotion logic model to review progress in HIV prevention in China. Health Promot Int (2015) 30(2):270–80.10.1093/heapro/dat037
    1. Lane A, Martin M. Logic model use for breast health in rural communities. Oncol Nurs Forum (2005) 32(1):105–10.10.1188/05.ONF.105-110
    1. Hulton LJ. An evaluation of a school-based teenage pregnancy prevention program using a logic model framework. J Sch Nurs (2007) 23(2):104–10.10.1177/10598405070230020801
    1. MacPhee M. Developing a practice-academic partnership logic model. Nurs Outlook (2009) 57:143–7.10.1016/j.outlook.2008.08.003
    1. Fielden S, Rusch M, Masinda M, Sands J, Frankish J, Evoy B. Key considerations for logic model development in research partnerships: a Canadian case study. Eval Program Plann (2007) 30:115–24.10.1016/j.evalprogplan.2007.01.002
    1. Hayes H, Parchman M, Howard R. A logic model framework for evaluation and planning in a primary care practice-based research network (PBRN). J Am Board Fam Med (2011) 24:576–82.10.3122/jabfm.2011.05.110043
    1. Rowan M. Logic models in primary care reform: navigating the evaluation. Can J Program Eval (2000) 15(2):81–92.
    1. Dorsey S, Schiffman R, Redeker N, Heitkemper M, McCloskey D, Weglicki L, et al. National Institute of Nursing Research Centers of Excellence: a logic model for sustainability, leveraging resources, and collaboration to accelerate cross-disciplinary science. Nurs Outlook (2014) 62(6):384–93.10.1016/j.outlook.2014.06.003
    1. Medeiros L, Butkus S, Chipman H, Cox R, Jones L, Little D. A logic model framework for community nutrition education. J Nutr Educ Behav (2005) 37(4):197–202.10.1016/S1499-4046(06)60246-7
    1. Huhman M, Heitzler C, Wong F. The VERB campaign logic model: a tool for planning and evaluation. Prev Chronic Dis (2004) 1(3):A11.
    1. Orfaly RA, Frances JC, Campbell P, Whittemore B, Joly B, Koh H. Train-the-trainer as an educational model in public health preparedness. J Public Health Manag Pract (2005) 11(6):S123–7.10.1097/00124784-200511001-00021
    1. Pearce J, Jones C, Morrison S, Olff M, van Buschbach S, Witteveen AB, et al. Using a Delphi process to develop an effective train-the-trainers program to train health and social care professionals throughout Europe. J Trauma Stress (2012) 25(3):337–43.10.1002/jts.21705
    1. Pearce J, Mann MK, Jones C, van Buschbach S, Olff M, Bisson JI. The most effective way of delivering a train-the-trainers program: a systematic review. J Contin Educ Health Prof (2012) 32(3):215–26.10.1002/chp.21148
    1. Thorning H, Shibusawa T, Lukens E, Fang L. Developing a train-the-trainer (TTT) model for social work education in Kazakhstan. Int Soc Work (2013) 56(4):534–43.10.1177/0020872812437064
    1. Chan SS, Viswanath K, Au DW, Ma CM, Lam WW, Fielding R, et al. Hong Kong Chinese community leaders’ perspectives on family health, happiness and harmony: a qualitative study. Health Educ Res (2011) 26(4):664–74.10.1093/her/cyr026
    1. Lai A, Mui M, Wan A, Stewart S, Yew C, Lam T, et al. Development and two-year follow-up evaluation of a training workshop for the large preventive positive psychology Happy Family Kitchen Project in Hong Kong. PLoS One (2016) 11(1):e0147712.10.1371/journal.pone.0147712
    1. Zhou Q, Stewart SM, Wan A, Leung CS, Lai A, Lam TH, et al. Development and evaluation of a train-the-trainer workshop for Hong Kong community social service agency staff. Front Public Health (2017) 5:15.10.3389/fpubh.2017.00015
    1. Centre for Suicide Research and Prevention. A Study of the Phenomenon of Divorce in Hong Kong. Hong Kong: The University of Hong Kong; (2014).
    1. Spector PE, Cooper CL, Poelmans S, Allen TD, Driscoll M, SJ I, et al. A cross-national comparative study of work-family stressors, working hours, and well-being: China and Latin America vs the Anglo world. Pers Psychol (2004) 57:119–42.10.1111/j.1744-6570.2004.tb02486.x
    1. Seligman ME. Authentic Happiness: Using the New Positive Psychology to Realize Your Potential for Lasting Fulfillment. New York: Simon and Schuster; (2002).
    1. Peterson C, Seligman M. Character Strengths and Virtues: A Handbook and Classification. Washington, DC: American Psychological Association; (2004).
    1. Csikszentmihalyi M. Finding Flow: The Psychology of Engagement with Everyday Life. New York: Basic Books; (1997).
    1. Seligman ME, Rashid T, Parks AC. Positive psychotherapy. Am Psychol (2006) 61(8):774.10.1037/0003-066X.61.8.774
    1. Seligman M, Park N, Peterson C. The values in action (VIA) classification of character strengths. Ricerche di Psicologia (2004) 27:63–78.
    1. Ho H, Mui M, Wan A, Ng Y, Stewart S, Yew C, et al. Happy Family Kitchen II: a cluster randomized controlled trial of a community-based family intervention for enhancing family communication and well-being in Hong Kong. Front Psychol (2016) 7:638.10.3389/fpsyg.2016.00638
    1. Lazarus A. Reality check: is your behavior aligned with organizational goals? Physician Exec (2004) 30(5):50–2.
    1. Cooksy LJ, Gillb P, Kelly PA. The program logic model as an integrative framework for a multimethod evaluation. Eval Program Plann (2011) 24(2):119–28.10.1016/S0149-7189(01)00003-9
    1. Cohen J. Statistical Power Analysis for the Behavioral Sciences. New York: Academic Press; (1977).
    1. Morse JM, Field PA. Qualitative Research Methods for Health Professionals. London: SAGE Publications; (1995).
    1. Tobias CR, Downes A, Eddens S, Ruiz J. Building blocks for peer success: lessons learned from a train-the-trainer program. AIDS Patient Care STDS (2012) 26(1):53–9.10.1089/apc.2011.0224
    1. Crosby LE, Parr MW, Smith MT, Mitchell MJ. The community leaders institute: an innovative program to train community leaders in health research. Acad Med (2013) 88(3):335.10.1097/ACM.0b013e318280d8de
    1. Meissner HI, Glasgow RE, Vinson CA, Chambers D, Brownson RC, Green LW, et al. The US training institute for dissemination and implementation research in health. Implementation Sci (2013) 8(1):12.10.1186/1748-5908-8-12
    1. Lam C. Experiential and reflective learning approaches for the train-the-trainers program of Project PATHS. Int J Adolesc Med Health (2011) 23(4):305–10.10.1515/IJAMH.2011.026
    1. Adams J, Terry MA, Rebchook GM, O’Donnell L, Kelly JA, Leonard NR, et al. Orientation and training: preparing agency administrators and staff to replicate an HIV prevention intervention. AIDS Educ Prev (2000) 12(Suppl A):75–86.
    1. Fitzgerald MA, Chromy B, Philbrick CA, Sanders GF, Muske KL, Bratteli M. The North Dakota mental health and aging education project: curriculum design and training outcomes for a train-the-trainer model. Gerontol Geriatr Educ (2009) 30(2):114–29.10.1080/02701960902911257

Source: PubMed

スポンサーと協力者

医学的状態

薬物療法

3
購読する