Evaluating fidelity: predictive validity for a measure of competent adherence to the Oregon model of parent management training

Abstract

When efficacious interventions are implemented in real-world conditions, it is important to evaluate whether or not the programs are practiced as intended. This article presents the Fidelity of Implementation Rating System (FIMP), an observation-based measure assessing competent adherence to the Oregon model of Parent Management Training (PMTO). FIMP evaluates 5 dimensions of competent adherence to PMTO (i.e., knowledge, structure, teaching skill, clinical skill, and overall effectiveness) specified in the intervention model. Predictive validity for FIMP was evaluated with a subsample of stepfamilies participating in a preventive PMTO intervention. As hypothesized, high FIMP ratings predicted change in observed parenting practices from baseline to 12 months. The rigor and scope of adherence measures are discussed.

Figures

FIGURE 1

FIMP Dimensions Rating Form. From “Fidelity of Implementation Rating System: The training manual for PMTO” by N. M. Knutson, M. S. Forgatch, and L. A. Rains, 2003, p. 25. Copyright 2003 by Oregon Social Learning Center. Reprinted with permission of the authors.

FIGURE 2

Structural equation path model testing effects of interventionist fidelity on change in effective parenting practices. Standardized coefficients presented, χ2(12) = 9.11, p < .69, CFI = 1.00, n =20, † p < .10; * p < .05, ** p < .01, *** p < .001.