Psychometric properties of the Spanish version of the Clinical Outcomes in Routine Evaluation - Outcome Measure

Adriana Trujillo, Guillem Feixas, Arturo Bados, Eugeni García-Grau, Marta Salla, Joan Carles Medina, Adrián Montesano, José Soriano, Leticia Medeiros-Ferreira, Josep Cañete, Sergi Corbella, Antoni Grau, Fernando Lana, Chris Evans, Adriana Trujillo, Guillem Feixas, Arturo Bados, Eugeni García-Grau, Marta Salla, Joan Carles Medina, Adrián Montesano, José Soriano, Leticia Medeiros-Ferreira, Josep Cañete, Sergi Corbella, Antoni Grau, Fernando Lana, Chris Evans

Abstract

Objective: The objective of this paper is to assess the reliability and validity of the Spanish translation of the Clinical Outcomes in Routine Evaluation - Outcome Measure, a 34-item self-report questionnaire that measures the client's status in the domains of Subjective well-being, Problems/Symptoms, Life functioning, and Risk.

Method: Six hundred and forty-four adult participants were included in two samples: the clinical sample (n=192) from different mental health and primary care centers; and the nonclinical sample (n=452), which included a student and a community sample.

Results: The questionnaire showed good acceptability and internal consistency, appropriate test-retest reliability, and acceptable convergent validity. Strong differentiation between clinical and nonclinical samples was found. As expected, the Risk domain had different characteristics than other domains, but all findings were comparable with the UK referential data. Cutoff scores were calculated for clinical significant change assessment.

Conclusion: The Spanish version of the Clinical Outcomes in Routine Evaluation - Outcome Measure showed acceptable psychometric properties, providing support for using the questionnaire for monitoring the progress of Spanish-speaking psychotherapy clients.

Keywords: CORE-OM; outcome measure; psychometric validation; reliability; validity.

Figures

Figure 1
Figure 1
Forest plot showing comparison between Spanish scores and UK referential data.
Figure 2
Figure 2
Box plot of mean item score for all items for clinical and nonclinical samples. Abbreviation: CORE-OM, Clinical Outcomes in Routine Evaluation - Outcome Measure.

References

    1. Margison FR, Barkham M, Evans C, et al. Measurement and psychotherapy evidence-based practice and practice-based evidence. Br J Psychiatry. 2000;177(2):123–130.
    1. CORE System Trust [homepage on the Internet] United Kingdom: CORE Information Management Systems; [Accessed March 18, 2016]. [updated 2015 Jun 1; cited 2015 Oct 10]. Available from: .
    1. CORE System Trust [homepage on the Internet] United Kingdom: CORE Information Management Systems; [Accessed March 18, 2016]. [updated 2015 Jun 1; cited 2015 Oct 10]. Available from: .
    1. Spanish CORE-OM [homepage on the Internet] Spain: CORE-OM Official Spanish Website; [Accessed March 18, 2016]. [updated 2015 Jun 1; cited 2015 Oct 10]. Available from: .
    1. Barkham M, Evans C, Margison F, et al. The rationale for developing and implementing core batteries in service settings and psychotherapy outcome research. J Ment Health. 1998;7(1):35–47.
    1. Barkham M, Margison F, Leach C, et al. Service profiling and outcomes benchmarking using the CORE-OM: toward practice-based evidence in the psychological therapies. J Consult Clin Psychol. 2001;69(2):184–196.
    1. Barkham M, Gilbert N, Connell J, Marshall C, Twigg E. Suitability and utility of the CORE-OM and CORE-A for assessing severity of presenting problems in psychological therapy services based in primary and secondary care settings. Br J Psychiatry. 2005;186:239–246.
    1. Evans C, Connell J, Barkham M, Marshall C, Mellor-Clark J. Practice-based evidence: benchmarking NHS primary care counselling services at national and local levels. Clin Psychol Psychother. 2003;10(6):374–388.
    1. Gilbert N, Barkham M, Richards A, Cameron I. The effectiveness of a primary care mental health service delivering brief psychological interventions: a benchmarking study using the CORE system. Prim Care Ment Health. 2005;3(4):241–251.
    1. McHugh P, Gordon M, Byrne M. Evaluating brief cognitive behavioural therapy within primary care. Ment Health Rev J. 2014;19(3):196–206.
    1. Hardy GE, Cahill J, Stiles WB, et al. Sudden gains in cognitive therapy for depression: a replication and extension. J Consult Clin Psychol. 2005;73(1):59–67.
    1. Stiles WB, Leach C, Barkham M, et al. Early sudden gains in psychotherapy under routine clinic conditions: practice-based evidence. J Consult Clin Psychol. 2003;71(1):14–21.
    1. Di Bona L, Saxon D, Barkham M, Dent-Brown K, Parry G. Predictors of patient non-attendance at improving access to psychological therapy services demonstration sites. J Affect Disord. 2014;169:157–164.
    1. Royal College of Nursing . Working Well? Results from the RCN Working Well Survey into the Wellbeing and Working Lives of Nurses. London: Author; 2003.
    1. Connell J, Barkham M, Stiles WB, et al. Distribution of CORE−OM scores in a general population, clinical cut-off points and comparison with the CIS-R. Br J Psychiatry. 2007;190(1):69–74.
    1. Connell J, Barkham M, Mellor-Clark J. Mental health CORE-OM norms of students attending university counselling services bench-marked against an age-matched primary care sample. Br J Guid Counc. 2007;35(1):41–56.
    1. Barkham M, Culverwell A, Spindler K, Twigg E. The CORE-OM in an older adult population: psychometric status, acceptability, and feasibility. Aging Ment Health. 2005;9(3):235–245.
    1. Jenkins PE, Turner HM. An investigation into the psychometric properties of the CORE-OM in patients with eating disorders. Couns Psychother Res. 2014;14(2):102–110.
    1. Richards DA, Lovell K, Gilbody S, et al. Collaborative care for depression in UK primary care: a randomized controlled trial. Psychol Med. 2003;38(02):279–287.
    1. Feixas G, Bados A, García-Grau E, et al. A dilemma-focused intervention for depression: a multicenter, randomized controlled trial with a 3-month follow-up. Depress Anxiety. 2016 Apr 22; Epub.
    1. Nordgren LB, Hedman E, Etienne J, et al. Effectiveness and cost-effectiveness of individually tailored internet-delivered cognitive behavior therapy for anxiety disorders in a primary care population: a randomized controlled trial. Behav Res Ther. 2014;59:1–11.
    1. CORE System Trust [homepage on the Internet] United Kingdom: CORE Information Management Systems; [Accessed March 18, 2016]. [updated 2015 Jun 1; cited 2015 Oct 10]. Available from: .
    1. Palmieri G, Evans C, Hansen V, et al. Validation of the Italian version of the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-OM) Clin Psychol Psychother. 2009;16(5):444–449.
    1. Dias Sales MC, de Matos Moleiro CM, Evans C, Gomes Alves PC. The Portuguese version of the CORE-OM: translation, adaptation, and preliminary study of psychometric properties. Rev Psiquiatria Clín. 2011;39(2):54–59.
    1. Elfström ML, Evans C, Lundgren J, Johansson B, Hakeberg M, Carlsson SG. Validation of the Swedish Version of the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-OM) Clin Psychol Psychother. 2013;20(5):447–455. doi: 10.1002/cpp.1788.
    1. Viliūniené R, Evans C, Hilbig J, et al. Translating the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-OM) into Lithuanian. Nord J Psychiatry. 2012;67(5):305–311.
    1. Kristjánsdóttir H, Sigurðsson BH, Salkovskis P, et al. Evaluation of the psychometric properties of the Icelandic version of the Clinical Outcomes in Routine Evaluation–Outcome Measure, its transdiagnostic utility and cross-cultural validation. Clin Psychol Psychother. 2015;22(1):64–74. doi: 10.1002/epp.1874.
    1. Jokić-Begić N, Lauri Korajlija A, Jurin T, Evans C. Faktorska struktura, psihometrijske karakteristike i kritična vrijednost hrvatskoga prijevoda CORE-OM upitnika [Factor structure, psychometric properties and cut-off scores of Croatian version of clinical outcomes in routines evaluation – outcome measure (CORE-OM)] Psihologijske Teme. 2014;23(2):265–288. Slovenian.
    1. Stiles WB, Barkham M, Wheeler S. Effect of duration of psychological therapy on recovery and improvement rates: evidence from UK routine practice. Br J Psychiatry. 2015;207:115–122.
    1. Biescad M, Timulak L. Measuring psychotherapy outcomes in routine practice: examining Slovak versions of three commonly used outcome instruments. Eur J Psychother Couns. 2014;16(2):140–162.
    1. Mechler J, Holmqvist R. Deteriorated and unchanged patients in psychological treatment in Swedish primary care and psychiatry. Nord J Psychiatry. 2016;70(1):16–23.
    1. Sturludottir K, Gestsdottir S, Rafnsson RH, Johannsson E. Áhrif hrey-fiíhlutunar á einkenni geðklofa, andlega líðan og líkamssamsetningu hjá ungu fólki [The effects of physical activity intervention on symptoms in schizophrenia, mental well-being and body composition in young adults] Laeknabladid. 2015;101(11):519. Icelandic.
    1. Feixas G, Evans C, Trujillo A, et al. La versión española del CORE-OM: Clinical Outcomes in Routine Evaluation – Outcome Measure [Spanish version of the CORE-OM: Clinical Outcomes in Routine Evaluation – Outcome Measure] Rev de Psicot. 2012;89:109–135. Spanish.
    1. International Test Commission International Test Commission guidelines for translating and adapting tests. 2010. [Accesed March 18, 2016]. Available from: .
    1. Evans C. The CORE-OM (Clinical Outcomes in Routine Evaluation) and its derivatives. Integra Sci Pract. 2012;2(2):12–14.
    1. Evans C, Connell J, Barkham M, et al. Towards a standardised brief outcome measure: psychometric properties and utility of the CORE-OM. Br J Psychiatry. 2002;180:51–60.
    1. Evans C, Mellor-Clark J, Margison F, et al. CORE: clinical outcome in routine evaluation. J Ment Health. 2000;9:247–255.
    1. Lyne KJ, Barrett P, Evans C, Barkham M. Dimensions of variation on the CORE-OM. Br J Clin Psychol. 2006;45(2):185–203.
    1. Barkham M, Mellor-Clark J, Connell J, Cahill J. A core approach to practice-based evidence: a brief history of the origins and applications of the CORE-OM and CORE System. Couns Psychother Res. 2006;6(1):3–15.
    1. Beck AT, Steer RA, Brown GK. Manual for the Beck Depression Inventory – Second Edition (BDI-II) San Antonio, TX: Psychological Corporation; 1996.
    1. Sanz J, Perdigón AL, Vázquez C. Adaptación Española del inventario para la depresión de Beck-II (BDI-II): Propiedades psicométricas en población general [Spanish adaptation for depression inventory Beck-II (BDI-II): psychometric properties in general population] Clín Salud. 2003;14:249–280. Spanish.
    1. Derogatis LR. SCL-90-R: Administration, Scoring and Procedures: Manual II. Towson, MD: Clinical Psychometric Research; 1983.
    1. González de Rivera JL, De las Cuevas C, Rodríguez M, Rodríguez F. Cuestionario de 90 síntomas SCL-90-R de Derogatis, L. Adaptación española [90 Symptoms Questionnaire SCL-90-R of Derogatis, L. Spanish Adaptation] Madrid, Spain: Pearson; 2002. Spanish.
    1. Cronbach LJ. Coefficient alpha and the internal structure of test. Psychometrika. 1951;16(3):297–334.
    1. Feldt LS, Woodruff DJ, Salih FA. Statistical inference for coefficient alpha. Appl Psychol Meas. 1987;11(1):93–103.
    1. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol. 1991;59(1):12–19.
    1. Bernal M, Haro JM, Bernert S, et al. Risk factors for suicidality in Europe: results from the ESEMED study. J Affect Disord. 2007;101(1–3):27–34.
    1. Casey PR, Dunn G, Kelly BD, et al. Factors associated with suicidal ideation in the general population five-centre analysis from the ODIN study. Br J Psychiatry. 2006;189(5):410–415.
    1. Cahill J, Barkham M, Stiles WB, Twigg W, Rees A, Hardy GE. Convergent validity of the CORE measures with measures of depression for clients in cognitive therapy for depression. J Couns Psychol. 2006;53(2):253–259.

Source: PubMed

3
Subskrybuj