Health Sciences-Evidence Based Practice questionnaire (HS-EBP) for measuring transprofessional evidence-based practice: Creation, development and psychometric validation

Juan Carlos Fernández-Domínguez, Joan Ernest de Pedro-Gómez, José Miguel Morales-Asencio, Miquel Bennasar-Veny, Pedro Sastre-Fullana, Albert Sesé-Abad, Juan Carlos Fernández-Domínguez, Joan Ernest de Pedro-Gómez, José Miguel Morales-Asencio, Miquel Bennasar-Veny, Pedro Sastre-Fullana, Albert Sesé-Abad

Abstract

Introduction: Most of the EBP measuring instruments available to date present limitations both in the operationalisation of the construct and also in the rigour of their psychometric development, as revealed in the literature review performed. The aim of this paper is to provide rigorous and adequate reliability and validity evidence of the scores of a new transdisciplinary psychometric tool, the Health Sciences Evidence-Based Practice (HS-EBP), for measuring the construct EBP in Health Sciences professionals.

Methods: A pilot study and a subsequent two-stage validation test sample were conducted to progressively refine the instrument until a reduced 60-item version with a five-factor latent structure. Reliability was analysed through both Cronbach's alpha coefficient and intraclass correlations (ICC). Latent structure was contrasted using confirmatory factor analysis (CFA) following a model comparison aproach. Evidence of criterion validity of the scores obtained was achieved by considering attitudinal resistance to change, burnout, and quality of professional life as criterion variables; while convergent validity was assessed using the Spanish version of the Evidence-Based Practice Questionnaire (EBPQ-19).

Results: Adequate evidence of both reliability and ICC was obtained for the five dimensions of the questionnaire. According to the CFA model comparison, the best fit corresponded to the five-factor model (RMSEA = 0.049; CI 90% RMSEA = [0.047; 0.050]; CFI = 0.99). Adequate criterion and convergent validity evidence was also provided. Finally, the HS-EBP showed the capability to find differences between EBP training levels as an important evidence of decision validity.

Conclusions: Reliability and validity evidence obtained regarding the HS-EBP confirm the adequate operationalisation of the EBP construct as a process put into practice to respond to every clinical situation arising in the daily practice of professionals in health sciences (transprofessional). The tool could be useful for EBP individual assessment and for evaluating the impact of specific interventions to improve EBP.

Conflict of interest statement

Competing Interests: The authors have declared that no competing interests exist.

References

    1. Fernández-Domínguez JC, Sesé-Abad A, Morales-Asencio JM, Oliva-Pascual-Vaca A, Salinas-Bueno I, de Pedro-Gómez JE. Validity and reliability of instruments aimed at measuring Evidence-Based Practice in Physical Therapy: a systematic review of the literature. J Eval Clin Pract. 2014;20: 767–78. doi:
    1. Scurlock-Evans L, Upton P, Upton D. Evidence-Based Practice in physiotherapy: a systematic review of barriers, enablers and interventions. Physiotherapy. 2014;100(3): 208–19. doi:
    1. Leung K, Trevena L, Waters D. Systematic review of instruments for measuring nurses’ knowledge, skills and attitudes for evidence-based practice. J Adv Nurs. 2014;70: 2181–95. doi:
    1. Buchanan H, Siegfried N, Jelsma J. Survey Instruments for Knowledge, Skills, Attitudes and Behaviour Related to Evidence-based Practice in Occupational Therapy: A Systematic Review. Occup Ther Int. 2016;23(2): 59–90. doi:
    1. McEvoy M, Williams M, Olds T. Development and psychometric testing of a trans-professional evidence-based practice profile questionnaire. Med Teach. 2010;32(9): e373–80. doi:
    1. Pollock AS, Legg L, Langhorne P, Sellars C. Barriers to achieving evidence-based stroke rehabilitation. Clin Rehabil. 2000;14(6): 611–7. doi:
    1. Metcalfe C, Lewin R, Wisher S, Perry S, Bannigan K, Moffett JK. Barriers to implementing the evidence base in four NHS therapies: dietitians, occupational therapists, physiotherapists, speech and language therapists. Physiotherap. 2001;87(8): 433–441.
    1. Palfreyman S, Tod A, Doyle J. Comparing evidence-based practice of nurses and physiotherapists. Br J Nurs. 2003;12(4): 246–253. doi:
    1. Kaper NM, Swennen MH, van Wijk AJ, Kalkman CJ, van Rheenen N, van der Graaf Y, et al. The ‘‘evidence-based practice inventory”: reliability and validity was demonstrated for a novel instrument to identify barriers and facilitators for Evidence Based Practice in health care. J. Clin. Epidemiol. 2015; 68(11), 1261–9. doi:
    1. Bernal G, Rodríguez-Soto NdelC . Development and psychometric properties of the Evidence-based Professional Practice Scale (EBPP-S). P R Health Sci J. 2010;29(4): 385–90.
    1. Fritsche L, Greenhalgh T, Falck-Ytter Y, Neumayer HH, Kunz R. Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine. BMJ. 2002;325(7376): 1338–41.
    1. Ramos KD, Schafer S, Tracz SM. Validation of the Fresno test of competence in evidence based medicine. BMJ. 2003;326(7384):319–21.
    1. Tilson JK. Validation of the modified Fresno test: assessing physical therapists’ evidence based practice knowledge and skills. BMC Med Educ. 2010;10:38 doi:
    1. American Educational Research Association, American Psychological Association & National Council on Measurement in Education. Standards for educational and psychological testing. Washington DC: American Educational Research Association; 1999.
    1. American Educational Research Association, American Psychological Association & National Council on Measurement in Education. Standards for educational and psychological testing. Washington DC: American Educational Research Association; 2014.
    1. International Test Commission. ITC guidelines on quality control, test analysis and reporting of test scores; 2013. Available:
    1. Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol 2010;10(1):22.
    1. Williams B, Perillo S, Brown T. What are the factors of organisational culture in health care settings that act as barriers to the implementation of evidence-based practice? A scoping review. Nurse Educ Today. 2015;35(2):e34–41. doi:
    1. DiCenso A, Guyatt G, Ciliska D. Evidence-based nursing: A guide to clinical practice. London: Elsevier Health Sciences; 2014.
    1. Melnyk BM. Building cultures and environments that facilitate clinician behavior change to evidence-based practice: what works? Worldviews Evid Based Nurs. 2014;11(2):79–80. doi:
    1. Dawes M, Summerskill W, Glasziou P, Cartabellotta A, Martin J, Hopayian K, et al. Sicily statement on evidence-based practice. BMC Med Educ 2005; 5(1):1 doi:
    1. Fernández-Domínguez JC, Sesé-Abad A, Morales-Asencio JM, Sastre-Fullana P, Pol-Castaneda S, de Pedro-Gómez JE. Content Validity of a Health Science Evidence-Based Practice questionnaire (HS-EBP) with a web-based modified-Delphi approach. Int J Qual Health Care. 2016; 28(6):764–773. doi:
    1. De Pedro-Gómez JE, Morales-Asencio JM, Sesé-Abad A, Bennasar-Veny M, Ruiz-Román MJ, Muñoz-Ronda F. Validation of the Spanish version of the Evidence Based Practice Questionnaire in Nurses. Rev Esp Salud Publica. 2009;83(4):577–86.
    1. Arciniega LM, González L. Validation of the Spanish-language version of the resistance to change scale. Pers Individ Dif. 2009;46(2): 178–182.
    1. Seisdedos N. MBI Inventario “Burnout de Maslach”. Madrid, España: TEA ediciones; 1997
    1. Cabezas C. La calidad de vida de los profesionales. FMC. 2000; 7(Supl 7): 53–68.
    1. Martín J, Cortés JA, Morente M, Caboblanco M, Garijo J, Rodríguez A. Metric characteristics of the Professional Quality of Life Questionnaire [QPL-35] in primary care professionals. Gac Sanit. 2004;18(2): 129–36.
    1. Jöreskog KG, Sörbom D. LISREL 8.80 for Windows [Computer software]. Lincolnwood, Illinois, USA: Scientific Software International; 2006
    1. Pallant J. SPSS survival manual: A step by step guide to data analysis using SPSS (version 15). 3rd ed. Crows Nest: Allen and Unwin; 2007.
    1. Tabachnick BG, Fidell LS. Using multivariate statistics. 5th ed. Boston: Allyn and Bacon; 2007.
    1. Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. Oxford: Oxford University Press; 2008.
    1. Hu L, Bentler M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6(1): 1–55.
    1. Schreiber JB, Nora A, Stage FK, Barlow EA, King J. Reporting Structural Equation Modeling and Confirmatory Factor Analysis Results: A Review. J Educ Res. 2006;99(6): 323–328.
    1. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33: 159–74.
    1. Benner PE. From novice to expert: Excellence and power in clinical nursing practice. New Jersey: Pearson Education; 2001.
    1. Kraus SJ. Attitudes and the prediction of behavior: A meta-analysis of the empirical literature. Pers Soc Psychol Bull. 1995;21(1): 58–75.

Source: PubMed

3
구독하다