Burnout Assessment Tool (BAT)-Development, Validity, and Reliability

Wilmar B Schaufeli, Steffie Desart, Hans De Witte, Wilmar B Schaufeli, Steffie Desart, Hans De Witte

Abstract

This paper introduces a new definition for burnout and investigates the psychometric properties of the Burnout Assessment Tool (BAT). In a prior qualitative study, 49 practitioners were interviewed about their conceptualization of burnout (part 1). Using a dialectical approach, four core dimensions-exhaustion, mental distance, and impaired emotional and cognitive impairment-and three secondary dimensions-depressed mood, psychological distress, and psychosomatic complaints-emerged, which constitute the basis of the BAT. In the second study, the psychometric characteristics of the BAT were investigated in a representative sample of 1500 Flemish employees, focusing on factorial validity, reliability, and construct validity, respectively. Results demonstrate the assumed four-factor structure for the core dimensions, which is best represented by one general burnout factor. Contrary to expectations, instead of a three-factor structure, a two-factor structure was found for the secondary dimensions. Furthermore, the BAT and its subscales show adequate reliability. Convergent validity and discriminant validity with other burnout measures-including the MBI and OLBI-was demonstrated, as well as discriminant validity with other well-being constructs, such as work engagement and workaholism.

Keywords: Burnout Assessment Tool (BAT); burnout; conceptualization; scale development; validation.

Conflict of interest statement

The authors declare no conflict of interest.

Figures

Figure 1
Figure 1
Multi-trait, multi-method framework for the Burnout Assessment Tool—Core (BAT-C), Maslach Burnout Inventory-General Survey (MBI-GS), and Oldenburg Burnout Inventory (OLBI) (correlated traits–correlated methods (CT-CM) model) with average pad coefficients.

References

    1. Maslach C., Jackson S.E. The Measurement of Experienced Burnout. J. Organ. Behav. 1981;2:99–113. doi: 10.1002/job.4030020205.
    1. Boudreau R.A., Boudreau W.F., Mauthe-Kaddoura A.J. From 57 for 57: A Bibliography of Burnout Citations; Proceedings of the 17th Conference of the European Association of Work and Organizational Psychology (EAWOP); Oslo, Norway. 20–22 May 2015.
    1. Maslach C., Jackson S.E. Maslach Burnout Inventory. Manual. 2nd ed. Consulting Psychologists Press; Palo Alto, CA, USA: 1986.
    1. Maslach C., Leiter M.P., Jackson S.E. Maslach Burnout Inventory Manual. 4th ed. Mind Garden, Inc.; Palo Alto, CA, USA: 2017.
    1. Schaufeli W.B., Leiter M.P., Maslach C., Jackson S.E. The Maslach Burnout Inventory–General Survey. Consulting Psychologists Press; Palo Alto, CA, USA: 1996. pp. 19–26. Maslach Burnout Inventory.
    1. Deligkaris P., Panagopoulou E., Montgomery A.J., Masoura E. Job Burnout and Cognitive Functioning: A Systematic Review. Work Stress. 2014;28:107–123. doi: 10.1080/02678373.2014.909545.
    1. van der Heiden C., Hoogduin C.A.L. Burn-out: Diagnostiek En Behandeling. TBV—Tijdschr. voor Bedrijfs-en Verzek. 2010;10:48–53. doi: 10.1007/BF03073692.
    1. Bianchi R., Schonfeld I.S., Laurent E. Is Burnout a Depressive Disorder? A Reexamination with Special Focus on Atypical Depression. Int. J. Stress Manag. 2014;21:307–324. doi: 10.1037/a0037906.
    1. Koutsimani P., Montgomery A., Georganta K. The Relationship Between Burnout, Depression, and Anxiety: A Systematic Review and Meta-Analysis. Front. Psychol. 2019;10:284. doi: 10.3389/fpsyg.2019.00284.
    1. Kakiashvili T., Leszek J., Rutkowski K. The Medical Perspective on Burnout. Int. J. Occup. Med. Environ. Health. 2013;26:401–412. doi: 10.2478/s13382-013-0093-3.
    1. Ahola K., Hakanen J., Perhoniemi R., Mutanen P. Relationship between Burnout and Depressive Symptoms: A Study Using the Person-Centred Approach. Burn. Res. 2014;1:29–37. doi: 10.1016/j.burn.2014.03.003.
    1. Schaufeli W.B., Taris T.W. The Conceptualization and Measurement of Burnout: Common Ground and Worlds Apart. Work Stress. 2005;19:256–262. doi: 10.1080/02678370500385913.
    1. Wheeler D.L., Vassar M., Worley J.A., Barnes L.L.B. A Reliability Generalization Meta-Analysis of Coefficient Alpha for the Maslach Burnout Inventory. Educ. Psychol. Meas. 2011;71:231–244. doi: 10.1177/0013164410391579.
    1. Schaufeli W.B., Salanova M. Efficacy or Inefficacy, That’s the Question: Burnout and Work Engagement, and Their Relationships with Efficacy Beliefs. Anxiety Stress Coping. 2007;20:177–196. doi: 10.1080/10615800701217878.
    1. de Beer L.T., Bianchi R. Confirmatory Factor Analysis of the Maslach Burnout Inventory. Eur. J. Psychol. Assess. 2019;35:217–224. doi: 10.1027/1015-5759/a000392.
    1. WHO . International Classification of Diseases (ICD-11) WHO; Geneva, Switzerland: 2019.
    1. Lastovkova A., Carder M., Rasmussen H.M., Sjobergg L., de Groene G.J., Sauni R., Vevoda J., Vevodova S., Lasfargues G., Svartegren M., et al. Burnout Syndrome as an Occupational Disease in the European Union: An Exploratory Study. Ind. Health. 2018;56:160–165. doi: 10.2486/indhealth.2017-0132.
    1. Malakh-Pines A., Aronson E., Kafry D. Burnout: From Tedium to Personal Growth. Free Press; Washington, DC, USA: 1981.
    1. Shirom A., Melamed S. A Comparison of the Construct Validity of Two Burnout Measures in Two Groups of Professionals. Int. J. Stress Manag. 2006;13:176–200. doi: 10.1037/1072-5245.13.2.176.
    1. Kristensen T.S., Borritz M., Villadsen E., Christensen K.B. The Copenhagen Burnout Inventory: A New Tool for the Assessment of Burnout. Work Stress. 2005;19:192–207. doi: 10.1080/02678370500297720.
    1. Salmela-Aro K., Rantanen J., Hyvönen K., Tilleman K., Feldt T. Bergen Burnout Inventory: Reliability and Validity among Finnish and Estonian Managers. Int. Arch. Occup. Environ. Health. 2011;84:635–645. doi: 10.1007/s00420-010-0594-3.
    1. De la Fuente E.I., Lozano L.M., García-Cueto E., Luis C.S., Vargas C., Cañadas G.R., Cañadas-De la Fuente G.A., Hambleton R.K. Development and Validation of the Granada Burnout Questionnaire in Spanish Police. Int. J. Clin. Health Psychol. 2013;13:216–225. doi: 10.1016/S1697-2600(13)70026-7.
    1. Demerouti E., Bakker A.B., Vardakou I., Kantas A. The Convergent Validity of Two Burnout Instruments. Eur. J. Psychol. Assess. 2003;18:296–307. doi: 10.1027//1015-5759.19.1.12.
    1. González-Romá V., Schaufeli W.B., Bakker A.B., Lloret S. Burnout and Work Engagement: Independent Factors or Opposite Poles? J. Vocat. Behav. 2006;68:165–174. doi: 10.1016/j.jvb.2005.01.003.
    1. Thorndike E.L. Educational Psychology, Volume III: Mental Work and Fatigue, Individual Differences and Their 885 Causes. Teachers College Columbia University; New York, NY, USA: 1914.
    1. Elo S., Kyngäs H. The Qualitative Content Analysis Process. J. Adv. Nurs. 2008;62:107–115. doi: 10.1111/j.1365-2648.2007.04569.x.
    1. Saunders B., Sim J., Kingstone T., Baker S., Waterfield J., Bartlam B., Burroughs H., Jinks C. Saturation in Qualitative Research: Exploring Its Conceptualization and Operationalization. Qual. Quant. 2018;52:1893–1907. doi: 10.1007/s11135-017-0574-8.
    1. Burnard P. A Method of Analysing Interview Transcripts in Qualitative Research. Nurse Educ. Today. 1991;11:461–466. doi: 10.1016/0260-6917(91)90009-Y.
    1. Warr P. Work, Unemployment, and Mental Health. Oxford University Press; Oxford, UK: 1987.
    1. Mikolajczak M., Gross J.J., Roskam I. Parental Burnout: What Is It, and Why Does It Matter? Clin. Psychol. Sci. 2019;7:1319–1329. doi: 10.1177/2167702619858430.
    1. Moreno-Jiménez B., Barbaranelli C., Herrer M.G., Hernández E.G. The Physician Burnout Questionnaire: A New Definition and Measure. TPM—Testing, Psychom. Methodol. Appl. Psychol. 2012;19:325–344. doi: 10.4473/TPM19.4.6.
    1. Terluin B., van Marwijk H.W., Adèr H.J., de Vet H.C., Penninx B.W., Hermens M.L., van Boeijen C.A., van Balkom A.J., van der Klink J.J., Stalman W.A. The Four-Dimensional Symptom Questionnaire (4DSQ): A Validation Study of a Multidimensional Self-Report Questionnaire to Assess Distress, Depression, Anxiety and Somatization. BMC Psychiatry. 2006;6:34. doi: 10.1186/1471-244X-6-34.
    1. Van der Klink J.J., van Dijk F.J. Dutch Practice Guidelines for Managing Adjustment Disorders in Occupational and Primary Health Care. Scand. J. Work. Environ. Health. 2003;29:478–487. doi: 10.5271/sjweh.756.
    1. Terluin B., Van Rhenen W., Schaufeli W.B., De Haan M. The Four-Dimensional Symptom Questionnaire (4DSQ): Measuring Distress and Other Mental Health Problems in a Working Population. Work Stress. 2004;18:187–207. doi: 10.1080/0267837042000297535.
    1. Verbraak M., Kleyweg J., van den Griendt J., Hoogduin K. Nadere Verkenning van de Psychometrische Kwaliteiten van de BurnOut-Neurasthenie Klachten Schaal (BO-NKS): Wat Valt Er Te Meten? Dir. Ther. 2008;28:187–221. doi: 10.1007/BF03076438.
    1. Campbell D.T., Fiske D.W. Convergent and Discriminant Validation by the Multitrait-Multimethod Matrix. Psychol. Bull. 1959;56:81–105. doi: 10.1037/h0046016.
    1. Salanova M., Del Líbano M., Llorens S., Schaufeli W.B. Engaged, Workaholic, Burned-out or Just 9-to-5? Toward a Typology of Employee Well-Being. Stress Health. 2014;30:71–81. doi: 10.1002/smi.2499.
    1. Schaufeli W.B., Salanova M., González-romá V., Bakker A.B. The Measurement of Engagement and Burnout: A Two Sample Confirmatory Factor analytic approach. J. Happiness Stud. 2002;3:71–92. doi: 10.1023/A:1015630930326.
    1. Maslach C., Leiter M.P. The Truth about Burnout. Jossey-Bass; San Fransisco, CA, USA: 1997.
    1. Schaufeli W., De Witte H. Outlook Work Engagement in Contrast to Burnout: Real and Redundant! Burn. Res. 2017;5:58–60. doi: 10.1016/j.burn.2017.06.002.
    1. Schaufeli W.B., Shimazu A., Taris T.W. Being Driven to Work Excessively Hard. Cross-Cult. Res. 2009;43:320–348. doi: 10.1177/1069397109337239.
    1. Hakanen J.J., Peeters M.C.W., Schaufeli W.B. Different Types of Employee Well-Being Across Time and Their Relationships With Job Crafting. J. Occup. Health Psychol. 2018;23:289–301. doi: 10.1037/ocp0000081.
    1. Burke R.J. Workaholism in Organizations: Concepts, Results and Future Research Directions. Int. J. Manag. Rev. 2000;2:1–16. doi: 10.1111/1468-2370.00028.
    1. Mikulas W.L., Vodanovich S.J. The Essence of Boredom. Psychol. Rec. 1993;43:3–13. doi: 10.1007/s11606-012-2196-0.
    1. Schaufeli W.B., Salanova M. Burnout, Boredom and Engagement in the Workplace. In: Peeters M., de Jonge J., Taris T., editors. People at Work: An Introduction to Contemporary Work Psychology. Wiley-Blackwell; Chichester, UK: 2014. pp. 293–320.
    1. Schaufeli W.B., van Dierendonck D. Utrechtse Burnout Schaal. Test Handleiding [Utrecht Burnout Scale. Test Manual]. Swets Test Publishers; Lisse, The Netherlands: 2000.
    1. Schaufeli W.B., Shimazu A., Hakanen J., Salanova M., De Witte H. An Ultra-Short Measure for Work Engagement. Eur. J. Psychol. Assess. 2019;35:577–591. doi: 10.1027/1015-5759/a000430.
    1. Schaufeli W.B., Bakker A.B., Van Der Heijden F.M.M.A., Prins J.T. Workaholism Among Medical Residents: It Is the Combination of Working Excessively and Compulsively That Counts. Int. J. Stress Manag. 2009;16:249–272. doi: 10.1037/a0017537.
    1. Reijseger G., Schaufeli W.B., Peeters M.C.W., Taris T.W., van Beek I., Ouweneel E. Watching the Paint Dry at Work: Psychometric Examination of the Dutch Boredom Scale. Anxiety Stress Coping. 2013;26:508–525. doi: 10.1080/10615806.2012.720676.
    1. Field A. Discovering Statistics Using IBM SPSS Statistics. Sage; Thousand Oaks, CA, USA: 2013.
    1. Chen F.F., West S.G., Sousa K.H. A Comparison of Bifactor and Second-Order Models of Quality of Life. Multivar. Behav. Res. 2010 doi: 10.1207/s15327906mbr4102_5.
    1. Kline R.B. Principles and Practice of Structural Equation Modeling. 4th ed. Guilford Press; New York, NY, USA: 2015.
    1. Byrne B.M. Structural Equation Modeling with AMOS. Lawrence Earlbaum; Mahwah, NJ, USA: 2001.
    1. Hu L., Bentler P. Evaluating Model Fit. In: Hoyle R.H., editor. Structural Equation Modeling. Concepts, Issues, and Applications. Sage; London, UK: 1995. pp. 76–99.
    1. Widaman K.F. Hierarchically Nested Covariance Structure Models for Multi- Trait-Multimethod Data. Appl. Psychol. Meas. 1985;9:1–26. doi: 10.1177/014662168500900101.
    1. Raedeke T.D., Arce C., De Francisco C., Seoane G., Ferraces M.J. The Construct Validity of the Spanish Version of the ABQ Using a Multi-Trait/Multi-Method Approach. An. Psicol. 2013;29:693–700.
    1. Fornell C., Larcker D.F. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. J. Mark. Res. 1981;18:39. doi: 10.1177/002224378101800104.
    1. Hutcheson G., Sofroniou N. The Multivariate Social Scientist: Introductory Statistics Using Generalized Linear Models. Sage Publications; Thousand Oaks, CA, USA: 1999.
    1. Heinemann L.V., Heinemann T. Burnout Research: Emergence and Scientific Investigation of a Contested Diagnosis. SAGE Open. 2017 doi: 10.1177/2158244017697154.
    1. Bianchi R., Schonfeld I.S., Laurent E. Burnout: Moving beyond the Status Quo. Int. J. Stress Manag. 2019;26:36–45. doi: 10.1037/str0000088.
    1. Maslach C., Schaufeli W.B. Historical and Conceptual Development of Burnout. In: Schaufeli W., Maslach C., Marek T., editors. Professional Burnout: Recent Developments in Theory and Research. Taylor & Francis; Washington, DC, USA: 1993. pp. 1–16.
    1. Oosterholt B.G., Maes J.H.R., Van der Linden D., Verbraak M.J.P.M., Kompier M.A.J. Getting Better, but Not Well: A 1.5 Year Follow-up of Cognitive Performance and Cortisol Levels in Clinical and Non-Clinical Burnout. Biol. Psychol. 2016;117:89–99. doi: 10.1016/j.biopsycho.2016.02.009.
    1. van Dam A., Keijsers G.P.J., Eling P.A.T.M., Becker E.S. Impaired Cognitive Performance and Responsiveness to Reward in Burnout Patients: Two Years Later. Work Stress. 2012;26:333–346. doi: 10.1080/02678373.2012.737550.
    1. Shirom A. International Review of Industrial and Organizational Psychology 1989. John Wiley & Sons; Oxford, UK: 1989. Burnout in Work Organizations; pp. 25–48.
    1. Zapf D., Seifert C., Schmutte B., Mertini H., Holz M. Emotion Work and Job Stressors and Their Effects on Burnout. Psychol. Health. 2007 doi: 10.1080/08870440108405525.
    1. Taris T.W., Le Blanc P.M., Schaufeli W.B., Schreurs P.J.G. Are There Causal Relationships between the Dimensions of the Maslach Burnout Inventory? A Review and Two Longitudinal Tests. Work Stress. 2005;19:238–255. doi: 10.1080/02678370500270453.
    1. Arrindell W., Ettema H., Groenman N., Brook F., Janssen I., Slaets J., Hekster G., Derksen J., van der Ende J., Land H., et al. Further Dutch Experiences with the Symptom Checklist-90 Revised. Swets Test Publishers; Lisse, The Netherlands: 2003.
    1. Sakakibara K., Shimazu A., Toyama H., Schaufeli W.B. Validation of the Japanese Version of the Burnout Assessment Tool. Front. Psychol. 2020;11:1819. doi: 10.3389/fpsyg.2020.01819.
    1. de Beer L.T., Schaufeli W.B., De Witte H., Hakanen J.J., Shimazu A., Glaser J., Seubert C., Bosak J., Sinval J., Rudnev M. Measurement Invariance of the Burnout Assessment Tool (BAT) Across Seven Cross-National Representative Samples. Int. J. Environ. Res. Public Health. 2020;17:5604. doi: 10.3390/ijerph17155604.
    1. Hadzibajramovic E., Schaufeli W.B., De Witte H. A Rasch Analysis of the Burnout Assessment Tool. PLoS ONE. 2020;15:e0242241. doi: 10.1371/journal.pone.0242241.
    1. Nunnally J., Bernstein I. Psychometric Theory. 3rd ed. Volume 3. McGraw-Hill; New York, NY USA: 1994. p. 701.
    1. Halbesleben J.R.B., Demerouti E. The Construct Validity of an Alternative Measure of Burnout: Investigating the English Translation of the Oldenburg Burnout Inventory. Work Stress. 2005;19:208–220. doi: 10.1080/02678370500340728.
    1. Schaufeli W.B., Taris T.W., Van Rhenen W. Workaholism, Burnout, and Work Engagement: Three of a Kind or Three Different Kinds of Employee Well-Being? Appl. Psychol. 2008;57:173–203. doi: 10.1111/j.1464-0597.2007.00285.x.
    1. Goldberg D.P. Manual of the General Health Questionnaire. NFER; Windsor, ON, Canada: 1978.
    1. Streiner D.L., Cairney J. What’s under the ROC? An Introduction to Receiver Operating Characteristics Curves. Can. J. Psychiatry. 2007;52:121–128. doi: 10.1177/070674370705200210.
    1. Schaufeli W.B., Bakker A.B., Hoogduin K., Schaap C., Kladler A. On the Clinical Validity of the Maslach Burnout Inventory and the Burnout Measure. Psychol. Health. 2001;16:565–582. doi: 10.1080/08870440108405527.
    1. Roelen C.A.M., van Hoffen M.F.A., Groothoff J.W., de Bruin J., Schaufeli W.B., van Rhenen W. Can the Maslach Burnout Inventory and Utrecht Work Engagement Scale Be Used to Screen for Risk of Long-Term Sickness Absence? Int. Arch. Occup. Environ. Health. 2015;88:467–475. doi: 10.1007/s00420-014-0981-2.

Source: PubMed

Patrocinadores y Colaboradores

Condiciones médicas

Intervenciones de drogas

3
Suscribir