Acessibilidade / Reportar erro

Confirmatory factorial analysis of the Maslach Burnout Inventory – Human Services Survey in health professionals in emergency services* * Paper extracted from doctoral dissertation “Mediators variables of Burnout in emergency services professionals: appicability of Maslach Burnout Inventory - Human Services Survey (MBI-HSS)”, presented to Universidade de São Paulo, Escola de Enfermagem de Ribeirão Preto, PAHO/WHO Collaborating Centre for Nursing Research Development, Ribeirão Preto, SP, Brazil.

Abstracts

Objective:

to confirm the factorial validity of the Maslach Burnout Inventory – Human Services Survey version in a sample of health professionals from the emergency services.

Method:

a quantitative, exploratory, descriptive and analytical study. Two hundred and eighty-two health professionals participated in the study. For data collection, a sociodemographic questionnaire and the Maslach Burnout Inventory were used. The psychometric sensitivity for the MBI-HSS items was estimated by measures of central tendency, variability and the distribution shape. Internal consistency was estimated using Cronbach’s alpha coefficient and the adequacy of the sample was verified using the Kaiser-Meyer-Olkin (KMO) index. As indexes for assessing the quality of fit of the model, the chi-square ratio by the degrees of freedom (χ2/DoF), the comparative fit index (CFI), the goodness of fit index (GFI), the Tucker Lewis index (TLI) and the root mean square error of approximation (RMSEA) were considered. To test data fit, the maximum likelihood method was used.

Results:

the three-factor structure of the Maslach Burnout Inventory was confirmed. Items 9, 12, 15 and 16 had a factorial weight below what was considered appropriate and were removed from the model. The second order hierarchical model with the aforementioned modifications presented an adequate adjustment to the data and can be considered the best and most parsimonious model tested according to the information theory indexes. The internal consistency of the instrument’s factors was recalculated considering the exclusion of the items and the three factors were considered adequate.

Conclusion:

the results obtained show that the Maslach Burnout Inventory is a reliable and factorially valid instrument for measuring the burnout syndrome in emergency service professionals in Brazil.

Descriptors:
Factor Analysis, Statistical; Psychometrics; Burnout, Psychological; Health Personnel; Emergencies; Stress, Psychological


Objetivo:

confirmar a validade fatorial do Maslach Bunout Inventory – versão Human Services Survey numa amostra de profissionais da saúde dos serviços de emergência.

Método:

estudo de abordagem quantitativa, exploratório, descritivo e analítico. Participaram do estudo 282 profissionais de saúde. Utilizou-se para a coleta de dados, um questionário sociodemográfico e o Maslach Burnout Inventory. A sensibilidade psicométrica dos itens do Maslach Bunout Inventory – versão Human Services Survey foi estimada pelas medidas de tendência central, variabilidade e forma da distribuição. A consistência interna foi estimada por meio do Coeficiente alfa de Cronbach e a adequação da amostra verificada por meio do índice de Kaiser-Meyer-Olkin (KMO). Como índices para a avaliação da qualidade de ajustamento do modelo foram considerados a razão de qui-quadrado pelos graus de liberdade (χ2 /gl), comparative fit index (CFI), goodness of fit index (GFI), índice de Tucker Lewis (TLI) e root mean square error of aproximation (RMSEA). Para testar o ajustamento dos dados utilizou-se o método de máxima verossimilhança.

Resultados:

confirmou-se a estrutura trifatorial do Maslach Burnout Inventory. Os itens 9, 12, 15 e 16 apresentaram peso fatorial abaixo do considerado adequado e foram removidos do modelo. O modelo hierárquico de segunda ordem, com as modificações mencionadas, apresentou ajustamento adequado aos dados e pôde ser considerado o melhor e mais parcimonioso modelo testado de acordo com os índices da teoria da informação. A consistência interna dos fatores do instrumento foi recalculada considerando-se a exclusão dos itens e foi considerada adequada nos três os fatores.

Conclusão:

os resultados obtidos mostram que o Maslach Burnout Inventory é um instrumento confiável e fatorialmente válido para medir a síndrome de o burnout em profissionais dos serviços de emergência no Brasil.

Descritores:
Análise Fatorial; Psicometria; Esgotamento Psicológico; Pessoal de Saúde; Emergências; Estresse Psicológico.


Objetivo:

confirmar la validez factorial del Maslach Bunout Inventory – versión Human Services Survey en una muestra de profesionales de la salud de los servicios de emergencia.

Método:

estudio cuantitativo, exploratorio, descriptivo y analítico. Participaron en el estudio 282 profesionales de la salud. Para la recopilación de datos, se utilizó un cuestionario sociodemográfico y el Maslach Burnout Inventory . La sensibilidad psicométrica de los ítems del Maslach Bunout Inventory – versión Human Services Survey se estimó mediante medidas de tendencia central, variabilidad y forma de distribución. La consistencia interna se estimó usando el Coeficiente alfa de Cronbach y la adecuación de la muestra se verificó usando el índice de Kaiser-Meyer-Olkin (KMO). Como índices para evaluar la calidad de ajuste del modelo fueron considerados la razón chi-cuadrado para los grados de libertad (χ 2 /gl), comparative fit index (CFI), goodness of fit index (GFI), índice de Tucker Lewis (TLI) y root mean square error of aproximation (RMSEA). Para probar el ajuste de los datos, se utilizó el método de máxima verosimilitud.

Resultados:

se confirmó la estructura de tres factores del Maslach Burnout Inventory . Los ítems 9, 12, 15 y 16 presentaron un peso factorial por debajo de lo que se consideraba adecuado y se eliminaron del modelo. El modelo jerárquico de segundo orden, con las modificaciones antes mencionadas, presentó un ajuste adecuado a los datos y puede considerarse el mejor y más parsimonioso modelo probado de acuerdo con los índices de teoría de la información. La consistencia interna de los factores del instrumento se recalculó ponderando la exclusión de los ítems y se consideró adecuada en los tres factores.

Conclusión:

los resultados obtenidos muestran que el Maslach Burnout Inventory es un instrumento confiable y factorialmente válido para medir el síndrome de burnout en los profesionales de los servicios de emergencia en Brasil.

Descriptores:
Análisis Factorial; Psicometría; Agotamiento Psicológico; Personal de Salud; Urgencias Médicas; Estrés Psicológico


Introduction

The Maslach Burnout Inventory – Human Service Survey (MBI-HSS) stands out as the most used instrument to assess the burnout syndrome and its configuration in three dimensions has been confirmed, worldwide, in different populations. However, there is no Brazilian study that has investigated its validity in health teams from emergency services. Furthermore, it is relevant to develop analyses that prove that the items on a scale measure exactly what they propose.

This is a psychological syndrome that develops in response to chronic interpersonal stressors in the workplace(11 Spontón C, Trógolo M, Castellano E, Medrano LA. Medición del Burnout: estructura factorial, validez y confiabilidad en trabajadores argentinos. Interdisciplinaria. [Internet]. 2019 [Acceso 17 dic 2019];36(1):87-103]. Disponible en: http://www.redalyc.org/articulo.oa?d=18060087007
http://www.redalyc.org/articulo.oa?d=180...

2 Baldonedo-Mosteiro M, Almeida MCS, Baptista PCP, Sánchez-Zaballos, Rodriguez-Diaz FJ, Mosteiro-Diaz MP. Burnout syndrome in Brazilian and Spanish nursing workers. Rev. Latino-Am. Enfermagem. 2019;27(e3192):1-9. doi: 10.1590/1518-8345.2818.3192
https://doi.org/10.1590/1518-8345.2818.3...
-33 Montiel-Carbajat M, Ortiz-Viveros GR, Ortega-Herrera ME, Reyes-López U, Sotomayor-Peterson M, Durón-Ramos MF. Psychometric analysis of the stress symtoms inventory, Maslach Burnout Inventory, Zarit Burden Inventory and the General Health Questionnaire applied to a sample of Mexican homemakers. J Behav Health Soc Iss. 2015;7(1):25-39. doi: 10.5460/jbhsi.7.1.50185
https://doi.org/10.5460/jbhsi.7.1.50185...
). It is characterized by emotional exhaustion (feelings of extreme tiredness related to excessive physical and emotional effort); depersonalization (negative attitudes in interpersonal relationships, marked by cynicism and disinterest) and low personal fulfillment (negative self-assessment of oneself, work ability, and to deal with other people)(11 Spontón C, Trógolo M, Castellano E, Medrano LA. Medición del Burnout: estructura factorial, validez y confiabilidad en trabajadores argentinos. Interdisciplinaria. [Internet]. 2019 [Acceso 17 dic 2019];36(1):87-103]. Disponible en: http://www.redalyc.org/articulo.oa?d=18060087007
http://www.redalyc.org/articulo.oa?d=180...
,44 Cruz GAC, Merino-Soto C, Juárez-García A, Dominguez-Lara S, Fernández-Arata M. Es replicable la estructura factorial del Maslach Burnout Inventory Human Service Survey (MBI-HSS) en la profesión de enfermeira del Perú?: un estudio nacional. Enfermería Clínica. [Internet]. 2020 [Acceso 8 jun 2020];30(1):129-52. Disponible en: https://doi.org/10.1016/j.enfcli.2019.12.013
https://doi.org/10.1016/j.enfcli.2019.12...

5 Bianchi R, Schonfeld S, Laurent E. Burnout-depression overlap: a review. Clin Psychol Rev. [Internet]. 2015;36:28-41. doi: 10.1016/j.cpr.2015.01.004
https://doi.org/10.1016/j.cpr.2015.01.00...

6 Bianchi R, Schonfeld IS, Verkuilen J. A five-sample confirmatory factor analytic study of burnout-depression overlap. J Clin Psychol. [Internet]. 2020 [cited Jun 8, 2020];76(4):367-85. Available from: https://doi.org/10.1002/jclp.22927
https://doi.org/10.1002/jclp.22927...
-77 Adriaenssens J, Gucht V, Maes S. Determinants and prevalence of burnout in emergency nurces: a systematic review of 25 years of research. Int J Nurs Stud. 2015;52:649-61. doi: 10.1016/j.ijnurstu.2014.11.004
https://doi.org/10.1016/j.ijnurstu.2014....
).

The Maslach Burnout Inventory was developed in 1981, originally to be applied to human service professionals. The three dimensions that make up the scale emerged from exploratory items collected from interviews with health care professionals, with the aim of reflecting on the experiences related to the phenomenon(11 Spontón C, Trógolo M, Castellano E, Medrano LA. Medición del Burnout: estructura factorial, validez y confiabilidad en trabajadores argentinos. Interdisciplinaria. [Internet]. 2019 [Acceso 17 dic 2019];36(1):87-103]. Disponible en: http://www.redalyc.org/articulo.oa?d=18060087007
http://www.redalyc.org/articulo.oa?d=180...
). With increasing interest in the burnout syndrome, other versions of this instrument have been developed(33 Montiel-Carbajat M, Ortiz-Viveros GR, Ortega-Herrera ME, Reyes-López U, Sotomayor-Peterson M, Durón-Ramos MF. Psychometric analysis of the stress symtoms inventory, Maslach Burnout Inventory, Zarit Burden Inventory and the General Health Questionnaire applied to a sample of Mexican homemakers. J Behav Health Soc Iss. 2015;7(1):25-39. doi: 10.5460/jbhsi.7.1.50185
https://doi.org/10.5460/jbhsi.7.1.50185...
).

There are currently three versions of the Maslach Burnout Inventory: the Human Services Survey (MBI-HSS), used for the health services; the Educators Survey (MBI-ES), used in the educational area and the General Survey (MBI-GS), used for workers in general(88 Shaufeli WB, Maslach C, Marek T. Professional burnout: recent developments in theory and research. 1. ed. New York: Taylor & Francis; 2017.). There are other assessment instruments, however, the MBI is the most used by the national and international scientific community, showing high reliability regardless of the sample(44 Cruz GAC, Merino-Soto C, Juárez-García A, Dominguez-Lara S, Fernández-Arata M. Es replicable la estructura factorial del Maslach Burnout Inventory Human Service Survey (MBI-HSS) en la profesión de enfermeira del Perú?: un estudio nacional. Enfermería Clínica. [Internet]. 2020 [Acceso 8 jun 2020];30(1):129-52. Disponible en: https://doi.org/10.1016/j.enfcli.2019.12.013
https://doi.org/10.1016/j.enfcli.2019.12...
,77 Adriaenssens J, Gucht V, Maes S. Determinants and prevalence of burnout in emergency nurces: a systematic review of 25 years of research. Int J Nurs Stud. 2015;52:649-61. doi: 10.1016/j.ijnurstu.2014.11.004
https://doi.org/10.1016/j.ijnurstu.2014....
).

The MBI-HSS has 22 statements that comprise the frequency of feelings and attitudes towards clients and work. These statements are divided into three dimensions: emotional exhaustion (made up of nine items), depersonalization (made up of five items) and personal fulfillment (made up of eight items). The answers follow a five-point Likert scale ranging from 1 to 5 (from never to every day). There is the burnout syndrome in the manifestation of high emotional exhaustion, high depersonalization and low personal fulfillment(11 Spontón C, Trógolo M, Castellano E, Medrano LA. Medición del Burnout: estructura factorial, validez y confiabilidad en trabajadores argentinos. Interdisciplinaria. [Internet]. 2019 [Acceso 17 dic 2019];36(1):87-103]. Disponible en: http://www.redalyc.org/articulo.oa?d=18060087007
http://www.redalyc.org/articulo.oa?d=180...

2 Baldonedo-Mosteiro M, Almeida MCS, Baptista PCP, Sánchez-Zaballos, Rodriguez-Diaz FJ, Mosteiro-Diaz MP. Burnout syndrome in Brazilian and Spanish nursing workers. Rev. Latino-Am. Enfermagem. 2019;27(e3192):1-9. doi: 10.1590/1518-8345.2818.3192
https://doi.org/10.1590/1518-8345.2818.3...

3 Montiel-Carbajat M, Ortiz-Viveros GR, Ortega-Herrera ME, Reyes-López U, Sotomayor-Peterson M, Durón-Ramos MF. Psychometric analysis of the stress symtoms inventory, Maslach Burnout Inventory, Zarit Burden Inventory and the General Health Questionnaire applied to a sample of Mexican homemakers. J Behav Health Soc Iss. 2015;7(1):25-39. doi: 10.5460/jbhsi.7.1.50185
https://doi.org/10.5460/jbhsi.7.1.50185...
-44 Cruz GAC, Merino-Soto C, Juárez-García A, Dominguez-Lara S, Fernández-Arata M. Es replicable la estructura factorial del Maslach Burnout Inventory Human Service Survey (MBI-HSS) en la profesión de enfermeira del Perú?: un estudio nacional. Enfermería Clínica. [Internet]. 2020 [Acceso 8 jun 2020];30(1):129-52. Disponible en: https://doi.org/10.1016/j.enfcli.2019.12.013
https://doi.org/10.1016/j.enfcli.2019.12...
).

The MBI-HSS has shown good internal consistency in studies carried out in several countries such as Spain, Mexico, Chile, Portugal, Colombia and Brazil, ranging from 0.79 to 0.91 for the emotional exhaustion dimension (α=0.90 in the original version); between 0.69 and 0.87 for personal fulfillment (α=0.71 in the original version) and between 0.42 and 0.66 for the depersonalization dimension (α=0.79 in the original version). This lower score for the depersonalization dimension has, frequently, occurred in studies conducted outside the United States(11 Spontón C, Trógolo M, Castellano E, Medrano LA. Medición del Burnout: estructura factorial, validez y confiabilidad en trabajadores argentinos. Interdisciplinaria. [Internet]. 2019 [Acceso 17 dic 2019];36(1):87-103]. Disponible en: http://www.redalyc.org/articulo.oa?d=18060087007
http://www.redalyc.org/articulo.oa?d=180...

2 Baldonedo-Mosteiro M, Almeida MCS, Baptista PCP, Sánchez-Zaballos, Rodriguez-Diaz FJ, Mosteiro-Diaz MP. Burnout syndrome in Brazilian and Spanish nursing workers. Rev. Latino-Am. Enfermagem. 2019;27(e3192):1-9. doi: 10.1590/1518-8345.2818.3192
https://doi.org/10.1590/1518-8345.2818.3...

3 Montiel-Carbajat M, Ortiz-Viveros GR, Ortega-Herrera ME, Reyes-López U, Sotomayor-Peterson M, Durón-Ramos MF. Psychometric analysis of the stress symtoms inventory, Maslach Burnout Inventory, Zarit Burden Inventory and the General Health Questionnaire applied to a sample of Mexican homemakers. J Behav Health Soc Iss. 2015;7(1):25-39. doi: 10.5460/jbhsi.7.1.50185
https://doi.org/10.5460/jbhsi.7.1.50185...
-44 Cruz GAC, Merino-Soto C, Juárez-García A, Dominguez-Lara S, Fernández-Arata M. Es replicable la estructura factorial del Maslach Burnout Inventory Human Service Survey (MBI-HSS) en la profesión de enfermeira del Perú?: un estudio nacional. Enfermería Clínica. [Internet]. 2020 [Acceso 8 jun 2020];30(1):129-52. Disponible en: https://doi.org/10.1016/j.enfcli.2019.12.013
https://doi.org/10.1016/j.enfcli.2019.12...
,99 Menezes PCM, Alves ESRC, Araújo Neto AS, Davim RMB, Guare RO. Burnout syndrome: a reflective analysis. Rev Enferm UFPE On Line. [Internet]. 2017 [cited Jan 5, 2019];11(12):5092-101. Available from: https://doi.org/10.5205/1981-8963-v11i12a25086p5092-5101-2017
https://doi.org/10.5205/1981-8963-v11i12...
-1010 Pereira SS, Teixeira CAB, Reisdorfer E, Gherardi-Donato ECS, Juruena MF, Cardoso L. Burnout in nursing profesionals: associations with early stress. Br J Ment Health Nurs. [Internet]. 2015 [cited Jan 5, 2019];4(6):267-75. Available from: https://doi.org/10.12968/bjmh.2015.4.6.267
https://doi.org/10.12968/bjmh.2015.4.6.2...
).

Confirmatory structural analysis is widely used to assess the relationship between items and factors in an instrument and in the international scientific literature there are studies that indicate from one to six factors for MBI-HSS(44 Cruz GAC, Merino-Soto C, Juárez-García A, Dominguez-Lara S, Fernández-Arata M. Es replicable la estructura factorial del Maslach Burnout Inventory Human Service Survey (MBI-HSS) en la profesión de enfermeira del Perú?: un estudio nacional. Enfermería Clínica. [Internet]. 2020 [Acceso 8 jun 2020];30(1):129-52. Disponible en: https://doi.org/10.1016/j.enfcli.2019.12.013
https://doi.org/10.1016/j.enfcli.2019.12...
,1111 Schneider A, Forster JE, Mealer M. Exploratory and confirmatory factor analysis of the Maslach Burnout Inventory to measure burnout syndrome in critical care nurses. J Nurs Meas. 2020;16:345-61. doi: 10.1891/JNM-D-18-00055
https://doi.org/10.1891/JNM-D-18-00055...

12 Beltran CA, Moreno MP, Estrada JGS. Confiabilidad y validación de la escala Maslach Burnout Inventory (Hss) en trabajadores del occidente de México. Salud Uninorte. [Internet]. 2016 [Acceso 5 ene 2019];32(2):218-27. Disponible en: http://www.scielo.org.co/pdf/sun/v32n2/v32n2a05.pdf
http://www.scielo.org.co/pdf/sun/v32n2/v...
-1313 Poletto NA, Probst LF, Oliveira TL, Guerra LM, Ambrosano MB, Cortellazzi KL, et. al. Burnout Syndrome in municipal health. Cad Saúde Coletiva. 2016;24(2):209-15. doi: 10.1590/1414-462X201600020005
https://doi.org/10.1590/1414-462X2016000...
). Most of them indicate the original composition, with three factors/dimensions, as the most suitable(1111 Schneider A, Forster JE, Mealer M. Exploratory and confirmatory factor analysis of the Maslach Burnout Inventory to measure burnout syndrome in critical care nurses. J Nurs Meas. 2020;16:345-61. doi: 10.1891/JNM-D-18-00055
https://doi.org/10.1891/JNM-D-18-00055...
,1313 Poletto NA, Probst LF, Oliveira TL, Guerra LM, Ambrosano MB, Cortellazzi KL, et. al. Burnout Syndrome in municipal health. Cad Saúde Coletiva. 2016;24(2):209-15. doi: 10.1590/1414-462X201600020005
https://doi.org/10.1590/1414-462X2016000...
).

In Brazil, in recent years, studies on the factorial validity of the MBI for students (MBI-ES)(1414 Souza LRS, Souza EL, Barroso BIL. Síndrome de Burnout: mapeamento em graduandos de terapia ocupacional. Rev Ter Ocupac USP. [Internet].2018 [Acesso 9 jun 2020];29(2):104-10. Disponível em: https://doi.org/10.11606/issn.2238-6149.v29i2p104-110
https://doi.org/10.11606/issn.2238-6149....

15 Ruback SP, Tavares JMAB, Lins SMSB, Campos TS, Rocha RG, Caetano DA. Stress and Burnout syndrome among nursing professionals working in nephrology: a integrative review. J Res Fundam Care Online. 2018;889-99. doi: 10.9789/2175-5361.2018.v10i3.889-899
https://doi.org/10.9789/2175-5361.2018.v...
-1616 Souza SAS, Souza LAS, Lima MAV Junior. Síndrome de Burnout: o cirurgião-dentista docente e o esgotamento laboral crônico. Rev Campo Saber. [Internet]. 2017 [Acesso 5 jan 2019];3(2):1-10. Disponível em: http://periodicos.iesp.edu.br/index.php/campodosaber/article/view/77
http://periodicos.iesp.edu.br/index.php/...
), health, justice, security and education professionals (MBI-GS)(1515 Ruback SP, Tavares JMAB, Lins SMSB, Campos TS, Rocha RG, Caetano DA. Stress and Burnout syndrome among nursing professionals working in nephrology: a integrative review. J Res Fundam Care Online. 2018;889-99. doi: 10.9789/2175-5361.2018.v10i3.889-899
https://doi.org/10.9789/2175-5361.2018.v...
), nephrology nurses (MBI-HSS)(1515 Ruback SP, Tavares JMAB, Lins SMSB, Campos TS, Rocha RG, Caetano DA. Stress and Burnout syndrome among nursing professionals working in nephrology: a integrative review. J Res Fundam Care Online. 2018;889-99. doi: 10.9789/2175-5361.2018.v10i3.889-899
https://doi.org/10.9789/2175-5361.2018.v...
) and nursing assistants (MBI-HSS)(1717 Andolhe R, Barbosa RL, Oliveira EM, Costa ALS, Padilha KG. Stress, coping and burnout among intensive care unit nursing staff: associated factors. Rev Esc Enferm USP. [Internet]. 2015 [cited Jan 5, 2019];49(Sp Iss):58-64. Available from: http://www.scielo.br/pdf/reeusp/v49nspe/1980-220X-reeusp-49-spe-0058.pdf
http://www.scielo.br/pdf/reeusp/v49nspe/...
) have been developed.

Given such context, even though the instrument is safe and measures what it is really wanted to measure, it is necessary to demonstrate how it behaved in this study, with this specific sample, in order to provide relevant data for the literature, which indicate that the instrument is consistent, does not have distortion in the measurement and remains with its three-factor structure according to the original version.

Considering the variability of results in the studies already carried out with MBI-HSS and the relevance of confirmatory analyses for the validation of this important measurement instrument in different populations and contexts, this study aims to confirm the factorial validity of the Maslach Burnout Inventory – Human Services Survey version in a sample of health professionals from the emergency services.

Method

The study population corresponded to 840 health professionals (physicians, nurses, and nursing technicians), who work in mobile, pre-hospital, and hospital emergency services in a city in the inland of the state of São Paulo, Brazil. The inclusion criterion was a minimum service time of one year. Thus, the sample was calculated taking into account ten subjects for each variable, with the final N equal to 282 participants(1818 García AJ. Investigaciones psicométricas de escalas psicosociales en trabajadores mexicanos. México: Plaza y Valdés, 2014.).

All the ethical aspects were respected and the research project was approved by the institution’s Ethics Committee, with opinion number No. 1,266,959 and CAAE No. 47147815.0000.5993 according to Resolution No. 466/2012, which deals with research with human beings in Brazil.

For data collection, the participants of the Maslach Burnout Inventory – Human Services Survey (MBI-HSS), self-completed a Likert type scale type with 5 points and a sociodemographic questionnaire with 20 questions, namely: gender; date of birth; scholarship; marital situation; religion; occupation; position; service time; number of employment contracts; work shift; weekly workload; with whom do you live?; do you have children?; do you practice physical activity?; sleep duration; do you have a health problem?; do you use a psychotropic drug?; do you use anti-inflammatory drugs?; have you been away from work in the last year?, and: do you smoke?

Collection took place during the work shift, in a place reserved in the service itself, from October 2015 to March 2016. The data were analyzed using the additional specific AMOS module from the Statistical Package for the Social Sciences (SPSS) statistical program, version 19.0.

The psychometric sensitivity of the MBI-HSS items was estimated by measures of central tendency (mean and median), variability (standard deviation) and distribution shape. The latter being tested by the Shapiro-Wilk test, a result of p<0.05 was obtained. The internal consistency of each MBI-HSS factor was estimated using the standardized Cronbach’s alpha coefficient (α), with α≥0.70 being considered adequate. The adequacy of the sample was verified using the Kaiser-Meyer-Olkin (KMO) index.

To test the data fit to the original three-factor structure proposed for the MBI-HSS, a confirmatory factor analysis (CFA) was performed, using the maximum likelihood method.

As indexes for assessing the quality of fit of the model, the chi-square ratio for degrees of freedom (χ2/DoF), the comparative fit index (CFI), the goodness of fit index (GFI), the Tucker Lewis Index (TLI) and root mean square error of approximation (RMSEA) were considered. The adjustment of the models was considered adequate when χ2/DoF≤5.0, CFI and GFI≥0.90 and with RMSEA values <0.08(1818 García AJ. Investigaciones psicométricas de escalas psicosociales en trabajadores mexicanos. México: Plaza y Valdés, 2014.).

To check for the existence of a correlation between the errors, the modification indexes were used from the Lagrange Multipliers. The comparison between the models was performed using indexes based on the Information Theory (Akaike Information Criterion - AIC, Browne-Cudeck Criterion - BCC and Bayes Information Criterion - BIC), the best model being considered the one that displayed the lowest values in these indexes(1818 García AJ. Investigaciones psicométricas de escalas psicosociales en trabajadores mexicanos. México: Plaza y Valdés, 2014.).

Results

The sample consisted of 282 health professionals with a mean age of 40 years old (SD±9.4), mostly characterized by women (79.1%), married or with partners (52.1%) and with children (66.3%). As for schooling, 61.3% have high school and 38.7%, higher education. Considering their professions, 16% were nurses, 73.4% nursing technicians and 10.6% physicians. The mean time of work in the emergency services was 10 years (SD±8.2).

As for the characteristics related to the health of the professionals, 55% do not practice regular physical activity, the mean hours of sleep per night was 6.2 h (SD±1.3), 41.1% would report any health problem, 13.8% used psychotropic drugs, 49.3% used psychostimulants, 58.2% used anti-inflammatories and 37.6% reported being away from work in the last year.

Table 1 details the descriptive results of the instrument, regarding the psychometric sensitivity of the MBI-HSS items. It was considered that the absolute values of kurtosis (Ku<7) and asymmetry (Sk<3) did not indicate severe deviations from the normal distribution of the answers and, consequently, from psychometric sensitivity.

Table 1
Summary and distribution measures by items of the Maslach Burnout Inventory - Human Services Survey (MBI-HSS) for health professionals in emergency services (n=282). Ribeirão Preto, SP, Brazil, 2015-2016

The internal consistency of the MBI-HSS, considering the complete instrument, was adequate for the emotional exhaustion (α=0.879) and personal fulfillment (α=0.692) factors, being below the adequate for the depersonalization factor (α=0.594).

During the MBI-HSS internal consistency analysis process, it was verified that some items exceeded the alpha of the dimension to which they belong: 16 (α=0.88); 9 (α=0.693); 15 (α=0.663) and 22 (α=0.600). After eliminating these items from the KMO index, the best result (KMO=0.891) was obtained.

Subsequently, the confirmatory factor analysis began and, in Table 2, the results for the three models proposed for the MBI-HSS can be seen.

Table 2
Quality indexes for adjustment of the Confirmatory Factor Analysis (CFA) and Indexes based on the information theory (AIC, BIC and BCC) for health professionals in emergency services (n=282). Ribeirão Preto, SP, Brazil, 2015-2016

Model 1, initial model following the three-factor proposal of the original MBI-HSS, adjusted for the sample of health professionals working in the area of urgency and emergency, revealed a quality of adjustment that can be considered unsatisfactory, according to the values obtained χ2/DoF = 2.16; CFI = 0.86; GFI = 0.86; TLI = 0.85 and RMSEA = 0.07.

In order to achieve a better fit of the model, the original model was refined according to the modification indexes obtained through AMOS. In this first phase, item 12 of the personal fulfillment dimension and item 16 of the emotional exhaustion dimension were deleted due to their modification indexes suggesting such a correction.

In Model 2, after deleting items 12 and 16, a more satisfactory fit quality was obtained, according to the values obtained in the indexes χ2/DoF = 1.87; CFI = 0.91; GFI = 0.89; TLI = 0.89 and RMSEA = 0.06. However, it was observed that item 9 of the personal fulfillment dimension and item 15 of the depersonalization dimension still had factorial weights below what was considered adequate (≥0.40) and needed to be removed from the model.

With the removal of items 9 and 15 Model 3 was obtained, with indexes χ2/DoF = 1.84; CFI = 0.93; GFI = 0.90; TLI = 0.91 and RMSEA = 0.06, considered the best in relation to the three models, which arrived at the second order hierarchical model with the mentioned modifications (Figure 1), presented adequate adjustment to the data and can be considered the best and most parsimonious model tested according to the information theory indexes (AIC = 320.73; BIC = 459.44; BCC = 326.93). The internal consistency of the three dimensions of the MBI-HSS was recalculated considering the exclusion of the items and were considered adequate according to the literature (Emotional exhaustion: α = 0.88; Depersonalization: α = 0.66; Professional fulfillment: α = 0.67). Model 4 is shown in Figure 1.

Figure 1
Second-order hierarchical model of the MBI-HSS adjusted for the sample of health professionals in emergency services (n=282). Ribeirão Preto, SP, Brazil, 2015-2016

EE = Emotional exhaustion; PF = Professional fulfillment; DP = Depersonalization


Discussion

The results obtained in this sample confirm the theoretical model of the burnout syndrome with regard to the constitution of three dimensions as proposed by the original American inventory(11 Spontón C, Trógolo M, Castellano E, Medrano LA. Medición del Burnout: estructura factorial, validez y confiabilidad en trabajadores argentinos. Interdisciplinaria. [Internet]. 2019 [Acceso 17 dic 2019];36(1):87-103]. Disponible en: http://www.redalyc.org/articulo.oa?d=18060087007
http://www.redalyc.org/articulo.oa?d=180...
), as well as in studies carried out in other countries, in which the factorial structure found was maintained as in the original version(44 Cruz GAC, Merino-Soto C, Juárez-García A, Dominguez-Lara S, Fernández-Arata M. Es replicable la estructura factorial del Maslach Burnout Inventory Human Service Survey (MBI-HSS) en la profesión de enfermeira del Perú?: un estudio nacional. Enfermería Clínica. [Internet]. 2020 [Acceso 8 jun 2020];30(1):129-52. Disponible en: https://doi.org/10.1016/j.enfcli.2019.12.013
https://doi.org/10.1016/j.enfcli.2019.12...
,1818 García AJ. Investigaciones psicométricas de escalas psicosociales en trabajadores mexicanos. México: Plaza y Valdés, 2014.

19 Gilla MA, Giménez SB, Moran VE, Olaz FO. Adaptación y validación del inventario de burnout de Maslach en profesionales argentinos de la salud mental. Laberabit. [Internet]. 2019 [Acceso 8 jun 2020];25(2):179-93. Disponible en: https://doi.org/10.24265/liberabit.2019.v25n2.04
https://doi.org/10.24265/liberabit.2019....

20 Silva GSA, Silva GAV, Silva RM, Andolhe R, Padilha KG, Costa ALS. Stress and burnout in nursing workers of an intensive and semi-intensive health care unit. Rev Cient Sena Aires. [Internet]. 2018 [cited Jan 5, 2019];7(1):5-11. Available from: http://revistafacesa.senaaires.com.br/index.php/revisa/article/view/297/207
http://revistafacesa.senaaires.com.br/in...
-2121 Faundez-Olivares VE, Mena-Miranda L, Sepúlveda FM, Wilke CJ. Validez factorial del Maslach Burnout Inventory Human Services (MBI-HSS) en profesionales chilenos. Univ Psychol. [Internet]. 2014 [cited Jan 5, 2019];13(1):1-28. doi:10.11144/Javeriana.UPSY13-1.vfmb
https://doi.org/10.11144/Javeriana.UPSY1...
).

The internal consistency of the MBI-HSS for health professionals in emergency services was considered adequate for the emotional exhaustion and personal fulfillment factors, but it was below the adequate for the depersonalization factor.

Similar results were found in studies developed in other countries(44 Cruz GAC, Merino-Soto C, Juárez-García A, Dominguez-Lara S, Fernández-Arata M. Es replicable la estructura factorial del Maslach Burnout Inventory Human Service Survey (MBI-HSS) en la profesión de enfermeira del Perú?: un estudio nacional. Enfermería Clínica. [Internet]. 2020 [Acceso 8 jun 2020];30(1):129-52. Disponible en: https://doi.org/10.1016/j.enfcli.2019.12.013
https://doi.org/10.1016/j.enfcli.2019.12...
,2020 Silva GSA, Silva GAV, Silva RM, Andolhe R, Padilha KG, Costa ALS. Stress and burnout in nursing workers of an intensive and semi-intensive health care unit. Rev Cient Sena Aires. [Internet]. 2018 [cited Jan 5, 2019];7(1):5-11. Available from: http://revistafacesa.senaaires.com.br/index.php/revisa/article/view/297/207
http://revistafacesa.senaaires.com.br/in...

21 Faundez-Olivares VE, Mena-Miranda L, Sepúlveda FM, Wilke CJ. Validez factorial del Maslach Burnout Inventory Human Services (MBI-HSS) en profesionales chilenos. Univ Psychol. [Internet]. 2014 [cited Jan 5, 2019];13(1):1-28. doi:10.11144/Javeriana.UPSY13-1.vfmb
https://doi.org/10.11144/Javeriana.UPSY1...

22 Kulakova O, Jiménez BM, Garrosa E, Hernández MOS, Aragón A. University of the construct Maslach Burnout Inventory in a latin-american context. Acta de Investigación Psicol. [Internet]. 2017 [cited Jan 5, 2019];7(2017):2679-90. doi: https://doi.org/10.1016/j.aipprr.2017.05.001
https://doi.org/10.1016/j.aipprr.2017.05...

23 Puranitee P, Saetang S, Sumrithe S, Busari JO, Mook WNKA, Heeneman S. Exploring burnout and depression of Thai medical students: the psychometric properties of the Maslach Burnout Inventory. Int J Med Educ. 2019;10:223-9. doi: 10.5116/ijme.5dc6.8228
https://doi.org/10.5116/ijme.5dc6.8228...

24 Berjot S, Altintas E, Lesage F, Grebot E. Burnout risk profiles among French psychologists. Burnout Res. 2017;7:10-20. doi: 10.1016/j.burn.2017.10.001
https://doi.org/10.1016/j.burn.2017.10.0...
-2525 Moreno MP, Aranda BC, López MRP. Validez factorial del Maslach Burnout Inventory - General Survey en ocho países latinoamericanos. Ciência Trabajo. [Internet]. 2015 [Acceso 5 ene 2019];17(52):28-31. Disponible en: http://dx.doi.org/10.4067/S0718-24492015000100006
http://dx.doi.org/10.4067/S0718-24492015...
), indicating that, despite the cultural differences, the scale has maintained its cross-cultural validity(2626 Carreón OHA, Reyes AGU. Confiabilidad, validez factorial y normalización exploratórias del inventario de Burnout de Maslach em Nayarit. Rev Eletrónica Psicol Iztacala. [Internet]. 2017 [Acceso 9 Jun 2020];20(3). Disponible en: https://www.iztacala.unam.mx/carreras/psicologia/psiclin/vol20num3/Vol20No3Art20.pdf
https://www.iztacala.unam.mx/carreras/ps...
). Normally, indexes have been found between 0.71 and 0.91 for the emotional exhaustion dimension, between 0.69 and 0.87 for personal fulfillment and between 0.42 and 0.64 for depersonalization(33 Montiel-Carbajat M, Ortiz-Viveros GR, Ortega-Herrera ME, Reyes-López U, Sotomayor-Peterson M, Durón-Ramos MF. Psychometric analysis of the stress symtoms inventory, Maslach Burnout Inventory, Zarit Burden Inventory and the General Health Questionnaire applied to a sample of Mexican homemakers. J Behav Health Soc Iss. 2015;7(1):25-39. doi: 10.5460/jbhsi.7.1.50185
https://doi.org/10.5460/jbhsi.7.1.50185...
,2020 Silva GSA, Silva GAV, Silva RM, Andolhe R, Padilha KG, Costa ALS. Stress and burnout in nursing workers of an intensive and semi-intensive health care unit. Rev Cient Sena Aires. [Internet]. 2018 [cited Jan 5, 2019];7(1):5-11. Available from: http://revistafacesa.senaaires.com.br/index.php/revisa/article/view/297/207
http://revistafacesa.senaaires.com.br/in...

21 Faundez-Olivares VE, Mena-Miranda L, Sepúlveda FM, Wilke CJ. Validez factorial del Maslach Burnout Inventory Human Services (MBI-HSS) en profesionales chilenos. Univ Psychol. [Internet]. 2014 [cited Jan 5, 2019];13(1):1-28. doi:10.11144/Javeriana.UPSY13-1.vfmb
https://doi.org/10.11144/Javeriana.UPSY1...

22 Kulakova O, Jiménez BM, Garrosa E, Hernández MOS, Aragón A. University of the construct Maslach Burnout Inventory in a latin-american context. Acta de Investigación Psicol. [Internet]. 2017 [cited Jan 5, 2019];7(2017):2679-90. doi: https://doi.org/10.1016/j.aipprr.2017.05.001
https://doi.org/10.1016/j.aipprr.2017.05...

23 Puranitee P, Saetang S, Sumrithe S, Busari JO, Mook WNKA, Heeneman S. Exploring burnout and depression of Thai medical students: the psychometric properties of the Maslach Burnout Inventory. Int J Med Educ. 2019;10:223-9. doi: 10.5116/ijme.5dc6.8228
https://doi.org/10.5116/ijme.5dc6.8228...

24 Berjot S, Altintas E, Lesage F, Grebot E. Burnout risk profiles among French psychologists. Burnout Res. 2017;7:10-20. doi: 10.1016/j.burn.2017.10.001
https://doi.org/10.1016/j.burn.2017.10.0...
-2525 Moreno MP, Aranda BC, López MRP. Validez factorial del Maslach Burnout Inventory - General Survey en ocho países latinoamericanos. Ciência Trabajo. [Internet]. 2015 [Acceso 5 ene 2019];17(52):28-31. Disponible en: http://dx.doi.org/10.4067/S0718-24492015000100006
http://dx.doi.org/10.4067/S0718-24492015...
).

The emotional exhaustion dimension stands out as the least vulnerable to cultural issues(2626 Carreón OHA, Reyes AGU. Confiabilidad, validez factorial y normalización exploratórias del inventario de Burnout de Maslach em Nayarit. Rev Eletrónica Psicol Iztacala. [Internet]. 2017 [Acceso 9 Jun 2020];20(3). Disponible en: https://www.iztacala.unam.mx/carreras/psicologia/psiclin/vol20num3/Vol20No3Art20.pdf
https://www.iztacala.unam.mx/carreras/ps...
). This result may indicate a more universal relationship between the statements that make up the emotional exhaustion dimension and the feeling of weariness due to work that occurs in individuals (relationship between the dimension and the construct).

The low internal consistency of the depersonalization dimension, in comparison with the other two dimensions of emotional exhaustion and personal fulfillment, is often found in other studies(33 Montiel-Carbajat M, Ortiz-Viveros GR, Ortega-Herrera ME, Reyes-López U, Sotomayor-Peterson M, Durón-Ramos MF. Psychometric analysis of the stress symtoms inventory, Maslach Burnout Inventory, Zarit Burden Inventory and the General Health Questionnaire applied to a sample of Mexican homemakers. J Behav Health Soc Iss. 2015;7(1):25-39. doi: 10.5460/jbhsi.7.1.50185
https://doi.org/10.5460/jbhsi.7.1.50185...
-44 Cruz GAC, Merino-Soto C, Juárez-García A, Dominguez-Lara S, Fernández-Arata M. Es replicable la estructura factorial del Maslach Burnout Inventory Human Service Survey (MBI-HSS) en la profesión de enfermeira del Perú?: un estudio nacional. Enfermería Clínica. [Internet]. 2020 [Acceso 8 jun 2020];30(1):129-52. Disponible en: https://doi.org/10.1016/j.enfcli.2019.12.013
https://doi.org/10.1016/j.enfcli.2019.12...
,1111 Schneider A, Forster JE, Mealer M. Exploratory and confirmatory factor analysis of the Maslach Burnout Inventory to measure burnout syndrome in critical care nurses. J Nurs Meas. 2020;16:345-61. doi: 10.1891/JNM-D-18-00055
https://doi.org/10.1891/JNM-D-18-00055...
,2525 Moreno MP, Aranda BC, López MRP. Validez factorial del Maslach Burnout Inventory - General Survey en ocho países latinoamericanos. Ciência Trabajo. [Internet]. 2015 [Acceso 5 ene 2019];17(52):28-31. Disponible en: http://dx.doi.org/10.4067/S0718-24492015000100006
http://dx.doi.org/10.4067/S0718-24492015...
). This result may be related to the small number of items that make up this dimension(1111 Schneider A, Forster JE, Mealer M. Exploratory and confirmatory factor analysis of the Maslach Burnout Inventory to measure burnout syndrome in critical care nurses. J Nurs Meas. 2020;16:345-61. doi: 10.1891/JNM-D-18-00055
https://doi.org/10.1891/JNM-D-18-00055...
). In addition, social demands can be a burden for the health professionals, whose main objective is to care for others. Admitting certain level of depersonalization can pose a psychological threat and interfere with their levels of self-esteem and perceived self-efficacy, as feelings of depersonalization refer to certain distancing from the service recipients.

Despite the lower internal consistency of the factors that make up the depersonalization dimension and the lack of personal fulfillment in the face of emotional exhaustion, the latter is considered, according to the scale’s own authors, the most important and the one that really reflects emotional strain(88 Shaufeli WB, Maslach C, Marek T. Professional burnout: recent developments in theory and research. 1. ed. New York: Taylor & Francis; 2017.). Also according to the authors, depersonalization can act as a coping strategy in a situation of exhaustion, while the lack of personal fulfillment would be a consequence(33 Montiel-Carbajat M, Ortiz-Viveros GR, Ortega-Herrera ME, Reyes-López U, Sotomayor-Peterson M, Durón-Ramos MF. Psychometric analysis of the stress symtoms inventory, Maslach Burnout Inventory, Zarit Burden Inventory and the General Health Questionnaire applied to a sample of Mexican homemakers. J Behav Health Soc Iss. 2015;7(1):25-39. doi: 10.5460/jbhsi.7.1.50185
https://doi.org/10.5460/jbhsi.7.1.50185...
). Therefore, maintaining it in the instrument is relevant and was adopted in this study.

It was possible to obtain an adequate factorial solution, with satisfactory adjustment levels, paying attention to the psychometric sensitivity of the items in the sample. All the items that make up the MBI-HSS showed adequate asymmetry and kurtosis, allowing asserting that, in general, they fit well to a normal distribution being able to, adequately, discriminate different levels of evaluation.

Considering the factorial loads of the items that make up the MBI-HSS scale, it is possible to verify that the same has occurred in other studies(2121 Faundez-Olivares VE, Mena-Miranda L, Sepúlveda FM, Wilke CJ. Validez factorial del Maslach Burnout Inventory Human Services (MBI-HSS) en profesionales chilenos. Univ Psychol. [Internet]. 2014 [cited Jan 5, 2019];13(1):1-28. doi:10.11144/Javeriana.UPSY13-1.vfmb
https://doi.org/10.11144/Javeriana.UPSY1...
,2626 Carreón OHA, Reyes AGU. Confiabilidad, validez factorial y normalización exploratórias del inventario de Burnout de Maslach em Nayarit. Rev Eletrónica Psicol Iztacala. [Internet]. 2017 [Acceso 9 Jun 2020];20(3). Disponible en: https://www.iztacala.unam.mx/carreras/psicologia/psiclin/vol20num3/Vol20No3Art20.pdf
https://www.iztacala.unam.mx/carreras/ps...
) and such loads may be related to the sample characteristics, the scale design or the cultural factors.

Despite the satisfactory adjustment of the three models tested for the MBI-HSS for health professionals in emergency services, Model 3 was considered the most parsimonious and the model of choice for continuing the process of validating the factorial structure of the MBI-HSS in this sample. It was chosen to consider the correlations between errors detected by the modification indexes and four items had a factorial weight below what was considered adequate.

Thus, the following items were removed from the model: item 16 of the emotional exhaustion dimension; items 9 and 12 of the personal fulfillment dimension and item 15 of the depersonalization dimension, due to their factor-related weight below the one considered adequate.

There is no consensus regarding the items that should be excluded from the scale. However, some items are known to be more ambiguous, as is the case of items 12 and 16, as well as items 2, 6 and 20(44 Cruz GAC, Merino-Soto C, Juárez-García A, Dominguez-Lara S, Fernández-Arata M. Es replicable la estructura factorial del Maslach Burnout Inventory Human Service Survey (MBI-HSS) en la profesión de enfermeira del Perú?: un estudio nacional. Enfermería Clínica. [Internet]. 2020 [Acceso 8 jun 2020];30(1):129-52. Disponible en: https://doi.org/10.1016/j.enfcli.2019.12.013
https://doi.org/10.1016/j.enfcli.2019.12...
,1111 Schneider A, Forster JE, Mealer M. Exploratory and confirmatory factor analysis of the Maslach Burnout Inventory to measure burnout syndrome in critical care nurses. J Nurs Meas. 2020;16:345-61. doi: 10.1891/JNM-D-18-00055
https://doi.org/10.1891/JNM-D-18-00055...
,1919 Gilla MA, Giménez SB, Moran VE, Olaz FO. Adaptación y validación del inventario de burnout de Maslach en profesionales argentinos de la salud mental. Laberabit. [Internet]. 2019 [Acceso 8 jun 2020];25(2):179-93. Disponible en: https://doi.org/10.24265/liberabit.2019.v25n2.04
https://doi.org/10.24265/liberabit.2019....
,2121 Faundez-Olivares VE, Mena-Miranda L, Sepúlveda FM, Wilke CJ. Validez factorial del Maslach Burnout Inventory Human Services (MBI-HSS) en profesionales chilenos. Univ Psychol. [Internet]. 2014 [cited Jan 5, 2019];13(1):1-28. doi:10.11144/Javeriana.UPSY13-1.vfmb
https://doi.org/10.11144/Javeriana.UPSY1...
). The scale’s authors themselves suggested not considering items 12 and 16 in confirmatory factorial studies(2222 Kulakova O, Jiménez BM, Garrosa E, Hernández MOS, Aragón A. University of the construct Maslach Burnout Inventory in a latin-american context. Acta de Investigación Psicol. [Internet]. 2017 [cited Jan 5, 2019];7(2017):2679-90. doi: https://doi.org/10.1016/j.aipprr.2017.05.001
https://doi.org/10.1016/j.aipprr.2017.05...
,2727 Densten I. Re-thinking burnout. J Organiz Behav. [Internet]. 2018 [cited Jan 5, 2019];22(8):833-40. Available from: https://www.ashclinicalnews.org/features/rethinking-burnout/
https://www.ashclinicalnews.org/features...
). In this sense, different studies have shown that, due to their inadequate factor weight, some items end up being removed.

A number of studies carried out in Latin America corroborate the results obtained. In Peru, a research carried out with nurses removed a total of seven items from the original scale, leaving the final version with 15 items(44 Cruz GAC, Merino-Soto C, Juárez-García A, Dominguez-Lara S, Fernández-Arata M. Es replicable la estructura factorial del Maslach Burnout Inventory Human Service Survey (MBI-HSS) en la profesión de enfermeira del Perú?: un estudio nacional. Enfermería Clínica. [Internet]. 2020 [Acceso 8 jun 2020];30(1):129-52. Disponible en: https://doi.org/10.1016/j.enfcli.2019.12.013
https://doi.org/10.1016/j.enfcli.2019.12...
). In a Chilean study, conducted with professionals from different health services, items 5, 13, 20, and 21 were excluded because they had an inadequate factorial weight, as well as items 12 and 14 due to factorial ambiguity. Thus, the 17-item version replicates the theoretical model of the expected relationships between the factors(2121 Faundez-Olivares VE, Mena-Miranda L, Sepúlveda FM, Wilke CJ. Validez factorial del Maslach Burnout Inventory Human Services (MBI-HSS) en profesionales chilenos. Univ Psychol. [Internet]. 2014 [cited Jan 5, 2019];13(1):1-28. doi:10.11144/Javeriana.UPSY13-1.vfmb
https://doi.org/10.11144/Javeriana.UPSY1...
). Another investigation, conducted with Nicaraguan teachers of basic and high school education from 112 rural and urban educational centers, concluded that the corrected version with 13 items had higher rates than the original scale consisting of 22. Furthermore, this study concluded that 41% of the items in the scale did not correctly saturate the established factorial loads and showed an inadequate factorial weight, thus evidencing that the MBI construct, as planned, does not show enough weight to assume its universality among heterogeneous cultures(2222 Kulakova O, Jiménez BM, Garrosa E, Hernández MOS, Aragón A. University of the construct Maslach Burnout Inventory in a latin-american context. Acta de Investigación Psicol. [Internet]. 2017 [cited Jan 5, 2019];7(2017):2679-90. doi: https://doi.org/10.1016/j.aipprr.2017.05.001
https://doi.org/10.1016/j.aipprr.2017.05...
).

In an Argentinian study conducted with mental health professionals, it was observed that the adjustment of the model improved satisfactorily, confirming the three-factor structure after removing item 12. This item obtained a satisfactory factorial load in the three dimensions, behaving in an ambiguous way; the same was verified in the original study(1919 Gilla MA, Giménez SB, Moran VE, Olaz FO. Adaptación y validación del inventario de burnout de Maslach en profesionales argentinos de la salud mental. Laberabit. [Internet]. 2019 [Acceso 8 jun 2020];25(2):179-93. Disponible en: https://doi.org/10.24265/liberabit.2019.v25n2.04
https://doi.org/10.24265/liberabit.2019....
). In Córdoba, a study conducted with professionals from different work services tested six models that varied from one to four factors. The best adjustment occurred with Model 2, with the removal of three items: 3, 8 and 13(2121 Faundez-Olivares VE, Mena-Miranda L, Sepúlveda FM, Wilke CJ. Validez factorial del Maslach Burnout Inventory Human Services (MBI-HSS) en profesionales chilenos. Univ Psychol. [Internet]. 2014 [cited Jan 5, 2019];13(1):1-28. doi:10.11144/Javeriana.UPSY13-1.vfmb
https://doi.org/10.11144/Javeriana.UPSY1...
).

A multi-center study carried out with 2,470 health care professionals from Bolivia, Colombia, Costa Rica, Ecuador, Mexico, Peru, Dominican Republic and Venezuela, excluded item 8 for better adjustment of the three-factor model, due to its low factorial weight(2525 Moreno MP, Aranda BC, López MRP. Validez factorial del Maslach Burnout Inventory - General Survey en ocho países latinoamericanos. Ciência Trabajo. [Internet]. 2015 [Acceso 5 ene 2019];17(52):28-31. Disponible en: http://dx.doi.org/10.4067/S0718-24492015000100006
http://dx.doi.org/10.4067/S0718-24492015...
).

In Brazil, a research conducted with bank employees showed a four-factor structural model composed of 19 items. Eight models were tested and, after exclusion of items 4, 7 and 22 for presenting inappropriate factorial behavior to the matrix, model eight presented the best fit(2828 Valente M, Wang YP, Menezes PR. Structural validity of the Maslach Burnout Inventory and influence of depressive symptoms in banking workplace: unfastening the occupational conundrum. Psychiatry Res. 2018;267:168-74. doi: 10.1016/j.psychres.2018.05.069
https://doi.org/10.1016/j.psychres.2018....
). Another Brazilian study with a sample of nursing assistants, divided between groups with major depressive disorder and absence of the disorder, found that the acceptable rates for RMSEA and CFI occurred in the group with no disorder. And in the general sample of the study, the three-factor model proved to be acceptable, but concluding that the two-factor model was better adjusted in this sample(2929 Trigo TR, Freitas CCS, Wang YP, Ribeiro FG, Lucia MCS, Siqueira JO, et al. The influence of depression on the psychometric properties of the Maslach Burnout Inventory - Human Services Survey: a cross-sectional study with nursing assistants. Front Psychiatry. 2018;9:695-710. doi: 10.3389/fpsyt.2018.00695
https://doi.org/10.3389/fpsyt.2018.00695...
).

In the same sense, a number of European studies showed the relevance of confirmatory analysis studies for the scale in different samples. A Hungarian study conducted with elementary and high school teachers tested eight models, with the best fit obtained with the bi-factorial model(3030 Szigeti R, Balazs N, Bikfalvi R, Urban R. Burnout and depressive symptoms in teachers: factor structure and construct validity of the Maslach Burnout Inventory-educators survey among elementary and secondary school teachers in Hungary. Stress Health. 2017;33:530-9. doi: 10.1002/smi.2737
https://doi.org/10.1002/smi.2737...
). A Spanish investigation, conducted with a sample of social workers, supported the superior three-factor model compared to alternative models of one or two factors. In addition, items 12, 13 and 16 were excluded, which favored better adjustment and internal consistency to MBI-HSS in the referred sample(3131 García RG, Sangregorio MA, Sánchez MLL. Factorial validity of the Maslach Burnout Inventory - Human Services Survey (MBI-HSS) in a sample of Spanish Social Workers. J Soc Serv Res. [Internet]. 2018 [cited Jun 9, 2020];45(2):207-19. Available from: https://doi.org/10.1080/01488376.2018.1480549
https://doi.org/10.1080/01488376.2018.14...
).

Another study, conducted with Australian lawyers, concluded that the five-factor structure better explains the multi-factorial nature of the burnout syndrome(1818 García AJ. Investigaciones psicométricas de escalas psicosociales en trabajadores mexicanos. México: Plaza y Valdés, 2014.). In a study conducted in Thailand with Medicine post-graduate students, identified that the three-factor model obtained values considered acceptable, after data adjustment(2323 Puranitee P, Saetang S, Sumrithe S, Busari JO, Mook WNKA, Heeneman S. Exploring burnout and depression of Thai medical students: the psychometric properties of the Maslach Burnout Inventory. Int J Med Educ. 2019;10:223-9. doi: 10.5116/ijme.5dc6.8228
https://doi.org/10.5116/ijme.5dc6.8228...
).

In turn, with respect to items 9 and 15 excluded in this study and not associated with any of the three dimensions of the scale, no studies with similar results were identified in the scientific literature. Item 9 refers to the perception of the professional to be positively influencing other people’s lives through their work. As for item 15, it can be that the health professionals have had difficulty in admitting, really, not caring about “what happens to some” patients, which can justify the result obtained.

These factorial differences of some MBI items in different samples and cultural contexts show the relevance of validation studies in different populations, demonstrating the need for rigor in the adaptation of the instrument, considering its content, language adopted, cultural reality, context, and homogeneity of the samples investigated.

Despite the removal of four items from the original scale, the final instrument that resulted from the analysis of this study, consisting of 18 items, replicates the theoretical model of the authors of the scale and reproduces the expected theoretical relationships between the factors. The internal consistency of the three factors of the MBI-HSS for health professionals in emergency services was recalculated considering the exclusion of the items and was considered adequate. If compared to the original version, the final version obtained has 18 items now, with better internal consistency, considering the Brazilian reality of the health professionals working in the emergency services.

As limitations, although the instrument has some weaknesses in the depersonalization dimension, it has a satisfactory internal consistency, particularly in the emotional exhaustion and personal fulfillment dimensions, which confirms its psychometric quality.

The behavior of a scale in one sample does not guarantee the same behavior in other samples, so it is desirable that they be confirmed in other studies, exploring new samples in order to arrive at a more consistent conclusion about a psychometric instrument.

The present study confirms the factorial validity of MBI-HSS for health professionals in emergency services and corroborates with other researchs that prove it as one of the most used instruments in empirical research studies on workers’ health, with greater international diffusion, reliable and relevant for burnout syndrome assessment.

Conclusion

The confirmatory factor analysis of the MBI-HSS instrument for measuring burnout syndrome in health professionals from the emergency services signals that the Brazilian version of the instrument follows a three-factor structure, as in the original version, with adequate internal consistency of the items. This outcome contributes to the scientific validation of the instrument and provides greater safety for its use by researchers on this them and similar samples.

The Brazilian version of the MBI-HSS for health professionals from the emergency services meets all the necessary requirements in terms of internal consistency and structural validity to be widely used in the assessment of the burnout syndrome in this context. Researchers in the field are recommended to consider studies already carried out and the existing updated evidence for planning and carrying out new studies with the MBI-HSS.

  • *
    Paper extracted from doctoral dissertation “Mediators variables of Burnout in emergency services professionals: appicability of Maslach Burnout Inventory - Human Services Survey (MBI-HSS)”, presented to Universidade de São Paulo, Escola de Enfermagem de Ribeirão Preto, PAHO/WHO Collaborating Centre for Nursing Research Development, Ribeirão Preto, SP, Brazil.

References

  • 1
    Spontón C, Trógolo M, Castellano E, Medrano LA. Medición del Burnout: estructura factorial, validez y confiabilidad en trabajadores argentinos. Interdisciplinaria. [Internet]. 2019 [Acceso 17 dic 2019];36(1):87-103]. Disponible en: http://www.redalyc.org/articulo.oa?d=18060087007
    » http://www.redalyc.org/articulo.oa?d=18060087007
  • 2
    Baldonedo-Mosteiro M, Almeida MCS, Baptista PCP, Sánchez-Zaballos, Rodriguez-Diaz FJ, Mosteiro-Diaz MP. Burnout syndrome in Brazilian and Spanish nursing workers. Rev. Latino-Am. Enfermagem. 2019;27(e3192):1-9. doi: 10.1590/1518-8345.2818.3192
    » https://doi.org/10.1590/1518-8345.2818.3192
  • 3
    Montiel-Carbajat M, Ortiz-Viveros GR, Ortega-Herrera ME, Reyes-López U, Sotomayor-Peterson M, Durón-Ramos MF. Psychometric analysis of the stress symtoms inventory, Maslach Burnout Inventory, Zarit Burden Inventory and the General Health Questionnaire applied to a sample of Mexican homemakers. J Behav Health Soc Iss. 2015;7(1):25-39. doi: 10.5460/jbhsi.7.1.50185
    » https://doi.org/10.5460/jbhsi.7.1.50185
  • 4
    Cruz GAC, Merino-Soto C, Juárez-García A, Dominguez-Lara S, Fernández-Arata M. Es replicable la estructura factorial del Maslach Burnout Inventory Human Service Survey (MBI-HSS) en la profesión de enfermeira del Perú?: un estudio nacional. Enfermería Clínica. [Internet]. 2020 [Acceso 8 jun 2020];30(1):129-52. Disponible en: https://doi.org/10.1016/j.enfcli.2019.12.013
    » https://doi.org/10.1016/j.enfcli.2019.12.013
  • 5
    Bianchi R, Schonfeld S, Laurent E. Burnout-depression overlap: a review. Clin Psychol Rev. [Internet]. 2015;36:28-41. doi: 10.1016/j.cpr.2015.01.004
    » https://doi.org/10.1016/j.cpr.2015.01.004
  • 6
    Bianchi R, Schonfeld IS, Verkuilen J. A five-sample confirmatory factor analytic study of burnout-depression overlap. J Clin Psychol. [Internet]. 2020 [cited Jun 8, 2020];76(4):367-85. Available from: https://doi.org/10.1002/jclp.22927
    » https://doi.org/10.1002/jclp.22927
  • 7
    Adriaenssens J, Gucht V, Maes S. Determinants and prevalence of burnout in emergency nurces: a systematic review of 25 years of research. Int J Nurs Stud. 2015;52:649-61. doi: 10.1016/j.ijnurstu.2014.11.004
    » https://doi.org/10.1016/j.ijnurstu.2014.11.004
  • 8
    Shaufeli WB, Maslach C, Marek T. Professional burnout: recent developments in theory and research. 1. ed. New York: Taylor & Francis; 2017.
  • 9
    Menezes PCM, Alves ESRC, Araújo Neto AS, Davim RMB, Guare RO. Burnout syndrome: a reflective analysis. Rev Enferm UFPE On Line. [Internet]. 2017 [cited Jan 5, 2019];11(12):5092-101. Available from: https://doi.org/10.5205/1981-8963-v11i12a25086p5092-5101-2017
    » https://doi.org/10.5205/1981-8963-v11i12a25086p5092-5101-2017
  • 10
    Pereira SS, Teixeira CAB, Reisdorfer E, Gherardi-Donato ECS, Juruena MF, Cardoso L. Burnout in nursing profesionals: associations with early stress. Br J Ment Health Nurs. [Internet]. 2015 [cited Jan 5, 2019];4(6):267-75. Available from: https://doi.org/10.12968/bjmh.2015.4.6.267
    » https://doi.org/10.12968/bjmh.2015.4.6.267
  • 11
    Schneider A, Forster JE, Mealer M. Exploratory and confirmatory factor analysis of the Maslach Burnout Inventory to measure burnout syndrome in critical care nurses. J Nurs Meas. 2020;16:345-61. doi: 10.1891/JNM-D-18-00055
    » https://doi.org/10.1891/JNM-D-18-00055
  • 12
    Beltran CA, Moreno MP, Estrada JGS. Confiabilidad y validación de la escala Maslach Burnout Inventory (Hss) en trabajadores del occidente de México. Salud Uninorte. [Internet]. 2016 [Acceso 5 ene 2019];32(2):218-27. Disponible en: http://www.scielo.org.co/pdf/sun/v32n2/v32n2a05.pdf
    » http://www.scielo.org.co/pdf/sun/v32n2/v32n2a05.pdf
  • 13
    Poletto NA, Probst LF, Oliveira TL, Guerra LM, Ambrosano MB, Cortellazzi KL, et. al. Burnout Syndrome in municipal health. Cad Saúde Coletiva. 2016;24(2):209-15. doi: 10.1590/1414-462X201600020005
    » https://doi.org/10.1590/1414-462X201600020005
  • 14
    Souza LRS, Souza EL, Barroso BIL. Síndrome de Burnout: mapeamento em graduandos de terapia ocupacional. Rev Ter Ocupac USP. [Internet].2018 [Acesso 9 jun 2020];29(2):104-10. Disponível em: https://doi.org/10.11606/issn.2238-6149.v29i2p104-110
    » https://doi.org/10.11606/issn.2238-6149.v29i2p104-110
  • 15
    Ruback SP, Tavares JMAB, Lins SMSB, Campos TS, Rocha RG, Caetano DA. Stress and Burnout syndrome among nursing professionals working in nephrology: a integrative review. J Res Fundam Care Online. 2018;889-99. doi: 10.9789/2175-5361.2018.v10i3.889-899
    » https://doi.org/10.9789/2175-5361.2018.v10i3.889-899
  • 16
    Souza SAS, Souza LAS, Lima MAV Junior. Síndrome de Burnout: o cirurgião-dentista docente e o esgotamento laboral crônico. Rev Campo Saber. [Internet]. 2017 [Acesso 5 jan 2019];3(2):1-10. Disponível em: http://periodicos.iesp.edu.br/index.php/campodosaber/article/view/77
    » http://periodicos.iesp.edu.br/index.php/campodosaber/article/view/77
  • 17
    Andolhe R, Barbosa RL, Oliveira EM, Costa ALS, Padilha KG. Stress, coping and burnout among intensive care unit nursing staff: associated factors. Rev Esc Enferm USP. [Internet]. 2015 [cited Jan 5, 2019];49(Sp Iss):58-64. Available from: http://www.scielo.br/pdf/reeusp/v49nspe/1980-220X-reeusp-49-spe-0058.pdf
    » http://www.scielo.br/pdf/reeusp/v49nspe/1980-220X-reeusp-49-spe-0058.pdf
  • 18
    García AJ. Investigaciones psicométricas de escalas psicosociales en trabajadores mexicanos. México: Plaza y Valdés, 2014.
  • 19
    Gilla MA, Giménez SB, Moran VE, Olaz FO. Adaptación y validación del inventario de burnout de Maslach en profesionales argentinos de la salud mental. Laberabit. [Internet]. 2019 [Acceso 8 jun 2020];25(2):179-93. Disponible en: https://doi.org/10.24265/liberabit.2019.v25n2.04
    » https://doi.org/10.24265/liberabit.2019.v25n2.04
  • 20
    Silva GSA, Silva GAV, Silva RM, Andolhe R, Padilha KG, Costa ALS. Stress and burnout in nursing workers of an intensive and semi-intensive health care unit. Rev Cient Sena Aires. [Internet]. 2018 [cited Jan 5, 2019];7(1):5-11. Available from: http://revistafacesa.senaaires.com.br/index.php/revisa/article/view/297/207
    » http://revistafacesa.senaaires.com.br/index.php/revisa/article/view/297/207
  • 21
    Faundez-Olivares VE, Mena-Miranda L, Sepúlveda FM, Wilke CJ. Validez factorial del Maslach Burnout Inventory Human Services (MBI-HSS) en profesionales chilenos. Univ Psychol. [Internet]. 2014 [cited Jan 5, 2019];13(1):1-28. doi:10.11144/Javeriana.UPSY13-1.vfmb
    » https://doi.org/10.11144/Javeriana.UPSY13-1.vfmb
  • 22
    Kulakova O, Jiménez BM, Garrosa E, Hernández MOS, Aragón A. University of the construct Maslach Burnout Inventory in a latin-american context. Acta de Investigación Psicol. [Internet]. 2017 [cited Jan 5, 2019];7(2017):2679-90. doi: https://doi.org/10.1016/j.aipprr.2017.05.001
    » https://doi.org/10.1016/j.aipprr.2017.05.001
  • 23
    Puranitee P, Saetang S, Sumrithe S, Busari JO, Mook WNKA, Heeneman S. Exploring burnout and depression of Thai medical students: the psychometric properties of the Maslach Burnout Inventory. Int J Med Educ. 2019;10:223-9. doi: 10.5116/ijme.5dc6.8228
    » https://doi.org/10.5116/ijme.5dc6.8228
  • 24
    Berjot S, Altintas E, Lesage F, Grebot E. Burnout risk profiles among French psychologists. Burnout Res. 2017;7:10-20. doi: 10.1016/j.burn.2017.10.001
    » https://doi.org/10.1016/j.burn.2017.10.001
  • 25
    Moreno MP, Aranda BC, López MRP. Validez factorial del Maslach Burnout Inventory - General Survey en ocho países latinoamericanos. Ciência Trabajo. [Internet]. 2015 [Acceso 5 ene 2019];17(52):28-31. Disponible en: http://dx.doi.org/10.4067/S0718-24492015000100006
    » http://dx.doi.org/10.4067/S0718-24492015000100006
  • 26
    Carreón OHA, Reyes AGU. Confiabilidad, validez factorial y normalización exploratórias del inventario de Burnout de Maslach em Nayarit. Rev Eletrónica Psicol Iztacala. [Internet]. 2017 [Acceso 9 Jun 2020];20(3). Disponible en: https://www.iztacala.unam.mx/carreras/psicologia/psiclin/vol20num3/Vol20No3Art20.pdf
    » https://www.iztacala.unam.mx/carreras/psicologia/psiclin/vol20num3/Vol20No3Art20.pdf
  • 27
    Densten I. Re-thinking burnout. J Organiz Behav. [Internet]. 2018 [cited Jan 5, 2019];22(8):833-40. Available from: https://www.ashclinicalnews.org/features/rethinking-burnout/
    » https://www.ashclinicalnews.org/features/rethinking-burnout/
  • 28
    Valente M, Wang YP, Menezes PR. Structural validity of the Maslach Burnout Inventory and influence of depressive symptoms in banking workplace: unfastening the occupational conundrum. Psychiatry Res. 2018;267:168-74. doi: 10.1016/j.psychres.2018.05.069
    » https://doi.org/10.1016/j.psychres.2018.05.069
  • 29
    Trigo TR, Freitas CCS, Wang YP, Ribeiro FG, Lucia MCS, Siqueira JO, et al. The influence of depression on the psychometric properties of the Maslach Burnout Inventory - Human Services Survey: a cross-sectional study with nursing assistants. Front Psychiatry. 2018;9:695-710. doi: 10.3389/fpsyt.2018.00695
    » https://doi.org/10.3389/fpsyt.2018.00695
  • 30
    Szigeti R, Balazs N, Bikfalvi R, Urban R. Burnout and depressive symptoms in teachers: factor structure and construct validity of the Maslach Burnout Inventory-educators survey among elementary and secondary school teachers in Hungary. Stress Health. 2017;33:530-9. doi: 10.1002/smi.2737
    » https://doi.org/10.1002/smi.2737
  • 31
    García RG, Sangregorio MA, Sánchez MLL. Factorial validity of the Maslach Burnout Inventory - Human Services Survey (MBI-HSS) in a sample of Spanish Social Workers. J Soc Serv Res. [Internet]. 2018 [cited Jun 9, 2020];45(2):207-19. Available from: https://doi.org/10.1080/01488376.2018.1480549
    » https://doi.org/10.1080/01488376.2018.1480549

Edited by

Associate editor: Maria Lúcia do Carmo Cruz Robazzi

Publication Dates

  • Publication in this collection
    08 Jan 2021
  • Date of issue
    2021

History

  • Received
    25 June 2019
  • Accepted
    04 July 2020
Escola de Enfermagem de Ribeirão Preto / Universidade de São Paulo Av. Bandeirantes, 3900, 14040-902 Ribeirão Preto SP Brazil, Tel.: +55 (16) 3315-3451 / 3315-4407 - Ribeirão Preto - SP - Brazil
E-mail: rlae@eerp.usp.br