Acessibilidade / Reportar erro

Psychometric evaluation of the Resilience at Work Scale (RAW Scale - Brazil)

Evaluación psicométrica de la Escala de Resiliencia Laboral (RAW Scale - Brasil)

ABSTRACT

Objectives:

to analyze the validity of the Resilience at Work Scale (RAW Scale - Brazil), 25 and 20-item versions, based on its internal structure (dimensional and correlation), with professors and health workers from a public university in southern Brazil.

Methods:

methodological study, developed in 2018, with 526 participants. For psychometric tests, the following were used: Confirmatory Factor Analysis; composite reliability, and convergent validity against the Engagement at work; Occupational self-efficacy; Overall resilience; General Health Questionnaire; and Social support at work scales.

Results:

both versions had factor loadings > 0.30, adequate fit indices and satisfactory composite reliability. In both versions, strong and direct correlations with general Resilience and Self-efficacy were evidenced; moderate and direct with social Engagement and Support; and moderate and inverse with General Health.

Conclusions:

the RAW Scale 25 and 20 - Brazil meets the validity requirements with potential for assessing resilience at work within the studied context.

Descriptors:
Validation Studies; Psychological Resilience; Occupational Health; Work; Psychometrics

RESUMEN

Objetivos:

analizar evidencia de validez basada en estructura interna (dimensional y de correlación) de la Escala de Resiliencia Laboral (RAW Scale - Brasil), versiones 25 y 20 ítems, con docentes y trabajadores de salud de una universidad pública del Sur brasileño.

Métodos:

estudio metodológico, desarrollado en 2018, con 526 participantes. En las pruebas psicométricas, se utilizaron: Análisis Factorial Confirmatorio; confiabilidad compuesta y validez convergente con Compromiso laboral; Autoeficacia ocupacional; Resiliencia general; Encuesta General de Salud; y Apoyo social laboral.

Resultados:

las dos versiones presentaron cargas factoriales > 0,30, índices de ajuste adecuados y confiabilidad compuesta satisfactoria. En las dos versiones, evidenciadas correlaciones fuerte y directa con Resiliencia general y Autoeficacia; moderada y directa con Compromiso y Apoyo social; y moderada e inversa con Salud general.

Conclusiones:

la RAW Scale 25 y 20 - Brasil atiende a los requisitos de validez, con potencial para la evaluación de resiliencia laboral en el contexto estudiado.

Descriptores:
Estudio de Validación; Resiliencia Psicológica; Salud Laboral; Trabajo; Psicometría

RESUMO

Objetivos:

analisar a evidência de validade baseada na estrutura interna (dimensional e de correlação) da Escala de Resiliência no Trabalho (RAW Scale - Brasil), versões 25 e 20 itens, com docentes e trabalhadores da saúde de uma universidade pública do Sul do Brasil.

Métodos:

estudo metodológico, desenvolvido em 2018, com 526 participantes. Nos testes psicométricos, utilizaram se: Análise Fatorial Confirmatória; confiabilidade composta e validade convergente com Engajamento no trabalho; Autoeficácia ocupacional; Resiliência geral; Questionário Geral de Saúde; e Apoio social no trabalho.

Resultados:

as duas versões apresentaram cargas fatoriais > 0,30, índices de ajuste adequados e confiabilidade composta satisfatória. Nas duas versões, evidenciaram-se correlações forte e direta com Resiliência geral e Autoeficácia; moderada e direta com Engajamento e Apoio social; e moderada e inversa com Saúde geral. Conclusões: a RAW Scale 25 e 20 - Brasil atende aos requisitos de validade, com potencial para a avaliação de resiliência no trabalho no contexto estudado.

Descritores:
Estudos de Validação; Resiliência Psicológica; Saúde do Trabalhador; Trabalho; Psicometria

INTRODUCTION

The concept of resilience is considered complex, lacking a universal definition. However, there is consensus that it involves the ability to tolerate or overcome adversity and unpleasant events and successfully adjust to and prepare for change and uncertainty(11 McEwen K. Building Resilience at work. Australian academic press; 2011. 149 p.-22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
).

Likewise, there is conceptual complexity when this term is adopted for work environments. From this perspective, it is important to consider the context of organizations, which try to respond and adapt to competitive global markets, as well as changes related to the social, technological, and climate environment(11 McEwen K. Building Resilience at work. Australian academic press; 2011. 149 p.). On the other hand, there’s an increase in the workload and personal stress levels(11 McEwen K. Building Resilience at work. Australian academic press; 2011. 149 p.). Thus, enhancing or finding opportunities to apply individual strengths at work can favor growth, development, and satisfaction(33 Mc ewen K. Building personal resilience as a geoscientist: Applied Earth Science 2013;121(4):155-62. https://doi.org/10.1179/1743275813Y.0000000026
https://doi.org/10.1179/1743275813Y.0000...
), that is, it can contribute to the development of work resilience.

The assessment of personal resilience at work provides important self-awareness for workers as well as support for organizations in planning actions to foster resilience, health, and quality of life. The Resilience at Work Scale (RAW Scale) is an instrument designed for this purpose by researchers from Working with Resilience and the University of South Australia(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
). Initially, it is a scale composed of 20 items and seven factors: Living Authentically, Finding your Calling, Maintaining Perspective, Managing Stress, Interacting Cooperatively, Staying Healthy, and Building Networks(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
). Later, a 25-item version was also proposed, which is used more in clinical practice with workers. For each question, the participant indicates their agreement with the items, based on a seven-point Likert scale (0-6), ranging from “strongly disagree” (0) to “strongly agree” (6). In the analyses, items nine and 11 have a reverse score in both versions (20 and 25 items)(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
).

The RAW Scale was created and validated for the Australian workforce in 2013, with the participants drawn from health, education in general, commerce, information technology, finance, manufacturing, among others(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
). Several countries are conducting studies utilizing the English version of the RAW Scale. These include India, Australia, England, Ireland, and the United States of America(44 Working With Resilience (WWR). North Adelaide: Working With Resilience (WWR)-Escala R@W[Internet]. 2020 [cited 2020 Jun 13]. Available from: https://workingwithresilience.com.au/measure-resilience/rw-research
https://workingwithresilience.com.au/mea...
). Not all research being done among these countries have been published as of yet(44 Working With Resilience (WWR). North Adelaide: Working With Resilience (WWR)-Escala R@W[Internet]. 2020 [cited 2020 Jun 13]. Available from: https://workingwithresilience.com.au/measure-resilience/rw-research
https://workingwithresilience.com.au/mea...
).

In India, the psychometric analysis of the RAW Scale was carried out with information technology workers, managers, and engineers(55 Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
https://doi.org/10.1177%2F02560909187739...
). The analysis highlighted the exclusion of three questions, which resulted in a 17-item and six factor scale(55 Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
https://doi.org/10.1177%2F02560909187739...
). In an Australian research with university students, the RAW Scale was adapted by changing the term “work” with “university”, preserving the structure with 20 items, but grouping six factors that explained 63.7% of variance(66 Turner M, Scott-Young C, Holdsworth S. Navigating the chasm from student to professional: the role of resilience. In: COBRA AUBEA-The Australian Universities’ Building Educators Association Conference [Internet]. 2015 July 8-10; Sydney, Australia: Association with AUBEA, the University of Technology Sydney and University of Western Sydney; 2015 [cited 2020 Jun 13]. [Paper 1-14]. Available from: https://workingwithresilience.com.au/wp-content/uploads/2016/05/Navigating-the-Chasm.pdf
https://workingwithresilience.com.au/wp-...
). Despite being something recent, review studies recommend its use as it is a more contextualized model for measuring resilience in work and that allows interventions to promote resilience(77 Robertson IT, Cooper CL, Sarkar, M, Currans T. Resilience training in the workplace from 2003 to 2014: a systematic review. J Occupat Organiz Psychol. 2015;88(3):533-62. https://doi.org/10.1111/joop.12120
https://doi.org/10.1111/joop.12120...
-88 Helmreich I, Kunzler A, Chmitorz A, König J, Binder H., Wessa M. et. al. Psychological interventions for resilience enhancement in adults. Cochrane Database System Rev. 2017;2(CD012527):1-42. https://doi.org/10.1002/14651858.CD012527
https://doi.org/10.1002/14651858.CD01252...
).

This scale did not have a version adapted to the Brazilian context, but it has an adequate psychometric performance in other contexts such as Australia(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
) and India(55 Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
https://doi.org/10.1177%2F02560909187739...
). Considering this, in 2018, the RAW Scale 20 and 25 items underwent a rigorous process of cross-cultural adaptation to Brazilian Portuguese(99 Greco PBT. Adaptação transcultural para a língua portuguesa do Brasil da Resilience at Work Scale (RAW Scale)[Tese] [Internet]. Santa Maria: Universidade Federal de Santa Maria, Programa de Pós-Graduação em Enfermagem. 2018 [cited 2020 Jun 13]. Available from: https://repositorio.ufsm.br/bitstream/handle/1/16353/TES_PPGENFERMAGEM_2018_GRECO_PATRICIA.pdf?sequence=1&isAllowed=y
https://repositorio.ufsm.br/bitstream/ha...
-1010 Reichenheim ME, Moraes CL. Operationalizing the cross-cultural adaptation of epidemological measurement instruments. Rev Saúde Pública. 2007;41(4):665-73. https://doi.org/10.1590/S0034-89102006005000035
https://doi.org/10.1590/S0034-8910200600...
). Conceptual, semantic, operational, and measurement equivalences were evaluated(1010 Reichenheim ME, Moraes CL. Operationalizing the cross-cultural adaptation of epidemological measurement instruments. Rev Saúde Pública. 2007;41(4):665-73. https://doi.org/10.1590/S0034-89102006005000035
https://doi.org/10.1590/S0034-8910200600...
). This article presents the measurement equivalence using dimensional validity.

It can be used in the worker’s clinical practice, favoring the organization with strategies both to promote individual resilience and organizational management. Furthermore, it is highlighted that the use of the RAW Scale helps nurses to reflect on the health care of workers, enabling them to support actions that minimize the negative effects of adversity and work stress.

OBJECTIVES

To analyze the validity of the Resilience at Work Scale (RAW Scale - Brazil), 25 and 20-item versions, based on its internal structure (dimensional and correlation), with professors and health workers from a public university in southern Brazil.

METHODS

Ethical aspects

All ethical principles according to the precepts established by Resolution 466/2012 of the National Health Council were respected, and the research project was approved by the Research Ethics Committee.

Study design, period, and location

Methodological study, with emphasis on the psychometric assessment of the RAW Scale - Brazil, after a careful cross-cultural adaptation process(1010 Reichenheim ME, Moraes CL. Operationalizing the cross-cultural adaptation of epidemological measurement instruments. Rev Saúde Pública. 2007;41(4):665-73. https://doi.org/10.1590/S0034-89102006005000035
https://doi.org/10.1590/S0034-8910200600...
). Data collection took place from April to July 2018, at a public university in the state of Rio Grande do Sul (RS), Brazil.

Population or sample; inclusion and exclusion criteria

A total of 526 workers participated in the study, being 242 professors and 283 health workers. Included, were all professors from the university, from technical, technological, and child education areas, as well as health workers from the university hospital of that institution. Those who were on leave (maternity, sick) during the data collection and those working less than one year at the institution were excluded. Participants were recruited individually, after drawing lots in the workplace.

Study protocol

Data collection was done through a self-administered questionnaire by the participants, who were approached on the institution’s premises by collectors previously trained and certified by the project coordinator. The questionnaire included sociodemographic (age, sex, race, marital status, profession) and labor (highest title, time since graduation, time in service, time working at the institution, workplace, workload) variables. The Job Stress Scale(1111 Alves MGM, Chor D, Faerstein E, Lopes CS, Werneck GL. Short version of the “job stress scale”: a Portuguese-language adaptation. Rev Saúde Pública. 2004;38 (2):164-71. https://doi.org/https://doi.org/10.1590/S0034-89102004000200003
https://doi.org/https://doi.org/10.1590/...
), General Health Questionnaire (GHQ-12), which assesses psychological well-being(1212 Sarriera JC, Schwarcz C, Câmara SG. Bem-estar psicológico: análise fatorial da escala de Goldberg (GHQ-12) numa amostra de jovens. Psicol Reflex Crit [Internet]. 1996[cited 2020 Jun 23];9:293-306. Available from: https://www.researchgate.net/publication/275276458_Bem-Estar_Psicologico_Analise_Fatorial_da_Escala_Golberg_Ghq-12_Numa_Amostra_de_Jovens
https://www.researchgate.net/publication...
), Resilience Scale(1313 Pesce RP, Assis SG, Avanci JQ, Santos NC, Malaquias JV, Carvalhaes R. Adaptação transcultural, confiabilidade e validade da escala de resiliência. Cad Saúde Pública. 2005;21(2):436-48. https://doi.org/10.1590/S0102-311X2005000200010
https://doi.org/10.1590/S0102-311X200500...
), which evaluates resilience in general; the Utrecht Work Engagement Scale(1414 Magnan ES, Vazquez ACS, Pacico JCI, Hutz CS. Normatização da versão Brasileira da Escala Utrecht de Engajamento no Trabalho. Aval Psicol. 2016;15(2):133-40. https://doi.org/10.15689/ap.2016.1502.01
https://doi.org/10.15689/ap.2016.1502.01...
), Occupational Self-Efficiency Scale(1515 Damásio BF, Freitas CPP, Koller SH. Occupational Self-Efficacy Scale - Short Form (OSS-SF): adaptation and evidence of construct validity of the Brazilian version. Rev Bras Orientac Prof[Internet]. 2014[cited 2020 Jun 23];15(1):65-74. Available from: http://pepsic.bvsalud.org/scielo.php?script=sci_arttext&pid=S1679-33902014000100008&lng=pt&tlng=en
http://pepsic.bvsalud.org/scielo.php?scr...
), and RAW Scale 25 and 20 - Brazil were also included.

RAW is a scale that has two versions, one with 25 and the other with 20 items, arranged in seven dimensions: Living authentically (four/three items, respectively), Finding your calling (four items), Maintaining perspective (four items), Managing stress (four/three items, respectively), Interacting cooperatively (three/two items, respectively), Staying healthy (three/two items, respectively), Building networks (three/two items, respectively). In RAW 20, items 4, 12, 19, 22, and 25(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
) are excluded.

Analysis of results and statistics

Data was inputted into the Epi-info® program, version 6.4, with independent double typing. After checking for typing errors and inconsistencies, data analysis was performed using the R® program (R CORE TEAM, 2016), Lavaan package. Descriptive statistics were used to characterize the sample. The equation for analyzing the resilience score at work, due to Australian authorship copyright issues, will not be released. Authorization for future research can be requested on the Website: workingwithresilience.com.au or contact@workingwithresilience.com.au.

1st Stage: Construct validity indicators based on internal structure

First, an assessment of the RAW Scale factorial structure was carried out through confirmatory factor analyses (CFA). For the CFA, the ordinal measurement level of items was considered; the analysis was conducted from the matrix of polychoric correlations of the RAW Scale - Brazil items and the Diagonally Weighted Least Squares (DWLS) estimation method with robust standard errors was used. To interpret how the model fit the data, the following indexes were considered: Comparative Fit Index (CFI ≥ 0.90), Tucker-Lewis Index (TLI ≥ 0.90), and Root Mean Square Error of Approximation (RMSEA ≤ 0.06). The correlation between the scale factors was also performed, using the 0.80 limit as a parameter.

2nd Stage: Convergent validity indicators

Correlations against the Engagement at Work(1414 Magnan ES, Vazquez ACS, Pacico JCI, Hutz CS. Normatização da versão Brasileira da Escala Utrecht de Engajamento no Trabalho. Aval Psicol. 2016;15(2):133-40. https://doi.org/10.15689/ap.2016.1502.01
https://doi.org/10.15689/ap.2016.1502.01...
), Occupational Self-efficacy(1515 Damásio BF, Freitas CPP, Koller SH. Occupational Self-Efficacy Scale - Short Form (OSS-SF): adaptation and evidence of construct validity of the Brazilian version. Rev Bras Orientac Prof[Internet]. 2014[cited 2020 Jun 23];15(1):65-74. Available from: http://pepsic.bvsalud.org/scielo.php?script=sci_arttext&pid=S1679-33902014000100008&lng=pt&tlng=en
http://pepsic.bvsalud.org/scielo.php?scr...
), Overall Resilience(1313 Pesce RP, Assis SG, Avanci JQ, Santos NC, Malaquias JV, Carvalhaes R. Adaptação transcultural, confiabilidade e validade da escala de resiliência. Cad Saúde Pública. 2005;21(2):436-48. https://doi.org/10.1590/S0102-311X2005000200010
https://doi.org/10.1590/S0102-311X200500...
), General Health Questionnaire(1212 Sarriera JC, Schwarcz C, Câmara SG. Bem-estar psicológico: análise fatorial da escala de Goldberg (GHQ-12) numa amostra de jovens. Psicol Reflex Crit [Internet]. 1996[cited 2020 Jun 23];9:293-306. Available from: https://www.researchgate.net/publication/275276458_Bem-Estar_Psicologico_Analise_Fatorial_da_Escala_Golberg_Ghq-12_Numa_Amostra_de_Jovens
https://www.researchgate.net/publication...
), and Social Support at Work(1111 Alves MGM, Chor D, Faerstein E, Lopes CS, Werneck GL. Short version of the “job stress scale”: a Portuguese-language adaptation. Rev Saúde Pública. 2004;38 (2):164-71. https://doi.org/https://doi.org/10.1590/S0034-89102004000200003
https://doi.org/https://doi.org/10.1590/...
) scales were performed according to the types of variables analyzed. In this context, the validity of the correlational construct (convergent validity) was assessed using Spearman’s correlation. In the correlations, the following reference rates were adopted: from 0.1 to 0.29 - weak correlation; from 0.3 to 0.49 - moderate correlation; and rates greater than 0.5 - strong correlation.

3rd Stage: Reliability indicators

The reliability of items was estimated in two ways, the Cronbach’s alpha index and the composite reliability, through Raykov’s equation, also called Mcdonald’s Omega. Both reliability indicators are considered acceptable with values ≥ 0.70(1616 Valentini, F, Damásio BF. Variância Média Extraída e Confiabilidade Composta: Indicadores de Precisão. Psicol: Teor Pesqui. 2016;32(2)e322225. https://doi.org/10.1590/0102-3772e322225
https://doi.org/10.1590/0102-3772e322225...
).

RESULTS

The average age was 43.97 years (SD=10.06; Min=23 Max=74) with a prevalence of females (64.6%), of workers who were married/with a partner (66.5%), and white (92.2%). With regards to labor variables, most were professors (45.4%). Among health workers, there was a predominance of nursing technicians (16.9%) and nurses (11.8%). With regards to level of education and working hours, 86.3% had a graduate degree and 54.6% had a 40-hour weekly workload. The mean time since graduation was 18.8 years (SD=10.3; Min=2, Max.=48). The mean time working at the university and the hospital were, respectively, 14.4 (SD=10.3; Min=1, Max=45) and 2.9 (SD=0.8; Min=1, Max=4) years.

1st Stage: Factorial Structure

The factorial structure was initially verified by Confirmatory Factor Analysis (CFA). Both models had adjustments according to the indexes considered in this study. The model of the 25-item version of the instrument was adjusted to the data, with Chi-Square (254) = 884.1, CFI = 0.93, TLI = 0.91, RMSEA (90% CI) = 0.069 (0.064-0.074). Likewise, the shorter version of the instrument, with 20 items, also adjusted well with the data, with Chi-Square (149) = 515.8, CFI = 0.95, TLI = 0.93, RMSEA (90% CI) = 0.069 (0.062-0.075). The factorial loads were all adequate, above 0.30(1717 Tabachnick BG, Fidell LS. Using multivariate statistics. 7ºEd. Boston: Allyn & Bacon/Pearson Education, 2019. 815p), and the reliability measures were adequate for most subscales (e.g., ≥ 0.7).

The RAW Scale 25 - Brazil CFA is shown in Table 1.

Table 1
Confirmatory factor analysis of the seven-factor structure of the RAW Scale 25 instrument - Brazil, Santa Maria, Rio Grande do Sul, Brazil, 2018, (N = 526)

The Confirmatory Factor Analysis of the RAW Scale 20 - Brazil is shown in Table 2.

Table 2
Confirmatory factor analysis of the 7-factor RAW Scale 20 - Brazil, Santa Maria, Rio Grande do Sul, Brazil, 2018, (N = 526)

Regarding the correlation between factors of the RAW Scale 20 - Brazil and the RAW Scale 25 - Brazil, no correlation among the seven factors was above the limit of 0.80. In the RAW Scale 25 - Brazil, the values varied from 0.219 (between F4 - Managing stress and F7 - Building networks), to 0.632 (between F2 - Finding your calling and F7 - Building networks). In the RAW Scale 20 - Brazil, the values varied from 0.151 (between F1 - Living authentically and F3 - Maintaining perspective); to 0.639 (between F5 - Interacting cooperatively and F7 - Building networks). The correlations between factors of the RAW Scale 25 and 20 - Brazil are presented in Table 3.

Table 3
Correlations between factors of the RAW Scale - Brazil 25 and 20 items, Santa Maria, Rio Grande do Sul, Brazil, 2018, (N = 526)

2nd Stage: Convergent correlational validity

The correlations between RAW Scale 25 and 20 - Brazil and the analyzed constructs varied from strong to moderate, they are displayed in Table 4.

Table 4
Correlations between RAW Scale 25 and 20 - Brazil and the constructs of General health, General resilience, Engagement at work, Social support, and Occupational self-efficacy, Santa Maria, Rio Grande do Sul, Brazil, 2018, (N = 526)

The RAW Scale 25 and 20 - Brazil correlated strongly and positively with the General Resilience Scale (r = 0.590 and 0.580, respectively) and Occupational self-efficacy (r = 0.578 and r = 0.577, in this order); with moderate strength and positively with Engagement (r = 0.445 and r = 0.436, respectively), and Social support (r = 0.462 and r = 0.452, respectively). On the other hand, with Psychological well-being (General Health Questionnaire-GHQ), the two versions correlated with moderate strength and in the opposite direction (RAW Scale 25 - Brazil r =-0.462; RAW Scale 20 - Brazil r =-0.455).

DISCUSSION

This study, given that the RAW Scale already presents a dimensional proposal, commenced with a CFA, which allows an item conjecture representation based on theory, using its manifested indicators which are, at first, linked to the respective assumable factors(1818 Reichenheim ME, Hökerberg YHM, Moraes CL. Assessing construct structural validity of epidemiological measurement tools: a seven-step roadmap. Cad Saúde Pública. 2014;30(5):927-39. https://doi.org/10.1590/0102-311X00143613
https://doi.org/10.1590/0102-311X0014361...
). Thus, we used the seven-factor structure that includes the original RAW containing 25 and 20 items(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
).

For evidence of validity based on the internal dimensional structure, the 25-item RAW scale does not have research to evaluate its psychometric properties. This means that it is not possible to compare the findings with other studies. However, in this study it was found, in the CFA of the two versions of the RAW Scale - Brazil (25 and 20 items), that the factor loadings of the items in each analyzed subscale were greater than 0.30. In the RAW Scale 25 - Brazil, items three, nine, and 11 stand out with the lowest factor loadings (0.36, 0.32, and 0.32 respectively). The other factorial loads of the items ranged from 0.57 to 0.91. In RAW Scale 20 - Brazil, items three, nine, and 11 also had the lowest factor loadings (0.37, 0.48 and 0.45, respectively). The factorial loads of the other items ranged from 0.54 to 0.90. The adjustment indexes were adequate in both versions of the scale.

It is important to highlight that the RAW Scale was created within a developed country scenario; in this sense, it’s worth reflecting that the economic, social, and political structures, as well as the working conditions in Brazil, differ greatly from those of the Australian context. Although the population of the original study is privileged with regards to education and income, the reality of work in Brazil is very different from that of Australia, which can have an impact on the interpretation of items by respondents.

The Indian study, when testing the RAW Scale with 17 items and six factors in the CFA, deemed it reliable, with adequate adjustment indexes of (RMSEA = 0.05, CFI = 0.96, χ2 (180) = 286.2)(55 Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
https://doi.org/10.1177%2F02560909187739...
). When comparing items that presented a factor load close to 0.30 in the Brazilian version (items three, nine, and 11) with those from other studies, they worked differently. Item three, in the original version study, also had one of the lowest factor loads (0.541)(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
), as well as in the adaptation of the RAW Scale to be used with university students (0.49)(66 Turner M, Scott-Young C, Holdsworth S. Navigating the chasm from student to professional: the role of resilience. In: COBRA AUBEA-The Australian Universities’ Building Educators Association Conference [Internet]. 2015 July 8-10; Sydney, Australia: Association with AUBEA, the University of Technology Sydney and University of Western Sydney; 2015 [cited 2020 Jun 13]. [Paper 1-14]. Available from: https://workingwithresilience.com.au/wp-content/uploads/2016/05/Navigating-the-Chasm.pdf
https://workingwithresilience.com.au/wp-...
). The Indian study had a high factor load (0.881)(55 Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
https://doi.org/10.1177%2F02560909187739...
). This item refers to the ability to change one’s mood, when required, to manage emotional responses under situations of stress at work. However, it could be interpreted within the Brazilian culture as the individual’s integrality, such as a unique being, who cannot separate general life emotions from those that are work-related. That is, it does not necessarily suggest a divergence of behavior.

Item nine, in the original version(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
), and in the study with university students(66 Turner M, Scott-Young C, Holdsworth S. Navigating the chasm from student to professional: the role of resilience. In: COBRA AUBEA-The Australian Universities’ Building Educators Association Conference [Internet]. 2015 July 8-10; Sydney, Australia: Association with AUBEA, the University of Technology Sydney and University of Western Sydney; 2015 [cited 2020 Jun 13]. [Paper 1-14]. Available from: https://workingwithresilience.com.au/wp-content/uploads/2016/05/Navigating-the-Chasm.pdf
https://workingwithresilience.com.au/wp-...
), had a satisfactory factor load (-0.661 and 0.71, respectively). In the Indian study, this item was discarded due to the negligible factor load (0.10)(55 Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
https://doi.org/10.1177%2F02560909187739...
). For item 11, the original version(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
) had a load of-0.548. In the other two researches with students(66 Turner M, Scott-Young C, Holdsworth S. Navigating the chasm from student to professional: the role of resilience. In: COBRA AUBEA-The Australian Universities’ Building Educators Association Conference [Internet]. 2015 July 8-10; Sydney, Australia: Association with AUBEA, the University of Technology Sydney and University of Western Sydney; 2015 [cited 2020 Jun 13]. [Paper 1-14]. Available from: https://workingwithresilience.com.au/wp-content/uploads/2016/05/Navigating-the-Chasm.pdf
https://workingwithresilience.com.au/wp-...
) and the Indian worker population(55 Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
https://doi.org/10.1177%2F02560909187739...
), the loads were high (0.83 and 0.886, respectively). In this sense, it is possible to think that perhaps these items may be showing interference regarding cross-cultural adaptation about idiomatic, semantic, or even cultural aspects, or even denote the possibilities of interpretation that the statement allows.

In addition, items nine and 11 are reverse items. In this sense, the reverse items can be more complex to understand, which can end up confusing the respondent(1919 Streiner DL, Norman GR, Cairney J. Health Measurement Scales: a practical guide to their development and use. 5ª Ed. New York: Oxford University Press, 2015. 416 p.). In this perspective, the need of other psychometric studies with Brazilian workers is emphasized, to make it possible to deepen the discussions on the behavior of these items.

In most cases, when undertaking an instrument’s CFA, unexpected disagreements may occur, which may be due to the population’s heterogeneity(1919 Streiner DL, Norman GR, Cairney J. Health Measurement Scales: a practical guide to their development and use. 5ª Ed. New York: Oxford University Press, 2015. 416 p.). Not all items will be interpreted as intended, with some confusing the participant or being understood in unexpected ways(1919 Streiner DL, Norman GR, Cairney J. Health Measurement Scales: a practical guide to their development and use. 5ª Ed. New York: Oxford University Press, 2015. 416 p.).

The correlations among the factors of the two versions of the RAW Scale - Brazil were less than 0.80, which shows discriminating factor validity. In the RAW Scale 25 - Brazil, the highest correlations were between the factors “Building networks” and “Finding your calling”, and in the RAW Scale 20 - Brazil, between the factors “Interacting cooperatively” and “Building networks”. An Indian study showed a variation of 0.21 to 0.55 among the factors “Staying healthy” and “Living authentically”, “Building networks” and “Finding your calling”; and “Maintaining perspective” and “Finding your calling” (respectively)(55 Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
https://doi.org/10.1177%2F02560909187739...
).

In this study, the strong correlation between the factors “Finding your calling” and “Building networks” may be a result of participants feeling that interpersonal relationships established at work give meaning to the work environment, and thus are able to find strength in this. Also, these connections can contribute to the feeling of belonging, adjustment of personal beliefs, which favors mutual support among colleagues to solve problem-situations. However, it is observed that each factor maintains distinct properties. For this reason, the discriminating factor validity was maintained. It is noteworthy that the Resilience at work construct comprises the seven presented domains. Thus, domains should not be evaluated separately from the scale.

In this sense, the study showed convergent validity correlating strongly and positively with the General Resilience Scale and Occupational self-efficacy; moderate strength and positive sense with engagement and social support; and moderate strength and negative sense with Psychological well-being (general health). In the Australian validation of the RAW 20 items, there was a strong and positive correlation with Engagement at work (r = 0.53) and a strong and negative correlation with Psychological well-being (r =-0.55)(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
). An Indian study tested the relationship between Resilience and Engagement at work using the Structural Equation Model, which presented an excellent fit (GFI = 0.98; NFI = 0.96; CFI = 0.97; RMSEA = 0.05). The model outlined the standardized path coefficient between Resilience and Engagement at work with a direct relationship (β = 0.38; p<0.05)(55 Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
https://doi.org/10.1177%2F02560909187739...
). Although a different statistical analysis technique was used, the results agree with the findings of this study.

The characteristics related to the General resilience, Occupational self-efficacy, Engagement at work, and Social support constructs are in line with RAW’s theoretical contribution, mainly with the domains “Living authentically”, “Maintaining perspective”, and “Building networks”, as the first of these emphasizes the need for the worker to know how to and be able to use personal strengths at work and still have knowledge about their emotions and control them in challenging situations; the second is related to managing negativity and focusing on problem solving. The third, relates to a work or family support network that can provide practical help, perspective, and emotional support(33 Mc ewen K. Building personal resilience as a geoscientist: Applied Earth Science 2013;121(4):155-62. https://doi.org/10.1179/1743275813Y.0000000026
https://doi.org/10.1179/1743275813Y.0000...
).

The aspects of Psychological well-being (General health) had a negative correlation with resilience at work, as expected. These results are theoretically supported in the domains “Managing stress”, “Staying healthy”, and “Maintaining perspective”. In the “Managing stress” domain, we find individuals capable of keeping routines that can help reduce daily stress, maintain a balance between professional and personal life, and ensure recovery time; and within “Staying healthy” it is understood that, regardless of the work type, relates to the importance of maintaining physical and nutritional health, as these interfere with the cognitive and emotional skills of everyday life; “Maintaining perspective” is understood as the necessity of maintaining focus in the solving and managing of difficult and unfavorable situations.

From the existing correlations of the RAW Scale 25 and 20 - Brazil and its dimensions with the Resilience, Occupational self-efficacy, Psychological well-being, Engagement at work, and Social support constructs, it is observed that there is coherence of the instrument with the theoretical aspects that support it. Thus, it would be possible to conclude that the RAW Scale 25 and 20 - Brazil have convergent validity, considering that they are statistically correlated with aspects that have a theoretical connection.

The internal consistency of the RAW Scale 25 - Brazil (α = 0.83) was satisfactory. These findings agree with the results of other studies: 0.84(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
), and 0.81(55 Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
https://doi.org/10.1177%2F02560909187739...
). When the factors were evaluated, moderate internal consistency indexes were observed in the “Living authentically”, “Finding your calling”, and “Interacting cooperatively” domains. With the scale adapted for students(66 Turner M, Scott-Young C, Holdsworth S. Navigating the chasm from student to professional: the role of resilience. In: COBRA AUBEA-The Australian Universities’ Building Educators Association Conference [Internet]. 2015 July 8-10; Sydney, Australia: Association with AUBEA, the University of Technology Sydney and University of Western Sydney; 2015 [cited 2020 Jun 13]. [Paper 1-14]. Available from: https://workingwithresilience.com.au/wp-content/uploads/2016/05/Navigating-the-Chasm.pdf
https://workingwithresilience.com.au/wp-...
), the RAW presented a variation of Cronbach’s α in the domains from 0.63 to 0.79. An original study(22 Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
https://doi.org/10.1097/JOM.0b013e3182a2...
) showed a variation from 0.60 to 0.89, and an Indian study(55 Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
https://doi.org/10.1177%2F02560909187739...
), although with a different structure of items and factors, showed a variation of Cronbach’s α between 0.76 to 0.84.

In this sense, considering an acceptable compound reliability of 0.70(1616 Valentini, F, Damásio BF. Variância Média Extraída e Confiabilidade Composta: Indicadores de Precisão. Psicol: Teor Pesqui. 2016;32(2)e322225. https://doi.org/10.1590/0102-3772e322225
https://doi.org/10.1590/0102-3772e322225...
), we observed, in the “Maintaining perspective” domain (0.56-RAW Scale 25 - Brazil), indexes below the reference value. In an Indian study, they found compound reliability greater than 0.70 in the RAW domains with 17 items(55 Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
https://doi.org/10.1177%2F02560909187739...
). It is noteworthy that the compound reliability is influenced by the number of items and the homogeneity of the factorial loads(1616 Valentini, F, Damásio BF. Variância Média Extraída e Confiabilidade Composta: Indicadores de Precisão. Psicol: Teor Pesqui. 2016;32(2)e322225. https://doi.org/10.1590/0102-3772e322225
https://doi.org/10.1590/0102-3772e322225...
). From this perspective, in a general context, the compound reliability can be understood as adequate for this instrument, especially considering that it has less items in some domains, which can influence reliability. The findings regarding consistency validate the quality of the instrument, since an instrument that proves to be reliable in repeated measurement processes corroborates its operational potential for use in population studies(1010 Reichenheim ME, Moraes CL. Operationalizing the cross-cultural adaptation of epidemological measurement instruments. Rev Saúde Pública. 2007;41(4):665-73. https://doi.org/10.1590/S0034-89102006005000035
https://doi.org/10.1590/S0034-8910200600...
,1818 Reichenheim ME, Hökerberg YHM, Moraes CL. Assessing construct structural validity of epidemiological measurement tools: a seven-step roadmap. Cad Saúde Pública. 2014;30(5):927-39. https://doi.org/10.1590/0102-311X00143613
https://doi.org/10.1590/0102-311X0014361...
).

Study limitations

The limitations of the study are mainly related to the representativeness of the studied sample, since it includes but a portion of workers. The reassessment of low factor loadings and high residual items in RAW Scale 25 and 20 - Brazil is important, which will make it possible to improve the current instrument. It would also be relevant to investigate whether the measurement accuracy of RAW Scale 25 and 20 - Brazil is the same in all sample groups, such as gender, age, and type of work.

Contributions to the Field

Two contributions stand out. First, the reflection on the possibility of investing in workers’ health care in order to maintain or improve individuals’ responses to adversity at work. Consequently, it could produce health, or minimize the negative effects of adversity and stress at work. Second, this study brings the methodological framework of psychometrics, which comes from epidemiological and psychological studies. The appropriation of these references contributes to the construction of knowledge in different areas of the nurse’s work.

CONCLUSIONS

The statistical procedures applied in this study concluded that the Resilience at Work (RAW Scale 25 and 20 - Brazil) is a reliable, valid instrument with strong psychometric properties for assessing resilience in the Brazilian work environment. This instrument can also assist in the development of actions and strategies to promote, maintain, or improve resilience at work.

SUPPLEMENTARY MATERIAL

This manuscript is the result of a doctoral thesis, which can be found in the UFSM repository, via: https://repositorio.ufsm.br/handle/1/16353

ACKNOWLEDGMENT

We thank the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - CAPES 001.

REFERENCES

  • 1
    McEwen K. Building Resilience at work. Australian academic press; 2011. 149 p.
  • 2
    Winwood PC, Colon R, Mc ewen K. A practical a measure of workplace resilience: Developing the Resilience at work scale. Journal of occupational and environmental medicine / American college of occupational and environmental medicine. 2013;55(10):1205-12. https://doi.org/10.1097/JOM.0b013e3182a2a60a
    » https://doi.org/10.1097/JOM.0b013e3182a2a60a
  • 3
    Mc ewen K. Building personal resilience as a geoscientist: Applied Earth Science 2013;121(4):155-62. https://doi.org/10.1179/1743275813Y.0000000026
    » https://doi.org/10.1179/1743275813Y.0000000026
  • 4
    Working With Resilience (WWR). North Adelaide: Working With Resilience (WWR)-Escala R@W[Internet]. 2020 [cited 2020 Jun 13]. Available from: https://workingwithresilience.com.au/measure-resilience/rw-research
    » https://workingwithresilience.com.au/measure-resilience/rw-research
  • 5
    Malik P, Garg P. Psychometric Testing of the Resilience at Work Scale Using Indian Sample. VIKALPA J Decis Mak. 2018;43(2):77-91. https://doi.org/10.1177%2F0256090918773922
    » https://doi.org/10.1177%2F0256090918773922
  • 6
    Turner M, Scott-Young C, Holdsworth S. Navigating the chasm from student to professional: the role of resilience. In: COBRA AUBEA-The Australian Universities’ Building Educators Association Conference [Internet]. 2015 July 8-10; Sydney, Australia: Association with AUBEA, the University of Technology Sydney and University of Western Sydney; 2015 [cited 2020 Jun 13]. [Paper 1-14]. Available from: https://workingwithresilience.com.au/wp-content/uploads/2016/05/Navigating-the-Chasm.pdf
    » https://workingwithresilience.com.au/wp-content/uploads/2016/05/Navigating-the-Chasm.pdf
  • 7
    Robertson IT, Cooper CL, Sarkar, M, Currans T. Resilience training in the workplace from 2003 to 2014: a systematic review. J Occupat Organiz Psychol. 2015;88(3):533-62. https://doi.org/10.1111/joop.12120
    » https://doi.org/10.1111/joop.12120
  • 8
    Helmreich I, Kunzler A, Chmitorz A, König J, Binder H., Wessa M. et. al. Psychological interventions for resilience enhancement in adults. Cochrane Database System Rev. 2017;2(CD012527):1-42. https://doi.org/10.1002/14651858.CD012527
    » https://doi.org/10.1002/14651858.CD012527
  • 9
    Greco PBT. Adaptação transcultural para a língua portuguesa do Brasil da Resilience at Work Scale (RAW Scale)[Tese] [Internet]. Santa Maria: Universidade Federal de Santa Maria, Programa de Pós-Graduação em Enfermagem. 2018 [cited 2020 Jun 13]. Available from: https://repositorio.ufsm.br/bitstream/handle/1/16353/TES_PPGENFERMAGEM_2018_GRECO_PATRICIA.pdf?sequence=1&isAllowed=y
    » https://repositorio.ufsm.br/bitstream/handle/1/16353/TES_PPGENFERMAGEM_2018_GRECO_PATRICIA.pdf?sequence=1&isAllowed=y
  • 10
    Reichenheim ME, Moraes CL. Operationalizing the cross-cultural adaptation of epidemological measurement instruments. Rev Saúde Pública. 2007;41(4):665-73. https://doi.org/10.1590/S0034-89102006005000035
    » https://doi.org/10.1590/S0034-89102006005000035
  • 11
    Alves MGM, Chor D, Faerstein E, Lopes CS, Werneck GL. Short version of the “job stress scale”: a Portuguese-language adaptation. Rev Saúde Pública. 2004;38 (2):164-71. https://doi.org/https://doi.org/10.1590/S0034-89102004000200003
    » https://doi.org/https://doi.org/10.1590/S0034-89102004000200003
  • 12
    Sarriera JC, Schwarcz C, Câmara SG. Bem-estar psicológico: análise fatorial da escala de Goldberg (GHQ-12) numa amostra de jovens. Psicol Reflex Crit [Internet]. 1996[cited 2020 Jun 23];9:293-306. Available from: https://www.researchgate.net/publication/275276458_Bem-Estar_Psicologico_Analise_Fatorial_da_Escala_Golberg_Ghq-12_Numa_Amostra_de_Jovens
    » https://www.researchgate.net/publication/275276458_Bem-Estar_Psicologico_Analise_Fatorial_da_Escala_Golberg_Ghq-12_Numa_Amostra_de_Jovens
  • 13
    Pesce RP, Assis SG, Avanci JQ, Santos NC, Malaquias JV, Carvalhaes R. Adaptação transcultural, confiabilidade e validade da escala de resiliência. Cad Saúde Pública. 2005;21(2):436-48. https://doi.org/10.1590/S0102-311X2005000200010
    » https://doi.org/10.1590/S0102-311X2005000200010
  • 14
    Magnan ES, Vazquez ACS, Pacico JCI, Hutz CS. Normatização da versão Brasileira da Escala Utrecht de Engajamento no Trabalho. Aval Psicol. 2016;15(2):133-40. https://doi.org/10.15689/ap.2016.1502.01
    » https://doi.org/10.15689/ap.2016.1502.01
  • 15
    Damásio BF, Freitas CPP, Koller SH. Occupational Self-Efficacy Scale - Short Form (OSS-SF): adaptation and evidence of construct validity of the Brazilian version. Rev Bras Orientac Prof[Internet]. 2014[cited 2020 Jun 23];15(1):65-74. Available from: http://pepsic.bvsalud.org/scielo.php?script=sci_arttext&pid=S1679-33902014000100008&lng=pt&tlng=en
    » http://pepsic.bvsalud.org/scielo.php?script=sci_arttext&pid=S1679-33902014000100008&lng=pt&tlng=en
  • 16
    Valentini, F, Damásio BF. Variância Média Extraída e Confiabilidade Composta: Indicadores de Precisão. Psicol: Teor Pesqui. 2016;32(2)e322225. https://doi.org/10.1590/0102-3772e322225
    » https://doi.org/10.1590/0102-3772e322225
  • 17
    Tabachnick BG, Fidell LS. Using multivariate statistics. 7ºEd. Boston: Allyn & Bacon/Pearson Education, 2019. 815p
  • 18
    Reichenheim ME, Hökerberg YHM, Moraes CL. Assessing construct structural validity of epidemiological measurement tools: a seven-step roadmap. Cad Saúde Pública. 2014;30(5):927-39. https://doi.org/10.1590/0102-311X00143613
    » https://doi.org/10.1590/0102-311X00143613
  • 19
    Streiner DL, Norman GR, Cairney J. Health Measurement Scales: a practical guide to their development and use. 5ª Ed. New York: Oxford University Press, 2015. 416 p.

Edited by

EDITOR IN CHIEF: Álvaro Sousa
ASSOCIATE EDITOR: Maria Itayra Padilha

Publication Dates

  • Publication in this collection
    25 Feb 2022
  • Date of issue
    2022

History

  • Received
    27 May 2021
  • Accepted
    17 Oct 2021
Associação Brasileira de Enfermagem SGA Norte Quadra 603 Conj. "B" - Av. L2 Norte 70830-102 Brasília, DF, Brasil, Tel.: (55 61) 3226-0653, Fax: (55 61) 3225-4473 - Brasília - DF - Brazil
E-mail: reben@abennacional.org.br