Acessibilidade / Reportar erro

Relationship between depressive symptoms, burnout, job satisfaction and patient safety culture among workers at a university hospital in the Brazilian Amazon region: cross-sectional study with structural equation modeling

ABSTRACT

BACKGROUND:

Workplaces can be sources of mental distress. In healthcare services, this can also affect patients.

OBJECTIVE:

To assess the prevalence of and factors associated with depressive symptoms, burnout, job satisfaction and patient safety culture and the relationships between these constructs, among healthcare workers.

DESIGN AND SETTING:

Cross-sectional study in a university hospital in Manaus, Brazil.

METHODS:

Randomly selected workers were interviewed based on Brazilian-validated tools. We calculated the prevalence ratio (PR) and 95% confidence interval (CI) of depressive symptoms and burnout using Poisson regression with robust variance; and the β-coefficient of safety culture and job satisfaction using linear regression. Outcome relationships were assessed using partial least-squares structural equation modeling.

RESULTS:

300 professionals were included; 67.3% were women. The prevalence of depressive symptom was 19.0% (95% CI: 14.5; 23.5%) and burnout, 8.7% (95% CI: 5.2; 12.3%). Lack of work stability increased depression (PR = 1.88; 95% CI: 1.17; 3.01) and burnout (PR = 2.17; 95% CI: 1.03; 4.57); and reduced job satisfaction (β = -11.93; 95% CI: -18.79; -5.07). Depressive symptoms and burnout were positively correlated, as also were job satisfaction and safety culture (P < 0.001); job satisfaction was negatively correlated with burnout (P < 0.001) and depression (P = 0.035).

CONCLUSION:

Impermanent employment contracts increased depression and burnout and reduced job satisfaction. Job satisfaction reduced poor mental health outcomes and increased safety culture. Job satisfaction and safety culture were directly proportional (one construct increased the other and vice versa), as also were depression and burnout. Better working conditions can provide a virtuous cycle of patient safety and occupational health.

KEY WORDS (MeSH terms):
Burnout, professional; Depression; Job satisfaction; Patient safety; Health personnel; Brazil

AUTHORS’ KEY WORDS:
Depressive symptoms; Culture of patient safety; Healthcare workers; Amazon

INTRODUCTION

Negative psychological effects are frequently experienced by healthcare professionals, due to distress relating to patients’ sorrows, health-threatening diseases and poor working environments. Workplace conditions within healthcare affect both the health of the workers and the safety of care.11. Silver S, Boiano J, Li J. Patient care aides: Differences in healthcare coverage, health-related behaviors, and health outcomes in a low-wage workforce by healthcare setting. Am J Ind Med. 2020;63(1):60-73. PMID: 31631375; https://doi.org/10.1002/ajim.23053.
https://doi.org/https://doi.org/10.1002/...
Adverse events and harm to patients cause physical, psychological and professional distress and require proper organizational support for the team.22. Elizabeth Marran J. Supporting staff who are second victims after adverse healthcare events. Nurs Manag (Harrow). 2019;26(6):36-43. PMID: 31777240; https://doi.org/10.7748/nm.2019.e1872.
https://doi.org/https://doi.org/10.7748/...
Frequent exposure to this insalubrious setting affects the emotional health of workers, who face high prevalence of mental health problems.33. DeLucia JA, Bitter C, Fitzgerald J, et al. Prevalence of Post-Traumatic Stress Disorder in Emergency Physicians in the United States. West J Emerg Med. 2019;20(5):740-6. PMID: 31539331; https://doi.org/10.5811/westjem.2019.7.42671.
https://doi.org/https://doi.org/10.5811/...
,44. van Steijn ME, Scheepstra KWF, Yasar G, et al. Occupational well-being in pediatricians-a survey about work-related posttraumatic stress, depression, and anxiety. Eur J Pediatr. 2019;178(5):681-93. PMID: 30783762; https://doi.org/10.1007/s00431-019-03334-7.
https://doi.org/https://doi.org/10.1007/...
In this highly human-mediated activity, practitioners’ and patients’ health are mutually influenced.55. Pereira-Lima K, Mata DA, Loureiro SR, et al. Association Between Physician Depressive Symptoms and Medical Errors: A Systematic Review and Meta-analysis. JAMA network open. 2019;2(11):e1916097. PMID: 31774520; https://doi.org/10.1001/jamanetworkopen.2019.16097.
https://doi.org/https://doi.org/10.1001/...

Chronic workplace stress that is not properly managed has been recognized as a cause of burnout syndrome, which was included as a morbidity in the International Classification of Diseases for Mortality and Morbidity Statistics, eleventh revision, in 2019.66. WHO. ICD-11: international statistical classification of diseases and related health problems: eleventh revision. QD85 Burnout. Geneva: World Health Organization; 2019 Available from: https://icd.who.int/browse11/l-m/en#/http://id.who.int/icd/entity/129180281. Accessed in 2021 (Sep 24).
https://icd.who.int/browse11/l-m/en#/htt...
Satisfaction and engagement with labor are central to wellbeing and good performance at both the individual and the collective level.77. Garcia-Buades ME, Peiro JM, Montanez-Juan MI, Kozusznik MW, Ortiz-Bonnin S. Happy-Productive Teams and Work Units: A Systematic Review of the ‘Happy-Productive Worker Thesis’. Int J Environ Res Public Health. 2019;17(1). PMID: 31861812; https://doi.org/10.3390/ijerph17010069.
https://doi.org/https://doi.org/10.3390/...

The relationships between work conditions, workers’ health and patient safety need further investigation. A review on professional burnout, depression, employee commitment, patient outcomes and safety culture interplays identified that even though safety culture and clinical errors were both associated with burnout, few studies had focused on engagement and individual-level factors that impact patient safety culture.88. Mossburg SE, Dennison Himmelfarb C. The Association Between Professional Burnout and Engagement With Patient Safety Culture and Outcomes: A Systematic Review. Journal of patient safety. 2018. PMID: 29944601; https://doi.org/10.1097/pts.0000000000000519.
https://doi.org/https://doi.org/10.1097/...
A previous Brazilian survey observed an inverse causal relationship between burnout syndrome and job satisfaction, while depressive symptoms were predictors for burnout.99. Oliveira AM, Silva MT, Galvao TF, Lopes LC. The relationship between job satisfaction, burnout syndrome and depressive symptoms: An analysis of professionals in a teaching hospital in Brazil. Medicine (Baltimore). 2018;97(49):e13364. PMID: 30544404; https://doi.org/10.1097/md.0000000000013364.
https://doi.org/https://doi.org/10.1097/...
Real-world evidence about the connections between safety culture, job satisfaction, depression and burnout could enlighten the discussions and improve both workplace and patient safety.

Safety culture was deemed to be fragile, with predominance of individual culpability standards, in a previous survey at a university hospital in the Brazilian Amazon region.1010. Galvão TF, Lopes MCC, Oliva CCC, Araújo MEA, Silva MT. Patient safety culture in a university hospital. Rev Lat Am Enfermagem. 2018;26:e3014. PMID: 30110092; https://doi.org/10.1590/1518-8345.2257.3014.
https://doi.org/https://doi.org/10.1590/...
This scenario motivated an investigation on how patient safety culture, workers’ engagement and outcomes interact in this setting.

OBJECTIVE

The aim of this study was to assess the prevalence of and factors associated with depressive symptoms, burnout, job satisfaction and patient safety culture and the relationships between these constructs, among healthcare workers at a university in the Brazilian Amazon region.

METHODS

Study design and setting

This was a cross-sectional study conducted among healthcare workers at Getulio Vargas University Hospital from July to November 2016. This is a teaching hospital belonging to the Universidade Federal do Amazonas (UFAM), and it forms part of the Brazilian National Health System (Sistema Único de Saúde, SUS). At the time of this study, the hospital had 159 beds (11 in intensive care) and 1,222 employees.

Participants

Individuals who had been employees for at least three months and who were working in the main building of the hospital were eligible for inclusion in this study. The sample size was calculated as 300 participants, considering the potential total population of 863 eligible employees, a frequency of positive answers regarding safety culture of 50%, a confidence level of 95%, design effect of 1 (random sampling) and addition of 10% to compensate for losses. From the hospital’s human resources spreadsheet, we randomly selected 300 employees for interviews and 300 employees to serve as replacements in cases of refusals.

Variables

The primary outcomes were the prevalences of depressive symptoms and burnout, and the perceptions of job satisfaction and patient safety culture.

The independent variables were the following: sex (women or men); age (in years, categorized as 18-35, 35-50 or 51 or over); skin color/race (whites [white and Asian] or non-whites [black, indigenous and brown, i.e. Brazilian mixed race]); marital status (married or single [single, separated, divorced or widowed]); body composition (normal, overweight or obese); educational level (high school or less, higher education or postgraduate school); economic classification (A, B1, B2 or C/D/E); profession (physicians, nursing staff [nurses and nursing technicians], other healthcare professionals [psychologists, nutrition/radiology/laboratory technicians, physiotherapists, social workers and nutritionists] or technical support [maintenance/cleaning and administrative staff, i.e. office assistant/secretary/receptionist]); working in direct contact with patients (yes or no); length of time working in the hospital (in years, categorized as < 1, 1-2, 3-4, 5-10, 11-20 or ≥ 21); work contract stability (permanent [statutory, contracted through consolidation of labor laws] or temporary [contracted through a support foundation or residency scholarship]); number of jobs (1, 2 or ≥ 3); and weekly workload (in hours, categorized as 20-40, 41-60 or ≥ 61).

Data sources and measurement

The participants who had been drawn for inclusion were contacted by the research team and were asked to answer a questionnaire using electronic devices (Samsung Tab-3 SM-T110). The KoboToolbox software (https://www.kobotoolbox.org/) was used to configure the questionnaire, with mandatory answers for each question. The software worked offline and filled-out forms were submitted automatically once an internet connection was available.

Depressive symptoms were measured using the nine-item Patient Health Questionnaire (PHQ-9), in its version validated for use in Brazil.1111. de Lima Osório F, Vilela Mendes A, Crippa JA, Loureiro SR. Study of the discriminative validity of the PHQ-9 and PHQ-2 in a sample of Brazilian women in the context of primary health care. Perspect Psychiatr Care. 2009;45(3):216-27. PMID: 19566694; https://doi.org/10.1111/j.1744-6163.2009.00224.x.
https://doi.org/https://doi.org/10.1111/...
We adopted the cutoff point of ≥ 9 to define presence of depressive symptoms.1212. Santos IS, Tavares BF, Munhoz TN, et al. Sensibilidade e especificidade do Patient Health Questionnaire-9 (PHQ-9) entre adultos da população geral [Sensitivity and specificity of the Patient Health Questionnaire-9 (PHQ-9) among adults from the general population]. Cad Saude Publica. 2013;29(8):1533-43. PMID: 24005919; https://doi.org/10.1590/0102-311x00144612.
https://doi.org/https://doi.org/10.1590/...
The Brazilian version of the Maslach Burnout Inventory Human Services Survey (MBI-HSS) was used to assess burnout, which was taken to be present in cases of higher scores for emotional exhaustion (≥ 27) and depersonalization (≥ 13), and lower scores for personal accomplishment (≤ 31).1313. Carlotto MS, Câmara SG. Propriedades psicométricas do Maslach Burnout Inventory em uma amostra multifuncional. Estudos de Psicologia. 2007;24(3):325-32. https://doi.org/10.1590/S0103-166X2007000300004.
https://doi.org/https://doi.org/10.1590/...

Job satisfaction was assessed through the validated version of the Job Satisfaction Survey (JSS) for the Brazilian context.1414. Souza AC, Milani D, Alexandre NMC. Adaptação cultural de um instrumento para avaliar a satisfação no trabalho. Rev Bras Saúde ocup. 2015;40(132):219-27. https://doi.org/10.1590/0303-7657000113715.
https://doi.org/https://doi.org/10.1590/...
The score range of 36-108 was taken to indicate dissatisfaction; 144-216, satisfaction; and 109-143, ambivalence. Safety culture was measured through the Brazilian validated version of the Safety Attitudes Questionnaire (SAQ). After reversing the scores of negatively worded items, the positivity percentage was calculated and results of 75% or more were considered to denote the presence of a positive safety culture.1515. de Carvalho RE, Cassiani SH. Cross-cultural adaptation of the Safety Attitudes Questionnaire - Short Form 2006 for Brazil. Rev Lat Am Enfermagem. 2012;20(3):575-82. PMID: 22991121.

The economic classification was based on reported possession of comfort items and on the education level of the head of the family, which led to a classification from A (richest) to E (poorest).1616. Associação Brasielira de Empresas de Pesquisa (ABEP). Critério Brasil 2015 e atualização da distribuição de classes para 2016. São Paulo: ABEP; 2016. Available from: http://www.abep.org/criterio-brasil. Acessed in 2021 (Sep 24).
http://www.abep.org/criterio-brasil...
Weight and height were self-reported by the participants and body mass index (BMI) was obtained by dividing the weight in kilograms (kg) by the square of the height in meters (m2). BMI was classified as normal (≤ 24.9 kg/m2), overweight (25-29.9 kg/m2) or obese (≥ 30 kg/m2). Weekly workload and the number of jobs were obtained from the Brazilian National Registry of Healthcare Establishments by searching for the professional’s name.1717. Cadastro Nacional de Estabelecimentos de Saúde (CNES). Informações de Saúde (TABNET) Rede Assistencial. Brasília: DATASUS; 2015. Available from: http://cnes.datasus.gov.br/. Accessed in 2021 (Sep 24).
http://cnes.datasus.gov.br/...
Information on work contract stability was obtained from the hospital’s human resources spreadsheet.

Statistical methods

We calculated descriptive statistics for all variables, and obtained frequencies, means, standard deviations and 95% confidence intervals (CI), according to the nature of the data. The instruments’ reliability was calculated by means of Cronbach’s alpha, using a cutoff of ≥ 0.6.

The prevalence ratio (PR) and 95% CI of depressive symptoms and burnout were calculated by means of Poisson regression with robust variance. Factors associated with safety culture and job satisfaction were calculated through linear regression to obtain the coefficient β and 95% CI. We adopted the significance level of P < 0.05 to identify presence of associations between the outcomes and independent variables.

The relationships between depressive symptoms, burnout, job satisfaction and patient safety culture were assessed using partial least-squares structural equation modeling (PLS-SEM). The significance and the relationships between the constructs were established through the path coefficient, expressed as values between -1 and 1. Values close to 0 indicate weak relationships and Pearson’s coefficient of determination was classified as showing a large effect if R2 ≥ 26%.1818. Hair JF, Hult GTM, Ringle CM, Sarstedt M. A primer on partial least squares structural equation modeling (PLS-SEM). Los Angeles (CA): SAGE Publications; 2014. We tested all relationships between constructs and kept significant associations (P < 0.05) in the final PLS-SEM. All analyses were done using the Stata software, version 14.2 (StataCorp, College Station, Texas, United States).

Ethics

This project was approved by the Research Ethics Committee of the UFAM, through opinion report no. 1,564,841, dated May 30, 2016 (Certificate of Submission for Ethical Appreciation: 44286115.0.0000.5020, on the Brazil Platform); and by the university hospital’s teaching and research management (research monitoring number 03/2016 NP0 25/2015). Participation in the research was voluntary, and only took place after the individual had read and signed an informed consent statement.

RESULTS

Participants’ characteristics

Out of the 1,222 active employees, 863 were eligible and 300 were included. There were 23 refusals among the first 300 invitees, thus yielding initial response rate of 93% (Figure 1).

Figure 1.
Process of study participant selection and inclusion.

The majority were women (67%), aged 36-50 years (48%) and married (65%), had nonwhite skin color (black, brown or indigenous; 66%), had a postgraduate degree (53.3%), were overweight (42%) and belonged to economic classification B2 (33%) (Table 1).

Table 1.
Sociodemographic and professional characteristics of participants and frequencies of depressive symptoms, burnout, job satisfaction and safety culture (n = 300)

Frequencies of depressive symptoms, burnout, job satisfaction and safety culture

Depressive symptoms were present in 19.0% (95% CI: 14.5; 23.5%; α = 0.845). The highest prevalences in our sample were noted among people who had been working in the hospital for fewer than five years and among those with higher education, one job and weekly workload of up to 40 hours. Burnout affected 8.7% of the participants (95% CI: 5.2; 12.3%; α = 0.908). Higher prevalence was noted among the participants in higher social classes, physicians, people who had been working in the hospital for 3-4 years and those with higher educational attainment (Table 1).

Job satisfaction scores were ambivalent in the whole sample (131.3; 95% CI: 128.4; 134.2; α = 0.884). Higher scores were observed among nursing staff, people who had been working in the hospital for 5-10 years, those with high school education or less and those with two job contracts. The level of safety culture did not reach the criterion for a positive safety culture that had been defined (i.e. 75%) (62.7%; 95% CI: 60.7; 64.6%; α = 0.920). Higher scores for safety culture were observed among men and professionals with weekly workloads of over 60 hours (Table 1).

Factors associated with outcomes

Workers with temporary contracts (PR = 1.88; 95% CI: 1.17; 3.01) and with higher education (PR = 2.19; 95% CI = 1.33; 3.59) had higher prevalence of depressive symptoms than workers with stable contracts (Table 2). Those with two jobs (PR = 0.39; 95% CI: 0.19; 0.79) and with weekly workloads of 61 hours or more had fewer depressive symptoms (PR = 0.40; 95% CI: 0.16; 0.97). The prevalence of burnout was lower among people aged 36 to 50 years (PR = 0.43; 95% CI: 0.19; 0.97), married people (PR = 0.39; 95% CI: 0.19; 0.83), individuals in lower economic strata (PR = 0.10; 95% CI: 0.01; 0.75) and nursing staff (PR = 0.27; 95% CI: 0.10; 0.75), in comparison with the respective reference. It was significantly higher among workers with temporary contracts (PR = 2.17; 95% CI: 1.03; 4.57) and with higher education (PR = 2.59; 95% CI: 1.22; 5.51).

Table 2.
Factors associated with depressive symptoms and burnout, calculated by means of Poisson regression with robust variance; and with patient safety culture and job satisfaction, calculated by means of logistic regression

Workers within the fields of nursing (β = 18.7; 95% CI: 11.62; 25.88) and technical support (β = 15.9; 95% CI: 6.85; 24.90) had greater job satisfaction than did physicians. People in lower economic strata had higher job satisfaction than did those in higher strata (P < 0.003); and those with temporary contracts had lower satisfaction than permanent workers (β = -11.93; 95% CI: -18.79; -5.07). Men (β = 6.47; 95% CI: 2.27; 10.68), professionals in direct contact with patients (β = 7.03; 95% CI: 1.05; 13.00), those with three or more jobs (β = 5.80; 0.70; 10.89) and those with weekly workloads exceeding 60 hours (β = 6.57; 95% CI: 1.36; 11.77) had significantly higher perception of safety culture, compared with their reference categories.

Relationships between depressive symptoms, burnout, job satisfaction and safety culture

Burnout was negatively correlated with job satisfaction (path coefficient = -0.342; P < 0.001) and it was positively correlated with depressive symptoms (path coefficient = 0.520; P < 0.001); 56% of burnout variance was explained by these factors (Table 3 and Figure 2). Job satisfaction reduced depressive symptoms (path coefficient = -0.125; P = 0.035) and burnout increased these symptoms (path coefficient = 0.614; P < 0.001); 48% of the variability of the depressive symptoms was explained by the predictive variables.

Table 3.
Correlation between depressive symptoms, burnout, job satisfaction and safety culture
Figure 2.
Correlation path of depressive symptoms, burnout, job satisfaction and safety culture, obtained through partial least-squares structural equation modeling (PLS-SEM).

Job satisfaction increased patient safety culture (path coefficient = 0.741; P < 0.001) and explained 55% of its variance. Safety culture increased job satisfaction (path coefficient = 0.590; P < 0.001) and burnout reduced it (path coefficient = -0.310; P < 0.001); 62% of job satisfaction variance was explained by these predictors. Other path coefficients between the constructs were not significant (P < 0.05) and were removed from the PLS-SEM.

DISCUSSION

The healthcare workers in this university hospital in the Amazon region had high prevalences of depressive symptoms and burnout, while patient safety culture and job satisfaction were sub-optimal. Burnout and depressive symptoms were directly proportional: the presence of one outcome potentiated the occurrence of the other. Job satisfaction was a protective factor for depression and burnout and was negatively affected by these constructs. Satisfaction with work increased patient safety culture, which in turn improved job satisfaction; and it reduced the frequency of poor mental health outcomes.

Although we used a causality technique to assess how the constructs were related to each other (structural equation modeling), the cross-sectional design did not allow us to draw conclusions regarding causal relationships. No adjustments for confounding factors in regression analyses were performed in order to investigate individual associations: instead, we aimed to study the relationships between constructs.

The present results may have been affected by survival bias, since individuals with severe emotional problems could have been on sick leave or could have taken early retirement, which would thus have rendered them ineligible for this study. Nonetheless, the random sampling adopted and the consequent high response rate increased the level of confidence in the representativeness of this study.

The conclusions from the present study were supported only through quantitative data. Comprehension of the constructs would become better explained if these were supplemented with qualitative data. Measurements were based on a self-administered questionnaire that asked sensitive questions about the workplace and the participants’ mental health of participant. The nature of these questions might have led to non-response bias, but the high reliability that was found for the constructs showed that this risk was low. One contextual factor that could not be avoided was that at the time of data collection, there was co-occurrence of physical renovation and managerial changes, which may have impacted the professionals’ perceptions.

Safety culture and job satisfaction had a positive and reciprocal relationship. Job satisfaction reduced depressive symptoms and burnout and the latter reduced satisfaction. Depressive symptoms and burnout were positively and mutually associated. In a previous survey conducted in a hospital in the state of São Paulo, Brazil, similar relationships between job satisfaction, depressive symptoms and burnout were observed.99. Oliveira AM, Silva MT, Galvao TF, Lopes LC. The relationship between job satisfaction, burnout syndrome and depressive symptoms: An analysis of professionals in a teaching hospital in Brazil. Medicine (Baltimore). 2018;97(49):e13364. PMID: 30544404; https://doi.org/10.1097/md.0000000000013364.
https://doi.org/https://doi.org/10.1097/...
An adequate labor environment favors better mental outcomes and safety culture, thereby contributing to the quality of the care provided.

Almost one-fifth of the workers presented depressive symptoms and one-tenth, burnout. The prevalence of depressive symptom was almost three times greater than the 7% observed in the adult population of Manaus Metropolitan Region in 2015,1919. Silva MT, Caicedo Roa M, Martins SS, da Silva ATC, Galvao TF. Prevalence and correlates of depressive symptoms among adults living in the Amazon, Brazil: A population-based study. J Affect Disord. 2017;222:162-8. PMID: 28709023; https://doi.org/10.1016/j.jad.2017.06.053.
https://doi.org/https://doi.org/10.1016/...
while the burnout rates were similar to global trends among nurses (10%) and ranged from 9 to 60% among physicians, using the same instruments and cutoffs that we adopted.2020. Woo T, Ho R, Tang A, Tam W. Global prevalence of burnout symptoms among nurses: A systematic review and meta-analysis. J Psychiatr Res. 2020;123:9-20. PMID: 32007680; https://doi.org/10.1016/j.jpsychires.2019.12.015.
https://doi.org/https://doi.org/10.1016/...
, 2121. Rotenstein LS, Torre M, Ramos MA, et al. Prevalence of Burnout Among Physicians: A Systematic Review. JAMA. 2018;320(11):1131-50. PMID: 30326495; https://doi.org/10.1001/jama.2018.12777.
https://doi.org/https://doi.org/10.1001/...
Poor mental health outcomes seem to occur more frequently among healthcare workers, and this represents a risk factor for unsafe care.33. DeLucia JA, Bitter C, Fitzgerald J, et al. Prevalence of Post-Traumatic Stress Disorder in Emergency Physicians in the United States. West J Emerg Med. 2019;20(5):740-6. PMID: 31539331; https://doi.org/10.5811/westjem.2019.7.42671.
https://doi.org/https://doi.org/10.5811/...

4. van Steijn ME, Scheepstra KWF, Yasar G, et al. Occupational well-being in pediatricians-a survey about work-related posttraumatic stress, depression, and anxiety. Eur J Pediatr. 2019;178(5):681-93. PMID: 30783762; https://doi.org/10.1007/s00431-019-03334-7.
https://doi.org/https://doi.org/10.1007/...
-55. Pereira-Lima K, Mata DA, Loureiro SR, et al. Association Between Physician Depressive Symptoms and Medical Errors: A Systematic Review and Meta-analysis. JAMA network open. 2019;2(11):e1916097. PMID: 31774520; https://doi.org/10.1001/jamanetworkopen.2019.16097.
https://doi.org/https://doi.org/10.1001/...
Lack of stability in work contracts doubled the prevalence of both depression and burnout, and significantly reduced job satisfaction in our sample. Concerns about job loss frequently lead to emotional distress.2222. Kim W, Kim TH, Lee TH, et al. Temporary work and depressive symptoms in South Korean workers. Occup Med (Lond). 2017;67(6):421-4. PMID: 28486680; https://doi.org/10.1093/occmed/kqx050.
https://doi.org/https://doi.org/10.1093/...
This situation will probably deteriorate in Brazil with a major labor reform that has been implemented in Brazil, which has increased the occurrence of precarious contracts and has reduced workers’ rights.2323. Lacaz FAC. The (Counter) Labor Reform: Law 13,467/2017, a disaster for Workers’ Health. Cien Saude Colet. 2019;24(3):680. PMID: 30892490; https://doi.org/10.1590/1413-81232018243.01452019.
https://doi.org/https://doi.org/10.1590/...
Higher pressures on public healthcare, and on healthcare personnel, are also expected because of a freeze on government investments in healthcare and other social areas for 20 years that was started in 2017.2424. de Souza LEPF. The right to health in Brazil: A Constitutional guarantee threatened by fiscal austerity. J Public Health Policy. 2017;38(4):493-502. PMID: 28659606; https://doi.org/10.1057/s41271-017-0083-y.
https://doi.org/https://doi.org/10.1057/...

People with two work contracts and with higher weekly workloads had fewer depressive symptoms. This was inconsistent with previous research, in which higher rates of depression due to reduced time for eating, leisure, rest, sleep and social and family contact were observed.2525. Oliveira FPd, Mazzaia MC, Marcolan JF. Symptoms of depression and intervening factors among nurses of emergency hospital services. Acta Paulista De Enfermagem. 2015;28:209-15. https://doi.org/10.1590/1982-0194201500036.
https://doi.org/https://doi.org/10.1590/...
,2626. Cruz Robazzi MLC, Chaves Mauro MY, Barcellos Dalri RCM, et al. Exceso de trabajo y agravios mentales a los trabajadores de la salud. Rev Cubana Enferm. 2010;26(1):52-64. The possible explanations for our findings are that coping skills may have been developed through more job experience; or that it may have been a limitations of our cross-sectional design due to reverse causality, i.e. people who fell ill reduced their workload; or that it may have been related to survival bias, as mentioned earlier. Higher workload was also associated with better perception of safety in our sample and in some previous studies,2727. Shu Q, Cai M, Tao HB, et al. What Does a Hospital Survey on Patient Safety Reveal About Patient Safety Culture of Surgical Units Compared With That of Other Units? Medicine (Baltimore). 2015;94(27):e1074. PMID: 26166083; https://doi.org/10.1097/md.0000000000001074.
https://doi.org/https://doi.org/10.1097/...
,2828. Hamdan M, Saleem AA. Assessment of patient safety culture in Palestinian public hospitals. Int J Qual Health Care. 2013;25(2):167-75. PMID: 23382367; https://doi.org/10.1093/intqhc/mzt007.
https://doi.org/https://doi.org/10.1093/...
but this was seen to have a negative effect in other settings.2929. Wami SD, Demssie AF, Wassie MM, Ahmed AN. Patient safety culture and associated factors: A quantitative and qualitative study of healthcare workers’ view in Jimma zone Hospitals, Southwest Ethiopia. BMC Health Serv Res. 2016;16:495. PMID: 27644960; https://doi.org/10.1186/s12913-016-1757-z.
https://doi.org/https://doi.org/10.1186/...
,3030. Teles M, Kaya S. Staff perceptions of patient safety culture in general surgery departments in Turkey. Afr Health Sci. 2019;19(2):2208-18. PMID: 31656506; https://doi.org/10.4314/ahs.v19i2.46.
https://doi.org/https://doi.org/10.4314/...
The divergences regarding this finding may reflect the labor market and safety culture perceptions of each geographical area,3131. Okuyama JHH, Galvao TF, Silva MT. Healthcare Professional’s Perception of Patient Safety Measured by the Hospital Survey on Patient Safety Culture: A Systematic Review and Meta-Analysis. TheScientificWorldJournal. 2018;2018:9156301. PMID: 30104917; https://doi.org/10.1155/2018/9156301.
https://doi.org/https://doi.org/10.1155/...
or possible desensitization to safety issues in situations of longer working hours.

The score for patient safety culture was only slightly above the midpoint and was therefore not considered to be positive culture. The 2015 survey conducted in this hospital also found weaknesses in safety culture, using another instrument.1010. Galvão TF, Lopes MCC, Oliva CCC, Araújo MEA, Silva MT. Patient safety culture in a university hospital. Rev Lat Am Enfermagem. 2018;26:e3014. PMID: 30110092; https://doi.org/10.1590/1518-8345.2257.3014.
https://doi.org/https://doi.org/10.1590/...
Men, workers in direct contact with patients and people with greater workloads and more jobs had better perceptions of safety culture. Men also had more favorable perceptions regarding teamwork climate, job satisfaction, management and working conditions in a survey held in the United States using SAQ.3232. Carney BT, Mills PD, Bagian JP, Weeks WB. Sex differences in operating room care giver perceptions of patient safety: a pilot study from the Veterans Health Administration Medical Team Training Program. Qual Saf Health Care. 2010;19(2):128-31. PMID: 20142406; https://doi.org/10.1136/qshc.2008.028233.
https://doi.org/https://doi.org/10.1136/...
Men tend to present positive reactivity and, according to the model of patterns of change, need more time to perceive potential errors. Thus, they may classify performance as excellent, while this might be considered substandard by women.3333. Hess U, David S, Hareli S. Emotional restraint is good for men only: The influence of emotional restraint on perceptions of competence. Emotion. 2016;16(2):208-13. PMID: 26461250; https://doi.org/10.1037/emo0000125.
https://doi.org/https://doi.org/10.1037/...
A survey among 1,408 professionals also observed higher safety culture among professionals who work in direct contact with patients than among those without contact.2828. Hamdan M, Saleem AA. Assessment of patient safety culture in Palestinian public hospitals. Int J Qual Health Care. 2013;25(2):167-75. PMID: 23382367; https://doi.org/10.1093/intqhc/mzt007.
https://doi.org/https://doi.org/10.1093/...
This may reflect the skills developed in adjusting professional and technical issues to achieve a capacity to interrelate with patients.3434. Beltrán Salazar OA. Humanized care: A relationship of familiarity and affectivity. Invest Educ Enferm. 2015;33(1):17-27. PMID: 26148152: https://doi.org/10.1590/S0120-53072015000100003.
https://doi.org/https://doi.org/10.1590/...

Job satisfaction was ambivalent in our sample as a whole. Professionals of lower social class and in the field of nursing had higher job satisfaction and lower prevalence of burnout. Job satisfaction probably acted as a protective factor against burnout in these categories. Higher satisfaction in lower social classes is counterintuitive, in that higher income is generally associated with greater satisfaction with payment.3535. Hauret L, Williams DR. Relative income and pay satisfaction: Further evidence on the role of the reference group. Journal of Happiness Studies. 2019;20(1):307-29. https://doi.org/10.1007/s10902-017-9950-2.
https://doi.org/https://doi.org/10.1007/...
One possible explanation for this is that people of lower economic level place greater value on the type of work performed in hospitals, while those with higher incomes feel disregarded in relation to their working conditions. It is also possible that wealthier people occupy positions that bring more responsibilities, dissatisfaction with work and professional burnout. Lower levels of satisfaction and high prevalence of burnout among both nurses and physicians is a common finding, but comparisons of satisfaction across healthcare professions in the same sample are scarce.3636. Hoff T, Carabetta S, Collinson GE. Satisfaction, Burnout, and Turnover Among Nurse Practitioners and Physician Assistants: A Review of the Empirical Literature. Med Care Res Rev. 2019;76(1):3-31. PMID: 28901205; https://doi.org/10.1177/1077558717730157.
https://doi.org/https://doi.org/10.1177/...
Local reasons can also explain these findings.

More than half of the professionals presented overweight or obesity, without any association with patient safety, job satisfaction, depressive symptoms or burnout. A previous investigation found positive associations between eating problems and burnout,3737. Nevanperä NJ, Hopsu L, Kuosma E, et al. Occupational burnout, eating behavior, and weight among working women. Am J Clin Nutr. 2012;95(4):934-43. PMID: 22378728; https://doi.org/10.3945/ajcn.111.014191.
https://doi.org/https://doi.org/10.3945/...
between burnout and obesity,3838. Armon G, Shirom A, Berliner S, Shapira I, Melamed S. A prospective study of the association between obesity and burnout among apparently healthy men and women. J Occup Health Psychol. 2008;13(1):43-57. PMID: 18211168; https://doi.org/10.1037/1076-8998.13.1.43.
https://doi.org/https://doi.org/10.1037/...
and between depression and obesity.3939. Milaneschi Y, Simmons WK, van Rossum EFC, Penninx BW. Depression and obesity: evidence of shared biological mechanisms. Mol Psychiatry. 2019;24(1):18-33. PMID: 29453413; https://doi.org/10.1038/s41380-018-0017-5.
https://doi.org/https://doi.org/10.1038/...
Most of our sample were black, brown or indigenous, and ethnicity was not associated with the constructs in our study, which was a pattern differing from what had previously been observed.4040. Kashani K, Carrera P, De Moraes AG, et al. Stress and burnout among critical care fellows: preliminary evaluation of an educational intervention. Med Educ Online. 2015;20:27840. PMID: 26208706.

CONCLUSION

Job satisfaction increased safety culture, which also positively affected satisfaction, and reduced depressive symptoms and professional burnout. Depressive symptoms, burnout, job satisfaction and safety culture were partially explained by and individually associated with lack of work stability, number of jobs, weekly workload and sociodemographic factors. Improving the institution’s patient safety culture involves enhancement of working conditions and empowerment of workers, in order to provide a healthy environment for professionals and safe care for patients. Job satisfaction has a central role in relation to safer care for patients and better mental health among workers.

Acknowledgements:

The authors thank Rosilene da Silva, Bruno Cardoso Silvestre, Marcelo Garcia Perdigão and Mariana Regina Costa Lopes for their assistance in data collection

REFERENCES

  • 1.
    Silver S, Boiano J, Li J. Patient care aides: Differences in healthcare coverage, health-related behaviors, and health outcomes in a low-wage workforce by healthcare setting. Am J Ind Med. 2020;63(1):60-73. PMID: 31631375; https://doi.org/10.1002/ajim.23053.
    » https://doi.org/https://doi.org/10.1002/ajim.23053
  • 2.
    Elizabeth Marran J. Supporting staff who are second victims after adverse healthcare events. Nurs Manag (Harrow). 2019;26(6):36-43. PMID: 31777240; https://doi.org/10.7748/nm.2019.e1872.
    » https://doi.org/https://doi.org/10.7748/nm.2019.e1872
  • 3.
    DeLucia JA, Bitter C, Fitzgerald J, et al. Prevalence of Post-Traumatic Stress Disorder in Emergency Physicians in the United States. West J Emerg Med. 2019;20(5):740-6. PMID: 31539331; https://doi.org/10.5811/westjem.2019.7.42671.
    » https://doi.org/https://doi.org/10.5811/westjem.2019.7.42671
  • 4.
    van Steijn ME, Scheepstra KWF, Yasar G, et al. Occupational well-being in pediatricians-a survey about work-related posttraumatic stress, depression, and anxiety. Eur J Pediatr. 2019;178(5):681-93. PMID: 30783762; https://doi.org/10.1007/s00431-019-03334-7.
    » https://doi.org/https://doi.org/10.1007/s00431-019-03334-7
  • 5.
    Pereira-Lima K, Mata DA, Loureiro SR, et al. Association Between Physician Depressive Symptoms and Medical Errors: A Systematic Review and Meta-analysis. JAMA network open. 2019;2(11):e1916097. PMID: 31774520; https://doi.org/10.1001/jamanetworkopen.2019.16097.
    » https://doi.org/https://doi.org/10.1001/jamanetworkopen.2019.16097
  • 6.
    WHO. ICD-11: international statistical classification of diseases and related health problems: eleventh revision. QD85 Burnout. Geneva: World Health Organization; 2019 Available from: https://icd.who.int/browse11/l-m/en#/http://id.who.int/icd/entity/129180281 Accessed in 2021 (Sep 24).
    » https://icd.who.int/browse11/l-m/en#/http://id.who.int/icd/entity/129180281
  • 7.
    Garcia-Buades ME, Peiro JM, Montanez-Juan MI, Kozusznik MW, Ortiz-Bonnin S. Happy-Productive Teams and Work Units: A Systematic Review of the ‘Happy-Productive Worker Thesis’. Int J Environ Res Public Health. 2019;17(1). PMID: 31861812; https://doi.org/10.3390/ijerph17010069.
    » https://doi.org/https://doi.org/10.3390/ijerph17010069
  • 8.
    Mossburg SE, Dennison Himmelfarb C. The Association Between Professional Burnout and Engagement With Patient Safety Culture and Outcomes: A Systematic Review. Journal of patient safety. 2018. PMID: 29944601; https://doi.org/10.1097/pts.0000000000000519.
    » https://doi.org/https://doi.org/10.1097/pts.0000000000000519
  • 9.
    Oliveira AM, Silva MT, Galvao TF, Lopes LC. The relationship between job satisfaction, burnout syndrome and depressive symptoms: An analysis of professionals in a teaching hospital in Brazil. Medicine (Baltimore). 2018;97(49):e13364. PMID: 30544404; https://doi.org/10.1097/md.0000000000013364.
    » https://doi.org/https://doi.org/10.1097/md.0000000000013364
  • 10.
    Galvão TF, Lopes MCC, Oliva CCC, Araújo MEA, Silva MT. Patient safety culture in a university hospital. Rev Lat Am Enfermagem. 2018;26:e3014. PMID: 30110092; https://doi.org/10.1590/1518-8345.2257.3014.
    » https://doi.org/https://doi.org/10.1590/1518-8345.2257.3014
  • 11.
    de Lima Osório F, Vilela Mendes A, Crippa JA, Loureiro SR. Study of the discriminative validity of the PHQ-9 and PHQ-2 in a sample of Brazilian women in the context of primary health care. Perspect Psychiatr Care. 2009;45(3):216-27. PMID: 19566694; https://doi.org/10.1111/j.1744-6163.2009.00224.x.
    » https://doi.org/https://doi.org/10.1111/j.1744-6163.2009.00224.x
  • 12.
    Santos IS, Tavares BF, Munhoz TN, et al. Sensibilidade e especificidade do Patient Health Questionnaire-9 (PHQ-9) entre adultos da população geral [Sensitivity and specificity of the Patient Health Questionnaire-9 (PHQ-9) among adults from the general population]. Cad Saude Publica. 2013;29(8):1533-43. PMID: 24005919; https://doi.org/10.1590/0102-311x00144612.
    » https://doi.org/https://doi.org/10.1590/0102-311x00144612
  • 13.
    Carlotto MS, Câmara SG. Propriedades psicométricas do Maslach Burnout Inventory em uma amostra multifuncional. Estudos de Psicologia. 2007;24(3):325-32. https://doi.org/10.1590/S0103-166X2007000300004.
    » https://doi.org/https://doi.org/10.1590/S0103-166X2007000300004
  • 14.
    Souza AC, Milani D, Alexandre NMC. Adaptação cultural de um instrumento para avaliar a satisfação no trabalho. Rev Bras Saúde ocup. 2015;40(132):219-27. https://doi.org/10.1590/0303-7657000113715.
    » https://doi.org/https://doi.org/10.1590/0303-7657000113715
  • 15.
    de Carvalho RE, Cassiani SH. Cross-cultural adaptation of the Safety Attitudes Questionnaire - Short Form 2006 for Brazil. Rev Lat Am Enfermagem. 2012;20(3):575-82. PMID: 22991121.
  • 16.
    Associação Brasielira de Empresas de Pesquisa (ABEP). Critério Brasil 2015 e atualização da distribuição de classes para 2016. São Paulo: ABEP; 2016. Available from: http://www.abep.org/criterio-brasil Acessed in 2021 (Sep 24).
    » http://www.abep.org/criterio-brasil
  • 17.
    Cadastro Nacional de Estabelecimentos de Saúde (CNES). Informações de Saúde (TABNET) Rede Assistencial. Brasília: DATASUS; 2015. Available from: http://cnes.datasus.gov.br/ Accessed in 2021 (Sep 24).
    » http://cnes.datasus.gov.br/
  • 18.
    Hair JF, Hult GTM, Ringle CM, Sarstedt M. A primer on partial least squares structural equation modeling (PLS-SEM). Los Angeles (CA): SAGE Publications; 2014.
  • 19.
    Silva MT, Caicedo Roa M, Martins SS, da Silva ATC, Galvao TF. Prevalence and correlates of depressive symptoms among adults living in the Amazon, Brazil: A population-based study. J Affect Disord. 2017;222:162-8. PMID: 28709023; https://doi.org/10.1016/j.jad.2017.06.053.
    » https://doi.org/https://doi.org/10.1016/j.jad.2017.06.053
  • 20.
    Woo T, Ho R, Tang A, Tam W. Global prevalence of burnout symptoms among nurses: A systematic review and meta-analysis. J Psychiatr Res. 2020;123:9-20. PMID: 32007680; https://doi.org/10.1016/j.jpsychires.2019.12.015.
    » https://doi.org/https://doi.org/10.1016/j.jpsychires.2019.12.015
  • 21.
    Rotenstein LS, Torre M, Ramos MA, et al. Prevalence of Burnout Among Physicians: A Systematic Review. JAMA. 2018;320(11):1131-50. PMID: 30326495; https://doi.org/10.1001/jama.2018.12777.
    » https://doi.org/https://doi.org/10.1001/jama.2018.12777
  • 22.
    Kim W, Kim TH, Lee TH, et al. Temporary work and depressive symptoms in South Korean workers. Occup Med (Lond). 2017;67(6):421-4. PMID: 28486680; https://doi.org/10.1093/occmed/kqx050.
    » https://doi.org/https://doi.org/10.1093/occmed/kqx050
  • 23.
    Lacaz FAC. The (Counter) Labor Reform: Law 13,467/2017, a disaster for Workers’ Health. Cien Saude Colet. 2019;24(3):680. PMID: 30892490; https://doi.org/10.1590/1413-81232018243.01452019.
    » https://doi.org/https://doi.org/10.1590/1413-81232018243.01452019
  • 24.
    de Souza LEPF. The right to health in Brazil: A Constitutional guarantee threatened by fiscal austerity. J Public Health Policy. 2017;38(4):493-502. PMID: 28659606; https://doi.org/10.1057/s41271-017-0083-y.
    » https://doi.org/https://doi.org/10.1057/s41271-017-0083-y
  • 25.
    Oliveira FPd, Mazzaia MC, Marcolan JF. Symptoms of depression and intervening factors among nurses of emergency hospital services. Acta Paulista De Enfermagem. 2015;28:209-15. https://doi.org/10.1590/1982-0194201500036.
    » https://doi.org/https://doi.org/10.1590/1982-0194201500036
  • 26.
    Cruz Robazzi MLC, Chaves Mauro MY, Barcellos Dalri RCM, et al. Exceso de trabajo y agravios mentales a los trabajadores de la salud. Rev Cubana Enferm. 2010;26(1):52-64.
  • 27.
    Shu Q, Cai M, Tao HB, et al. What Does a Hospital Survey on Patient Safety Reveal About Patient Safety Culture of Surgical Units Compared With That of Other Units? Medicine (Baltimore). 2015;94(27):e1074. PMID: 26166083; https://doi.org/10.1097/md.0000000000001074.
    » https://doi.org/https://doi.org/10.1097/md.0000000000001074
  • 28.
    Hamdan M, Saleem AA. Assessment of patient safety culture in Palestinian public hospitals. Int J Qual Health Care. 2013;25(2):167-75. PMID: 23382367; https://doi.org/10.1093/intqhc/mzt007.
    » https://doi.org/https://doi.org/10.1093/intqhc/mzt007
  • 29.
    Wami SD, Demssie AF, Wassie MM, Ahmed AN. Patient safety culture and associated factors: A quantitative and qualitative study of healthcare workers’ view in Jimma zone Hospitals, Southwest Ethiopia. BMC Health Serv Res. 2016;16:495. PMID: 27644960; https://doi.org/10.1186/s12913-016-1757-z.
    » https://doi.org/https://doi.org/10.1186/s12913-016-1757-z
  • 30.
    Teles M, Kaya S. Staff perceptions of patient safety culture in general surgery departments in Turkey. Afr Health Sci. 2019;19(2):2208-18. PMID: 31656506; https://doi.org/10.4314/ahs.v19i2.46.
    » https://doi.org/https://doi.org/10.4314/ahs.v19i2.46
  • 31.
    Okuyama JHH, Galvao TF, Silva MT. Healthcare Professional’s Perception of Patient Safety Measured by the Hospital Survey on Patient Safety Culture: A Systematic Review and Meta-Analysis. TheScientificWorldJournal. 2018;2018:9156301. PMID: 30104917; https://doi.org/10.1155/2018/9156301.
    » https://doi.org/https://doi.org/10.1155/2018/9156301
  • 32.
    Carney BT, Mills PD, Bagian JP, Weeks WB. Sex differences in operating room care giver perceptions of patient safety: a pilot study from the Veterans Health Administration Medical Team Training Program. Qual Saf Health Care. 2010;19(2):128-31. PMID: 20142406; https://doi.org/10.1136/qshc.2008.028233.
    » https://doi.org/https://doi.org/10.1136/qshc.2008.028233
  • 33.
    Hess U, David S, Hareli S. Emotional restraint is good for men only: The influence of emotional restraint on perceptions of competence. Emotion. 2016;16(2):208-13. PMID: 26461250; https://doi.org/10.1037/emo0000125.
    » https://doi.org/https://doi.org/10.1037/emo0000125
  • 34.
    Beltrán Salazar OA. Humanized care: A relationship of familiarity and affectivity. Invest Educ Enferm. 2015;33(1):17-27. PMID: 26148152: https://doi.org/10.1590/S0120-53072015000100003.
    » https://doi.org/https://doi.org/10.1590/S0120-53072015000100003
  • 35.
    Hauret L, Williams DR. Relative income and pay satisfaction: Further evidence on the role of the reference group. Journal of Happiness Studies. 2019;20(1):307-29. https://doi.org/10.1007/s10902-017-9950-2.
    » https://doi.org/https://doi.org/10.1007/s10902-017-9950-2
  • 36.
    Hoff T, Carabetta S, Collinson GE. Satisfaction, Burnout, and Turnover Among Nurse Practitioners and Physician Assistants: A Review of the Empirical Literature. Med Care Res Rev. 2019;76(1):3-31. PMID: 28901205; https://doi.org/10.1177/1077558717730157.
    » https://doi.org/https://doi.org/10.1177/1077558717730157
  • 37.
    Nevanperä NJ, Hopsu L, Kuosma E, et al. Occupational burnout, eating behavior, and weight among working women. Am J Clin Nutr. 2012;95(4):934-43. PMID: 22378728; https://doi.org/10.3945/ajcn.111.014191.
    » https://doi.org/https://doi.org/10.3945/ajcn.111.014191
  • 38.
    Armon G, Shirom A, Berliner S, Shapira I, Melamed S. A prospective study of the association between obesity and burnout among apparently healthy men and women. J Occup Health Psychol. 2008;13(1):43-57. PMID: 18211168; https://doi.org/10.1037/1076-8998.13.1.43.
    » https://doi.org/https://doi.org/10.1037/1076-8998.13.1.43
  • 39.
    Milaneschi Y, Simmons WK, van Rossum EFC, Penninx BW. Depression and obesity: evidence of shared biological mechanisms. Mol Psychiatry. 2019;24(1):18-33. PMID: 29453413; https://doi.org/10.1038/s41380-018-0017-5.
    » https://doi.org/https://doi.org/10.1038/s41380-018-0017-5
  • 40.
    Kashani K, Carrera P, De Moraes AG, et al. Stress and burnout among critical care fellows: preliminary evaluation of an educational intervention. Med Educ Online. 2015;20:27840. PMID: 26208706.
  • Hospital Universitário Getúlio Vargas (HUGV), Universidade Federal do Amazonas (UFAM), Manaus (AM), Brazil
  • Sources of funding: TFG received a productivity scholarship from the National Council for Scientific and Technological Development (CNPq; grant 310238/2020-0). The present publication was partially supported by the Amazonas Research Foundation (FAPEAM) support program for paper publishing (PAPAC, call no. 015/2014, grant 139/2015, awarded to TFG)

Publication Dates

  • Publication in this collection
    29 Apr 2022
  • Date of issue
    May-Jun 2022

History

  • Received
    12 July 2021
  • Reviewed
    12 July 2021
  • Accepted
    15 Sept 2021
Associação Paulista de Medicina - APM APM / Publicações Científicas, Av. Brigadeiro Luís Antonio, 278 - 7º and., 01318-901 São Paulo SP - Brazil, Tel.: +55 11 3188-4310 / 3188-4311, Fax: +55 11 3188-4255 - São Paulo - SP - Brazil
E-mail: revistas@apm.org.br