ABSTRACT
OBJECTIVE
To identify the prevalence of and factors associated with: (1) major depressive episodes; (2) minor psychiatric disorders (MPDs); and (3) suicidal ideation among nursing professionals from a municipality in southern Brazil.
METHODS
Using a cross-sectional design, we recruited 890 nursing professionals linked to 50 Primary Care units, 2 walk-in clinics, 2 hospital services, 1 emergency room service, 1 mobile emergency care service, and 1 teleconsultation service, in addition to the municipal epidemiological surveillance service and the vacancy regulation center between June and July 2020. We used the Patient Health Questionnaire-9 and the Self-Reporting Questionnaire to evaluate the studied outcomes. Associations between the outcomes and variables related to sociodemographic profile, work, health conditions, and daily life were explored using Poisson regression models with robust variance estimators.
RESULTS
The observed prevalence of depression, MPDs, and suicidal ideation were 36.6%, 44%, and 7.4%, respectively. MPDs were associated with the assessment of support received by the service as ‘regular’ (PR: 1.48; 95% CI: 1.19–1.85) or ‘poor’ (PR: 1.54; 95% CI: 1.23–1.94), with a reported moderate (PR: 1.63; 95% CI: 1.29–2.07), or heavy (PR: 2.54; 95% CI: 2.05–3.15) workload, and with suspected COVID-19 infection (PR: 1.44; 95% CI: 1.25–1.66). Major depressive episodes were associated with a reported lack of personal protective equipment (PR: 1.20; 95% CI: 1.01–1.42), whereas suicidal ideation was inversely related to per capita income > 3 minimum monthly wages (PR: 0.28; 95% CI: 0.11–0.68), and positively related to the use of psychotropic drugs (PR: 3.14; 95% CI: 1.87–5.26).
CONCLUSION
Our results suggest that nursing professionals’ working conditions are associated with their mental health status. The need to improve working conditions through adequate dimensioning, support and proper biosafety measures is only heightened in the context of the COVID-19 pandemic.
Nursing, Team, psychology; COVID-19, nursing; Mental Disorders, epidemiology; Mental Health; Occupational Health; Cross-Sectional Studies
INTRODUCTION
The COVID-19 pandemic has challenged health systems worldwide11. World Health Organization. Coronavirus Disease (COVID-19): events as they happen. Geneva (CH): WHO; 2020 [cited 2020 Oct 29]. Available from: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/events-as-they-happen
https://www.who.int/emergencies/diseases...
. Nursing professionals constitute approximately half of the global health workforce22. World Health Organization. Global strategic directions for strengthening nursing and midwifery 2016-2020. Geneva (CH): WHO; 2016 [cited 2020 Oct 29]. Available from: https://www.who.int/hrh/nursing_midwifery/global-strategic-midwifery2016-2020.pdf
https://www.who.int/hrh/nursing_midwifer...
, and in the current pandemic, they perform the majority of tasks related to preventing and containing infections. Nursing professionals’ role in caring for COVID-19-infected patients and patients’ family members may have negative consequences to their mental health33. Hu D, Kong Y, Li W, Han Q, Zhang X, Zhu LX, et al. Frontline nurses’ burnout, anxiety, depression, and fear statuses and their associated factors during the COVID-19 outbreak in Wuhan, China: a large-scale cross-sectional study. EClinicalMedicine. 2020;24:100424. https://doi.org/10.1016/j.eclinm.2020.100424
https://doi.org/10.1016/j.eclinm.2020.10...
.
Increasing COVID-19 cases have coincided with increased workloads, particularly for front-line healthcare professionals. Recognizing potential adverse effects on the mental health of these professionals has instigated research efforts in several countries. Findings, such as the high prevalence of depression, anxiety, sleep disorders, and Minor Psychiatric Disorders (MPDs), stand out44. Chen Q, Liang M, Li Y, Guo J, Fei D, Wang L, et al. Mental health care for medical staff in China during the COVID-19 outbreak. Lancet Psychiatry. 2020;7(4):e15-16. https://doi.org/10.1016/S2215-0366(20)30078-X
https://doi.org/10.1016/S2215-0366(20)30...
, and some studies point to a higher prevalence of these outcomes among nursing professionals88. Hacimusalar Y, Kahve AA, Yasar AB, Aydin MB. Anxiety and hopelessness levels in COVID-19 pandemic: a comparative study of healthcare professionals and other community sample in Turkey. J Psychiatric Res. 2020;129:181-8. https://doi.org/10.1016/j.jpsychires.2020.07.024
https://doi.org/10.1016/j.jpsychires.202...
, 99. Zhu Z, Xu S, Wang H. COVID-19 in Wuhan: immediate psychological impact on 5062 health workers. EClinical Medicine.2020 [cited 2020 Oct 29];24:100443. Available from: https://www.thelancet.com/pdfs/journals/eclinm/PIIS2589-5370(20)30187-5.pdf
https://www.thelancet.com/pdfs/journals/...
. In a comparison of reported hopelessness and anxiety among nurses, doctors, and other health professionals, we observed that nurses’ hopelessness and anxiety levels were significantly higher than the other two groups88. Hacimusalar Y, Kahve AA, Yasar AB, Aydin MB. Anxiety and hopelessness levels in COVID-19 pandemic: a comparative study of healthcare professionals and other community sample in Turkey. J Psychiatric Res. 2020;129:181-8. https://doi.org/10.1016/j.jpsychires.2020.07.024
https://doi.org/10.1016/j.jpsychires.202...
.
Daily challenges experienced by nursing professionals are exacerbated by a myriad of psychological stressors during the COVID-19 pandemic, such as high workload, lack of knowledge on the disease, lack of adequate personal protective equipment, and fear of becoming infected and/or infecting loved ones33. Hu D, Kong Y, Li W, Han Q, Zhang X, Zhu LX, et al. Frontline nurses’ burnout, anxiety, depression, and fear statuses and their associated factors during the COVID-19 outbreak in Wuhan, China: a large-scale cross-sectional study. EClinicalMedicine. 2020;24:100424. https://doi.org/10.1016/j.eclinm.2020.100424
https://doi.org/10.1016/j.eclinm.2020.10...
, 44. Chen Q, Liang M, Li Y, Guo J, Fei D, Wang L, et al. Mental health care for medical staff in China during the COVID-19 outbreak. Lancet Psychiatry. 2020;7(4):e15-16. https://doi.org/10.1016/S2215-0366(20)30078-X
https://doi.org/10.1016/S2215-0366(20)30...
, 1010. Greenberg N, Tracy D. What healthcare leaders need to do to protect the psychological well-being of frontline staff in the COVID-19 pandemic. BMJ Leader. 2020 May:leader-2020-000273. https://doi.org/10.1136/leader-2020-000273
https://doi.org/10.1136/leader-2020-0002...
, 1111. Williamson V, Greenberg N, Bowden G, Rothenfluh D, Nnadi C, Reynolds J. The mental health impact of providing spine care during COVID-19. Spine J. 2020;20(9):1363-6. https://doi.org/10.1016/j.spinee.2020.04.019
https://doi.org/10.1016/j.spinee.2020.04...
. In one study, nursing professionals demonstrated a prevalence of 53.5%, 47%, and 38.2% for depression, anxiety, and insomnia, respectively, which were high in comparison to other professionals66. Lai J, Ma S, Wang Y, Ca Z, Hu J, Wei N, et al. Factors associated with mental health outcomes among health care workers exposed to Coronavirus Disease 2019. JAMA Network Open. 2020;3(3):e203976. https://doi.org/10.1001/jamanetworkopen.2020.3976
https://doi.org/10.1001/jamanetworkopen....
.
Despite the high number of recently published studies on health professionals’ mental health in the context of the pandemic, more high-quality investigations are needed. Several published studies on this topic did not employ explicit sample frames and/or had low response rates, which challenges the representativeness of their results1212. Lamb D, Greenberg N, Stevelink S, Wessely S. Mixed signals about the mental health of the NHS workforce. Lancet Psychiatry. 2020;7(12):1009-11. https://doi.org/10.1016/S2215-0366(20)30379-5
https://doi.org/10.1016/S2215-0366(20)30...
.
In order to increase the evidence base, this study sought to identify the prevalence of, and factors associated with: (1) major depressive episodes; (2) MPDs; and (3) suicidal ideation among nursing professionals from Pelotas, a municipality in the state of Rio Grande do Sul, in southern Brazil. We hypothesized that nursing professionals working in the front lines of the pandemic and those who reported experiencing inadequate working conditions would be more likely to present with adverse mental health outcomes.
METHODS
Study Design and Sample
We conducted a cross-sectional study from June to July 2020 with nursing professionals from the municipality of Pelotas (population: 343,132), which serves as a health service and technology reference for 21 other small cities in the surrounding area1313. Conselho das Secretarias Municipais de Saúde do Rio Grande do Sul. Regiões de Saúde do Rio Grande do Sul. Porto Alegre, RS: Cosemsrs; 2020 [cited 2020 Oct 29]. Available from: https://www.cosemsrs.org.br/regioes-de-saude
https://www.cosemsrs.org.br/regioes-de-s...
. We recruited participants through services aimed at combating the pandemic; namely, 50 Primary Care units, 2 walk-in clinics, 2 hospital services, 1 emergency room service, 1 mobile emergency care service, and 1 teleconsultation service, in addition to the municipal epidemiological surveillance service and the vacancy regulation center. According to the city’s Municipal Health Department, a total of 1,297 nursing professionals worked in these services.
Inclusion criteria for the study were employment as a nursing professional, aging > 18 years, holding a registration with the Regional Nursing Council (COREN), and attending a current employment in a service actively combating the COVID-19 pandemic in the municipality of Pelotas. Exclusion criteria were being on vacation or otherwise absent from work during the data collection period. In addition, a total of 21 professionals who did not provide valid contact information were excluded.
Data collection was conducted using an online, self-administered questionnaire. If they agreed to participate, the nursing professionals were contacted about joining the study and were sent a link to the questionnaire. However, they were required to read and sign an informed consent form before receiving access to begin the questionnaire. This explained the purpose of the study, the participant’s right to decline participation or cease participation at any time, and their right to remain anonymous.
Thus, a total of 944 successful contacts were made among 1,186 eligible professionals; 242 individuals could not be reached. Finally, 54 of those successfully contacted declined to participate, resulting in a 75% response rate (n = 890).
Measures
The frequency of depressive symptoms in the past 2 weeks was assessed using the 9-question Patient Health Questionnaire (PHQ-9). This instrument scores responses from 0 to 3, and according to a validation study for the general Brazilian population1414. Santos IS, Tavares BF, Munhoz TN, Almeida LSP, Silva NTB, Tams BD, et al. Sensibilidade e especificidade do Patient Health Questionnaire-9 (PHQ-9) entre adultos da população geral. Cad Saude Publica. 2013;29(8):1533-43. https://doi.org/10.1590/0102-311X00144612
https://doi.org/10.1590/0102-311X0014461...
, a score ≥ 9 provides the highest sensitivity (77.5%; 61.5–89.2) and specificity (86.7%; 83.0–89.9) for screening for major depressive episodes.
The presence of MPDs was assessed using the 20-item Self-Reporting Questionnaire (SRQ-20). The SRQ-20 was also validated for use in Brazil1515. Santos KO, Araújo TM, Pinho PDS, Silva ACC. Avaliação de um instrumento de mensuração de morbidade psíquica: estudo de validação do Self-Reporting Questionnaire (SRQ-20). Rev Baiana Saude Publica. 2011 [cited 2020 Oct 29];34(3):544-60. Available from: http://files.bvs.br/upload/S/0100-0233/2010/v34n3/a1881.pdf
http://files.bvs.br/upload/S/0100-0233/2...
, and it includes questions on anxiety, depression, and somatic symptoms. All questions are answered with “yes” (1 point) or “no” (0 points), with the highest score being 20 points, and 7 points, identifying the presence or absence of the outcome.
Consistent with previous studies conducted in Brazil1616. Treichel CAS, Jardim VMR, Kantorski LP, Lima MG. Prevalence and factors associated with suicidal ideation among family caregivers of people with mental disorders. J Clin Nurs. 2019;28(19-20):3470-7. https://doi.org/10.1111/jocn.14938
https://doi.org/10.1111/jocn.14938...
, question 17 of the SRQ-20 instrument was used to screen suicidal ideation. The question asked if the individual “has ever thought about ending their life” in the past 30 days. Suicidal ideation was considered present in participants who answered affirmatively to this question.
Covariates
Sociodemographic and other COVID-19-related background data were collected using a questionnaire developed by our team. Sociodemographic data consisted of: gender; ethnicity; age; education level; per capita income; type of service; length of service in the nursing field and at the institution; nursing category; workload; information on secondary employment, if applicable; COVID-19-specific training; evaluations of working conditions and support at work; currently perceived burden, and a comparison of burden pre- and post-pandemic period; involvement level with COVID-19 cases; the proportion of the workload involving COVID-19 cases; lack of Personal Protective Equipment (PPE); suspected COVID-19 infection; absence from work due to suspected infection; family members or close friends diagnosed with COVID-19; degree of social distancing/isolation; belonging to the risk group (i.e. those with comorbidities, such as hypertension, diabetes, chronic heart, or respiratory disease, as well as those who had undergone a transplant or were using immunosuppressive drugs); problems with or abuse of alcohol or tobacco; and current use of psychotropic drugs.
Statistical Analysis
Statistical analyses were conducted using the Stata 16 software program (Stata Corporation, College Station, Texas USA). The prevalence of depression, MPDs, and suicidal ideation were calculated for the full sample and by covariate. Associations of depression, MPDs, and suicidal ideation with the studied covariates were tested using unadjusted and adjusted Poisson regression models with robust variance estimators. The forward stepwise selection was used to select covariates for inclusion in the adjusted analysis following the criterion p ≤ 0.201717. Maldonado G, Greenland S. Simulation study of confounder-selection strategies. Am J Epidemiol. 1993;138(11):923-36. https://doi.org/10.1093/oxfordjournals.aje.a116813
https://doi.org/10.1093/oxfordjournals.a...
.
Potential confounders common to the three outcomes studied (i.e. depression, MPDs, and suicidal ideation) were initially identified. These confounders were gender, age, and per capita income, which composed the first model (model 1) for which each variable was adjusted for each outcome. Next, the confounders for each outcome were identified and a model to adjust the studied variables related to each outcome was created. In Model 2, the dependent variable was major depressive episodes and the covariates entered as potential confounders were gender, age, education, per capita income, evaluation of support at work, burden, lack of PPE, suspected COVID-19 infection, use of tobacco, and use of psychotropic drugs.
The dependent variable in Model 3 was MPD and covariates entered as potential confounders were gender, age, per capita income, evaluation of support at work, burden, suspected COVID-19 infection, use of tobacco, and use of psychotropic drugs. Finally, the dependent variable in Model 4 was suicidal ideation, and covariates included as potential confounders were per capita income, length of service at the institution, workload, secondary employment, evaluation of conditions at work, comparison of burden pre- and post-pandemic, diagnosis of COVID-19 in a family member or close friend, problems with alcohol, and the use of psychotropic drugs.
Ethical Procedures
The study was reviewed and approved by the Ethics Research Committee in accordance with Brazilian guidelines and standards regulating research involving human beings (Resolution 466/2012) and the Declaration of Helsinki. Ethical principles were upheld as subjects were informed of their right to not participate in the research upon first contact, and a fully informed consent form was signed by all participants. As part of the informed consent process, participants agreed for their anonymized data to be disclosed for scientific purposes. This study adhered to the Guidelines for Strengthening the Reporting of Observational Studies in Epidemiology (STROBE).
RESULTS
Characterization of Participants
A total of 944 successful contacts were made among 1,186 eligible professionals; 242 individuals could not be reached because their contact information was either incorrect or no answers were obtained after 10-call attempts on different days, according to a pre-established data collection protocol. In addition, 54 of those successfully contacted declined to participate, resulting in a 75% response rate (n = 890).
Table 1 shows descriptive statistics for the 890 nursing professionals who completed the online questionnaire . In the final sample, 319 (35.8%) were registered nurses, 501 (56.3%) were nursing technicians, and 70 (7.9%) were nursing assistants. Most participants were female (n = 755, 84.8%), and the average age was 40.4 years (SD = 8.58). The majority of participants work in a hospital service (n = 577, 64.8%) or in Primary Care (n = 92, 10.3%). Variables with missing data were per capita income (n = 80) and length of service at the institution (n = 5).
Descriptive statistics for the sample of nursing professionals included in the study (n = 890) (Pelotas-RS, 2020).
Major Depressive Episodes
Screening indicated a prevalence of 36.6% for major depressive episodes among study participants. Table 2 shows the prevalence of this outcome in association with the study variables of interest and unadjusted and adjusted prevalence ratios.
We observed evidence of an inverse association between screening positive for major depressive episodes and being male (PR: 0.66; 95% CI: 0.48–0.91), aging between 41 and 50 (PR: 0.69; 95% CI: 0.53–0.91), or above 51 years of age (PR: 0.55; 95% CI: 0.38–0.80). A lower prevalence ratio was associated with higher income, for example, professionals whose per capita income was greater than three minimum monthly wage (PR: 0.58 (95% CI: 0.44–0.77).
Having up to one-third of the workload devoted to caring for patients with COVID-19 was inversely associated with major depressive episodes (PR: 0.77; 95% CI: 0.59–0.99). However, no associations were observed in cases where nursing professionals reported dedicating more than one-third of their workload to pandemic-related duties. At the same time, we found evidence for associations among major depressive episodes; having a graduate-level education (PR: 1.26; 95% CI: 1.03–1.56); assessing support from the service as regular (PR: 1.46; 95% CI: 1.14–1.86), or poor (PR: 1.33; 95% CI: 1.03–1.72); reporting a moderate (PR: 1.67; 95% CI: 1.27–2.18) or heavy (PR: 2.77; 95% CI: 2.16–3.54) burden at work; lack of PPE (PR: 1.20; 95% CI: 1.01–1.42); suspected COVID-19 infection (PR: 1.29; 95% CI: 1.09–1.53); use of tobacco (PR: 1.32; 95% CI: 1.07–1.62); and current use of psychotropic drugs (PR: 1.59; 95% CI: 1.34–1.89).
In the model where the adjustment was performed for all potential confounders related to the outcome, the variable related to the evaluation of working conditions showed an association direction contrary to that observed in the crude analysis and in the first model. This appeared to be due to the influence of the variable assessing support received at work. Following the removal of the support variable, however, the working conditions variable was not associated with the outcome, adjusting for other confounders.
Minor Psychiatric Disorders (MPDs)
The prevalence of MPDs in the sample was 43.9% (n = 391). Table 3 shows the prevalence of this outcome in association with the study variables of interest and unadjusted and adjusted prevalence ratios.
Similar to the major depressive episode outcome, we observed an inverse association between screening for MPDs and the male gender (PR: 0.57; 95% CI: 0.42–0.77), aging between 41 and 50 years (PR: 0.71; 95% CI: 0.56–0.90), or above 51 years of age (PR: 0.56; 95% CI: 0.40–0.78). A lower prevalence ratio of MPD was also found for professionals working in emergency services (PR: 0.68; 95% CI: 0.47–0.97), and for those whose per capita income was up to three minimum monthly (PR: 0.81; 95% CI: 0.66–0.99), or greater than three minimum monthly wages (PR: 0.79; 95% CI: 0.64–0.98).
We found evidence for positive associations of MPD with the following variables: assessment of support received by the service as regular (PR: 1.48; 95% CI: 1.19–1.85) or poor (PR: 1.54; 95% CI: 1.23–1.94); reported moderate (PR: 1.63; 95% CI: 1.29-2.07) or heavy (PR: 2.54; 95% CI: 2.05–3.15) burden at work; suspected COVID-19 infection (PR: 1.44; 95% CI: 1.25–1.66); current use of psychotropic drugs (PR: 1.34; 95% CI: 1.15–1.57); and tobacco use (PR: 1.22; 95% CI: 1.03–1.45).
Suicidal Ideation
The prevalence of suicidal ideation in our sample in the 30 days prior to completing the questionnaire was 7.4% (n = 66). Table 4 shows the prevalence of this outcome in association with the study variables of interest and unadjusted and adjusted prevalence ratios.
In the model where the adjustment was performed for all potential confounders related to the outcome, suicidal ideation showed a strong positive association with psychotropic drug use (PR: 3.14; 95% CI: 1.87–5.26), but this outcome was inversely correlated with having a per capita income greater than three minimum monthly wages (PR: 0.28; 95% CI: 0.11–0.68). When only adjusted for gender, age, and per capita income, suicidal ideation was also associated with assessing one’s working conditions as poor (PR: 2.16; 96% CI: 1.13–4.13), reporting a heavy burden at work (PR: 1.93; 95% CI: 1.08–3.43), reporting increased burden post-pandemic (PR: 2.03; 95% CI: 1.13–3.64), and problems with alcohol (PR: 2.56; 95% CI: 1.31–4.96).
DISCUSSION
The COVID-19 pandemic has had substantial negative effects on the mental health of many healthcare professionals. This study aimed to identify factors associated with mental health outcomes to develop strategies for mitigation. Importantly, our study design included a well-defined sample frame and strict recruitment protocol, thus meeting recommendations emerging from the field1212. Lamb D, Greenberg N, Stevelink S, Wessely S. Mixed signals about the mental health of the NHS workforce. Lancet Psychiatry. 2020;7(12):1009-11. https://doi.org/10.1016/S2215-0366(20)30379-5
https://doi.org/10.1016/S2215-0366(20)30...
.
The results notably indicated a high prevalence of major depressive episodes (36.6%) and MPDs (43.9%) in our sample, thus pointing to the need for interventions to promote mental health among nursing professionals.
However, the instruments used to track these outcomes vary among studies. For example, some authors have used the Patient Health Questionnaire-9 (PHQ-9)66. Lai J, Ma S, Wang Y, Ca Z, Hu J, Wei N, et al. Factors associated with mental health outcomes among health care workers exposed to Coronavirus Disease 2019. JAMA Network Open. 2020;3(3):e203976. https://doi.org/10.1001/jamanetworkopen.2020.3976
https://doi.org/10.1001/jamanetworkopen....
, the Zung Self-Rating Depression Scale (SDS)1818. Liu CY, Yang YZ, Zhang XM, Xu X, Dou QL, Zhang WW, et. al. The prevalence and influencing factors in anxiety in medical workers fighting COVID-19 in China: a cross-sectional survey. Epidemiol Infect. 2020;148:e98. https://doi.org/10.1017/S0950268820001107
https://doi.org/10.1017/S095026882000110...
, and the Hamilton Depression Scale (HAMD)1919. Lu W, Wang H, Lin Y, Li L. Psychological status of medical workforce during the COVID-19 pandemic: a cross-sectional study. Psychiatry Res. 2020;288:112936. https://doi.org/10.1016/j.psychres.2020.112936
https://doi.org/10.1016/j.psychres.2020....
(among others) to screen for depression among healthcare professionals since the pandemic began.
The prevalence of depression found in the current study was higher than that reported among other studies using the PHQ-9 [(12.2%)2020. Zhang C, Yang L, Liu S, Ma S, Wang Y, Cai Z, et al. Survey of insomnia and related social psychological factors among medical staff involved in the 2019 novel coronavirus disease outbreak. Front Psychiatry. 2020;11:306. https://doi.org/10.3389/fpsyt.2020.00306
https://doi.org/10.3389/fpsyt.2020.00306...
and (13.5%)99. Zhu Z, Xu S, Wang H. COVID-19 in Wuhan: immediate psychological impact on 5062 health workers. EClinical Medicine.2020 [cited 2020 Oct 29];24:100443. Available from: https://www.thelancet.com/pdfs/journals/eclinm/PIIS2589-5370(20)30187-5.pdf
https://www.thelancet.com/pdfs/journals/...
], but lower than the results observed by one study (50.4%)66. Lai J, Ma S, Wang Y, Ca Z, Hu J, Wei N, et al. Factors associated with mental health outcomes among health care workers exposed to Coronavirus Disease 2019. JAMA Network Open. 2020;3(3):e203976. https://doi.org/10.1001/jamanetworkopen.2020.3976
https://doi.org/10.1001/jamanetworkopen....
. However, our results were similar to the pooled prevalence calculated in a meta-analysis which included the above three studies: 36.7% (95% CI: 7.7–69.2, I22. World Health Organization. Global strategic directions for strengthening nursing and midwifery 2016-2020. Geneva (CH): WHO; 2016 [cited 2020 Oct 29]. Available from: https://www.who.int/hrh/nursing_midwifery/global-strategic-midwifery2016-2020.pdf
https://www.who.int/hrh/nursing_midwifer...
= 100%)77. Pappa S, Ntella V, Giannakas T, Giannakoulis VG, Papoutsi E, Katsaounou P. Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: a systematic review and meta-analysis. Brain Behav Immun. 2020;88:901-7. https://doi.org/10.1016/j.bbi.2020.05.026
https://doi.org/10.1016/j.bbi.2020.05.02...
.
The results reported herein suggest that pre- and post-pandemic depression prevalence is significantly higher among nursing professionals than in the general population. In a population-based study conducted before the pandemic in the same municipality (Pelotas), the prevalence of depression was 19.0% (CI: 15.4–22.7)1414. Santos IS, Tavares BF, Munhoz TN, Almeida LSP, Silva NTB, Tams BD, et al. Sensibilidade e especificidade do Patient Health Questionnaire-9 (PHQ-9) entre adultos da população geral. Cad Saude Publica. 2013;29(8):1533-43. https://doi.org/10.1590/0102-311X00144612
https://doi.org/10.1590/0102-311X0014461...
. In a cross-sectional online survey conducted among the general population in China, a prevalence of 20.1% (CI: 19.2–21.0) was reported55. Huang Y, Zhao N. Generalized anxiety disorder, depressive symptoms and sleep quality during COVID-19 outbreak in China: a web-based cross-sectional survey. Psychiatry Res. 2020;288:112954. https://doi.org/10.1016/j.psychres.2020.112954
https://doi.org/10.1016/j.psychres.2020....
.
During the pre-pandemic period in Brazil, studies reported depression prevalence of 21.3% and 27%, respectively2121. Junqueira MAB, Santos MA, Araújo LB, Ferreira MCM, Giuliani CD, Pillon SC. et al. Depressive symptoms and drug use among nursing staff professionals. Esc Anna Nery. 2018;22(4):e20180129. https://doi.org/10.1590/2177-9465-EAN-2018-0129
https://doi.org/10.1590/2177-9465-EAN-20...
, 2222. Freire FO, Marcon SR, Espinosa MM, Santos HGB, Kogien M, Lima NVP, et al. Factors associated with suicide risk among nurses and physicians: a cross-section study. Rev Bras Enferm. 2020;73 Suppl 1:e20200352. https://doi.org/10.1590/0034-7167-2020-0352
https://doi.org/10.1590/0034-7167-2020-0...
. This suggests a potentially greater occurrence of depressive episodes among nursing professionals during the pandemic. However, few studies to date have compared results obtained from the same sample of nurses both before and during the pandemic.
Our results similarly suggest a greater occurrence of MPDs among the nursing professionals in our sample than both the general population and nursing professionals working in other countries (both pre and post-pandemic). Our results are similar to those found among Pakistani doctors, in whom a MPD prevalence of 42.7% was found using the SRQ-202323. Amin F, Sharif S, Saeed R, Durranni N, Jilani D. COVID-19 pandemic- knowledge, perception, anxiety and depression among frontline doctors of Pakistan. BMC Psychiatry. 2020;20:459. https://doi.org/10.1186/s12888-020-02864-x
https://doi.org/10.1186/s12888-020-02864...
.
Two studies conducted in the pre-pandemic period among Brazilian nurses suggested the prevalence of MPD was 33.3%2424. Alves AP, Pedrosa LAK, Coimbra MAR, Miranzi MAS, Hass VJ. Prevalência de transtornos mentais comuns entre profissionais de saúde. Rev Enferm UERJ. 2015;23(1):64-9. https://doi.org/10.12957/reuerj.2015.8150
https://doi.org/10.12957/reuerj.2015.815...
and 35%2525. Rodrigues E, Rodrigues U, Oliveira L, Laudano R, Nascimento Sobrinho C. [Prevalence of common mental disorders in nursing workers at a hospital of Bahia]. Rev Bras Enferm. 2014;67(2):296-301. Portuguese. https://doi.org/10.5935/0034-7167.20140040
https://doi.org/10.5935/0034-7167.201400...
. We emphasize again the methodological variability among studies tracking these mental health outcomes both before and during the pandemic period.
We found a suicidal ideation prevalence of 7.4% in our sample. This is higher than that found for 12 months in a population-based study in Brazil conducted in 2003 but lower than that found for 30 days among the general population of the United States of America (10.7%) during the COVID-19 pandemic2626. Czeisler ME, Lane RI, Petrosky E, Wiley JF, Christensen A, Njai R, et al. Mental health, substance use, and suicidal ideation during the COVID-19 pandemic - United States, June 24-30, 2020. MMWR Morb Mortal Wkly Rep. 2020;69(32):1049- 57. https://doi.org/10.15585/mmwr.mm6932a1
https://doi.org/10.15585/mmwr.mm6932a1...
.
Nursing professionals compose approximately half of the world’s health workforce22. World Health Organization. Global strategic directions for strengthening nursing and midwifery 2016-2020. Geneva (CH): WHO; 2016 [cited 2020 Oct 29]. Available from: https://www.who.int/hrh/nursing_midwifery/global-strategic-midwifery2016-2020.pdf
https://www.who.int/hrh/nursing_midwifer...
. Their work involves several challenges, including potential ethical dilemmas, working with human suffering, long hours, low pay, lack of time and appropriate space to rest, burden, lack of resources, and low appreciation by other team members. These factors have previously been recognized to cause worsening in the nurses’ mental health2424. Alves AP, Pedrosa LAK, Coimbra MAR, Miranzi MAS, Hass VJ. Prevalência de transtornos mentais comuns entre profissionais de saúde. Rev Enferm UERJ. 2015;23(1):64-9. https://doi.org/10.12957/reuerj.2015.8150
https://doi.org/10.12957/reuerj.2015.815...
, 2525. Rodrigues E, Rodrigues U, Oliveira L, Laudano R, Nascimento Sobrinho C. [Prevalence of common mental disorders in nursing workers at a hospital of Bahia]. Rev Bras Enferm. 2014;67(2):296-301. Portuguese. https://doi.org/10.5935/0034-7167.20140040
https://doi.org/10.5935/0034-7167.201400...
, 2727. Silva MRG, Marcolan JF. Working conditions and depression in hospital emergency service nurses. Rev Bras Enferm. 2020;73 Suppl 1:e20180952. https://doi.org/10.1590/0034-7167-2018-0952
https://doi.org/10.1590/0034-7167-2018-0...
, and their effects may be exacerbated by the pandemic.
Thus, we emphasize the associations found for both major depressive episodes and MPDs with burden, a poor assessment of the support received by one’s service, and suspected COVID-19 infection among our results. The association observed for major depressive episodes and lack of PPE is also noteworthy. These results are consistent with previous studies that investigated the repercussions of the pandemic in nurses from other countries.
Positive associations between depression and/or anxiety and suspected infection with COVID-19 have been reported in studies conducted in China2828. Li J, Xu J, Zhou H, You H, Wang X, Li Y, et al. Working condition and health status of 6,317 front line public health workers across 5 provinces in China during the COVID-19 epidemic: a cross-sectional study. BMC Public Health. 2021;21:106. https://doi.org/10.1186/s12889-020-10146-0
https://doi.org/10.1186/s12889-020-10146...
and Iran2020. Zhang C, Yang L, Liu S, Ma S, Wang Y, Cai Z, et al. Survey of insomnia and related social psychological factors among medical staff involved in the 2019 novel coronavirus disease outbreak. Front Psychiatry. 2020;11:306. https://doi.org/10.3389/fpsyt.2020.00306
https://doi.org/10.3389/fpsyt.2020.00306...
, 2929. Pouralizadeh M, Bostani Z, Maroufizadeh S, Ghanbari A, Khoshbakht M, Alavi SA, et al. Anxiety and depression and the related factors in nurses of Guilan University of Medical Sciences hospitals during COVID-19: a web-based cross-sectional study. Int J Afr Nurs Sci. 2020;13:100233. https://doi.org/10.1016/j.ijans.2020.100233
https://doi.org/10.1016/j.ijans.2020.100...
. In turn, the perception of support received by the service was negatively associated with poor self-rated health in the study2828. Li J, Xu J, Zhou H, You H, Wang X, Li Y, et al. Working condition and health status of 6,317 front line public health workers across 5 provinces in China during the COVID-19 epidemic: a cross-sectional study. BMC Public Health. 2021;21:106. https://doi.org/10.1186/s12889-020-10146-0
https://doi.org/10.1186/s12889-020-10146...
, in addition to being seen as one of the greatest needs for reducing the psychological burden in a study conducted among German nurses3030. Zerbini G, Ebigbo A, Reicherts P, Kunz M, Messman H. Psychosocial burden of healthcare professionals in times of COVID-19: a survey conducted at the University Hospital Augsburg. GMS Ger Med Sci. 2020;18:Doc05. https://doi.org/10.3205/000281
https://doi.org/10.3205/000281...
. Finally, studies conducted among healthcare professionals in Italy3131. Felice C, Di Tanna GL, Zanus G, Grossi U. Impact of COVID-19 outbreak on healthcare workers in Italy: results from a National E-Survey. J Commun Health. 2020;45(4):675-83. https://doi.org/10.1007/s10900-020-00845-5
https://doi.org/10.1007/s10900-020-00845...
, Iran2020. Zhang C, Yang L, Liu S, Ma S, Wang Y, Cai Z, et al. Survey of insomnia and related social psychological factors among medical staff involved in the 2019 novel coronavirus disease outbreak. Front Psychiatry. 2020;11:306. https://doi.org/10.3389/fpsyt.2020.00306
https://doi.org/10.3389/fpsyt.2020.00306...
, 2929. Pouralizadeh M, Bostani Z, Maroufizadeh S, Ghanbari A, Khoshbakht M, Alavi SA, et al. Anxiety and depression and the related factors in nurses of Guilan University of Medical Sciences hospitals during COVID-19: a web-based cross-sectional study. Int J Afr Nurs Sci. 2020;13:100233. https://doi.org/10.1016/j.ijans.2020.100233
https://doi.org/10.1016/j.ijans.2020.100...
, and Portugal3232. Sampaio F, Sequeira C, Teixeira L. Nurses’ mental health during the Covid-19 outbreak: a cross-sectional study. J Occup Environ Med. 2020;62(10):783-7. https://doi.org/10.1097/JOM.0000000000001987
https://doi.org/10.1097/JOM.000000000000...
observed that adequate PPE provision was an important predictor of better psychological outcomes.
Although the results in our sample suggest a higher prevalence of depression and MPD in comparison to the general population or other pre-pandemic samples of nurses, few pandemic-specific study variables were related to these outcomes in our study. However, we can suggest that common challenges faced by the nursing teams were exacerbated by the pandemic.
A note of caution is also necessary regarding interpretations of depression and MPD prevalence. Importantly, screening for these outcomes using instruments, even validated ones, does not confirm a diagnosis, and many responses to questions in these instruments may reflect normal adaptive responses to a stressful period. Therefore, it is not necessary to pathologize conditions that could be treated with the adoption of simple measures, such as improving professional support and working conditions.
Some hospitals in China implemented psychological assistance services in response to large numbers of workers screening positive for adverse mental health outcomes. Interestingly, workers were reluctant to participate in the interventions offered44. Chen Q, Liang M, Li Y, Guo J, Fei D, Wang L, et al. Mental health care for medical staff in China during the COVID-19 outbreak. Lancet Psychiatry. 2020;7(4):e15-16. https://doi.org/10.1016/S2215-0366(20)30078-X
https://doi.org/10.1016/S2215-0366(20)30...
. Through interviews with 13 medical teams at Xiangya Hospital, a study found that many workers were more immediately concerned on biosafety and lack of knowledge on COVID-19 among the reasons for refusing mental healthcare. Rather than mental health assistance, workers reported needing more uninterrupted rest and sufficient PPE to perform their duties.
Finally, readers should consider the limitations of the current study. First, our study was cross-sectional, therefore reverse causality cannot be ruled out. We must also consider the risk of response bias given that the research involved self-reporting by the participants.
We chose to exclude nursing professionals who were absent from work during the data collection period from our sample. This exclusion criterion must also be considered a limitation because it may be the case that such individuals were absent from work as a result of mental health issues related to the pandemic. Moreover, nursing professionals with mental healthcare needs may have been more likely among those eligible to participate in this study.
Although associations observed among our outcomes of interest and participant income are plausible and in line with prior study findings, one should consider that there were 80 missing observations for the income variable in our dataset. A lack of reference values for the same population in the pre-pandemic period represents another limitation. This makes the comparison and interpretation of results more difficult, highlighting that longitudinal studies are urgently needed.
We observed a limited number of observations for suicidal ideation. This outcome demonstrated only weak associations with several study variables (i.e., evaluation of support at work, current burden, and burden pre-pandemic comparison) after adjustment for confounders. A larger sample may be required to detect stronger associations of suicidal ideation with other variables of interest.
Finally, it is necessary to point out that the selection of variables to compose the model with purely statistical criteria has been criticized by epidemiology theorists3333. VanderWeele TJ. Principles of confounder selection. Eur J Epidemiol. 2019;34(3):211-9. https://doi.org/10.1007/s10654-019-00494-6
https://doi.org/10.1007/s10654-019-00494...
. However, we understand that the selection of confounders through a selection based on statistical criteria helped us to enrich the analysis through identifying and including new variables in the literature (those related to the context of the COVID-19 pandemic), for the which relationships were not yet well defined.
CONCLUSIONS
Our results point to a high prevalence of major depressive episodes and MPDs among the nursing professionals studied. Associations observed for these outcomes included suspected COVID-19 infection, burden at work, a rating of support received by one’s service as poor, and a lack of PPE. Our study, therefore, suggests that factors related to services are associated with the mental health status of nursing professionals. There is a need to improve working conditions, especially by ensuring adequate dimensioning to avoid the burden. Employers should provide their employees with psychological and social support and implement adequate biosafety measures. Such measures are arguably needed to promote feelings of security and to reduce anxiety linked to pandemic-related uncertainties and risk of infection.
REFERENCES
-
1World Health Organization. Coronavirus Disease (COVID-19): events as they happen. Geneva (CH): WHO; 2020 [cited 2020 Oct 29]. Available from: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/events-as-they-happen
» https://www.who.int/emergencies/diseases/novel-coronavirus-2019/events-as-they-happen -
2World Health Organization. Global strategic directions for strengthening nursing and midwifery 2016-2020. Geneva (CH): WHO; 2016 [cited 2020 Oct 29]. Available from: https://www.who.int/hrh/nursing_midwifery/global-strategic-midwifery2016-2020.pdf
» https://www.who.int/hrh/nursing_midwifery/global-strategic-midwifery2016-2020.pdf -
3Hu D, Kong Y, Li W, Han Q, Zhang X, Zhu LX, et al. Frontline nurses’ burnout, anxiety, depression, and fear statuses and their associated factors during the COVID-19 outbreak in Wuhan, China: a large-scale cross-sectional study. EClinicalMedicine. 2020;24:100424. https://doi.org/10.1016/j.eclinm.2020.100424
» https://doi.org/10.1016/j.eclinm.2020.100424 -
4Chen Q, Liang M, Li Y, Guo J, Fei D, Wang L, et al. Mental health care for medical staff in China during the COVID-19 outbreak. Lancet Psychiatry. 2020;7(4):e15-16. https://doi.org/10.1016/S2215-0366(20)30078-X
» https://doi.org/10.1016/S2215-0366(20)30078-X -
5Huang Y, Zhao N. Generalized anxiety disorder, depressive symptoms and sleep quality during COVID-19 outbreak in China: a web-based cross-sectional survey. Psychiatry Res. 2020;288:112954. https://doi.org/10.1016/j.psychres.2020.112954
» https://doi.org/10.1016/j.psychres.2020.112954 -
6Lai J, Ma S, Wang Y, Ca Z, Hu J, Wei N, et al. Factors associated with mental health outcomes among health care workers exposed to Coronavirus Disease 2019. JAMA Network Open. 2020;3(3):e203976. https://doi.org/10.1001/jamanetworkopen.2020.3976
» https://doi.org/10.1001/jamanetworkopen.2020.3976 -
7Pappa S, Ntella V, Giannakas T, Giannakoulis VG, Papoutsi E, Katsaounou P. Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: a systematic review and meta-analysis. Brain Behav Immun. 2020;88:901-7. https://doi.org/10.1016/j.bbi.2020.05.026
» https://doi.org/10.1016/j.bbi.2020.05.026 -
8Hacimusalar Y, Kahve AA, Yasar AB, Aydin MB. Anxiety and hopelessness levels in COVID-19 pandemic: a comparative study of healthcare professionals and other community sample in Turkey. J Psychiatric Res. 2020;129:181-8. https://doi.org/10.1016/j.jpsychires.2020.07.024
» https://doi.org/10.1016/j.jpsychires.2020.07.024 -
9Zhu Z, Xu S, Wang H. COVID-19 in Wuhan: immediate psychological impact on 5062 health workers. EClinical Medicine.2020 [cited 2020 Oct 29];24:100443. Available from: https://www.thelancet.com/pdfs/journals/eclinm/PIIS2589-5370(20)30187-5.pdf
» https://www.thelancet.com/pdfs/journals/eclinm/PIIS2589-5370(20)30187-5.pdf -
10Greenberg N, Tracy D. What healthcare leaders need to do to protect the psychological well-being of frontline staff in the COVID-19 pandemic. BMJ Leader. 2020 May:leader-2020-000273. https://doi.org/10.1136/leader-2020-000273
» https://doi.org/10.1136/leader-2020-000273 -
11Williamson V, Greenberg N, Bowden G, Rothenfluh D, Nnadi C, Reynolds J. The mental health impact of providing spine care during COVID-19. Spine J. 2020;20(9):1363-6. https://doi.org/10.1016/j.spinee.2020.04.019
» https://doi.org/10.1016/j.spinee.2020.04.019 -
12Lamb D, Greenberg N, Stevelink S, Wessely S. Mixed signals about the mental health of the NHS workforce. Lancet Psychiatry. 2020;7(12):1009-11. https://doi.org/10.1016/S2215-0366(20)30379-5
» https://doi.org/10.1016/S2215-0366(20)30379-5 -
13Conselho das Secretarias Municipais de Saúde do Rio Grande do Sul. Regiões de Saúde do Rio Grande do Sul. Porto Alegre, RS: Cosemsrs; 2020 [cited 2020 Oct 29]. Available from: https://www.cosemsrs.org.br/regioes-de-saude
» https://www.cosemsrs.org.br/regioes-de-saude -
14Santos IS, Tavares BF, Munhoz TN, Almeida LSP, Silva NTB, Tams BD, et al. Sensibilidade e especificidade do Patient Health Questionnaire-9 (PHQ-9) entre adultos da população geral. Cad Saude Publica. 2013;29(8):1533-43. https://doi.org/10.1590/0102-311X00144612
» https://doi.org/10.1590/0102-311X00144612 -
15Santos KO, Araújo TM, Pinho PDS, Silva ACC. Avaliação de um instrumento de mensuração de morbidade psíquica: estudo de validação do Self-Reporting Questionnaire (SRQ-20). Rev Baiana Saude Publica. 2011 [cited 2020 Oct 29];34(3):544-60. Available from: http://files.bvs.br/upload/S/0100-0233/2010/v34n3/a1881.pdf
» http://files.bvs.br/upload/S/0100-0233/2010/v34n3/a1881.pdf -
16Treichel CAS, Jardim VMR, Kantorski LP, Lima MG. Prevalence and factors associated with suicidal ideation among family caregivers of people with mental disorders. J Clin Nurs. 2019;28(19-20):3470-7. https://doi.org/10.1111/jocn.14938
» https://doi.org/10.1111/jocn.14938 -
17Maldonado G, Greenland S. Simulation study of confounder-selection strategies. Am J Epidemiol. 1993;138(11):923-36. https://doi.org/10.1093/oxfordjournals.aje.a116813
» https://doi.org/10.1093/oxfordjournals.aje.a116813 -
18Liu CY, Yang YZ, Zhang XM, Xu X, Dou QL, Zhang WW, et. al. The prevalence and influencing factors in anxiety in medical workers fighting COVID-19 in China: a cross-sectional survey. Epidemiol Infect. 2020;148:e98. https://doi.org/10.1017/S0950268820001107
» https://doi.org/10.1017/S0950268820001107 -
19Lu W, Wang H, Lin Y, Li L. Psychological status of medical workforce during the COVID-19 pandemic: a cross-sectional study. Psychiatry Res. 2020;288:112936. https://doi.org/10.1016/j.psychres.2020.112936
» https://doi.org/10.1016/j.psychres.2020.112936 -
20Zhang C, Yang L, Liu S, Ma S, Wang Y, Cai Z, et al. Survey of insomnia and related social psychological factors among medical staff involved in the 2019 novel coronavirus disease outbreak. Front Psychiatry. 2020;11:306. https://doi.org/10.3389/fpsyt.2020.00306
» https://doi.org/10.3389/fpsyt.2020.00306 -
21Junqueira MAB, Santos MA, Araújo LB, Ferreira MCM, Giuliani CD, Pillon SC. et al. Depressive symptoms and drug use among nursing staff professionals. Esc Anna Nery. 2018;22(4):e20180129. https://doi.org/10.1590/2177-9465-EAN-2018-0129
» https://doi.org/10.1590/2177-9465-EAN-2018-0129 -
22Freire FO, Marcon SR, Espinosa MM, Santos HGB, Kogien M, Lima NVP, et al. Factors associated with suicide risk among nurses and physicians: a cross-section study. Rev Bras Enferm. 2020;73 Suppl 1:e20200352. https://doi.org/10.1590/0034-7167-2020-0352
» https://doi.org/10.1590/0034-7167-2020-0352 -
23Amin F, Sharif S, Saeed R, Durranni N, Jilani D. COVID-19 pandemic- knowledge, perception, anxiety and depression among frontline doctors of Pakistan. BMC Psychiatry. 2020;20:459. https://doi.org/10.1186/s12888-020-02864-x
» https://doi.org/10.1186/s12888-020-02864-x -
24Alves AP, Pedrosa LAK, Coimbra MAR, Miranzi MAS, Hass VJ. Prevalência de transtornos mentais comuns entre profissionais de saúde. Rev Enferm UERJ. 2015;23(1):64-9. https://doi.org/10.12957/reuerj.2015.8150
» https://doi.org/10.12957/reuerj.2015.8150 -
25Rodrigues E, Rodrigues U, Oliveira L, Laudano R, Nascimento Sobrinho C. [Prevalence of common mental disorders in nursing workers at a hospital of Bahia]. Rev Bras Enferm. 2014;67(2):296-301. Portuguese. https://doi.org/10.5935/0034-7167.20140040
» https://doi.org/10.5935/0034-7167.20140040 -
26Czeisler ME, Lane RI, Petrosky E, Wiley JF, Christensen A, Njai R, et al. Mental health, substance use, and suicidal ideation during the COVID-19 pandemic - United States, June 24-30, 2020. MMWR Morb Mortal Wkly Rep. 2020;69(32):1049- 57. https://doi.org/10.15585/mmwr.mm6932a1
» https://doi.org/10.15585/mmwr.mm6932a1 -
27Silva MRG, Marcolan JF. Working conditions and depression in hospital emergency service nurses. Rev Bras Enferm. 2020;73 Suppl 1:e20180952. https://doi.org/10.1590/0034-7167-2018-0952
» https://doi.org/10.1590/0034-7167-2018-0952 -
28Li J, Xu J, Zhou H, You H, Wang X, Li Y, et al. Working condition and health status of 6,317 front line public health workers across 5 provinces in China during the COVID-19 epidemic: a cross-sectional study. BMC Public Health. 2021;21:106. https://doi.org/10.1186/s12889-020-10146-0
» https://doi.org/10.1186/s12889-020-10146-0 -
29Pouralizadeh M, Bostani Z, Maroufizadeh S, Ghanbari A, Khoshbakht M, Alavi SA, et al. Anxiety and depression and the related factors in nurses of Guilan University of Medical Sciences hospitals during COVID-19: a web-based cross-sectional study. Int J Afr Nurs Sci. 2020;13:100233. https://doi.org/10.1016/j.ijans.2020.100233
» https://doi.org/10.1016/j.ijans.2020.100233 -
30Zerbini G, Ebigbo A, Reicherts P, Kunz M, Messman H. Psychosocial burden of healthcare professionals in times of COVID-19: a survey conducted at the University Hospital Augsburg. GMS Ger Med Sci. 2020;18:Doc05. https://doi.org/10.3205/000281
» https://doi.org/10.3205/000281 -
31Felice C, Di Tanna GL, Zanus G, Grossi U. Impact of COVID-19 outbreak on healthcare workers in Italy: results from a National E-Survey. J Commun Health. 2020;45(4):675-83. https://doi.org/10.1007/s10900-020-00845-5
» https://doi.org/10.1007/s10900-020-00845-5 -
32Sampaio F, Sequeira C, Teixeira L. Nurses’ mental health during the Covid-19 outbreak: a cross-sectional study. J Occup Environ Med. 2020;62(10):783-7. https://doi.org/10.1097/JOM.0000000000001987
» https://doi.org/10.1097/JOM.0000000000001987 -
33VanderWeele TJ. Principles of confounder selection. Eur J Epidemiol. 2019;34(3):211-9. https://doi.org/10.1007/s10654-019-00494-6
» https://doi.org/10.1007/s10654-019-00494-6
-
Funding: Fundação de Amparo à Pesquisa do Estado do Rio Grande do Sul (Fapergs Emergency Notice nº 06/2020 - Science and technology in the fight against COVID-19). Ioannis Bakolis is supported by the NIHR Maudsley Biomedical Research Centre and by the NIHR Collaboration for Leadership in Applied Health Research and Care South London at King’s College Hospital NHS Foundation Trust, King’s College London.
Publication Dates
-
Publication in this collection
14 Mar 2022 -
Date of issue
2022
History
-
Received
4 Aug 2021 -
Accepted
4 Nov 2021