Acessibilidade / Reportar erro

Temporal progression of sepsis on critical care COVID-19 patients: a retrospective cohort study

SUMMARY

OBJECTIVE:

This study aimed to describe sepsis progression in critical COVID-19 patients using the SOFA score and investigate its relationship with mortality.

METHODS:

Three researchers collected and analyzed retrospective clinical and laboratory data found in electronic health records from all patients admitted to a severe COVID-19 exclusive intensive care unit from March 2020 to October 2020. Mixed-effect logistic regression was used to evaluate SOFA (Sepsis-3) score variables as mortality prediction markers, while Kaplan-Meier survival curves were used to compare mortality between groups of patients. Cox proportional hazard models were used to further stratify mortality association between variants.

RESULTS:

A total of 73 patients were included. Temporal COVID-19-related sepsis progression analysis indicates difference in degrees and timing between different organ dysfunction over time. Sepsis-3 Cardiovascular Dysfunction characterized by severe hypotension added to the use of any vasopressor drugs was the only parameter associated with in-hospital death during the first 5 days of hospital admission (OR 2.19; 95%CI 1.14-4.20; p=0.01).

CONCLUSION:

Increased Sepsis-3 Cardiovascular Dysfunction score, characterized as hypotension associated with the use of vasopressor drugs in the first days of intensive care unit stay, is related to higher mortality in COVID-19 patients and may be a useful prognostic prediction tool.

KEYWORDS:
Sepsis; COVID-19; SaRS-CoV-2; Critical care

INTRODUCTION

The coronavirus disease 2019 (COVID-19) pandemic, which started in December 2019, has claimed over 6 million lives in more than 192 countries11 World Health Organization. WHO Coronavirus (COVID-19) Dashboard. 2022 [cited on May 6, 2022]. Available from: https://covid19.who.int/
https://covid19.who.int/...
and yet its physiopathology is poorly understood. Acute respiratory distress syndrome was described as a major complication22 Gibson PG, Qin L, Puah SH. COVID-19 acute respiratory distress syndrome (ARDS): clinical features and differences from typical pre-COVID-19 ARDS. Med J Aust. 2020;213(2):54-6.e1. https://doi.org/10.5694/mja2.50674
https://doi.org/10.5694/mja2.50674...
, but symptoms may present as a spectrum ranging from asymptomatic to multisystemic, and some patients do not even develop respiratory distress – instead, they develop other symptoms unrelated to respiratory distress, which may be valuable prognostic markers33 Alharthy A, Aletreby W, Faqihi F, Balhamar A, Alaklobi F, Alanezi K, et al. Clinical characteristics and predictors of 28-day mortality in 352 critically ill patients with COVID-19: a retrospective study. J Epidemiol Glob Health. 2021;11(1):98-104. https://doi.org/10.2991/jegh.k.200928.001
https://doi.org/10.2991/jegh.k.200928.00...
.

In these critical patients, multiorgan damage, manifested as sepsis, has been described since early reports44 Liu D, Wang Q, Zhang H, Cui L, Shen F, Chen Y, et al. Viral sepsis is a complication in patients with Novel Corona Virus Disease (COVID-19). Med Drug Discov. 2020;8:100057. https://doi.org/10.1016/j.medidd.2020.100057
https://doi.org/10.1016/j.medidd.2020.10...
,55 Li H, Liu L, Zhang D, Xu J, Dai H, Tang N, et al. SARS-CoV-2 and viral sepsis: observations and hypotheses. Lancet. 2020;395(10235):1517-20. https://doi.org/10.1016/S0140-6736(20)30920-X
https://doi.org/10.1016/S0140-6736(20)30...
. The most recent systematic review and meta-analysis about the prevalence of sepsis in COVID-1966 Karakike E, Giamarellos-Bourboulis EJ, Kyprianou M, Fleischmann-Struzek C, Pletz MW, Netea MG, et al. Coronavirus disease 2019 as cause of viral sepsis: a systematic review and meta-analysis. Crit Care Med. 2021;49(12):2042-57. https://doi.org/10.1097/CCM.0000000000005195
https://doi.org/10.1097/CCM.000000000000...
have explored the hypothesis of COVID-19 as the direct cause of viral sepsis and described a prevalence as high as 77.9% in affected patients.

However, after more than 2 years of the beginning of the COVID-19 pandemic and a wide description of multiple variants, as of April 2022, as few as nine systematic reviews could be found on the PubMed indexing website referring to a search combining “sepsis” and “covid-19” as MeSH terms, which suggests that the correlation between sepsis and COVID-19 is yet underestimated.

Given the lack of studies focusing on the multi-organic aspect of COVID-19 critical care, the continuous spread of the pandemic, and overall sub-notification of sepsis cases, it is necessary to describe and analyze the temporal evolution of systemic organ failure in intensive care patients, in order to accurately identify risk factors, hallmarks, and evidence of prognosis that can help the development of better treatment and reduce morbimortality.

This study aimed to describe sepsis progression in critical COVID-19 patients using the SOFA score and investigate its relationship with mortality.

METHODS

This is a retrospective cohort study based on the analysis of a COVID-19-positive sample of patients from Santa Clara Hospital, Porto Alegre, Brazil, admitted between May 2020 and October 2020 with available data on the local electronic health records system. Ethical approval for this study was obtained from Irmandade da Santa Casa de Misericórdia de Porto Alegre Review Board (approval number 4.237.991).

Eligibility criteria for data inclusion were as follows:

  1. having an RT-PCR method confirmed diagnostic of COVID-19;

  2. having 2 and more days of intensive care unit (ICU) stay; and

  3. availability of minimal data for patient identification, including age, sex, and comorbidities.

Sample size calculation using a 95% of confidence level with a margin of error of 5% and considering a 3% mortality rate for COVID-19 cases yielded a minimum necessary of 45 measurements to meet statistical constraints. This was exceeded using a convenience sampling drawn from the hospital setting chosen.

Our choice comprises the total number of patients in a COVID-19 exclusive ICU from the beginning to the end of the so-called the first wave of the pandemic in Brazil. After that, as disease treatment progressed and mortality was reduced as a result of vaccination and public health efforts, fewer examinations became available. Therefore, our sample displays abundant data for qualitative analysis and stratification while also readily representing disease progression with minimal confounding factors.

Data were collected by an independent researcher and checked by two researchers, while a fourth settled on differences in interpretations. Right censored data included patients who were

  1. lost to follow-up;

  2. lost due to evasion from healthcare complex facilities, and

  3. transferred to another healthcare complex.

The sample was divided and compared between groups of deceased versus recovered patients. The primary outcome under analysis was death. The predictors of mortality were SOFA (Sepsis-3) score77 Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):801-10. https://doi.org/10.1001/jama.2016.0287
https://doi.org/10.1001/jama.2016.0287...
values, which progressively rate organ dysfunction from 1 to 4, with 4 being the most severe, as follows:

  • Respiratory system (PaO2/FiO2 ratio) from <400 (1) to <100 (4)

  • Coagulation system (serum platelets in cell/mm3) from <150,000 (1) to <20,000 (4)

  • Liver function (serum bilirubin in mg/dL) from 1.2–1.9 (1) to >12.0 (4)

  • Cardiovascular system (mean arterial pressure in mmHg) <70 (1) or use of vasopressor drug >15 mcg/kg/min (4)

  • Renal system (serum creatinine in mg/dL) from 1.2–1.9 (1) to >5.0 (4)

Exposure was considered as RT-PCR confirmed SARS-CoV-2 infection. Tertiary medical care by ICU staff was considered a major potential confounder and modifier. Since it is impossible to distinguish its effects from those of usual COVID-19 progression, our time frame was defined as a 10-day analysis after ICU admission and then subdivided into two 5-day analyses, to reduce confounding effects.

Statistical analysis

We verified normality in data distribution using Shapiro-Wilk test. Our plot (Figure 1) was generated by using LOWESS (Locally Weighted Scatterplot Smoothing) to fit a smooth curve to nonparametric data points. LOWESS weight function gives the most weight to the data points nearest the point of estimation and the least weight to the data points that are furthest away.

Figure 1
SOFA Cardiovascular Dysfunction Score progression over time comparing deceased and recovered patients in a COVID-19 exclusive intensive care unit.

To analyze the association between increasing sepsis score and mortality, a mixed-effect logistic regression model was applied by using the lme4 package, available for R Studio software. The odds ratio was calculated by taking the exponential coefficient output. Our model aimed to estimate binary outcome variables (death vs. survival) ratios, with SOFA score variables as patient-level continuous predictors, days since admission as a patient-level categorical predictor (0–10), and a random intercept by patient ID. Cox proportional hazard models were used to further stratify mortality association between variants.

A p-value <0.05 was adopted as a cutoff value for statistical significance. All data were extracted and cleaned using R Studio version 4.1.2 for macOS.

RESULTS

Our sample yielded a total of 73 patients, of which 37 (50.3%) were deceased. The majority were 60 years or older (53%), and 38 (52%) were females. Hypertension was the most common comorbidity (58%), while kidney disease was the least common (4%). On admission, dyspnea was the most common symptom (67.5%), while tachycardia was present in only 1 patient. Median time from symptom onset until ICU admission was 10.17 days. Detailed clinical characteristics during admission can be observed in Table 1.

Table 1
Patient characteristics on admission.

Figure 1 shows the LOWESS plot for our data. Detailed results for mixed-effect logistic models and hazard models can be observed in Table 2. Complete data have been submitted as Supplementary file. On the first 4 days of ICU admission, the odds of in-hospital death was associated with increased cardiovascular dysfunction (OR 2.19; 95%CI 1.14-4.20; p=0.01). On days 5–10, no statistically significant relationship was detected. Cox proportional hazard model adjusted for multivariate analysis demonstrated increased risk for Cardiovascular Dysfunction score = 3 (OR 2.87; 95%CI 1.05–7.8; p=0.04), but reduced risk for Respiratory Dysfunction score = 1 (OR 0.3; 95%CI 0.092–1.0; p=0.04) when compared to score = 0 (no organ dysfunction).

Table 2
Sepsis-3 score hazard models and mixed-effect logistic regression.

DISCUSSION

Our study demonstrates that the progression of dysfunction has a different timing of worsening for each system evaluated. Regarding risk factors, cardiovascular dysfunction, characterized by Sepsis-3 as hypotension added to the use of vasopressor drugs77 Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):801-10. https://doi.org/10.1001/jama.2016.0287
https://doi.org/10.1001/jama.2016.0287...
, is the only factor evaluated with a positive correlation for mortality in the first 5 days of hospitalization. Respiratory dysfunction, characterized by a low PaO2/FiO2 ratio ranging from <400 – <100, showed no positive association.

There are three reasons for our choice of a time frame of 10 days of analysis. First, we considered that after 5 days, too many confounding factors could be included in the patient’s profile after intensive care symptomatic management. Second, we found no previous studies in which a time series analysis had been done in ICU patients for sepsis progression. One of the first reports pointed to a median time from disease onset to death of 16 days but did not stratify this number as a subset of ICU admission time88 Chen T, Wu D, Chen H, Yan W, Yang D, Chen G, et al. Clinical characteristics of 113 deceased patients with coronavirus disease 2019: retrospective study. BMJ. 2020;368:m1091. https://doi.org/10.1136/bmj.m1091
https://doi.org/10.1136/bmj.m1091...
. Third, our data displayed evident inflection points in which the parameter would behave differently, i.e., organ dysfunction would decrease.

The difference in observable trends implies that the primary mechanism behind clinical symptoms in critical patients does not involve only the lung, although it does not explain when the adjacent organ damage initially happens. Current evidence99 Batah SS, Fabro AT. Pulmonary pathology of ARDS in COVID-19: a pathological review for clinicians. Respir Med. 2021;176:106239. https://doi.org/10.1016/j.rmed.2020.106239
https://doi.org/10.1016/j.rmed.2020.1062...
implies that the exudative and proliferative phases of alveolar damage should happen within the first 10 days. However, respiratory dysfunction peaks around day 6 in our data, and platelets still seem to be within normal levels in our sample (although COVID-19 has been described as a coagulopathy1010 Kowalewski M, Fina D, Słomka A, Raffa GM, Martucci G, Lo Coco V, et al. COVID-19 and ECMO: the interplay between coagulation and inflammation-a narrative review. Crit Care. 2020;24(1):205. https://doi.org/10.1186/s13054-020-02925-3
https://doi.org/10.1186/s13054-020-02925...
,1111 Asakura H, Ogawa H. COVID-19-associated coagulopathy and disseminated intravascular coagulation. Int J Hematol. 2021;113(1):45-57. https://doi.org/10.1007/s12185-020-03029-y
https://doi.org/10.1007/s12185-020-03029...
.

A negative correlation of respiratory system distress also corresponds to that reported for the first wave in China, where the use of invasive mechanical ventilation ranged could go as low as 13.46%1212 Zhang M, Hu P, Xu X, Ai J, Li Y, Bao Y, et al. A look back at the first wave of COVID-19 in China: A systematic review and meta-analysis of mortality and health care resource use among severe or critical patients. PLoS One. 2022;17(3):e0265117. https://doi.org/10.1371/journal.pone.0265117
https://doi.org/10.1371/journal.pone.026...
, strengthening the hypothesis that multiple organ damage, which in turn may evolve into sepsis, does not derives uniquely from lung damage.

These data also confirm considerably reliable evidence, suggesting that patients with higher risk can be identified early in the hospitalization process. Cardiovascular disease and hypertension were already described as strong predictors1313 Jain V, Yuan JM. Predictive symptoms and comorbidities for severe COVID-19 and intensive care unit admission: a systematic review and meta-analysis. Int J Public Health. 2020;65(5):533-46. https://doi.org/10.1007/s00038-020-01390-7
https://doi.org/10.1007/s00038-020-01390...
since cardiac involvement is 13 times higher in critical patients1414 Li B, Yang J, Zhao F, Zhi L, Wang X, Liu L, et al. Prevalence and impact of cardiovascular metabolic diseases on COVID-19 in China. Clin Res Cardiol. 2020;109(5):531-8. https://doi.org/10.1007/s00392-020-01626-9
https://doi.org/10.1007/s00392-020-01626...
. The same dynamic applies to kidney injury1515 Liu YF, Zhang Z, Pan XL, Xing GL, Zhang Y, Liu ZS, et al. The chronic kidney disease and acute kidney injury involvement in COVID-19 pandemic: A systematic review and meta-analysis. PLoS One. 2021;16(1):e0244779. https://doi.org/10.1371/journal.pone.0244779
https://doi.org/10.1371/journal.pone.024...
, a major correlate with ICU mortality1616 Chang R, Elhusseiny KM, Yeh YC, Sun WZ. COVID-19 ICU and mechanical ventilation patient characteristics and outcomes-a systematic review and meta-analysis. PLoS One. 2021;16(2):e0246318. https://doi.org/10.1371/journal.pone.0246318
https://doi.org/10.1371/journal.pone.024...
. Many biomarkers have been pointed out as predictors in previous systematic reviews1717 Malik P, Patel U, Mehta D, Patel N, Kelkar R, Akrmah M, et al. Biomarkers and outcomes of COVID-19 hospitalisations: systematic review and meta-analysis. BMJ Evid Based Med. 2021;26(3):107-8. https://doi.org/10.1136/bmjebm-2020-111536
https://doi.org/10.1136/bmjebm-2020-1115...
, as well as genetic factors, such as overexpression of ADAM9 metalloprotease, which have also been suggested as a “signature” of critically ill patients1818 Carapito R, Li R, Helms J, Carapito C, Gujja S, Rolli V, et al. Identification of driver genes for critical forms of COVID-19 in a deeply phenotyped young patient cohort. Sci Transl Med. 2022;14(628):eabj7521. https://doi.org/10.1126/scitranslmed.abj752
https://doi.org/10.1126/scitranslmed.abj...
, since it directly influences the uptake and replication of SARS-CoV-2 in lung intraepithelial cells.

In terms of novelty and study similarity, to the best of our knowledge, our study is the first to analyze sepsis progression over a defined time frame by using the SOFA (Sepsis-3) score as a prognostic prediction tool for sepsis in intensive care COVID-19 patients. Our study adds further knowledge to the field of critical care by pointing out which parameters should be observed with additional attention on COVID-19 patients during intensive care admission to precociously differentiate which patients have a higher chance of worsening. Such knowledge is crucial considering each day in ICU may decrease mean survival probability by 3.27% per day1919 Sobral MFF, Roazzi A, Penha Sobral AIG, Oliveira BRB, Duarte GB, Silva JF, et al. A retrospective cohort study of 238,000 COVID-19 hospitalizations and deaths in Brazil. Sci Rep. 2022;12(1):3629. https://doi.org/10.1038/s41598-022-07538-0
https://doi.org/10.1038/s41598-022-07538...
.

Sepsis is still a major mortality cause in a hospital setting and further studies are necessary to increase survival rates through early detection and treatment. Nonetheless, our data provide evidence that supports the idea that cardiovascular system dysfunction might be an important parameter to be observed during the hospital admission process to distinguish between patients with good or bad chances of recovery before a major adverse event occurs.

Limitations

This study has some limitations. A larger sample could be used in the same study design to yield undetectable results. Also, the use of retrospective data from electronic health records in a hospital setting may result in a lack of uniformity of clinical data availability subjected to each patient’s profile. This may have impaired further clinical analysis by underestimating SOFA score results or impairing data analysis, such as in the case of renal system function, which had scarce data.

Finally, this is a study with data from patients of an exclusive ICU during the second half of the year 2020, and since then, multiple variants have been described and may display slightly different disease severity onset.

CONCLUSIONS

Increased Sepsis-3 Cardiovascular Dysfunction score, characterized as hypotension associated with the use of vasopressor drugs in the first days of ICU stay, is related to higher mortality in COVID-19 patients and may be a useful prognostic prediction tool.

  • Funding: none.

REFERENCES

  • 1
    World Health Organization. WHO Coronavirus (COVID-19) Dashboard. 2022 [cited on May 6, 2022]. Available from: https://covid19.who.int/
    » https://covid19.who.int/
  • 2
    Gibson PG, Qin L, Puah SH. COVID-19 acute respiratory distress syndrome (ARDS): clinical features and differences from typical pre-COVID-19 ARDS. Med J Aust. 2020;213(2):54-6.e1. https://doi.org/10.5694/mja2.50674
    » https://doi.org/10.5694/mja2.50674
  • 3
    Alharthy A, Aletreby W, Faqihi F, Balhamar A, Alaklobi F, Alanezi K, et al. Clinical characteristics and predictors of 28-day mortality in 352 critically ill patients with COVID-19: a retrospective study. J Epidemiol Glob Health. 2021;11(1):98-104. https://doi.org/10.2991/jegh.k.200928.001
    » https://doi.org/10.2991/jegh.k.200928.001
  • 4
    Liu D, Wang Q, Zhang H, Cui L, Shen F, Chen Y, et al. Viral sepsis is a complication in patients with Novel Corona Virus Disease (COVID-19). Med Drug Discov. 2020;8:100057. https://doi.org/10.1016/j.medidd.2020.100057
    » https://doi.org/10.1016/j.medidd.2020.100057
  • 5
    Li H, Liu L, Zhang D, Xu J, Dai H, Tang N, et al. SARS-CoV-2 and viral sepsis: observations and hypotheses. Lancet. 2020;395(10235):1517-20. https://doi.org/10.1016/S0140-6736(20)30920-X
    » https://doi.org/10.1016/S0140-6736(20)30920-X
  • 6
    Karakike E, Giamarellos-Bourboulis EJ, Kyprianou M, Fleischmann-Struzek C, Pletz MW, Netea MG, et al. Coronavirus disease 2019 as cause of viral sepsis: a systematic review and meta-analysis. Crit Care Med. 2021;49(12):2042-57. https://doi.org/10.1097/CCM.0000000000005195
    » https://doi.org/10.1097/CCM.0000000000005195
  • 7
    Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):801-10. https://doi.org/10.1001/jama.2016.0287
    » https://doi.org/10.1001/jama.2016.0287
  • 8
    Chen T, Wu D, Chen H, Yan W, Yang D, Chen G, et al. Clinical characteristics of 113 deceased patients with coronavirus disease 2019: retrospective study. BMJ. 2020;368:m1091. https://doi.org/10.1136/bmj.m1091
    » https://doi.org/10.1136/bmj.m1091
  • 9
    Batah SS, Fabro AT. Pulmonary pathology of ARDS in COVID-19: a pathological review for clinicians. Respir Med. 2021;176:106239. https://doi.org/10.1016/j.rmed.2020.106239
    » https://doi.org/10.1016/j.rmed.2020.106239
  • 10
    Kowalewski M, Fina D, Słomka A, Raffa GM, Martucci G, Lo Coco V, et al. COVID-19 and ECMO: the interplay between coagulation and inflammation-a narrative review. Crit Care. 2020;24(1):205. https://doi.org/10.1186/s13054-020-02925-3
    » https://doi.org/10.1186/s13054-020-02925-3
  • 11
    Asakura H, Ogawa H. COVID-19-associated coagulopathy and disseminated intravascular coagulation. Int J Hematol. 2021;113(1):45-57. https://doi.org/10.1007/s12185-020-03029-y
    » https://doi.org/10.1007/s12185-020-03029-y
  • 12
    Zhang M, Hu P, Xu X, Ai J, Li Y, Bao Y, et al. A look back at the first wave of COVID-19 in China: A systematic review and meta-analysis of mortality and health care resource use among severe or critical patients. PLoS One. 2022;17(3):e0265117. https://doi.org/10.1371/journal.pone.0265117
    » https://doi.org/10.1371/journal.pone.0265117
  • 13
    Jain V, Yuan JM. Predictive symptoms and comorbidities for severe COVID-19 and intensive care unit admission: a systematic review and meta-analysis. Int J Public Health. 2020;65(5):533-46. https://doi.org/10.1007/s00038-020-01390-7
    » https://doi.org/10.1007/s00038-020-01390-7
  • 14
    Li B, Yang J, Zhao F, Zhi L, Wang X, Liu L, et al. Prevalence and impact of cardiovascular metabolic diseases on COVID-19 in China. Clin Res Cardiol. 2020;109(5):531-8. https://doi.org/10.1007/s00392-020-01626-9
    » https://doi.org/10.1007/s00392-020-01626-9
  • 15
    Liu YF, Zhang Z, Pan XL, Xing GL, Zhang Y, Liu ZS, et al. The chronic kidney disease and acute kidney injury involvement in COVID-19 pandemic: A systematic review and meta-analysis. PLoS One. 2021;16(1):e0244779. https://doi.org/10.1371/journal.pone.0244779
    » https://doi.org/10.1371/journal.pone.0244779
  • 16
    Chang R, Elhusseiny KM, Yeh YC, Sun WZ. COVID-19 ICU and mechanical ventilation patient characteristics and outcomes-a systematic review and meta-analysis. PLoS One. 2021;16(2):e0246318. https://doi.org/10.1371/journal.pone.0246318
    » https://doi.org/10.1371/journal.pone.0246318
  • 17
    Malik P, Patel U, Mehta D, Patel N, Kelkar R, Akrmah M, et al. Biomarkers and outcomes of COVID-19 hospitalisations: systematic review and meta-analysis. BMJ Evid Based Med. 2021;26(3):107-8. https://doi.org/10.1136/bmjebm-2020-111536
    » https://doi.org/10.1136/bmjebm-2020-111536
  • 18
    Carapito R, Li R, Helms J, Carapito C, Gujja S, Rolli V, et al. Identification of driver genes for critical forms of COVID-19 in a deeply phenotyped young patient cohort. Sci Transl Med. 2022;14(628):eabj7521. https://doi.org/10.1126/scitranslmed.abj752
    » https://doi.org/10.1126/scitranslmed.abj752
  • 19
    Sobral MFF, Roazzi A, Penha Sobral AIG, Oliveira BRB, Duarte GB, Silva JF, et al. A retrospective cohort study of 238,000 COVID-19 hospitalizations and deaths in Brazil. Sci Rep. 2022;12(1):3629. https://doi.org/10.1038/s41598-022-07538-0
    » https://doi.org/10.1038/s41598-022-07538-0

Publication Dates

  • Publication in this collection
    21 Nov 2022
  • Date of issue
    2022

History

  • Received
    07 May 2022
  • Accepted
    09 July 2022
Associação Médica Brasileira R. São Carlos do Pinhal, 324, 01333-903 São Paulo SP - Brazil, Tel: +55 11 3178-6800, Fax: +55 11 3178-6816 - São Paulo - SP - Brazil
E-mail: ramb@amb.org.br