Acessibilidade / Reportar erro

EuroSCORE II and STS as mortality predictors in patients undergoing TAVI

EuroSCORE II e STS como preditores de mortalidade em pacientes submetidos ao TAVI

SUMMARY

Introduction:

the EuroSCORE II and STS are the most used scores for surgical risk stratification and indication of transcatheter aortic valve implantation (TAVI). However, its role as a tool for mortality prediction in patients undergoing TAVI is still unclear.

Objective:

to evaluate the performance of the EuroSCORE II and STS as predictors of in-hospital and 30-day mortality in patients undergoing TAVI.

Methods:

we included 59 symptomatic patients with severe aortic stenosis that underwent TAVI between 2010 and 2014. The variables were analyzed using Student's t-test and Fisher's exact test and the discriminative power was evaluated using receiver operating characteristic curve (ROC) and area under the curve (AUC) with a 95% confidence interval.

Results:

mean age was 81±7.3 years, 42.3% men. The mean EuroSCORE II was 7.6±7.3 % and STS was 20.7±10.3%. Transfemoral procedure was performed in 88.13%, transapical in 3.38% and transaortic in 8.47%. In-hospital mortality was 10.1% and 30-day mortality was 13.5%. Patients who died had EuroSCORE II and STS higher than the survivors (33.7±16.7vs. 18.6±7.3% p=0,0001 for STS and 13.9±16.1 vs. 4.8±3.8% p=0.0007 for EuroSCORE II). The STS showed an AUC of 0.81 and the EuroSCORE II of 0.77 and there were no differences in the discrimination ability using ROC curves (p=0.72).

Conclusion:

in this cohort, the STS and EuroSCORE II were predictors of in-hospital and 30-days mortality in patients with severe aortic stenosis undergoing TAVI.

Keywords:
aortic valve stenosis; prosthetic heart valves; hemodynamics

RESUMO

Introdução:

STS e EuroSCORE II são os escores mais utilizados para a estratificação de risco cirúrgico e indicação do implante de válvula aórtica transcateter (TAVI). Entretanto, seu papel como ferramenta para predição de mortalidade em pacientes submetidos ao TAVI ainda é incerto.

Objetivo:

avaliar o desempenho do EuroSCORE II e STS como preditores de mortalidade intra-hospitalar em 30 dias em pacientes submetidos ao TAVI.

Métodos:

59 pacientes com estenose aórtica importante submetidos ao TAVI entre 2010 e 2014. Variáveis foram analisadas por meio do teste t-Student e teste exato de Fisher, e o poder discriminativo foi avaliado pela curva ROC e área sob a curva, acompanhada de intervalo de confiança de 95%.

Resultados:

a idade média foi de 81±7,3 anos, 42,3% homens. Média do EuroSCORE II foi de 6,07±7,3%, e do STS, 20,7±10,3%. Procedimento transfemoral foi realizado em 88,13%, transapical, em 3,38% e transaórtico, em 8,47%. A mortalidade intra-hospitalar foi 10,1%, e em 30 dias, 13,5%. Os pacientes que evoluíram para óbito apresentavam STS e EuroSCORE II mais elevados que os sobreviventes (33,7±16,7% vs. 18,6±7,3%; p=0,0001 para STS e 13,9±16,1% vs. 4,8±3,8%; p=0,0007 para EuroSCORE II). O STS apresentou AUC de 0,81, e o EuroSCORE II, 0,77. Não houve diferença na capacidade de discriminação pelas curvas ROC (p=0,72).

Conclusão:

STS e EuroSCORE II foram preditores de mortalidade intra-hospitalar em 30 dias.

Palavras-chave:
estenose da valva aórtica; próteses valvulares cardíacas; hemodinâmica

INTRODUCTION

In the last few years, with the advent of transcatheter aortic valve implantation (TAVI), patients with symptomatic severe aortic stenosis, who previously had no treatment possibility due to contraindication or high surgical risk, began to have a treatment option.11 Brito Jr FS, Abizaid A, Almeida BO, Caixeta A, Tarasoutchi F, Grube E, et al. Implante por cateter de bioprótese valvar para tratamento da estenose aórtica: experiência de três anos. Arq Bras Cardiol. 2012; 99(2):697-705. Despite this new mode of intervention, these patients have high mortality at 2 years: 33.9% in high-risk cases and 43.3% in the inoperable.22 Kodali SK, Williams MR, Smith CR, Svensson LG, Webb JG, Makkar RR, et al. Two-year outcomes after transcatheter or surgical aortic-valve replacement. N Engl J Med. 2012; 366:1686-95.,33 Leon MB, Smith CR, Mack M, Miller DC, Moses JW, Svensson LG, et al. Transcatheter aortic-valve implantation for aortic stenosis in patients who can not undergo surgery. N Engl J Med. 2010; 363:1597-607.

The Society of Thoracic Surgeons (STS)44 O'Brien SM, Shahian DM, Filardo G, Ferraris VA, Haan CK, Rich JB, et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 2 - isolated valve surgery. Ann Thorac Surg. 2009; 88:S23.,55 Shahian DM, O'Brien SM, Filardo G, Ferraris VA, Haan CK, Rich JB, et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 1-coronary artery bypass grafting surgery. Ann Thorac Surg. 2009; 88:S2. score and the European System for Cardiac Operative Risk Evaluation II (EuroSCORE II)66 Nashef SA, Roques F, Sharples LD, Nilsson J, Smith C, Goldstone AR, et al. EuroSCORE II. Eur J Cardiothorac Surg. 2012; 41:734. are used to help stratify surgical risk and the indication of TAVI. However, they have limitations due to the difficulty in differentiating high-risk patients from those in which the procedure can be considered unproductive, and also because they do not include numerous comorbidities that cause adverse surgical outcomes such as chronic obstructive pulmonary disease, liver cirrhosis, pulmonary hypertension, previous cardiac surgery, porcelain aorta, recurrent pulmonary embolism, right ventricular failure, contraindication to open chest surgery (previous chest irradiation) or fragility. Thus, the role of risk scores as a predictive tool is questionable and there are no values to define patients not eligible for TAVI.77 Mylotte D, Martucci G, Piazza N. Patient selection for transcatheter aortic valve implantation: An interventional cardiology perspective. Ann Cardiothorac Surg. 2012; 1(2):206-15.

8 Van Mieghem NM, Serruys PW . The art of risk stratification in TAVI. Eur Heart J. 2013; 34:1859-61.
-99 Durand E, Borz B, Godin M, Tron C, Litzler PY, Bessou JP, et al. Performance analysis of EuroSCORE II compared to the original logistic EuroSCORE and STS scores for predicting 30-day mortality after transcatheter aortic valve replacement. Am J Cardiol. 2013; 111(6):891-7.

The objective of this study was to evaluate the performance of the EuroSCORE II and STS as predictors of in-hospital mortality and 30-day mortality in patients undergoing TAVI.

METHODS

Single-center retrospective study that included 59 consecutive patients with severe aortic stenosis, defined in accordance with current guidelines,1010 Tarasoutchi F, Montera MW, Grinberg M, Barbosa MR, Piñeiro DJ, Sánchez CRM, et al. Diretriz Brasileira de Valvopatias - SBC 2011 / I Diretriz Interamericana de Valvopatias - SIAC 2011. Arq Bras Cardiol. 2011; 97(5 supl. 1):1-67. symptomatic, who underwent TAVI in the period between 2010 and 2014. All cases were evaluated by a multidisciplinary team (Heart team) and underwent clinical assessment, electrocardiogram, chest X-ray, echocardiogram, multislice computed tomography of the aorta and branches, cine coronary angiography and laboratory tests. EuroSCORE II and STS scores were calculated using online tools (www.euroscore.org and riskcalc.sts.org/STSWebRiskCalc273). The procedure was performed in the cardiac catheterization lab or hybrid operating room under general anesthesia and with transesophageal echocardiography guidance. Medtronic CoreValve and Edwards Sapien heart valves were used. Complications and outcomes were defined according to the Valve Academic Research Consortium Consensus on Event Definition.1111 Kappetein AP, Head SJ, Généreux P, Piazza N, van Mieghem NM, Blackstone EH, et al. Updated standardized endpoint definitions for transcatheter aortic valve implantation: the Valve Academic Research Consortium-2 consensus document. J Am Coll Cardiol. 2012; 60:1438e1454.Fragility, characterized as poor physiological reserve,1313 Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001; 56:M146-56. was defined based on the index by Fried et al.1313 Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001; 56:M146-56. derived from the cohort of the Cardiovascular Health Study (CHS) with 5317 patients over 65 years, and includes items such as: weight loss, exhaustion, weakness, walking speed and reduced physical activity. Those with 3 or more criteria are considered fragile, adding risk of post-surgical complications, including mortality.1313 Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001; 56:M146-56.

Continuous variables are presented as means ± standard error while categorical variables are shown as frequencies and percentages. The continuous variables were analyzed using unpaired Student's t-test, and the categorical variables using Fisher's exact test. Data normality was tested by Kolmogorov-Smirnov test. Discriminative power was assessed by receiver operating characteristic (ROC) curve and area under the curve (AUC), accompanied by 95% confidence interval. The test used for comparison of ROC curves was DeLong et al.1414 DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operation characteristic curves: a nonparametric approach. Biometrics. 1988; 44(3):837-45. A p value <0.05 was considered statistically significant and the software used for the statistical analysis was MedCalc 15.4 (MedCalc Software bvba, Spain). This study was approved by the Research Ethics Committee.

RESULTS

Population characteristics

Baseline characteristics are described in Table 1. The average age was 81.0±7.3 years, 42.3% men. Etiology was degenerative in 96.61%, rheumatic in 1.69% and in 1.69%, bicuspid. The valve-in-valve procedure was performed in 8.47%. The average EuroSCORE II was 6.7±7.3% and STS 20.7±10.3%; 13.55% of patients had EuroSCORE II greater than 10%, while 91.5% had STS greater than 10%. The electrocardiographic evaluation shows atrioventricular conduction disorders in 15.2%, right bundle branch block in 6.7% and left bundle branch block in 6.7%. Echocardiography revealed a mean ejection fraction of 56±13.6%, mean aortic gradient of 47.5±16.7 mmHg and aortic valve area of 0.69±0.21 cm². Regarding laboratory tests, mean hemoglobin was 11.6±1.8 g/dL, serum creatinine 1.30±0.71 mg/dL and urea 60±29.2 mg/d. The average diameter of the valve annulus measured by computed tomography was 25.4±3.6vs. 24.0±4.7 mm and the distances of the left and right coronary ostia were 13.4±2.6 mm and 14.1±3.1 mm, respectively.

TABLE 1
Baseline characteristics of the population

Procedure

Transfemoral access was used in 88.13%, transapical in 3.38%, and transaortic in 8.47%. In 25.42% of cases, pre-dilatation was required, while 38.9% underwent post-dilatation due to peri-prosthetic failure. In 11.8%, coronary angioplasty was performed before the procedure. Medtronic CoreValve heart valves were used in 64.4% of patients, and Edwards Sapien valves in 35.59%.

Outcomes

General in-hospital mortality was 10.1% and 30-day mortality was 13.5%, all related to the procedure (Table 2). Two deaths (3.38%) occurred during the procedure due to cardiac tamponade. The remainder was caused by poor positioning of the prosthesis/thrombosis (1.69%), sepsis with worsening of heart function (3.38%), infective endocarditis with coronary embolization (1.69%) and aortic rupture (1.69%). None of the other deaths were witnessed. As for the transfemoral procedure alone, in-hospital mortality was 5.08% and 30-day mortality was 8.47%. In-hospital outcomes included stroke in 5.08%, major vascular complications in 8.47%, myocardial infarction in 1.69%, infective endocarditis in 5.08%, kidney injury in 23.7%, and need for permanent pacemaker implantation in 8.47%. In the latter, 10.8% used Medtronic CoreValve heart valves and 4.5% used Edwards Sapien valves.

TABLE 2
Outcomes

Predictors

In the overall analysis, patients who died showed STS and EuroSCORE II significantly higher than the survivors (33.7±16.7 vs.18.6±7.3 %; p= 0.0001 for STS and 13.9±16.1 vs.4.8±3.8 %; p= 0.0007 for EuroSCORE II). In the ROC curve analysis, STS showed AUC at 0.81, while EuroSCORE II AUC was 0.77; no difference was found in discrimination ability using ROC (p=0.72) (Figure 1). Other clinical, laboratory and echocardiographic variables, as well as those related to the procedure, were analyzed and did not show statistical significance, except for left ventricular ejection fraction, higher in the patients who died (p=0.03) (Table 3).

FIGURE 1
ROC curve analysis: STS showed AUC at 0.81, while EuroSCORE II AUC was 0.77.

TABLE 3
Variables related to supplementary exams

Among the patients undergoing transfemoral procedure, STS and EuroSCORE II results of those who died were higher than observed in the surviving group (38.1±18.1 vs. 18.7±7.5%; p< 0.01 for STS and 18.6±17.4 vs. 4.9±3.9 %; p< 0.01 for EuroSCORE II).

In the global univariate analysis, right bundle branch block was a predictor of permanent pacemaker (OR 24.0, RR 12.5; p=0,024). There was no association between type of cardiac prosthesis and need for pacemaker (p= 0.641).

DISCUSSION

The risk scores currently used (EuroSCORE II & STS) were derived from databases of patients undergoing cardiac surgery.1515 Sedaghat A, Sinning JM, Vasa-Nicotera M, Ghanem A, Hammerstingl C, Grube E, et al. The revised EuroSCORE II for the prediction of mortality in patients undergoing transcatheter aortic valve implantation. Clin Res Cardiol. 2013; 102(11):821-9.,1616 Stähli BE, Tasnady H, Lüscher TF, Gebhard C, Mikulicic F, Erhart L, et al. Early and late mortality in patients undergoing transcatheter aortic valve implantation: comparison of the novel EuroScore II with established risk scores. Cardiology. 2013; 126(1):15-23. In addition, TAVI patients are usually elderly, with greater surgical risk and with numerous risk factors often not included in the current scores.77 Mylotte D, Martucci G, Piazza N. Patient selection for transcatheter aortic valve implantation: An interventional cardiology perspective. Ann Cardiothorac Surg. 2012; 1(2):206-15.

8 Van Mieghem NM, Serruys PW . The art of risk stratification in TAVI. Eur Heart J. 2013; 34:1859-61.
-99 Durand E, Borz B, Godin M, Tron C, Litzler PY, Bessou JP, et al. Performance analysis of EuroSCORE II compared to the original logistic EuroSCORE and STS scores for predicting 30-day mortality after transcatheter aortic valve replacement. Am J Cardiol. 2013; 111(6):891-7.,1515 Sedaghat A, Sinning JM, Vasa-Nicotera M, Ghanem A, Hammerstingl C, Grube E, et al. The revised EuroSCORE II for the prediction of mortality in patients undergoing transcatheter aortic valve implantation. Clin Res Cardiol. 2013; 102(11):821-9.,1616 Stähli BE, Tasnady H, Lüscher TF, Gebhard C, Mikulicic F, Erhart L, et al. Early and late mortality in patients undergoing transcatheter aortic valve implantation: comparison of the novel EuroScore II with established risk scores. Cardiology. 2013; 126(1):15-23. For these reasons, there is a need to identify predictors that help distinguish patients who may not benefit from the percutaneous procedure.

Data reported in the literature differ with respect to the mortality prediction ability of the EuroSCORE II and STS scores. While Stahli et al.1616 Stähli BE, Tasnady H, Lüscher TF, Gebhard C, Mikulicic F, Erhart L, et al. Early and late mortality in patients undergoing transcatheter aortic valve implantation: comparison of the novel EuroScore II with established risk scores. Cardiology. 2013; 126(1):15-23. in a cohort of 350 patients and Sedaghat et al.1515 Sedaghat A, Sinning JM, Vasa-Nicotera M, Ghanem A, Hammerstingl C, Grube E, et al. The revised EuroSCORE II for the prediction of mortality in patients undergoing transcatheter aortic valve implantation. Clin Res Cardiol. 2013; 102(11):821-9. in a cohort of 206 patients demonstrated the superiority of EuroSCORE II, Hemmann et al.1717 Hemmann K, Sirotina M, De Rosa S, Ehrlich JR, Fox H, Weber J, Moritz A, et al. The STS score is the strongest predictor of long-term survival following transcatheter aortic valve implantation, whereas access route (transapical versus transfemoral) has no predictive value beyond the periprocedural phase. Interact Cardiovasc Thorac Surg. 2013; 17(2):359-64.in a record of 426 patients considered the STS superior. Other studies, as well as our work, demonstrated no difference between the scores, and, in our case, both the EuroSCORE II and STS scores had the ability to predict mortality, with AUC of 0.77 and 0.81, respectively. Since in our population the number of transaortic and transapical procedures was significantly lower than that of transfemoral procedures, preventing a comparative analysis, we chose to analyze the transfemoral procedure separately, and the findings were similar to the global analysis regarding mortality predictors.

In our study, STS overestimated the in-hospital and 30-day mortality rates, while the EuroSCORE II underestimated this outcome (Figure 2). One possible explanation for this finding is the fact that the STS score is composed of 40 clinical parameters for calculation, while the EuroSCORE II requires only 18. Despite that, in our study, STS score did not prove to be better able to predict mortality.1616 Stähli BE, Tasnady H, Lüscher TF, Gebhard C, Mikulicic F, Erhart L, et al. Early and late mortality in patients undergoing transcatheter aortic valve implantation: comparison of the novel EuroScore II with established risk scores. Cardiology. 2013; 126(1):15-23.

FIGURE 2
Mortality observed in hospital, in 30 days, and predicted by EuroSCORE II and STS scores.

A finding in this study was that the left ventricular ejection fraction of patients who progressed to death was significantly higher than seen in the survivors (65.25±1.74% for death and 54.58±14.18 for survival; p=0.03). However, the average of the two groups was within the normal range and none of the witnessed deaths was due to cardiogenic shock.

Among the risk variables not included in the scores, fragility is a challenge for preoperative evaluation and causes significant impact on morbidity and postoperative mortality.1212 Ahmed N, Mandel R, Fain MJ. Frailty: an emerging geriatric syndrome. Am J Med. 2007; 120:748-53.,1313 Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001; 56:M146-56. It was observed in 52.5% of patients and in 75% of those who died, confirming its importance for indication of percutaneous procedure and its influence on mortality in this therapeutic modality, although without statistical significance.

LIMITATIONS

This is a single-center study with a small sample population. In addition, being a record, it has no power to assess the impact of prognostic tools.

CONCLUSION

In this cohort, among patients with severe aortic stenosis undergoing TAVI, STS and EuroSCORE II were predictors of in-hospital and 30-day mortality. In the absence of a risk score developed exclusively for this procedure, these scores can be useful as tools to aid clinical decision.

  • Study conducted at Instituto do Coração (InCor) do Hospital das Clínicas, Faculdade de Medicina, Universidade de São Paulo (FMUSP), São Paulo, SP, Brazil
  • Financial support: none
  • Ethical aspects: the authors declare that there are no conflicts of interest. The study was approved by the Ethics Committee for Research Project Analysis - CAPPesq - Hospital das Clínicas, FMUSP, on 3/26/14, number 569304.

References

  • 1
    Brito Jr FS, Abizaid A, Almeida BO, Caixeta A, Tarasoutchi F, Grube E, et al. Implante por cateter de bioprótese valvar para tratamento da estenose aórtica: experiência de três anos. Arq Bras Cardiol. 2012; 99(2):697-705.
  • 2
    Kodali SK, Williams MR, Smith CR, Svensson LG, Webb JG, Makkar RR, et al. Two-year outcomes after transcatheter or surgical aortic-valve replacement. N Engl J Med. 2012; 366:1686-95.
  • 3
    Leon MB, Smith CR, Mack M, Miller DC, Moses JW, Svensson LG, et al. Transcatheter aortic-valve implantation for aortic stenosis in patients who can not undergo surgery. N Engl J Med. 2010; 363:1597-607.
  • 4
    O'Brien SM, Shahian DM, Filardo G, Ferraris VA, Haan CK, Rich JB, et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 2 - isolated valve surgery. Ann Thorac Surg. 2009; 88:S23.
  • 5
    Shahian DM, O'Brien SM, Filardo G, Ferraris VA, Haan CK, Rich JB, et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 1-coronary artery bypass grafting surgery. Ann Thorac Surg. 2009; 88:S2.
  • 6
    Nashef SA, Roques F, Sharples LD, Nilsson J, Smith C, Goldstone AR, et al. EuroSCORE II. Eur J Cardiothorac Surg. 2012; 41:734.
  • 7
    Mylotte D, Martucci G, Piazza N. Patient selection for transcatheter aortic valve implantation: An interventional cardiology perspective. Ann Cardiothorac Surg. 2012; 1(2):206-15.
  • 8
    Van Mieghem NM, Serruys PW . The art of risk stratification in TAVI. Eur Heart J. 2013; 34:1859-61.
  • 9
    Durand E, Borz B, Godin M, Tron C, Litzler PY, Bessou JP, et al. Performance analysis of EuroSCORE II compared to the original logistic EuroSCORE and STS scores for predicting 30-day mortality after transcatheter aortic valve replacement. Am J Cardiol. 2013; 111(6):891-7.
  • 10
    Tarasoutchi F, Montera MW, Grinberg M, Barbosa MR, Piñeiro DJ, Sánchez CRM, et al. Diretriz Brasileira de Valvopatias - SBC 2011 / I Diretriz Interamericana de Valvopatias - SIAC 2011. Arq Bras Cardiol. 2011; 97(5 supl. 1):1-67.
  • 11
    Kappetein AP, Head SJ, Généreux P, Piazza N, van Mieghem NM, Blackstone EH, et al. Updated standardized endpoint definitions for transcatheter aortic valve implantation: the Valve Academic Research Consortium-2 consensus document. J Am Coll Cardiol. 2012; 60:1438e1454.
  • 12
    Ahmed N, Mandel R, Fain MJ. Frailty: an emerging geriatric syndrome. Am J Med. 2007; 120:748-53.
  • 13
    Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001; 56:M146-56.
  • 14
    DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operation characteristic curves: a nonparametric approach. Biometrics. 1988; 44(3):837-45.
  • 15
    Sedaghat A, Sinning JM, Vasa-Nicotera M, Ghanem A, Hammerstingl C, Grube E, et al. The revised EuroSCORE II for the prediction of mortality in patients undergoing transcatheter aortic valve implantation. Clin Res Cardiol. 2013; 102(11):821-9.
  • 16
    Stähli BE, Tasnady H, Lüscher TF, Gebhard C, Mikulicic F, Erhart L, et al. Early and late mortality in patients undergoing transcatheter aortic valve implantation: comparison of the novel EuroScore II with established risk scores. Cardiology. 2013; 126(1):15-23.
  • 17
    Hemmann K, Sirotina M, De Rosa S, Ehrlich JR, Fox H, Weber J, Moritz A, et al. The STS score is the strongest predictor of long-term survival following transcatheter aortic valve implantation, whereas access route (transapical versus transfemoral) has no predictive value beyond the periprocedural phase. Interact Cardiovasc Thorac Surg. 2013; 17(2):359-64.

Publication Dates

  • Publication in this collection
    Jan-Feb 2016

History

  • Received
    17 July 2015
  • Accepted
    01 Dec 2015
Associação Médica Brasileira R. São Carlos do Pinhal, 324, 01333-903 São Paulo SP - Brazil, Tel: +55 11 3178-6800, Fax: +55 11 3178-6816 - São Paulo - SP - Brazil
E-mail: ramb@amb.org.br