Acessibilidade / Reportar erro

The SF-6D Brazil: construction models and applications in health economics

Abstracts

OBJECTIVE: To compare the preference measurements of the SF-36, derived from two Brazilian versions of the questionnaire Short Form 6 Dimensions - Brazil (SF-6D Brazil). METHODS: Cross-sectional study. We applied the tools to assess quality of life: HAQ, SF-36, EQ-5D and SF-6D (version 1998 and 2002). Descriptive statistics and correlation coefficients were used for data analysis. RESULTS: We studied 200 patients with rheumatoid arthritis, with a mean age of 49.22 years, 11.16 years of disease and mean HAQ 1.02. Preferences measured by the two versions of the SF-6D and the EQ-5D showed significant correlations between each other, with Pearson coefficients ranging from 0.59 to 0.88 (p <0.01). CONCLUSION: The latest version of the SF-6D based on the model 2002 is presented as a valid measurement when compared to the originally validated questionnaire in Brazil and represents an option for assessing preferences for economic analyses conducted in this country.

Arthritis, rheumatoid; Quality of life; Quality-adjusted life years


OBJETIVO: Comparar as medidas de preferência derivadas do SF-36 a partir das duas versões brasileiras do questionário Short-Form 6 Dimensions - Brasil (SF-6D Brasil). MÉTODOS: Estudo observacional e transversal. Foram aplicados os instrumentos de avaliação de qualidade de vida: HAQ, SF-36, EQ-5D e SF-6D (versão de 1998 e 2002). Estatísticas descritivas e coeficientes de correlação foram usados para a análise dos dados. RESULTADOS: Foram avaliados 200 pacientes portadores de artrite reumatoide, com média de idade de 49,22 anos, tempo medido de doença de 11,16 anos e HAQ médio de 1,02. As preferências mensuradas pelas duas versões do SF-6D e pelo EQ-5D apresentaram correlações significativas entre si com coeficientes de Pearson variando de 0,59 a 0,88 (p<0,01). CONCLUSÃO: A versão mais atual do SF-6D, baseada no modelo de 2002, apresenta-se válida quando comparada com a versão inicialmente validada para o Brasil e representa uma opção de questionário para a avaliação de preferências em análises econômicas realizadas em nosso meio.

Artrite reumatoide; Anos de vida ajustados por qualidade de vida; Qualidade de vida; Economia da Saúde


ORIGINAL ARTICLE

The sf-6D Brazil questionnaire: generation models and applications in health economics

Alessandro Gonçalves CampolinaI,*; Adriana Bruscato BortoluzzoII; Marcos Bosi FerrazIII; Rozana Mesquita CiconelliIII

IMestre em Ciências – Médico da Universidade Federal de São Paulo – Unifesp, São Paulo, SP

IIDoutora em Estatística – Professora da Insper Instituto de Ensino e Pesquisa, São Paulo, SP

IIILivre-docentes – Professores da Universidade Federal de São Paulo – Unifesp, São Paulo, SP

ABSTRACT

OBJECTIVE: Compare the preference measures derived from the SF-36, based on the two Brazilian versions of the Short Form 6 Dimensions questionnaire - Brazil (SF-6D Brazil).

METHODS: Observational and transversal study. The following quality of life assessment instruments were applied: HAQ, SF-36, EQ-5D and SF-6D (1998 and 2002 versions). Descriptive statistics and correlation coefficients were used for data analysis.

RESULTS: The study assessed 200 patients suffering from rheumatoid arthritis, with a mean age of 49.22 years, mean time with the disease of 11.16 years and mean HAQ score of 1.02. Preferences measured by the two versions of the SF-6D and by the EQ-5D showed significant correlations with one another, and Pearson coefficients ranged from 0.59 to 0.88 (p<0.01).

CONCLUSION: The most current version of the SF-6D, based on the 2002 model, was found to be valid when compared to the version initially validated to Brazil and is a questionnaire alternative to assess preferences in economic analyses carried out in health care.

Key words: Rheumatoid arthritis. Quality-adjusted life year. Quality of life. Health economics.

INTRODUCTION

In the past few decades, the scientific community's growing interest for the field of quality of life and Health Economics has led to significant development in methods applied in the assessment of new technologies1.

In that sense, two main approaches have been used to assess health-related quality of life: the use of descriptive measures and the preference-based measures. Descriptive approaches are those that use instruments with various domains, allowing for a broad description of the state of health. Approaches based on preference are those that seek to capture the value or usefulness, attributed by individuals, of a given health status, listing various possible scenarios and variables, from perfect health to death, in quantitative scales2.

With a view for application in decision-making analyses and in health economics analyses, the second approach has been more valued because it has greater theoretical support and because it allows for a measure of quality-adjusted life years (QALYs)3.

The concept of QALYs was developed in the 1970s, based on the pioneer studies by Torrance4, in Canada, and Kaplan et al., in the United States5. The advantage of using this measure is that it allows researchers to simultaneously capture gains with the reduction of morbidity (quality) and with the reduction of mortality (quantity), integrating both into a single score. Besides that, it enables adding the benefits obtained by different interventions in different health conditions6.

Application of the "QALY gain" measure can be better understood through some simple examples. We may consider an individual whose quality of life is reduced at a rate of 0.03 for 30 years due to the use of antihypertensive drugs in order to gain 10 years of life with a 0.9 level of quality. This individual's QALYs gain is 10 x 0.9 - 30 x 0.03 = 8.1. Likewise, we could consider a program that extends the life expectancy of some individuals for two years at a 0.50 level of quality and that improves the quality of life of other individuals from 0.50 to 0.75 for two years. The QALYs gain for the group of individuals would be 2 x 0.50 + 2 x 0.25 = 1.5.

The QALY model is the most widely used to assess outcomes in health care economic analyses, because it is intuitive, practical and easy to understand for clinicians and decision-makers7.

The generation of this measure is only possible, however, because quality of life can only be quantified by applying the concept of utility, based on the the theory of decision-making under uncertainty published in 1944 by John von Neumann and Oscar Morgenstern, based on which it is understood that individuals have preferences for different health states8-9.

Preference is a broad concept which expresses an individual's desire for a certain state, involving both the concept of utility as the concept of values. Utility is a specific type of preference, measured under uncertainty conditions, according to the paradigm founded by Von Neumann and Morgenstern. Values are preferences measured under certainty conditions, so as not to express subjective attitude when faced with risk, in the face of a decision10.

Based on this paradigm, various authors have looked for ways to generate QALYs through preferences taken from generic quality of life instrument Medical Outcomes Study 36-Item Short-Form Health Survey (SF-36)11, once this is a widely evaluated questionnaire, applied for over 200 diseases and translated in 40 countries12 .

AAt the present time, six publications, with eight different algorythms, have detailed methods to derive utility from SF-3613. The practicality, validity and responsiveness of these algorithms for preferences derived from the SF-36 have been tested in groups of patients who had various diseases or had undergone various interventions: low back pain14, deppression15, asthma14, lung transplant16, chronic renal failure17 and chronic hepatitis C 18.

As a result of these investigation efforts, the questionnaire Short-Form 6 dimensions (SF-6D) was developed in the United Kingdom, to allow researchers to obtain preference measures in health care, based on items from the SF-3619-20.

In Brazil, the first version of this questionnaire (made up of two generation models and developed in 1998) has already been translated and validated21. However, the comparison of this version with the new generation model of the SF-6D, developed in 2002, is not yet available.

The growing application of preference measures and the QALYs model for economic analysis of new interventions in health makes it essential to improve these measurement techniques.

The present study aims to compare the two generation models for the SF-6D (1998 version) with the new model for this questionnaire (2002 version), developed by Brazier et al.

METHODS

Participants

The sample was selected at the Rheumatology outpatient clinic of Universidade Federal de São Paulo, from April 2005 to April 2006.

The study included patients with a diagnosis of rheumatoid arthritis, according to the American College of Rheumatology criteria – (ACR)22, undergoing follow-up at the service, and who signed a written consent form. This population was selected because it has been previously evaluated for the translation, cultural adaptation and validation of the SF-36 questionnaire for Brazil.

Patients who has been diagnosed and/or undergoing treatment for other, associated rheumatic diseases, psychiatric condition or fibromyalgia were excluded. Patients with severe cognitive deficit that made it impossible for them to understand the research instruments were also excluded.

All participants signed the written consent form approved by the Universidade Federal de São Paulo Research Ethics Committee.

Evaluation Instruments

The Short Form 6 Dimension (SF-6D Brazil) questionnaire

Brazier et al. restructured the SF-36 into a health index called SF-6D, based on scenarios built with questions from that questionnaire and measured by the Standard Gamble (SG) and Visual Analogue Scale (VAS). The SF-36 questionnaire was reduced by combining two domains (role physical and role emotional) and eliminating the general health domain19. The classification system obtained was, therefore, structured in six domains, with the capacity to describe 9,000 health states based on the developed questionnaire21.

After this, a group of 59 health states described by the classification system was tested on a convenience sample, made up of 165 individuals, including health care professionals, students and patients. Each respondent was asked to assign preferences to the 12 health states described, using the VAS and SG techniques. Finally, the health states described by the classification system were mapped and associated with the direct preference measures (VAS and SG), by means of two multiple regression19.

EIn 2002, Brazier et al. reviewed the SF-36, establishing a new classification of health states into six domains. A total of 249 states defined by the SF-6D was valued in a representative sample of 611 members of the United Kingdom population, using the SG technique20. A health state can therefore be defined by the SF-6D by selecting one item in each of the six dimensions or domains that make up the instrument, beginning by the physical function and ending by vitality. A total of 18,000 health states can be defined in this manner, based on the structured questionnaire (Annex). All the answers in the original SF-36 questoinnaire can be used to build the SF-6D as long as the 10 items used to build the SF-6D have been completed.

The SF-36 items used for the construction of the SF-6D (2002 version) were as follows: functional capacity (items 1, 2 and 10); global limitation (item 3 from physical aspects and item 2 from emotional aspects); social aspects (item 2); pain (all items); mental health (item 1); and vitality (item 2).

The SF-6D unique score, which varies from 0 to 1, represents the strenght of an individual's preference for a given health state, in a scale in which 0 is equal to the worst health state and 1 is equal to the best health state19-20.

The Medical Outcomes Study 36-Item Short-Form Health Survey (SF-36)

The SF-36 is a generic quality of life questionnaire made up of 36 items (questions), distributed among eight domains and summarized into one physical component and one mental component. The score for each of the eight domains varies from 0 (worst health state) to 100 (best health state). The Brazilian version of the questionnaire can already be found in the scientific literature and was used for this study23.

Health Assessment Questionaire (HAQ)

The Health Assessment Questionaire (HAQ) is a specific quality of life instrument developed to enable the assessment of health state parameters in therapeutic tests involving patients with rheumatoid arthritis24. The scale includes a total of 20 items, grouped into eight categories, with two or three questions, accoriding to the daily life activities to which they refer. The score for each category varies from 0, assigned to the absence of difficulty, to three, for the inability to perform a given activity. Based on the category scores, the final score of the instrument can be obtained, which ranges from 0 to 3.

Euroqol-5D (EQ-5D)

The Euroqol-5D (EQ-5D) is an instrument developed in Europe for indirect measure of preferences for health states, validated in our field and widely used in health economics analyses. The tool is made up of five assessment domains, whose scale ranges from -0,594 to 1,000, and by a visual analogue scale of 20 cm, ranging from 0 (worst possible health state) to 100 (best possible health state) 25. The EQ-5D score was obtained by means of York tariffs for the English population26.

Statistical analysis

Data for this transversal study were collected by means of applying the instruments through an interview.

The focus of analysis is comparing the measures derived from the three generation models of the SF-6D (two from the 1998 version and one from the 2002 version) with one another and with the EQ-5D.

All analyses were performed using computer application SPSS® version 11.0 for Windows®. Descriptive statistics was employed to characterize the sample, through a socio-demographic questoinnaire. Correlations between the preferences measured by the SF-6D models and those obtained with the EQ-5D were determined using the Pearson correlation coefficient. For this study, we adopted p<0.05 (alpha = 5%) for statistically significant values.

RESULTS

A total of 200 patients who met the ACR criteria for rheumatoid arthritis and had agreed to take part in the study were evaluated. From the 200 individuals evaluated, 200 completed SF- 6D and EQ-5D, and 199 completed the HAQ.

The mean age of participants was 49.22 years (SD = 10), and 78% were female. Most individuals identified their skin color as white (41%) and brown (56.5%). Most were married (56.5%) and inactive in the job market (62%). Mean education was 6.38 years (SD = 4.1); mean family income per capita was R$ 366.88 (DP = 367.6) and mean number of residents per home was 3.80 residents (SD = 1.8).

Mean time with the disease was 11.16 years (SD = 8.4), and most participants belonged to the I and II functional categories (33% and 38.5%, respectively) and presented a mean HAQ of 1.02; 74% of individuals did not present extra-articular manifestation and 73% presented articular deformities. At the time of the assessment, the mean number of painful articulations was 5.56 e and the number of edematized articulations was 7.35. The self-assessment of pain and general state by VAS had a mean 41.42 mm (SD = 25.1) and 67.30 mm (SD = 20.7), respectively, for the participants in the study.

Table 1 presents the mean of domains and summaries obtained from the SF-36.

Table 2 presents the mean obtained for the preference measures obtained from the generation models of the SF-6D and from the EQ-5D.

Table 3 shows significant correlations (p<0.01) between the algorithms of preferences derived from the SF-6D and from the EQ-5D with correlation coefficients ranging from 0.59 to 0.88.

DISCUSSION

Over the years, the preference assessment systems based in questionnaires played an important role in disseminating the application of preference measures in developing countries because they were less influenced by the cognitive state and socioeconomic conditions of the evaluated individuals10.

The methods developed by Brazier in 1998 and 2002 derive direct preference measures (VAS and SG), having been built on valuations of hypothetical scenarios generated through the SF-36 in a sample of the British population19-20, which was then included in the SF-6D.

Despite the differences generated, which may harm the comparison of of studies that use different methods, the algorithms developed for the SF-6D presented correlations ranging from mild to strong with one another, which initially suggests that they are measuring the same construct. Similar findings are confirmed by studies that have used different methods to derive preference from the SF-36 in various populations13, 14, 16, 18.

When we compared the study by Kaplan et al. with our data, we observed very similar correlations between the preferences obtained by the tested algorithms and those of the EQ-5D27. In the studies that have evaluated other diseases, we also observed good correlations between different indirect measures of preference when compared to measures derived from the SF-3628, 29, 30.

Generally, the methods presented very similar behaviors when compared with one another and with the EQ-5D, which suggests the good validity of the construct. According to another study conducted previously in our field, the SF-6D (1998 version) also presented significant correlatoin with the clinical parameters of the population evaluated and with the direct measures of preference (Standard Gamble, Time Trade-Off and Visual Analogue Scale), which are seen as the gold standard for the measurement of preferences for health states21.

Some characteristics of the methods proposed by Brazier et al. deserve to be brought out in order to make the selection and comparison with other methods of deriving preferences from the SF-36. The Brazier method is the only one that estimates the SG (which is regarded as theoretically more consistent, in terms of health decision analysis), and also the only one to use hypothetical scenarios in valuation; that is, individuals do not assess their own health state. The literature highlights a tendency to obtain higher values when hypothetical scenarios are used31. On the other hand, the Cost-Effectiveness Panel in Health and Medicine has been standing up for the use of values obtained from the community and not from patients, when conducting economic analyses32. The Brazier method has been more commonly used in recent studies, especially the most up-to-date version, from 2002, which may, in the future, contribute to improve the assessment of the SF-6D validity33-37.

It is also interesting to highlight that both the methods that use the SF-36 questionnaire and those that use the SF-6D questionnaire present strong correlations with one another14-18, 21, 27. This behavior suggests that, regardless of using the SF-6D questionnaires, the measures derived from the SF-36 presented similar values. Therefore, studies that used the SF-36 could obtain preference measures in a practical way, simply by deriving preferences with the proposed algorithms, including Brazier's itself.

Some limitations of this study must be highlighted. First of all, the sample selected from a reference center may not be a good representation of the universe of patients with rheumatoid arthritis. Secondly, this study did not assess the responsiveness of the SF-6D to changes in the clinical picture of the disease over time. However, the study by Kaplan et al. has shown good responsiveness of the Fryback, Nichol and Brazier algorithms27.

CONCLUSION

The different generation models of the SF-6D present moderate to strong correlations with one another and with the preferences measured by the EQ-5D. This behavior suggests that the application of these different models are valid sources of preference measures for application in economic health analyses.

The most current version of the SF-6D, based on the 2002 model, was found to be valid when compared to the version initially validated to Brazil and is a questionnaire alternative to assess preferences in economic analyses carried out in health care.

Financial Support: Capes

Conflict of interest: No conflicts of interest declared concerning the publication of this article.

REFERÊNCIAS

  • 1. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46:1417-32.
  • 2. Revicki DA. Relationship of pharmacoeconomics and health-related quality of life. In: Spilker B, editor. Quality of life and paharmacoeconomics in clinical trials. Philadelphia (USA): Lippincott-Raven Publishers; 1996. p.1077-83.
  • 3. Nichol MB, Sengupta N, Globe DR. Evaluating quality-adjusted life years: estimation of the health utility index (HUI2) from the SF-36. Med Decis Making. 2001;21:105-12.
  • 4. Torrance GW. Social preferences for health states: an empirical evaluation of three measurement techniques. Socioecon Plan Sci.1976;10:128-36.
  • 5. Kaplan R M, Bush J W, Berry C. Health status: Types of validity and the index of well-being. Health Serv Res. 1976;11:478-507.
  • 6. Torrance GW. Designing and conducting cost-utility analyses. In: Spilker B, editor. Quality of life and pharmacoeconomics in clinical trials. Philadelphia (USA): Lippincott-Raven Publishers; 1996. p.1105-11.
  • 7. Doctor JN, Bleichrodt H, Miyamoto J, et al. A new and more robust test of QALYs. J Health Econom. 2004;23:353-67.
  • 8. Torrance GW, Feeny DH. Utilities and Quality-Adjusted Life Years. Int J Technol Assess Health Care. 1989;5:559-75.
  • 9. Prieto L, Sacristán JA. Problems and solutions in calculating quality-adjusted life years (QALY's). Health Quality Life Outcomes 2003;1:80.
  • 10. Torrance GW, Furlong W, Feeny D. Health utility estimation. Expert Rev Pharmacoecon Outcomes Res.2002;2:99-108.
  • 11. Ware JE, Sherbourne CD. The MOS 36-item short health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30:473-83.
  • 12. Garrat AM, Schmidt L, Mackintosh A, Fitzpatrick R. Quality of life measurement: bibliographic study of patient assessed health outcome measures. BMJ. 2002;324:1417-21.
  • 13. Lee TA, Hollingworth W, Sullivan SD. Comparison of directly elicited preference to preferences derived from the SF-36 in adults with asthma. Med Decis Making. 2003;23:323-34.
  • 14. Hollingworth W, Deyo RA, Sullivan SD, Emerson SS, Gray DT, Jarvik LG. The practicality and validity of directly elicited and SF-36 derived health state preferences in patients with low back pain. Health Econ. 2002;11:71-85.
  • 15. Sherbourne CD, Unutzer J, Schoenbaum M, Schoenbaum M, Duan N, Lenert LA, et al. Can utility-weighted health-related quality-of-life estimates capture heath effects of quality improvement for depression? Med Care. 2001;39:1246-59.
  • 16. Lobo ES, Gross CR, Matthees BJ. Estimation and comparison of derived preference scores from the SF-36 in lung transplant patients. Qual Life Res. 2004;13:377-9.
  • 17. Maor Y, King M, Olmer L, Mozes B. A comparison of three measures: the time trade-off technique, global heath related quality of Life and the SF-36 in dialysis patients. J Clin Epidemiol. 2001;54:565-70.
  • 18. Thein HH, Krahn M, Kaldor JM, Dore GJ. Estimation of utilities for chronic hepatitis C from SF-36 scores. Am J Gastroenterol. 2005;100:643-51.
  • 19. Brazier J, Usherwood T, Harper R, Thomas K. Deriving a preference-based single index from the UK SF-36 Health Survey. J Clin Epidemiol. 1998;51:1115-28.
  • 20. Brazier JB, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21:271-92.
  • 21. Gonçalves Campolina A, Bruscato Bortoluzzo A, Bosi Ferraz M, Mesquita Ciconelli R. Validity of the SF-6D index in Brazilian patients with rheumatoid arthritis. Clin Exp Rheumatol. 2009;27:237-45.
  • 22. Arnett FC, Edworthy SM, Bloch DA, Mc Shane DJ, Fries JF, Cooper NS, et al. The American Rheumatism Association 1987 revised criteria for the classification of rheumatoid arthritis. Arthritis Rheum. 1988;31:315-24.
  • 23. Ciconelli RM, Ferraz MB, Santos W, Meinão I, Quaresma MR. Tradução para a língua portuguesa e validação do questionário genérico de avaliação de qualidade de vida SF-36 (Brasil SF-36). Rev Bras Reumatol. 1999;39:143-50.
  • 24. Wolfe F, Kleinheksel SM, Cathey MA, Hawley DJ, Spitz PW, Fries JF. The clinical value of the Stanford Health Assessment Questionnaire functional disability index in patients with rheumatoid arthritis. J Rheumatol. 1988;15:1480-8.
  • 25. Kind P. The performance characteristics of EQ-5D, a measure of health related quality of life for use in technology assessment. In: 13 Annual Meeting of International Society of Technology Assessment in Health Care 1997. p.81. Abstract.
  • 26. Dolan P. Modeling valuations for Euroqol Health States. Med Care. 1997;35:1095-108.
  • 27. Kaplan RM, Groessl EJ, Sengupta N, Sieber WJ, Ganiats TG. Comparison of measure utility scores and imputed scores from the SF-36 in patients with rheumatoid arthritis. Med Care. 2005;43:79-87.
  • 28. Longworth L, Bryan S. An empirical comparison of EQ-5D and SF-6D in liver transplant patients. Health Econ. 2003;12:1061-7.
  • 29. O' Brien BJ, Spath M, Blackhouse G, Severens JL, Dorian P, Brazier P. A view from the bridge: agreement between the SF-6D utility algorithm and the Health Utilities Index. Health Econ. 2003;12:975-81.
  • 30. Conner-Spady B, Suarez-Almazor ME. Variation in the estimation of quality-adjusted life-years by different preference-based instruments. Med Care. 2003;41:791-801.
  • 31. De Wit GA, Busschbach JJ, De Charro FT. Sensitivity and perspective in the valuation o health status: whose values count? Health Econ. 2000;9:109-26.
  • 32. Weinstein MC, Siegel JE, Gold MR, Kamlet MS, Russell LB. Recommendations of the panel of cost-effectiveness in health and medicine. JAMA. 1996;276:1253-8.
  • 33. Emery P, Kosinski M, Li T, Williams GR, Becker JC, Blaisdell B, et al. Treatment of rheumatoid arthritis patients with abatacept and methotrexate significantly improved health-related quality of life. J Rheumatol. 2006;33:681-9.
  • 34. Heiberg MS, Nordvag BY, Mikkelsen K, Rodevand E, Kaufmann C, Mowinckel P, et al. The comparative effectiveness of tumor necrosis factor-blocking agents in patients with rheumatoid arthritis and patients with ankylosing spondylitis: a six month, longitudinal, observational, multicenter study. Arthritis Rheum. 2005;52:2506-12.
  • 35. Teng YK, Verburg RJ, Sont JK, Van den Hout WB, Breedveld FC, Van Laar JM. Long-term follow up of health status in patients with severe rheumatoid arthritis after high-dose chemotherapy followed by autologous hematopoietic stem cell transplantation. Arthritis Rheum. 2005;52: 2272-6.
  • 36. Van den Hout WB, de Jong Z, Munneke M, Hazes JM, Breedveld FC. Arthritis Rheum. 2005;53:39-47.
  • 37. Russell AS, Conner-Spady B, Mintz A, Maksmymowych WP. The responsiveness of generic health status measures as assessed in patients with rheumatoid arthritis receiving infliximab. J Rheumatol. 2003;30:941-7.
  • *
    Correspondência: Rua Cincinato Braga, 463 - 21 Bela Vista - São Paulo - SP. CEP: 01333-011
  • Publication Dates

    • Publication in this collection
      12 Nov 2010
    • Date of issue
      2010

    History

    • Received
      18 Nov 2009
    • Accepted
      03 May 2010
    Associação Médica Brasileira R. São Carlos do Pinhal, 324, 01333-903 São Paulo SP - Brazil, Tel: +55 11 3178-6800, Fax: +55 11 3178-6816 - São Paulo - SP - Brazil
    E-mail: ramb@amb.org.br