Acessibilidade / Reportar erro

Impact of Haemophilus influenzae b (Hib) vaccination on meningitis in Central Brazil

Abstracts

OBJECTIVE: To assess the impact of the Haemophilus influenzae b (Hib) conjugate vaccine in reducing the incidence of meningitis among children under five years old. METHODS: A 'before-after' design was used to compare Hib meningitis incidence rates in the pre-vaccine (July 1995 - June 1999) and post-vaccine (July 1999 - June 2001) periods in the state of Goiás, central Brazil. Bacterial meningitis case definition was based on World Health Organization criteria. Incidence rates of S. pneumoniae and N. meningitidis were used for comparison purposes. Chi-squared and Student's t tests were used for statistical analysis. P-values below 0.05 were considered as statistically significant. RESULTS: 979 children with acute bacterial meningitis were detected throughout the entire period. The incidence rate of Hib meningitis decreased from 10.8 (x10(5)) in the pre-vaccine period to 2.3 (x10(5)) in the 2nd year post vaccination, leading to a risk reduction of 78%, targeted to the 7-23 months age group (p<0.05). A total of 65 cases of Hib meningitis were prevented. An increase in S. pneumoniae meningitis was observed. Vaccine failure was detected in one child. CONCLUSIONS: This study showed that mass immunization with Hib conjugate vaccine brought about an expressive decline in childhood Hib meningitis in Goiás soon after the first year. Notwithstanding, an enhancement of surveillance using high-accuracy tools is essential to: (i) detect a possible reemergence of Hib; (ii) identify vaccine failure, and (iii) monitor changes in the H. influenzae serotype profile over time.

Haemophilus influenzae type b; Meningitis, Haemophilus; Haemophilus Vaccines; Effectiveness


OBJETIVO: Avaliar o impacto da vacinação contra o Haemophilus influenzae b na incidência de meningites em crianças menores de cinco anos de idade. MÉTODOS: Utilizou-se o delineamento tipo "antes-depois" para comparar as taxas de incidência de meningites por Haemophilus influenzae b nos períodos pré-vacinação (julho/95-junho/99) e pós-vacinação (julho/99-junho/2001) no Estado de Goiás. A definição de caso de meningite bacteriana seguiu os critérios da Organização Mundial de Saúde. As taxas de meningite por Streptococcus pneumoniae e Neisseria. meningitidis foram utilizadas para efeito de comparação. Para análise estatística foram utilizados o teste de chi2 e o t de Student. Valores de p<0,05 foram considerados estatisticamente significantes. RESULTADOS: Foi detectada meningite bacteriana aguda em 979 crianças no período de estudo. A incidência de meningite por Haemophilus influenzae b diminuiu de 10,8x10(5) no período pré-vacinal para 2,3x10(5) no segundo ano pós-vacina, significando 78% de redução no risco, principalmente na faixa etária de 7-23 meses (p<0,05). Foram prevenidos 65 casos de meningite por Haemophilus influenzae b. Observou-se aumento na incidência de meningite por S. pneumoniae. Foi observada falha vacinal em um caso. CONCLUSÕES: Expressivo declínio da incidência de meningite por Haemophilus influenzae b foi detectado, precocemente, logo após o primeiro ano de introdução da vacina contra o Haemophilus influenzae b. Assim, se faz necessária a vigilância contínua com instrumental de alta acurácia para: (i) detectar re-emergência do Haemophilus influenzae b; (ii) avaliar possibilidade de falha vacinal; (iii) identificar mudanças no padrão dos sorotipos do H. influenzae.

Haemophilus influenzae tipo b; Meningite por Haemophilus; Vacinas anti-Haemophilus; Efetividade


ORIGINAL ARTICLES

Impact of Haemophilus influenzae b (Hib) vaccination on meningitis in Central Brazil

Luciana Leite Pineli SimõesI; Ana Lúcia S S AndradeII; Cristina A LavalIII; Renato M OliveiraII; Simmone A SilvaII; Celina M T MartelliII; Sueli L de A AlvesIV; Robmary M AlmeidaIV; João G AndradeV

IHospital de Doenças Tropicais. Goiânia, GO, Brasil

IIDepartamento de Saúde Coletiva Universidade Federal de Goiás. Goiânia. GO, Brasil

IIISecretaria da Saúde do Município de Goiânia. Goiânia, GO, Brasil

IVLACEN. Secretaria da Saúde do Estado de Goiás. Goiânia, GO, Brasil

VDepartamento de Medicina Tropical. Universidade Federal de Goiás. Goiânia. GO, Brasil

Correspondence Correspondence to Luciana Leite Pineli Simões Instituto de Patologia Tropical e Saúde Pública Rua Delenda Rezende de Melo, S/N Setor Universitário - 74605-050 Goiânia, GO, Brasil E-mail: pineli@doutor.com.br

ABSTRACT

OBJECTIVE: To assess the impact of the Haemophilus influenzae b (Hib) conjugate vaccine in reducing the incidence of meningitis among children under five years old.

METHODS: A 'before-after' design was used to compare Hib meningitis incidence rates in the pre-vaccine (July 1995 - June 1999) and post-vaccine (July 1999 - June 2001) periods in the state of Goiás, central Brazil . Bacterial meningitis case definition was based on World Health Organization criteria. Incidence rates of S. pneumoniae and N. meningitidis were used for comparison purposes. Chi-squared and Student's t tests were used for statistical analysis. P-values below 0.05 were considered as statistically significant.

RESULTS: 979 children with acute bacterial meningitis were detected throughout the entire period. The incidence rate of Hib meningitis decreased from 10.8 (x105) in the pre-vaccine period to 2.3 (x105) in the 2nd year post vaccination, leading to a risk reduction of 78%, targeted to the 7-23 months age group (p<0.05). A total of 65 cases of Hib meningitis were prevented. An increase in S. pneumoniae meningitis was observed. Vaccine failure was detected in one child.

CONCLUSIONS: This study showed that mass immunization with Hib conjugate vaccine brought about an expressive decline in childhood Hib meningitis in Goiás soon after the first year. Notwithstanding, an enhancement of surveillance using high-accuracy tools is essential to: (i) detect a possible reemergence of Hib; (ii) identify vaccine failure, and (iii) monitor changes in the H. influenzae serotype profile over time.

Keywords: Haemophilus influenzae type b. Meningitis, Haemophilus, prevention control. Haemophilus Vaccines. Effectiveness.

INTRODUCTION

Acute bacterial meningitides are an important cause of morbidity and mortality during childhood. Haemophilus influenzae b (Hib) is an etiological agent of acute meningitis in a large proportion of countries in which the conjugate vaccine has not yet been introduced. In these areas, Hib is among the three primary causes of death in children under five years old.18 In Latin America, the relevance of Hib to meningitis has recently been highlighted in a systematic review of laboratory surveillance data on H. influenzae.1 The expressive impact of Hib vaccination on invasive diseases is well documented in industrialized areas such as the United States and several European countries, and, more recently, in certain regions of Latin America.9 Despite its availability, the conjugate vaccine has not yet been introduced in most developing countries, especially Africa and Asia, and thus millions of children continue to lack protection against Hib invasive diseases.5,17 The uncertainty regarding local incidence data, the high cost of the vaccine, and the lack of knowledge concerning vaccine effectiveness in populations with different epidemiological and genetic characteristics from those of developed countries have limited the incorporation of the Hib vaccine in the immunization programs of most developing countries.

In several industrialized countries, efficient surveillance systems have allowed for the definition of an epidemiological baseline, thus facilitating the monitoring of Hib meningitis, in programmatic conditions, in order to guide future public health actions and measures. In Latin America, Hib vaccination was first introduced in Uruguay in 1994, which was followed by Costa Rica and Chile. Currently, the Hib vaccine is part of the national immunization programs of almost all countries in this region.17 In Brazil, the role of Hib in invasive disease underfives has been evaluated by independent retrospective studies, based on data from hospitals and/or referral laboratories.6 The Hib vaccine was incorporated into the national immunization program (PNI) in mid 1999, and publications addressing the impact of vaccination are still scarce.12,13

The present study is aimed at identifying the impact of Hib vaccination on the incidence of meningitides among underfives in the State of Goiás, in Central Brazil, two years after the introduction of the conjugate vaccine.

METHODS

This investigation included children between ages 24 and 59 months diagnosed with acute bacterial meningitis between 1 July 1995 and 30 June 2001. In order to evaluate the effect of Hib vaccination on the risk of acquiring meningitis, a 'before-after' design was adopted. The period preceding vaccine implementation (July 1995-June 1999) was considered as the pre-vaccine period and the subsequent period (July 1999-June 2001), as the post-vaccine period. The Hib conjugate vaccine with diphtheria protein (CRM197; HibTITER®; Wyeth® Lederle) was administered between July and November 1999. After this period, the vaccine containing the Hib polysaccharide conjugate with tetanus toxoid (PRP-T), produced by the Brazilian laboratory Biomanguinhos (Fundação Oswaldo Cruz - Brazilian Ministry of Health) was used. Children under age 12 months were given three doses of the vaccine (at ages two, four, and six months) and those between 12 and 24 were given a single dose.

Acute bacterial meningitis was diagnosed based on the criteria established by the World Health Organization (WHO)15,16 and by the Brazilian Ministry of Health (MoH). Confirmed cases were defined by microbiological isolation or antigen detection (latex agglutination or counterimmunoelectrophoresis) in cerebrospinal fluid (CSF). For surveillance purposes, WHO recommends the inclusion of probable cases of acute bacterial meningitis (pABM).15 The definition of such cases is based on clinical suspicion of meningitis associated with a turbid ("cloudy") CSF and at least one of the following findings in the CSF: elevated protein (>100 mg/dl), decreased glucose (<40 mg/dl), or leukocytosis (>100 mg/dl) with >80% neutrophils.

From July 1995 to April 2000 the completeness .hospital admission data on bacterial meningitis was maximized by reconciling reports,11 thus ensuring greater accuracy of data. A single database was built by incorporating the data obtained from different sources: the National Notifiable Disease Surveillance System, logbooks of the state central reference laboratory and of pediatric hospitals, and death certificate records. Entries were subsequently confirmed or excluded based on additional information from patient records, according to the case definition criteria described above.

In May 2000 an active prospective populational surveillance system was implemented for the detection of cases of acute bacterial meningitis among underfives in Goiás state capital Goiânia, to which roughly 70% of all cases statewide are referred. All pediatric hospitals in the city were included in the enhanced surveillance. Demographical and clinical data were collected. The immunization status of children, including dates and number of doses of Hib vaccine was obtained from children's immunization cards.

Laboratory diagnosis followed WHO recommendations.16 CSF was streaked on chocolate agar plates supplemented with factors X and V. Difco® antisera were used for serotyping Haemophilus influenzae isolates.

Incidence rates were calculated based on populational estimates obtained from the Brazilian Institute for Geography and Statistics (IBGE). Cases of meningitis due to Streptococcus pneumoniae and Neisseria meningitidis were used for comparison purposes. The number of prevented cases per etiological agent in the first and second years post-vaccine was estimated based on the cumulative incidence in the pre-vaccine period. A modified version of the analytical graphic method used at the Centers for Disease Control and Prevention (Atlanta, USA) for notifiable diseases was used to compare the number of cases of meningitis in the periods before and after the implementation of Hib vaccination.3 According to this method, the number of cases of meningitis during the pre-vaccine period was considered as the historic value (expected value), and was compared with the number of cases in the first and second years after the introduction of the vaccine (observed values). A bar chart was constructed using a vertical axis which crosses a horizontal logarithmic axis at the unit (point 1). Results were presented in terms of a ratio r, calculating the number of cases observed per etiological agent over the arithmetic mean of the number of cases expected. Over the horizontal axis, a horizontal bar was constructed for each etiological agent according to the value of r. Hatched bars extend either to the right or to the left of the vertical axis, depending on if the ratio was higher or lower than the unit, respectively. Confidence intervals, based on the normal distribution theory, were constructed for r, and the portion of the bar extending beyond these confidence intervals is represented by a blank bar. The number of cases exceeding the upper limit of the 95%CI was considered as the number of 'excess' cases, whereas values below the lower limit were considered as 'decreases'.

Comparisons between proportions were evaluated by c2 tests and differences between means by Student's t test. P-values below 0.05 were considered as statistically significant. Data analysis was carried out using SPSS (v. 10.0.1) and Epi Info 6.04d software.

RESULTS

Between July 1995 and June 2001, 979 cases of bacterial meningitis were detected in children aged two to 59 months in the State of Goiás, of which 752 were in the pre-vaccine period and 227 in the post-vaccine period (Table 1). There were no statistically significant differences between age groups in the pre- and post-vaccine periods. There was a greater proportion of male cases in both periods (p<0.05). The overall case fatality rate did not vary between the two periods. However, H. influenzae was the main cause of death in the pre-vaccine period, whereas no statistically significant differences were detected in the post-vaccine period. There was a decrease in the proportion of cases of meningitis caused by H. influenzae, from 25.8% in the pre-vaccine period to 15.9% in the post-vaccine period (p<0,05), especially in the seven to 23 months age group (p<0,01) (Figure 1). On the other hand, there was a significant increase in S. pneumoniae cases, from 2.7% to 12.8%.


The log scale bar chart in Figure 2 shows that the number of cases of Hib meningitis decreased 41% (expected 0.92 - observed 0.51) in the first 12 months after the introduction of the vaccine and 69% (expected 0.92 - observed 0.23) in the subsequent year. By contrast, the number of cases of meningitis caused by S. pneumoniae increased 98% (expected 1.42 - observed 2.40) in the first 12 months and 198% (expected 1.42 - observed 3.40) in the following year. The number of cases of meningitis caused by N. meningitidis fell 53% in the first post-vaccine period, and 33% in the second. The number of probable cases of meningitis fell 39% in the first post-vaccine period and 53% in the second.


A comparison of incidence rates in the pre-vaccine (10.8x105) and post-vaccine (2.3x105) periods shows a 78% reduction in the risk of Hib meningitis. There was a progressive increase in the risk of S. pneumoniae meningitis, from 1.1x105 in the pre-vaccine period to 2.6x105 in the first year and 3.6x105 in the second year post-vaccine, a 227% increase. Furthermore, there was a reduction of 50.8% in the risk of probable meningitides between the pre-vaccine period and the second year post-vaccine. (from 24.8x105 to 12.2x105) (Table 2). In the post vaccine period, 65 cases of Hib meningitis and 102 cases of probable bacterial meningitis were prevented. Nineteen predicted cases of N. meningitidis failed to occur and there were 19 excess cases of S. pneumoniae meningitis (Table 2).

Seven cases of meningitis caused by H. influenzae occurred in children who had received at least one dose of the Hib vaccine. H. influenzae type "a" was detected in three of these cases. Vaccine failure was observed in a single case. This was a child over one year old, without chronic diseases or immunodeficiencies, who had received three doses of the vaccine, and who presented with Hib meningitis 16 months after receiving the last dose of the vaccine.

DISCUSSION

The present study shows an important reduction in the number of cases of Hib meningitis after the first year of anti-Hib vaccination. The reduction in the risk of meningitis - 51% in the first year and 78% in the second year post-vaccine - was significantly higher in the seven to 23 month age group, which is consistent with the protective immune response acquired after the third dose (sixth month of life).8 A comparison of the risk of Hib meningitis before vaccination (10.8x105) and after the second year post-vaccine (2.3x105) shows that this risk was 4.7-fold greater in the former period. In Brazil, few publications have measured the role of Hib as an etiological agent of meningitides in childhood before the introduction of the conjugate vaccine. The risk of Hib meningitis found for the pre-vaccine period was similar to that observed in Campinas, southeastern Brazil (17x105), and is comparable to those found in European countries such as Austria, Spain, and England.9,14 The impact of the Hib vaccination has also been evaluated in other Brazilian regions. In Curitiba, southern Brazil, the incidence of meningitis dropped from 35.5 to 9.7x105 (72% reduction), one year after the introduction of the vaccine.13 In Salvador, northeastern Brazil, similar results were found (69% reduction) after the first year of vaccination.12

There was a significant reduction in the number of probable acute bacterial meningitis (pABM) cases in the post-vaccine period, most likely due to the implementation of the surveillance system as well as to the accuracy of diagnostic tests. We may thereby infer that, in the pre-vaccine period, many of the cases labeled as 'probable' were caused by Hib. However, high rates of probable cases still persist, which may be explained by the practice of self-medication, including the use of antimicrobials.1 Considering that the sensitivity of the prospective surveillance component was greater than that of the retrospective component, the incidence rate in the pre-vaccine period was probably higher than that observed, and, therefore, vaccination impact may have been underestimated. It is well established that the effectiveness of vaccination also depends on vaccine coverage. In the state of Goiás vaccine coverage was 78% in the first year and 90% in the second year after implementation* * Data provided by the Goiânia Municipal Secretariat of Health and by the Brazilian Ministry of Health, 2001. which may have contributed towards the progressive reduction in the incidence of Hib meningitis.

In the present study, we observed an increase in the incidence of S. pneumoniae meningitis in the post vaccine period. Some investigators have raised the possibility that other serotypes of H. influenzae, and even S. pneumoniae itself may be occupying the ecologic niche left open by Hib.7 Our results show that the increase in the incidence of S. pneumoniae meningitis began already two years before the introduction of the Hib vaccine. It is therefore unlikely that the increase in pneumococcal meningitis has occurred as consequence of the effect of Hib vaccination on the reduction of Hib nasopharyngeal carriage. Such increase may be due to the diagnostic methods implemented after 1998. Only the continuous and efficient surveillance of bacterial meningitides will be able to provide evidence of the current increase of S. pneumoniae in the etiology of bacterial meningitis.

Recent studies have documented the emergence of invasive diseases caused by non-b H. influenzae as well as by the unencapsulated strains, and even the reemergence of Hib, causing concern among researchers in regions where the vaccine has been introduced over a decade ago.4 In Brazil, the appearance of serotype a after the introduction of Hib vaccination has recently been documented.12 In the United Kingdom, the combination of Hib and acellular diphtheria-tetanus-pertussis vaccine and the use of a accelerated scheme, with one-month intervals between doses and without a booster dose, are among the hypotheses proposed to explain the reemergence of Hib in the UK in the last four years.10 The vaccination schedule adopted in Brazil does not include a booster dose after 12 months, which should be taken into consideration by the surveillance system in order to monitor a possible reemergence of Hib. These findings reinforce the need for maintaining an efficient surveillance system in the post-vaccine period, since a new epidemiological scenario of invasive diseases due to H. influenzae has been revealed, thus requiring the definition of new laboratory strategies for the detection and serotyping of H. influenzae.

The potential limitations of surveillance systems have recently been underscored. In this sense, when evaluating the incidence of meningitis after routine vaccination, the sensitivity and specificity of the clinical definition of cases and of laboratory tests is crucial. If the specificity of case definition is low, when the actual incidence decreases, the predictive value of diagnostic tests also decreases, and the proportion of false-positive H. influenzae diagnoses increases. Furthermore, a recent study2 of H. influenzae isolates obtained from different Brazilian regions showed discordant results between routine serotyping (latex agglutination) and the PCR technique, considered as the gold standard. The results of this study ratify the need for a reevaluation of the laboratory procedure protocols used in H. influenzae serotyping. Correct identification of H. influenzae is essential in order do minimize biases when monitoring alterations in the incidence of invasive Hib infections in the post-vaccine period and when estimating the long-term impact of Hib vaccination.

The present study evaluated the effectiveness of Hib vaccination in the state of Goiás, in central Brazil, detecting a significant impact on meningitis. Active continuous surveillance is now needed in order to monitor changes in the epidemiological pattern of meningitides and a possible reemergence of Hib. An increase in the mean age of cases of Hib meningitis may occur, so new strategies for control should be adopted. Surveillance will also be useful in detecting decreases in vaccine coverage and cases of vaccine failure, with implications on the need for a booster dose after the child's first year of life. Cases of meningitis caused by non-b or by unencapsulated strains of H. influenzae, along with alterations in the incidence of pneumococci and meningococci must also be monitored. Finally, an efficient surveillance system will also provide an epidemiological baseline for the evaluation of the impact of conjugate vaccines against S. pneumoniae and N. meningitidis C.

REFERENCES

Received on 7/10/2003

Approved on 10/5/2004

Study financed by: Division of Vaccines and Immunization of the Pan American Health Organization, World Health Organization, the Bill and Melinda Gates Children's Vaccine Program, and Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq - Processes ns. 520399/00-5 and 300443/97-3).

  • 1. Andrade ALSS, Brandileone MC, DiFabio JL, Oliveira RM, Silva AS, Baiocchi SS, Martelli CMT. Haemophilus influenzae resistance in Latin America: systematic review of surveillance data. Microb Drug Resistance 2001;7:403-11.
  • 2. Bokermann S, Zanella RC, Lemos APS, Andrade ALSS, Brandileone MCC. Evaluation of serotyping methodology of invasive and nasopharyngeal isolates of Haemophilus influenzae (Hi) in the ongoing surveillance in Brazil. J Clin Microbiol 2003;41:5546-50.
  • 3. Centers for Diseases Control. Proposed changes in format for presentation of notifiable disease report data. MMWR 1989;38:805-9.
  • 4. Heath PT, McVernon J. The UK Hib vaccine experience. Arch Dis Child 2002;86:396-9.
  • 5. Jones G, Steketee RW, Black RE, Bhutta ZA, Morris SS, Bellagio Child Survival Study Group. How many child deaths can we prevent this year? Lancet 2003;362:65-71.
  • 6. Landgraf IM, Vieira MF. Biotypes and serotypes of Haemophilus influenzae from patients with meningitis in the city of São Paulo, Brazil. J Clin Microbiol 1993;31:743-5.
  • 7. Lipsitch M. Bacterial vaccines and serotype replacement: lessons from Haemophilus influenzae and prospects for Streptococcus pneumoniae. Emerg Infect Dis 1999;5:336-45.
  • 8. Mulholland K, Hilton S, Adegbola R, Usen S, Oparaugo A, Omosigho C et al. Randomised trial of Haemophilus influenzae type-b tetanus protein conjugate vaccine for prevention of pneumonia and meningitis in Gambian infants. Lancet 1997;349:1191-7.
  • 9. Peltola H. Worldwide Haemophilus influenzae type b disease at the beginning of the 21st century: global analysis of the disease burden 25 years after the use of the polysaccharide vaccine and a decade after the advent of conjugates. Clin Microbiol Rev 2000;13:302-17.
  • 10. Pushparajah K, Ramnarayan P, Maniyar A, Paget R, Britto J. Continued threat of Haemophilus influenzae type B disease in the UK. Lancet 2003;361:90.
  • 11. Ramsay M, Slack M, Kaczmarski E. Surveillance of Haemophilus influenzae infection. Surveillance data for assessing impact of vaccination are valid. BMJ 2001;322:613-4.
  • 12. Ribeiro GS, Reis JN, Cordeiro SM, Lima JB, Gouveia EL, Petersen M et al. Prevention of Haemophilus influenzae type b (Hib) meningitis and emergence of serotype replacement with type a strains after introduction of Hib immunization in Brazil. J Infect Dis 2003;187:109-16.
  • 13. Takemura NS, Andrade SM. Meningite por Haemophilus influenzae tipo b em cidades do estado do Paraná, Brasil. J Pediatria 2001;77:387-92.
  • 14. Weiss DP, Coplan P, Guess H. Epidemiology of bacterial meningitis among children in Brazil, 1997-1998. Rev Saúde Pública 2001;35:249-55.
  • 15
    World Health Organization. Generic protocol for population-based surveillance of Haemophilus influenzae type B. Geneva; 1996. (WHO/VRD/GEN/95.05).
  • 16
    World Health Organization. Laboratory manual for the diagnosis of meningitis caused by Neisseria meningitidis, Streptococcus pneumoniae and Haemophilus influenzae Geneva; 1999. (WHO/CDS/CSR/EDC/99.7). Available from: http://www.who.int/emcdocuments/meningitis/does/who cdscsredc997.pdf [2004 Jun 10].
  • 17. World Health Organization. Countries having introduced Hib vaccine. Geneva; 2001. Available from: http://www.who.int/vaccines-surveillance/ graphics/htmls/hib map.htm [2004 Jun 10].
  • 18
    World Health Organization. Haemophilus influenzae tipo b Hib meningitis in the pre-vaccine era: a global review of incidence, age distributions, and case-fatalily rates. Geneva; 2002. Available from: http://www.who.int/vaccines-documents/DocsPDF02/www696.pdf [2004 Jun 10].
  • Correspondence to
    Luciana Leite Pineli Simões
    Instituto de Patologia Tropical e Saúde Pública
    Rua Delenda Rezende de Melo, S/N
    Setor Universitário - 74605-050 Goiânia, GO, Brasil
    E-mail:
  • *
    Data provided by the Goiânia Municipal Secretariat of Health and by the Brazilian Ministry of Health, 2001.
  • Publication Dates

    • Publication in this collection
      18 Oct 2004
    • Date of issue
      Oct 2004

    History

    • Accepted
      10 May 2004
    • Received
      07 Oct 2003
    Faculdade de Saúde Pública da Universidade de São Paulo Avenida Dr. Arnaldo, 715, 01246-904 São Paulo SP Brazil, Tel./Fax: +55 11 3061-7985 - São Paulo - SP - Brazil
    E-mail: revsp@usp.br