Acessibilidade / Reportar erro

Trained innate immunity, COVID-19 therapeutic dilemma, and fake science

TRAINED INNATE IMMUNITY AND COVID-19

When we get sick, our body’s first line of defense, the immune cells, responds and stores a memory of the pathogen; this is called immunological memory (11. Kirman JR, Quinn KM, Seder RA. Immunological memory. Immunol Cell Biol. 2019;97(7):615-16. https://doi.org/10.1111/imcb.12280.
https://doi.org/10.1111/imcb.12280...
). Two types of functionally distinct memories have been described, i.e., innate memory (non-specific) and acquired memory (specific). There are two ways by which T and B cells form an acquired immunological memory. The first is based on genetic mechanisms that involve the recombination of membrane receptor genes (TCR) and selection of T cell clones capable of perfectly recognizing self and non-self antigens (e.g. proteins belonging to pathogens). The second, is based on the recombination of immunoglobulin genes (antibody genes) that recognize the proteins expressed by pathogens and the selection of memory B cell clones. Memory B cells express membrane receptors (BCR)—or bound antibody molecules with high affinity—that recognize the pathogens in the event of a second infection. However, the big question is, “how are antibodies produced against an infectious pathogen or vaccine?” First, dendritic cells phagocytize and degrade the pathogen and present its pieces in the form of epitopes (protein fragments) to CD4+ T lymphocytes. Then, helper CD4+ T cells communicate with lymphocytes B, which initiate the production of different classes of antibodies (humoral soluble response) against these epitopes. B lymphocyte clones die at the end of the infection and only few clones that contain the code (memory) for the synthesis of specific antibodies remain. Another population of lymphocytes, called effector CD8+ T lymphocytes (cellular response), also recognizes pathogen-related antigens in infected cells. These cytotoxic lymphocytes attack the pathogens by releasing cytokines, toxins, and enzymes that lead to cell death via apoptosis and necroptosis. These cytotoxic lymphocytes also die at the end, and only a few clones survive. The survivors are programmed to become memory CD8+ T lymphocytes that would recognize the pathogen in the event of a second infection.

How is memory in CD8+ T cells formed chemically? What we know is that cytosine and guanine (CpG)-rich regions in the promoters of genes encoding for various proteins, such as transcription factors, cytotoxic proteins, and cytokines involved in lymphocyte activation, undergo chemical modifications (methylation and demethylation, i.e., addition or removal of methyl groups). Such modifications form a silencing or activating on/off switch for the transcription of immune response genes. Histone proteins that bind DNA molecules also undergo methylation and acetylation at their lysine and arginine residues. These types of chemical changes are referred to epigenetic and non-genetic (non-hereditary) modifications, as they do not cause any changes (mutations) in the DNA molecule, nor are they transmitted to the next generation. Therefore, children need to receive vaccines that protected their parents from pathogen, for example, the measles vaccine, to develop their own immune responses.

Bone marrow progenitor myeloid cells that give rise to blood leukocytes, such as neutrophils, monocytes, and natural killer cells (NKs), are the innate cells participating in the non-specific innate response and trained immunity (22. Netea MG, Domínguez-Andrés J, Barreiro LB, Chavakis T, Divangahi M, Fuchs E, et al. Defining trained immunity and its role in health and disease. Nat Rev Immunol. 2020;20(6):375-88. https://doi.org/10.1038/s41577-020-0285-6.
https://doi.org/10.1038/s41577-020-0285-...
). Studies have shown that monocytes and macrophages are “educated or trained” during the first infection, and thus they acquire the ability to fight more effectively in subsequent infections. Monocytes are trained through stimulation with lipopolysaccharide (LPS)—a gram-negative bacterial membrane protein—or beta-glucan, a component of the fungal cell wall. For example, the bacillus Calmette-Guérin (BCG) vaccine can increase the production of pro-inflammatory cytokines, such as tumor necrosis factor (TNF), interleukin-1 (IL-1), and IL-6, up to 5 times on second contact with the pathogen. This type of immunological memory or epigenetic programming to a pre-activated state allows the generation of a sustained and more effective non-specific response, even after years, although in the protocols of these studies, the innate immunity was evaluated after 3 months (22. Netea MG, Domínguez-Andrés J, Barreiro LB, Chavakis T, Divangahi M, Fuchs E, et al. Defining trained immunity and its role in health and disease. Nat Rev Immunol. 2020;20(6):375-88. https://doi.org/10.1038/s41577-020-0285-6.
https://doi.org/10.1038/s41577-020-0285-...
).

Biochemical analyses on chromatin showed that trained monocytes are characterized by an increase in histone 3 acetylation, in particular H3K27Ac and H3K4me3 as well as by an increase in the metabolism of glucose (glycolysis) and glutamine (glutaminolysis), and by high levels of fumarate, a metabolite of the tricarboxylic acid cycle or Krebs cycle (22. Netea MG, Domínguez-Andrés J, Barreiro LB, Chavakis T, Divangahi M, Fuchs E, et al. Defining trained immunity and its role in health and disease. Nat Rev Immunol. 2020;20(6):375-88. https://doi.org/10.1038/s41577-020-0285-6.
https://doi.org/10.1038/s41577-020-0285-...
). It has also been observed that after the training of human monocytes with Candida albicans (a human opportunistic pathogen) beta-glucan, the induced innate immunity protects not only against fungi, but also against bacteria, viruses, and parasites (22. Netea MG, Domínguez-Andrés J, Barreiro LB, Chavakis T, Divangahi M, Fuchs E, et al. Defining trained immunity and its role in health and disease. Nat Rev Immunol. 2020;20(6):375-88. https://doi.org/10.1038/s41577-020-0285-6.
https://doi.org/10.1038/s41577-020-0285-...
). In addition, the training of human monocytes by Saccharomyces cerevisiae (another human opportunistic pathogen) chitin greatly increased their ability to eliminate microbes such as Candida albicans, Staphylococcus aureus (a gram-positive bacterium), and Escherichia coli (a gram-negative bacterium) in comparison with untrained human monocytes. More interesting, the non-specific effects of BCG vaccination improved the effects of low-efficiency vaccines, such as the vaccine against typhus—caused by Salmonella typhi (http://www.clinicaltrials.gov, number NCT02175420)—or the influenza vaccine. This protective effect has been known for decades in many countries (e.g. in Denmark and South Africa) where the BCG vaccine is administered to babies a few days after birth. In these countries, there was a 38-70% reduction in infant mortality associated with pneumonia and sepsis (33. Curtis N, Sparrow A, Ghebreyesus TA, Netea MG. Considering BCG vaccination to reduce the impact of COVID-19. Lancet. 2020;395(10236):1545-6. https://doi.org/10.1016/S0140-6736(20)31025-4.
https://doi.org/10.1016/S0140-6736(20)31...
). However, to the best of our knowledge, none of the studies have determined if a similar phenomenon occurs in vaccinated babies in Brazil.

Various clinical trials are underway to evaluate trained immunity through BCG vaccination in healthy volunteers under the coordination of Dr. Mihail Netea (Radboud University Medical Center, Nijmegen, the Netherlands). Clinical trials BRACE (http://www.clinicaltrialgov, number NCT04327206) and BCG-corona (http://www.clinicaltrial.gov, number NCT04328441) are employing large cohorts of health professionals in the Netherlands, Denmark, Germany, England, France, Tanzania, Uganda, Colombia, and Uruguay (33. Curtis N, Sparrow A, Ghebreyesus TA, Netea MG. Considering BCG vaccination to reduce the impact of COVID-19. Lancet. 2020;395(10236):1545-6. https://doi.org/10.1016/S0140-6736(20)31025-4.
https://doi.org/10.1016/S0140-6736(20)31...
). The objective is to demonstrate whether immunization with BCG vaccines produced using different strains and titers of the bacillus Calmette-Guérin—the vaccine against tuberculosis—can protect these professionals against SARS-CoV-2 infection (33. Curtis N, Sparrow A, Ghebreyesus TA, Netea MG. Considering BCG vaccination to reduce the impact of COVID-19. Lancet. 2020;395(10236):1545-6. https://doi.org/10.1016/S0140-6736(20)31025-4.
https://doi.org/10.1016/S0140-6736(20)31...
). A similar study will be carried out in Brazil (http://www.clinicaltrial.gov, number NCT04369794). Dr. Netea said that preliminary results showed that in a large number of human volunteer cohorts, the BCG vaccine induced trained immunity (>50%; as stated in https://www.youtube.com/watch?v=3W36p40poLs). It is expected that the volunteers, if infected, will respond mildly or asymptomatically to the SARS-CoV-2 infection. The scientific basis for this hypothesis comes from studies undertaken on human volunteers previously immunized with the live BCG vaccine and then with the vaccine for the yellow fever virus that causes a hemorrhagic disease (44. Arts RJW, Moorlag SJCFM, Novakovic B, Li Y, Wang SY, Oosting M, et al. BCG Vaccination Protects against Experimental Viral Infection in Humans through the Induction of Cytokines Associated with Trained Immunity. Cell Host Microbe. 2018;23(1):89-100.e5. https://doi.org/10.1016/j.chom.2017.12.010.
https://doi.org/10.1016/j.chom.2017.12.0...
). It has also been verified through epidemiological and observational clinical studies that the number of deaths caused by coronaviruses in low-income countries, such as India and some countries in Africa and the Americas, are significantly lower than those in countries with medium and high levels of economic development, such as Italy, Belgium, Holland, and the United States of America (55. Miller A, Reandelar, MJ, Fasciglione K, Roumenova V, Li Y, Otazu GH. Correlation between universal BCG vaccination policy and reduced morbidity and mortality for COVID-19: an epidemiological study. MedRxiv. 2020. https://doi.org/10.1101/2020.03.24.20042937.
https://doi.org/10.1101/2020.03.24.20042...
). Despite the presence of evidences regarding the efficacy of BCG, the latter countries have not adopted the universal policy of mandatory immunization against tuberculosis (66. Zwerling A, Behr MA, Verma A, Brewer TF, Menzies D, Pai M. The BCG World Atlas: a database of global BCG vaccination policies and practices. PLoS Med. 2011;8(3):e1001012. https://doi.org/10.1371/journal.pmed.1001012.
https://doi.org/10.1371/journal.pmed.100...
). Live or attenuated vaccines against measles and smallpox as well as the oral polio vaccine are also effective in inducing innate cross-protection against other unrelated viral infections. The hypothesis that all vaccinated children are protected or are less likely to develop severe symptoms of the SARS-CoV-2 has been contested by many investigators (77. Miyasaka M. Is BCG vaccination causally related to reduced COVID-19 mortality? Version 2. EMBO Mol Med. 2020;12(6):e12661. https://doi.org/10.15252/emmm.202012661.
https://doi.org/10.15252/emmm.202012661...
,88. Hamiel U, Kozer E, Youngster I. SARS-CoV-2 Rates in BCG-Vaccinated and Unvaccinated Young Adults. JAMA. 2020;323(22):2340-1. https://doi.org/10.1001/jama.2020.8189.
https://doi.org/10.1001/jama.2020.8189...
). Therefore, we need to wait for the results of the clinical trials that are currently underway.

In Brazil, epidemiological data on tuberculosis, published by the Ministry of Health on March 2019, indicates that the incidence of the disease (30-35 cases/100 thousand inhabitants) has not changed in the last 10 years (99. Tuberculose 2020. Boletim Epidemiológico Secretaria de Vigilância em Saúde - Ministério da Saúde Número Especial. 2020. Available from: http://www.saude.gov.br/svs
http://www.saude.gov.br/svs...
). Rio de Janeiro, Amazonas, Pará, Roraima, and Acre are the states with a tuberculosis incidence higher than the national average. In addition, mortality is higher than the national average (2.2 deaths /100 thousand inhabitants) in Rio de Janeiro, Amazonas, Pernambuco, Rio Grande do Sul, Pará, Maranhão, Rio Grande do Norte, Ceará, and Acre. Vaccination, although recommended by the WHO (World Health organization) for vulnerable populations, is not routinely employed, and only newborns receive the vaccine in Brazil. since 2010, the Butantan Institute has stopped the production of oral BCG (live strain); now, it only produces the BCG vaccine formulated using the recombinant tuberculin protein. To our knowledge, there are no published articles or clinical evidences that show that BCG immunization protects against SARS-CoV-2 in Brazil. Is innate memory more effective against SARS-CoV-2 than acquired memory? Could BCG vaccination be a more promising therapeutic alternative than chloroquine? These are the questions that need to be addressed.

WHY DO RESEARCH TRIALS FAIL?

Scientific knowledge is accepted or rejected based on measures of probabilities. How evidence is transformed into scientific knowledge depends on statistical methods that define whether certain types of interferences (errors, biases, or confounding factors)—that occur either randomly or systematically—are leading to relevant clinical outcomes in patient cohorts (1010. Heneghan C, Goldacre B, Mahtani KR. Why clinical trial outcomes fail to translate into benefits for patients. Trials. 2017;18(1):122. https://doi.org/10.1186/s13063-017-1870-2.
https://doi.org/10.1186/s13063-017-1870-...
). Chloroquine has been used in the prevention and treatment of malaria since 1947 (1111. Al-Bari MA. Chloroquine analogues in drug discovery: new directions of uses, mechanisms of actions and toxic manifestations from malaria to multifarious diseases. J Antimicrob Chemother. 2015;70(6):1608‐21. https://doi.org/10.1093/jac/dkv018.
https://doi.org/10.1093/jac/dkv018...
). Its clinical use in the treatment of rheumatoid arthritis and lupus erythematosus has been approved using pre-established protocols and doses based on the disease stage and the clinical conditions of the patient. The side effects of chloroquine, such as retinopathy and ventricular arrhythmia, are well-known, and are rarely reported by patients (1111. Al-Bari MA. Chloroquine analogues in drug discovery: new directions of uses, mechanisms of actions and toxic manifestations from malaria to multifarious diseases. J Antimicrob Chemother. 2015;70(6):1608‐21. https://doi.org/10.1093/jac/dkv018.
https://doi.org/10.1093/jac/dkv018...
). Chloroquine should not be used in the absence of any medical supervision in patients with diabetes and heart problems, neither in people over 65 who—among other problems—may have reduced kidney function. Therefore, any clinical study aimed at assessing the therapeutic effects of chloroquine should not include volunteers or patients having such comorbidities; therefore, these caveats should be included as a part of the trial protocol when establishing the inclusion and exclusion criteria. A previous study in a small patient cohort showed evidence that chloroquine could exhibit therapeutic effects in patients with COVID-19 (1212. Gautret P, Lagier JC, Parola P, Hoang VT, Meddeb L, Mailhe M, et al. Hydroxychloroquine and azithromycin as a treatment of COVID-19: results of an open-label non-randomized clinical trial. Int J Antimicrob Agents. 2020. https://doi.org/10.1016/j.ijantimicag.2020.105949.
https://doi.org/10.1016/j.ijantimicag.20...
). The journal The Lancet, in May 2020, published the results of an observational, longitudinal, and retrospective clinical study based on medical records of COVID-19 patient cohorts treated across 6 countries and 671 hospitals, with different technical capabilities and diverse drug protocols (1313. Mehra MR, Desai SS, Ruschitzka F, Patel AN. RETRACTED: Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis. Lancet. 2020. https://doi.org/https://doi.org/10.1016/S0140-6736(20)31180-6.
https://doi.org/https://doi.org/10.1016/...
). The results suggested that chloroquine and hydroxychloroquine—and their combination with azithromycin—did not result in any clinical benefit; on the contrary, they worsened the condition of the patients. However, in these studies, patients with several comorbidities were evaluated, including those with cardiovascular disease (including congestive heart failure and history of heart failure arrhythmia), current or previous smoking history, history of hypertension, diabetes, or hyperlipidemia, or chronic obstructive pulmonary disease (COPD). These trials also reported that 47% of the treated patients needed admission to an intensive care unit (ICU) and assisted ventilation (severe case of the disease) against only 5% in the control group. The authors concluded that all underlying diseases (comorbidities)—considered as confounding factors—influenced the mortality rate; this was the most relevant outcome of the study. The secondary outcome of interest was related to ventricular arrhythmia. It was mentioned that, among the 81 000 patients in the control group, a small population (16%, 14 300) had a history of heart disease, whereas 890 (1%) suffered from de novo ventricular arrhythmia, along with in-hospital treatment, and survived. Of the 14 800 patients in the treatment group, 10 600 died. A large number of patients in the non-survival population (33%, 3 500 patients) had a history of cardiovascular disease. These were the patients for whom chloroquine treatment was not recommended because of the high risk of suffering from adverse effects, such as the prolonged QT interval and arrhythmia. In this group, as expected, 400 patients (3.7%) suffered from de novo ventricular arrhythmia (1313. Mehra MR, Desai SS, Ruschitzka F, Patel AN. RETRACTED: Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis. Lancet. 2020. https://doi.org/https://doi.org/10.1016/S0140-6736(20)31180-6.
https://doi.org/https://doi.org/10.1016/...
). Whether this effect was observed before or during the treatment, was not specified by the authors. The episodes of de novo ventricular arrhythmia could be induced by several factors and clinical conditions; these include treatment with chloroquine, hydroxychloroquine, or a combination of chloroquine and azithromycin or that of hydroxychloroquine and azithromycin, and—finally—the pathology caused by SARS-CoV-2 (as it was observed in patients in the control group). I think that the study was not useful—or was partially useful—for assessing the cause and effect relationship of the medications because of the heterogeneity of the confounding factors. In fact, this paper was retracted a few days after its publication. Therefore, further studies are required to assess the effect of the tested medicaments in patients only having COVID-19 illness at the early phase, in which the drugs appear to exhibit the expected therapeutic benefits.

The uncertainties and dilemmas regarding COVID-19 and its treatment can be attributed to the fact that everything we know about this disease is still insufficient. There is no other way to prove the veracity of scientific findings without the replication of facts and experiences. Clinical trials in humans must be guided by the practice standards, norms, and rules established in the International Conference on Harmonization / Good Clinical Practices (ICH/GCP), while following the ethical principles of the Helsinki Declaration, proclaimed in June 1964 (http://www.wma.net), and the Hippocratic Oath, the origin of the modern medical ethics. To develop evidence-based effective public health strategies, all clinical protocols must be based on evidence, which is defined as the link between excellent scientific research and good clinical practices. Transparency in clinical trials begins with trial registration at the WHO International Clinical Trials Registry Platform (ICTRP), ClinicalTrials.gov; as detailed before, the Brazilian Clinical Trials Registry (ReBEC) is involved in this process in Brazil (1414. Freitas CG, Pesavento TF, Pedrosa MR, Riera R, Torloni MR. Practical and conceptual issues of clinical trial registration for Brazilian researchers. Sao Paulo Med J. 2016;134(1):28-33. https://doi.org/10.1590/1516-3180.2014.00441803.
https://doi.org/10.1590/1516-3180.2014.0...
). Although scientists are widely trusted and feted for their discoveries, they are repeatedly required to reexamine their findings using new technological strategies and new knowledge. The randomized clinical study (RCT) is a scientific innovation; a way to draw better conclusions about cause and effect of medications or clinical procedures in matched and paired cohort groups. A double-blind randomized clinical study is another scientific innovation; a way to avoid the interference of patients and investigators on the results. In this context, the effects of the placebo (inert drug) must be tested, and the effectiveness of the drug/vaccine must be higher in the treatment group than that in the placebo group. Surrogate markers and secondary endpoints are commonly used in clinical trials to anticipate absolute primary outcomes, which will result in beneficial or adverse effects in the patients. Equally important are the adoption of new strategies to analyze the data and draw scientific conclusions. Robust statistical methods and well-designed experiments are the fundamental requirements for testing novel treatments and repurposing existing drugs. The studies in progress—to evaluate the therapeutic effects of BCG and chloroquine in COVID-19—need to continue to answer these important questions and to reinstate peoplés trust in science. In the meantime, many lives may be lost. Therefore, we must exercise caution as to what types of evidence we can accept and share, and the types of arguments and reasons to publish any fact on a social network.

ACKNOWLEDGMENTS

My thanks to my colleagues at the Clinics Hospital and Medical School of the University of São Paulo for insights and productive discussions, and to the financial support from Conselho Nacional de Desenvolvimento Científico e Tecnológico (grants 486048/2011 and 312206/2016-0312206/2016-0).

REFERENCES

  • 1
    Kirman JR, Quinn KM, Seder RA. Immunological memory. Immunol Cell Biol. 2019;97(7):615-16. https://doi.org/10.1111/imcb.12280
    » https://doi.org/10.1111/imcb.12280
  • 2
    Netea MG, Domínguez-Andrés J, Barreiro LB, Chavakis T, Divangahi M, Fuchs E, et al. Defining trained immunity and its role in health and disease. Nat Rev Immunol. 2020;20(6):375-88. https://doi.org/10.1038/s41577-020-0285-6
    » https://doi.org/10.1038/s41577-020-0285-6
  • 3
    Curtis N, Sparrow A, Ghebreyesus TA, Netea MG. Considering BCG vaccination to reduce the impact of COVID-19. Lancet. 2020;395(10236):1545-6. https://doi.org/10.1016/S0140-6736(20)31025-4
    » https://doi.org/10.1016/S0140-6736(20)31025-4
  • 4
    Arts RJW, Moorlag SJCFM, Novakovic B, Li Y, Wang SY, Oosting M, et al. BCG Vaccination Protects against Experimental Viral Infection in Humans through the Induction of Cytokines Associated with Trained Immunity. Cell Host Microbe. 2018;23(1):89-100.e5. https://doi.org/10.1016/j.chom.2017.12.010
    » https://doi.org/10.1016/j.chom.2017.12.010
  • 5
    Miller A, Reandelar, MJ, Fasciglione K, Roumenova V, Li Y, Otazu GH. Correlation between universal BCG vaccination policy and reduced morbidity and mortality for COVID-19: an epidemiological study. MedRxiv. 2020. https://doi.org/10.1101/2020.03.24.20042937
    » https://doi.org/10.1101/2020.03.24.20042937
  • 6
    Zwerling A, Behr MA, Verma A, Brewer TF, Menzies D, Pai M. The BCG World Atlas: a database of global BCG vaccination policies and practices. PLoS Med. 2011;8(3):e1001012. https://doi.org/10.1371/journal.pmed.1001012
    » https://doi.org/10.1371/journal.pmed.1001012
  • 7
    Miyasaka M. Is BCG vaccination causally related to reduced COVID-19 mortality? Version 2. EMBO Mol Med. 2020;12(6):e12661. https://doi.org/10.15252/emmm.202012661
    » https://doi.org/10.15252/emmm.202012661
  • 8
    Hamiel U, Kozer E, Youngster I. SARS-CoV-2 Rates in BCG-Vaccinated and Unvaccinated Young Adults. JAMA. 2020;323(22):2340-1. https://doi.org/10.1001/jama.2020.8189
    » https://doi.org/10.1001/jama.2020.8189
  • 9
    Tuberculose 2020. Boletim Epidemiológico Secretaria de Vigilância em Saúde - Ministério da Saúde Número Especial. 2020. Available from: http://www.saude.gov.br/svs
    » http://www.saude.gov.br/svs
  • 10
    Heneghan C, Goldacre B, Mahtani KR. Why clinical trial outcomes fail to translate into benefits for patients. Trials. 2017;18(1):122. https://doi.org/10.1186/s13063-017-1870-2
    » https://doi.org/10.1186/s13063-017-1870-2
  • 11
    Al-Bari MA. Chloroquine analogues in drug discovery: new directions of uses, mechanisms of actions and toxic manifestations from malaria to multifarious diseases. J Antimicrob Chemother. 2015;70(6):1608‐21. https://doi.org/10.1093/jac/dkv018
    » https://doi.org/10.1093/jac/dkv018
  • 12
    Gautret P, Lagier JC, Parola P, Hoang VT, Meddeb L, Mailhe M, et al. Hydroxychloroquine and azithromycin as a treatment of COVID-19: results of an open-label non-randomized clinical trial. Int J Antimicrob Agents. 2020. https://doi.org/10.1016/j.ijantimicag.2020.105949
    » https://doi.org/10.1016/j.ijantimicag.2020.105949
  • 13
    Mehra MR, Desai SS, Ruschitzka F, Patel AN. RETRACTED: Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis. Lancet. 2020. https://doi.org/https://doi.org/10.1016/S0140-6736(20)31180-6
    » https://doi.org/https://doi.org/10.1016/S0140-6736(20)31180-6
  • 14
    Freitas CG, Pesavento TF, Pedrosa MR, Riera R, Torloni MR. Practical and conceptual issues of clinical trial registration for Brazilian researchers. Sao Paulo Med J. 2016;134(1):28-33. https://doi.org/10.1590/1516-3180.2014.00441803
    » https://doi.org/10.1590/1516-3180.2014.00441803

Publication Dates

  • Publication in this collection
    10 July 2020
  • Date of issue
    2020
Creative Common - by 4.0
This is an Open Access article distributed under the terms of the Creative Commons License (https://creativecommons.org/licenses/by/4.0/) which permits unrestricted use, distribution, and reproduction in any medium or format, provided the original work is properly cited.
Faculdade de Medicina / USP Rua Dr Ovídio Pires de Campos, 225 - 6 and., 05403-010 São Paulo SP - Brazil, Tel.: (55 11) 2661-6235 - São Paulo - SP - Brazil
E-mail: clinics@hc.fm.usp.br