Acessibilidade / Reportar erro

Validation survey of the impact of urinary incontinence (IIQ-7) and inventory of distress urogenital (UDI-6) – the short scales – in patients with multiple sclerosis

Validação da escala curta do questionário de impacto da incontinência urinária (IIQ-7) e do inventário de angústia urogenital (UDI-6) em pacientes com esclerose múltipla

Abstracts

Cross-cultural adaptation and validation of the Impact Questionnaire of Urinary Incontinence (IIQ-7) and Urogenital Distress Inventory (UDI-6) - short scale - in the Brazilian population with multiple sclerosis. The IIQ-7 and UDI-6 were translated into Portuguese, called IIQ-7-BR and UDI-6-BR. The questionnaires were administered in 211 individuals selected randomly. Of these, 140 had MS according to McDonald criteria and 71 were included in the control group. In both questionnaires, the Cronbach’s alpha coefficient was above 0.7. The IIQ-7-BR showed 94.31% concordance between the evaluated studies and UDI-6-BR, 93.33%. Thus, the instruments of this study were presented according to the standards proposed by the Instrument Review Criteria, reliability, validity and sensitivity, maintaining the original scales characteristics.

urinary incontinence; multiple sclerosis; questionnaires


Adaptação transcultural e validação da escala curta do Questionário de Impacto de Incontinência Urinária (IIQ-7) e do Inventário da Angústia Urogenital (UDI-6) na população brasileira com esclerose múltipla (EM). O IIQ-7 e o UDI-6 foram traduzidos para a língua portuguesa, obtendo-se IIQ-7-BR e UDI-6-BR. Os questionários foram aplicados em 211 indivíduos selecionados aleatoriamente. Destes, 140 apresentavam EM nos critérios de McDonald, e 71 foram incluídos no grupo controle. Em ambos os questionários aplicados nos grupos, o coeficiente alpha de Cronbach apresentou-se acima de 0,7. O IIQ-7-BR apresentou 94,31% de concordância entre os estudos avaliados e o UDI-6-BR, 93,33%. Sendo assim, os instrumentos desse estudo apresentaram-se, segundo as normas propostas pelo Instrument Review Criteria, confiabilidade, validade e sensibilidade, mantendo as características das escalas originais.

incontinência urinária; esclerose múltipla; questionários


Multiple sclerosis (MS) is an inflammatory demyelinating disease which affects the spinal cord (especially posterior cords), causing several symptoms, including urinary dysfunction, which affects up to 85% of the population11. Lassmann H. Neuropathology in multiple sclerosis: new concepts. Mult Scler. 1998;4(3):93-8. http://dx.doi.org/10.1177/135245859800400301
https://doi.org/10.1177/1352458598004003...
,22. Rovner ES, Gomes CM, Trigo-Rocha FE, Arap S, Wein AJ. Evaluation and treatment of the overactive bladder. Rev Hosp Clin Fac Med Sao Paulo. 2002;57(1):39-48. http://dx.doi.org/10.1590/s0041-87812002000100007
https://doi.org/10.1590/s0041-8781200200...
, leading to a decline inequality of life (QOL)33. Nogueira LA, Nóbrega FR, Lopes KN, Thuler LC, Alvarenga RM. The effect of functional limitations and fatigue on the quality of life in people with multiple sclerosis. Arq Neuropsiquiatr. 2009;67(3B):812-7. http://dx.doi.org/10.1590/s0004-282x2009000500006
https://doi.org/10.1590/s0004-282x200900...
.

Urinary incontinence (UI) causes severe changes in patient’s lives, making it stressful and debilitating and generate high morbidity, affecting the psychological, occupational, physical and sexual level44. Kelleher CJ, Cardozo LD, Toozs-Hobson PM. Quality of life and urinary incontinence. Curr Opin Obstet Gynecol. 1995;7(5):404-8. http://dx.doi.org/10.1097/00001703-199510000-00016
https://doi.org/10.1097/00001703-1995100...
. For this reason, the International Continence Society (ICS) has recommended that quality life measurement assessment, included in all studies, as a complement to clinical measures55. Bent AEO, Cundiff WG, Swiff ES. Ostergard's urogynecology & pelvic floor dysfunction. 5a ed. Philadelphia: Lippincott Williams & Wilkins; 2002.. The effectiveness of urinary incontinence’s treatment has been usually assessed according to objective parameters (urodynamic study, absorbent test and stress test). These parameters, however, fail to evaluate the impact of the disease and its treatment cause from the patient’s view. Because of these difficulties, generic and specific questionnaires for measuring quality of life have been created to access both the subjective aspects of disease. The Impact Urinary Incontinence (IIQ-7) and Urogenital Distress Inventory (UDI-6) questionnaires were developed and combined to assess the impact of urinary incontinence on QOL66. Shumaker SA, Wyman JF, Uebersax JS, McClish D, Fantil JA. Health-related quality of life measures for women with urinary incontinence: the Incontinence Impact Questionnaire and the Urogenital Distress Inventory. Continence Program in Women (CPW) Research Group. Qual Life Res. 1994;3(5):291-306. http://dx.doi.org/10.1007/bf00451721
https://doi.org/10.1007/bf00451721 ...
. Both questionnaires are recommended by ICS77. Abrams P, Blaivas JG, Stanton SL, Andersen JT. The standardisation of terminology of lower urinary tract function. The International Continence Society Committee on Standardisation of Terminology. Scand J Urol Nephrol Suppl. 1988;114:5-19.. In Portuguese, there is no validated instrument that measures the impact of urinary incontinence. Thus, the aim of this study was to adapt and validate the IIQ-7 and UDI-6 in Brazilian population and to check its measurement properties so they can be used as a tool for evaluating the impact of urinary incontinence in patients Brazilians with multiple sclerosis.

METHOD

Instrument

Questionnaires IIQ-7 and UDI- 6 are composed by 30 and 19 questions, respectively, and although they have been evaluated and classified as effective in the evaluation of treatment effectiveness, they proved to be impractical due to long period of time to be answered66. Shumaker SA, Wyman JF, Uebersax JS, McClish D, Fantil JA. Health-related quality of life measures for women with urinary incontinence: the Incontinence Impact Questionnaire and the Urogenital Distress Inventory. Continence Program in Women (CPW) Research Group. Qual Life Res. 1994;3(5):291-306. http://dx.doi.org/10.1007/bf00451721
https://doi.org/10.1007/bf00451721 ...
. Therefore, short versions of IIQ-7 and UDI-6, composed by 7 and 6 questions, respectively, were developed together to measure the impact of urinary incontinence. The UDI-6 can also be divided into three subscales: the first evaluates irritation symptoms (urgency, frequency and pain) (questions 1 and 2), the second stress symptoms (questions 3 and 4) and the third evaluates obstruction/discomfort or symptoms of voiding difficulty (questions 5 and 6). We also applied the Expanded Disability Status Scale - Kurtzke Expanded Functional Disability Scale (EDSS) to assess the progression of the disability caused by MS.

Translation and cultural adaptation

The translation, cultural adaptation and validation protocol was prepared according to some proposed steps on literature which addresses the methodology of translation of questionnaires into other languages88. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417-32. http://dx.doi.org/10.1016/0895-4356(93)90142-n
https://doi.org/10.1016/0895-4356(93)901...
. Initially, the items of the English version were translated into Portuguese by two English teachers, independent Brazilians aware of the objective of this research. The two translations were compared by translators and researchers of the study and modifications were made to obtain a consensus. This translation was rendered into English by a native English teacher who was not part of the previous step. The comparison between the back-translated English version and the original questionnaires (IIQ-7 and UDI-6) was performed and no significant discrepancies were noted.

For pretest analysis of cultural equivalence, a pilot study was conducted in which the scale was administered to a group of 11 MS patients, without cognitive impairment. They were selected randomly at the Centre of Care and Treatment of Multiple Sclerosis of Santa Casa de Misericórdia of São Paulo (CATEM). The purpose of this process was to identify issues that were not understood by the population and therefore were deemed culturally inappropriate, however, no question was framed in these parameters. Thus the final versions of the scales translated into Portuguese, named IIQ-7-BR and UDI-6-BR were generated.

Subjects

140 patients with MS treated at CATEM, including 104 women and 36 men were selected. In the control group 71 healthy individuals - 47 women and 24 men - were included. Patients with MS were randomly selected among CATEM patients. The inclusion criteria were: confirmed diagnosis of MS according to the revised McDonald criteria 201099. Mathiesen HK, Sørensen PS. [Diagnosis of multiple sclerosis--the 2010 revision of the McDonald criteria]. Ugeskr Laeg. 2012;174(13):862-5. Danish. and no other pathological conditions suffer that can lead to UI. The exclusion criterion for individuals with MS was being in times of disease outbreak. The 71 healthy individuals were randomly selected among MS patients at CATEM whose exclusion criteria were having MS or other pathology which could cause UI.

The study was approved by the Ethics and Research of the Santa Casa de Sao Paulo Brotherhood (Project no. 072 / 12). All subjects were informed about the purpose of the study and signed a consent form.

The questionnaires were conducted in a quiet and private environment minimizing the possible constraints. Were collected socio demographic data (gender, age and education), disease duration and form of MS, neurological examination and EDSS. After 30 days, the same researcher performed the re-test with 55 patients with the aim of analyzing the stability and reliability of the scale.

Statistical analysis

The descriptive analysis was developed by the frequency of categorical variables and measures of position and dispersion of continuous variables. A multivariate analysis of variance was performed for socio-demographic data, disease duration and EDSS, to identify factors that could possibly influence the results of each dependent variable. The playability of the instrument was estimated by calculating the averages and standard of the final result and the partial results of each group of survey questions deviations. The results were calculated and compared between the control group and patients with MS in order to understand the significance of the final score.

To validate the instrument, the standards proposed by Instrument Review Criteria (SAC) to analyze the reliability, validity and sensitivity. The reliability of the questionnaire was assessed by internal consistency and test-retest stability, respectively obtained by Test Statistics Cronbach’s alpha and Pearson correlation analysis. The validity of the instrument was assessed by comparing the questionnaire results in terms of another measure of clinical evaluation in case the EDSS, also by Pearson correlation. The sensitivity of the scale was assessed by comparing obtained results in four different groups: control group without UI, control group with UI, patients without UI and patients with UI. This subdivision was performed to evaluate the ability of the scale to identify each of these four groups, by applying the Mann-Whitney and Kruskal-Wallis tests.

The level of significance was 0.05 for all statistical tests. The statistical analysis program used was the Statistical Package for Social Sciences (SPSS) version 17.

RESULTS

211 individuals were evaluated - 71 in control group and 140 patients with MS - by the UDI-6-BR and IIQ-7-BR. The sociodemographic and clinical data are shown in Table 1. A multivariate analysis of variance showed that gender, age and education did not affect the results of both questionnaires and subsequent analysis of the results.

Table 1
Socio-demographic and clinical data of the control group and the MS group.

The internal consistency of the subscales and between 7 questions in IIQ-7-BR and 6 issues of UDI-6-BR, was assessed by Cronbach’s alpha coefficient, being above 0.7, so the reliability is high for entire sample and separately for the control group and the MS group.

As for the stability of the IIQ-7-BR instrument, it was found a high level of reproducibility, with 94.31% concordance between the studied behaviors. The average test results was 4.26 (5.884) and the re-test 4.28 (5.977). The level of reproducibility of the UDI-6-BR was also high, with 93.33% concordance between the studied behaviors. The average test results was 5.49 (6,130) and re-test 5.49 (6.145). In both scales the correlation between the outcome in the test and re-test, assessed by Pearson’s correlation coefficient showed a strong relationship with a figure above 0.90 and p < 0.001.

In the validity analysis, it was determined an evaluation of the behavior of the domains of IIQ-7-BR and UDI-6-BR depending on the extent of Disability Status Expanded Scale (DEES), also using the Pearson correlation. Although other studies have demonstrated an association between DEES score and sexual dysfunction1010. Hulter BM, Lundberg PO. Sexual function in women with advanced multiple sclerosis. J Neurol Neurosurg Psychiatr. 1995;59(1):83-6. http://dx.doi.org/10.1136/jnnp.59.1.83
https://doi.org/10.1136/jnnp.59.1.83...
,1111. Valleroy ML, Kraft GH. Sexual dysfunction in multiple sclerosis. Arch Phys Med Rehabil. 1984;65(3):125-8. no significant correlations were observed in this study, a consistent result with the Tzortzis work, et al.1212. Tzortzis V, Skriapas K, Hadjigeorgiuo G, Mitsogiannis I, Aggelakis K, Gravas S et al., Sexual dysfunction in newly diagnosed multiple sclerosis women. Mult Scler. 2008;14(4):561-3. http://dx.doi.org/10.1177/13524585080140040901
https://doi.org/10.1177/1352458508014004...
.

The sensitivity is a measure of the ability of the scale to identify groups with different characteristics. The study subjects were divided into four groups: control without Urinary Incontinence, control with Urinary Incontinence (UI), MS without UI and MS with Urinary Incontinence, according to the final scores in IIQ-7-BR and also the UDI-6-BR. The average scores of the groups were compared by applying the Mann-Whitney and Kruskal-Wallis tests. The results are shown in Tables 2, 3, 4 and 5.

Table 2
Sensitivity analysis of the IIQ-7-BR in control and MS groups, with and without UI.
Table 3
Sensitivity analysis of the IIQ-7-BR in the control and MS groups.
Table 4
Sensitivity analysis of the UDI-6-BR in control and MS groups, with and without UI.
Table 5
Sensitivity analysis of the UDI-6-BR in the control and MS groups.

DISCUSSION

The translation and cultural adaptation of the instruments IIQ-7 and UDI-6 is very important in clinical practice, because the UI is an issue that affects the patient’s quality of life. Everyday activities such as work, study, physical exercise and leisure become difficult to carry out and even generate embarrassing situations which might end up traumatizing the patient with MS. In addition, the UI can also lead to other problems such as psychological disorders (depression), infections and remoteness from social life.

A recent review1313. Sèze M, Ruffion A, Denys P, Joseph PA, Perrouin-Verbe B. The neurogenic bladder in multiple sclerosis: review of the literature and proposal of management guidelines. Mult Scler. 2007;13(7):915-28. http://dx.doi.org/10.1177/1352458506075651
https://doi.org/10.1177/1352458506075651...
reported a prevalence of 37%-99% of overactive bladder syndrome characterized by urgency, urinary frequency and/or other irritative symptoms, 34%-79% of obstructive symptoms and 25% with chronic urinary retention in patients with MS. Irritative symptoms and obstruction can coexist and can affect approximately 59% in men and 51% in women. Patients with MS have a higher prevalence of urinary incontinence than the general population, with over 70% of those affected. Symptoms of bladder dysfunction occur an average of six years after diagnosis of MS, but may be present in up to 10% of the initial patients.

As it is known, the UI problems are related to the areas of the anterior cingulate gyrus, with the route of the spinal cord and the medial prefrontal1414. Kim YH, Goodman C, Omessi E, Rivera V, Kattan MW, Boone TB. The correlation of urodynamic findings with cranial magnetic resonance imaging findings in multiple sclerosis. J Urol. 1998;159(3):972-6. http://dx.doi.org/10.1016/s0022-5347(01)63791-1
https://doi.org/10.1016/s0022-5347(01)63...
area which are affected by the formation of MS plaques. The use of questionnaires is essential for sorting to be a way for the patient to express their anguish over what they feel, and added to the MRI, it becomes possible to draw a more accurate prognosis and treatments. There are also other ways to assess UI as voiding diaries, pad test and urodynamic parameters. These observations may reflect the severity of the loss, but do not express the changes in daily activities.

The psychometric properties of an instrument (reliability, validity, and sensitivity), either in their development or obligatory ensure that it is easy to apply, quantifiable, presents sensitivity and specificity and is adapted to the cultural and legal conditions in the country where if you want to use it1515. Lohr KN, Aaronson NK, Alonso J, Burnam MA, Patrick DL, Perrin EB et al. Evaluating quality-of-life and health status instruments: development of scientific review criteria. Clin Ther. 1996;18(5):979-92. http://dx.doi.org/10.1016/S0149-2918(96)80054-3
https://doi.org/10.1016/S0149-2918(96)80...
.

Given the presented data, the use of the IIQ-7-BR and UDI-6-BR is very important for Portuguese language and Brazilian culture, because they are specific clinical questionnaires, which have psychometric properties and applicability in the development of populations in different countries, these important characteristics in selecting a questionnaire to the process of cultural adaptation and validation. All translations and back-translations were performed and evaluated semantically, experimental, idiomatic and conceptual view and few changes were made between the original and the translated questionnaires.

Both instruments of this study are presented according to the rules proposed by the Instrument Review Criteria1616. Scientific Advisory Committee of the Medical Outcomes Trust - SAC. Instrument Review Criteria. 1995. which states that the validation process of a QOL instrument for patients is applied to evaluate the data obtained internal consistency, reliability or stability of the instrument, validity and sensibility.

All these criteria had to be adequate as demonstrated by the good results. For example, the values of Cronbach’s alpha coefficient, in which may vary from 0 to 1.0, and such that follows the variation between 0 and 0.6 corresponds to unsatisfactory reliability rule, from 0.6 to 0.7 reliability satisfactory and between 0.7 to 1.0 high reliability, in both questionnaires and in both groups, the internal consistency was high, maintaining the characteristics of the original scale, which demonstrates the truth of the homogeneity test after translation into the language Portuguese.

Each society has its own beliefs, acts, customs, behavior and social habits, these characteristics give people a guideline of who they are, how they should behave and what they should not do. These rules or concepts reflect the country’s culture and also differentiates it from others. When we propose a translation of a questionnaire, this should be presented in simple and clear language for that population and keep equivalent with respect to their cultural concepts. Moreover, in situations where the primary goal is not the prolongation of life and specific methods of treatment response are flawed, as is the case of UI in patients with MS, the extent of impact on quality of life of these patients is imperative.

In conclusion, the translation of questionnaires IIQ-7-BR and UDI-6-BR, aim of this study have clinical easy applicability, good sensitivity, specificity and stability, similar to the fact already being used successfully in other countries, demonstrated well adapted to the Brazilian medical practice, and can be used in day-to-day care of patients with MS. Thus, proper evaluation of urinary incontinence allows a more individualized approach to their clinical and biopsychosocial consequences, favoring medical assessment and providing better therapeutic interventions.

Apêndice

Questionário de impacto da Iincontinência urinária (IIQ-7-BR)

Algumas pessoas pensam que a incontinência urinária pode afetar suas atividades, relacionamentos e sentimentos. As perguntas a seguir referem-se a aspectos da sua vida que podem ter sido influenciados ou alterados devido à incontinência urinária. Para cada pergunta, circule o número que corresponde à resposta que melhor descreve o quanto as suas atividades, relacionamentos e sentimentos tem sido afetados pela incontinência urinária.

A incontinência urinária tem afetado... Nem um pouco Um pouco Moderadamente Muito
Sua habilidade de realizar as tarefas diárias? (tarefas domésticas ou profissionais) 0 1 2 3
Suas atividades físicas? (como caminhar, nadar, dançar, entre outros) 0 1 2 3
Seu lazer? (como ir ao cinema ou a uma festa) 0 1 2 3
Sua habilidade de viajar de carro ou ônibus por mais de 30 minutos? 0 1 2 3
Sua participação em atividades sociais fora de sua casa? 0 1 2 3
Sua saúde emocional? (nervosismo, depressão, ansiedade, medo, etc) 0 1 2 3
Você se sentir frustrado por algum motivo? 0 1 2 3

Inventário de angústia urogenital (UDI-6-BR)

References

  • 1
    Lassmann H. Neuropathology in multiple sclerosis: new concepts. Mult Scler. 1998;4(3):93-8. http://dx.doi.org/10.1177/135245859800400301
    » https://doi.org/10.1177/135245859800400301
  • 2
    Rovner ES, Gomes CM, Trigo-Rocha FE, Arap S, Wein AJ. Evaluation and treatment of the overactive bladder. Rev Hosp Clin Fac Med Sao Paulo. 2002;57(1):39-48. http://dx.doi.org/10.1590/s0041-87812002000100007
    » https://doi.org/10.1590/s0041-87812002000100007
  • 3
    Nogueira LA, Nóbrega FR, Lopes KN, Thuler LC, Alvarenga RM. The effect of functional limitations and fatigue on the quality of life in people with multiple sclerosis. Arq Neuropsiquiatr. 2009;67(3B):812-7. http://dx.doi.org/10.1590/s0004-282x2009000500006
    » https://doi.org/10.1590/s0004-282x2009000500006
  • 4
    Kelleher CJ, Cardozo LD, Toozs-Hobson PM. Quality of life and urinary incontinence. Curr Opin Obstet Gynecol. 1995;7(5):404-8. http://dx.doi.org/10.1097/00001703-199510000-00016
    » https://doi.org/10.1097/00001703-199510000-00016
  • 5
    Bent AEO, Cundiff WG, Swiff ES. Ostergard's urogynecology & pelvic floor dysfunction. 5a ed. Philadelphia: Lippincott Williams & Wilkins; 2002.
  • 6
    Shumaker SA, Wyman JF, Uebersax JS, McClish D, Fantil JA. Health-related quality of life measures for women with urinary incontinence: the Incontinence Impact Questionnaire and the Urogenital Distress Inventory. Continence Program in Women (CPW) Research Group. Qual Life Res. 1994;3(5):291-306. http://dx.doi.org/10.1007/bf00451721
    » https://doi.org/10.1007/bf00451721
  • 7
    Abrams P, Blaivas JG, Stanton SL, Andersen JT. The standardisation of terminology of lower urinary tract function. The International Continence Society Committee on Standardisation of Terminology. Scand J Urol Nephrol Suppl. 1988;114:5-19.
  • 8
    Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417-32. http://dx.doi.org/10.1016/0895-4356(93)90142-n
    » https://doi.org/10.1016/0895-4356(93)90142-n
  • 9
    Mathiesen HK, Sørensen PS. [Diagnosis of multiple sclerosis--the 2010 revision of the McDonald criteria]. Ugeskr Laeg. 2012;174(13):862-5. Danish.
  • 10
    Hulter BM, Lundberg PO. Sexual function in women with advanced multiple sclerosis. J Neurol Neurosurg Psychiatr. 1995;59(1):83-6. http://dx.doi.org/10.1136/jnnp.59.1.83
    » https://doi.org/10.1136/jnnp.59.1.83
  • 11
    Valleroy ML, Kraft GH. Sexual dysfunction in multiple sclerosis. Arch Phys Med Rehabil. 1984;65(3):125-8.
  • 12
    Tzortzis V, Skriapas K, Hadjigeorgiuo G, Mitsogiannis I, Aggelakis K, Gravas S et al., Sexual dysfunction in newly diagnosed multiple sclerosis women. Mult Scler. 2008;14(4):561-3. http://dx.doi.org/10.1177/13524585080140040901
    » https://doi.org/10.1177/13524585080140040901
  • 13
    Sèze M, Ruffion A, Denys P, Joseph PA, Perrouin-Verbe B. The neurogenic bladder in multiple sclerosis: review of the literature and proposal of management guidelines. Mult Scler. 2007;13(7):915-28. http://dx.doi.org/10.1177/1352458506075651
    » https://doi.org/10.1177/1352458506075651
  • 14
    Kim YH, Goodman C, Omessi E, Rivera V, Kattan MW, Boone TB. The correlation of urodynamic findings with cranial magnetic resonance imaging findings in multiple sclerosis. J Urol. 1998;159(3):972-6. http://dx.doi.org/10.1016/s0022-5347(01)63791-1
    » https://doi.org/10.1016/s0022-5347(01)63791-1
  • 15
    Lohr KN, Aaronson NK, Alonso J, Burnam MA, Patrick DL, Perrin EB et al. Evaluating quality-of-life and health status instruments: development of scientific review criteria. Clin Ther. 1996;18(5):979-92. http://dx.doi.org/10.1016/S0149-2918(96)80054-3
    » https://doi.org/10.1016/S0149-2918(96)80054-3
  • 16
    Scientific Advisory Committee of the Medical Outcomes Trust - SAC. Instrument Review Criteria. 1995.

Publication Dates

  • Publication in this collection
    Jan 2015

History

  • Received
    09 Apr 2014
  • Reviewed
    11 Sept 2014
  • Accepted
    01 Oct 2014
Academia Brasileira de Neurologia - ABNEURO R. Vergueiro, 1353 sl.1404 - Ed. Top Towers Offices Torre Norte, 04101-000 São Paulo SP Brazil, Tel.: +55 11 5084-9463 | +55 11 5083-3876 - São Paulo - SP - Brazil
E-mail: revista.arquivos@abneuro.org