Acessibilidade / Reportar erro

Accuracy of the Brief Cognitive Screening Battery for diagnosing Alzheimer's disease defined by cerebrospinal fluid biomarkers and AT(N) classification: a case-control study

Acurácia da Bateria Breve de Rastreio Cognitivo no diagnóstico da doença de Alzheimer definida por biomarcadores no líquido cefalorraquidiano e classificação pelo sistema AT(N): estudo caso-controle

ABSTRACT

Background:

Validation of cognitive instruments for detection of Alzheimer's disease (AD) based on correlation with diagnostic biomarkers allows more reliable identification of the disease.

Objectives:

To investigate the accuracy of the Brief Cognitive Screening Battery (BCSB) in the differential diagnosis between AD, non-AD cognitive impairment (both defined by cerebrospinal fluid [CSF] biomarkers) and healthy cognition, and to correlate CSF biomarker results with cognitive performance.

Methods:

Overall, 117 individuals were evaluated: 45 patients with mild cognitive impairment (MCI) or mild dementia within the AD continuum defined by the AT(N) classification [A+T+/-(N)+/]; 27 non-AD patients with MCI or mild dementia [A-T+/-(N)+/-]; and 45 cognitively healthy individuals without CSF biomarker results. All participants underwent evaluation using the BCSB.

Results:

The total BCSB and delayed recall (DR) scores of the BCSB memory test showed high diagnostic accuracy, as indicated by areas under the ROC curve (AUC): 0.89 and 0.87, respectively, for discrimination between AD and non-AD versus cognitively healthy controls. Similarly, total BCSB and DR displayed high accuracy (AUC-ROC curves of 0.89 and 0.91, respectively) for differentiation between AD and controls. BCSB tests displayed low accuracy for differentiation between AD and non-AD. The CSF levels of biomarkers correlated significantly, though weakly, with DR.

Conclusions:

Total BCSB and DR scores presented good accuracy for differentiation between patients with a biological AD diagnosis and cognitively healthy individuals, but low accuracy for differentiating AD from non-AD patients.

Keywords:
Alzheimer Disease; Cognitive Dysfunction; Diagnosis; Biomarkers; Cognition

RESUMO

Antecedentes:

A validação de testes cognitivos para identificação da doença de Alzheimer (DA) definida por biomarcadores aumenta a confiabilidade diagnóstica.

Objetivos:

Investigar a acurácia da Bateria Breve de Rastreio Cognitivo (BBRC) no diagnóstico diferencial entre DA, comprometimento cognitivo não-DA (ambos diagnósticos definidos por biomarcadores no líquido cefalorraquidiano-LCR) e indivíduos cognitivamente saudáveis, e investigar correlações entre desempenho nos testes e concentrações dos biomarcadores no LCR.

Métodos:

No total, 117 indivíduos foram avaliados. Quarenta e cinco pacientes com comprometimento cognitivo leve (CCL) ou demência leve com diagnóstico do continuum de DA definido pela classificação AT(N) [A+T+/-(N)+/-], 27 pacientes com CCL ou demência leve não-DA [A-T+/-(N)+/-], e 45 controles cognitivamente saudáveis sem estudo de biomarcadores no LCR. Os participantes foram submetidos à BBRC.

Resultados:

O escore total da BBRC e a evocação tardia (ET) no teste de memória da BBRC apresentaram elevada acurácia diagnóstica na diferenciação entre DA e não-DA versus controles, indicada pelas áreas sob a curva ROC (AUC) de 0,89 e 0,87, respectivamente. De modo semelhante, o escore total da BBRC e a ET mostraram elevadas acurácias (AUC-ROC de 0,89 e 0,91, respectivamente) para o diagnóstico diferencial entre DA e controles. A acurácia da BBRC foi baixa na diferenciação entre DA e não-DA. Os níveis dos biomarcadores no LCR se correlacionaram de forma significativa, embora fraca, com ET.

Conclusões:

Os escores totais da BCSB e a ET apresentaram boa acurácia na diferenciação entre pacientes com diagnóstico biológico de DA e controles cognitivamente saudáveis, mas baixa acurácia para diferenciar DA de não-DA.

Palavras-chave:
Doença de Alzheimer; Disfunção Cognitiva; Diagnóstico; Biomarcadores; Cognição

INTRODUCTION

Alzheimer's disease (AD) is the leading cause of dementia worldwide11. Ferri CP, Prince M, Brayne C, Brodaty H, Fratiglioni L, Ganguli M, et al. Global prevalence of dementia: a Delphi consensus study. Lancet. 2005 Dec 17;366(9503):2112-7. https://doi.org/10.1016/S0140-6736(05)67889-0
https://doi.org/10.1016/S0140-6736(05)67...
,22. Fiest KM, Jetté N, Roberts JI, Maxwell CJ, Smith EE, Black SE, et al. The prevalence and incidence of dementia: a systematic review and meta-analysis. Can J Neurol Sci. 2016 Apr;43 Suppl 1:S3-50. https://doi.org/10.1017/cjn.2016.18
https://doi.org/10.1017/cjn.2016.18...
,33. The Lancet. Alzheimer's disease: expedition into the unknown. Lancet. 2016 Dec 3;388(10061):2713. https://doi.org/10.1016/S0140-6736(16)32457-6
https://doi.org/10.1016/S0140-6736(16)32...
, although often underreported44. Herrera Jr E, Caramelli P, Silveira ASB, Nitrini R. Epidemiologic survey of dementia in a community-dwelling Brazilian population. Alzheimer Dis Assoc Disord. 2002 Apr-Jun;16(2):103-8. https://doi.org/10.1097/00002093-200204000-00007
https://doi.org/10.1097/00002093-2002040...
,55. Nitrini R, Bottino CM, Albala C, Capuñay NSC, Ketzoian C, Rodriguez JJL, et al. Prevalence of dementia in Latin America: a collaborative study of population-based cohorts. Int Psychogeriatr. 2009 Aug;21(4):622‐30. https://doi.org/10.1017/S1041610209009430
https://doi.org/10.1017/S104161020900943...
,66. Callahan CM, Tu W, Stump TE, Clark DO, Unroe KT, Hendrie HC. Errors in self-reports of health services use: impact on alzheimer disease clinical trial designs. Alzheimer Dis Assoc Disord. 2015 Jan-Mar;29(1):75‐81. https://doi.org/10.1097/WAD.0000000000000048
https://doi.org/10.1097/WAD.000000000000...
. Until recently, AD was diagnosed based solely on identification of a characteristic cognitive profile and through ruling out other diseases using ancillary tests. Lately, important advances have been achieved through development of specific biomarkers77. Jack Jr CR, Albert MS, Knopman DS, McKhann GM, Sperling RA, Carrillo MC, et al. Introduction to the recommendations of the National Institute on Aging-Alzheimer's Association working groups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement. 2011 May;7(3):257-62. https://doi.org/10.1016/j.jalz.2011.03.004
https://doi.org/10.1016/j.jalz.2011.03.0...
.

The cerebrospinal fluid (CSF) biomarker profiles associated with AD consist of reduced concentration of beta-amyloid (Aβ42) and increased concentrations of total tau (T-Tau) and phosphorylated tau (P-Tau). Detection of these biomarkers, by means of CSF analysis or neuroimaging methods, allows a biological diagnosis of AD and differentiation from non-AD dementias through the AT(N) classification. In the AT(N) system, A+ individuals, regardless of whether T and (N) are + or -, are qualified as presenting the continuum of the AD pathological process. However, determining these diagnostic biomarkers is costly or invasive, besides being commonly unavailable. Thus, the most-used diagnostic methods are clinical assessment, laboratory tests and structural neuroimaging88. Nitrini R, Caramelli P, Bottino CMC, Damasceno BP, Brucki SMD, Anghinah R, Academia Brasileira de Neurologia. Diagnosis of Alzheimer's disease in Brazil: diagnostic criteria and auxiliary tests. Recommendations of the Scientific Department of Cognitive Neurology and Aging of the Brazilian Academy of Neurology. Arq Neuropsiquiatr. 2005 Sep;63(3A):713-9. https://doi.org/10.1590/S0004-282X2005000400033
https://doi.org/10.1590/S0004-282X200500...
.

The Brief Cognitive Screening Battery (BCSB) is a useful tool for detect dementia, particularly AD99. Nitrini R, Lefèvre BH, Mathias SC, Caramelli P, Carrilho PE, Sauaia N, et al. Neuropsychological tests of simple application for diagnosing dementia. Arq Neuropsiquiatr. 1994 Dec;52(4):457-65. https://doi.org/10.1590/S0004-282X1994000400001
https://doi.org/10.1590/S0004-282X199400...
. Several studies have investigated the psychometric characteristics of the BCSB1010. Yassuda MS, Silva HS, Lima-Silva TB, Cachioni M, Falcão DVS, Lopes A, et al. Normative data for the brief cognitive screening battery stratified by age and education. Dement Neuropsychol. 2017 Jan-Mar;11(1):48-53. https://doi.org/10.1590/1980-57642016dn11-010008
https://doi.org/10.1590/1980-57642016dn1...
,1111. Nitrini R, Caramelli P, Porto CS, Charchat-Fichman H, Formigoni AP, Carthery-Goulart MT, et al. Brief cognitive battery in the diagnosis of mild alzheimer's disease in subjects with medium and high levels of education. Dement Neuropsychol. 2007 Jan-Mar;1(1):32-6. https://doi.org/10.1590/S1980-57642008DN10100006
https://doi.org/10.1590/S1980-57642008DN...
,1212. Fichman-Charchat H, Miranda CV, Fernandes CS, Mograbi D, Oliveira RM, Novaes R, et al. Brief Cognitive Screening Battery (BCSB) is a very useful tool for diagnosis of probable mild Alzheimer´s disease in a geriatric clinic. Arq Neuropsiquiatr. 2016 Feb;74(2):149-54. https://doi.org/10.1590/0004-282X20150202
https://doi.org/10.1590/0004-282X2015020...
. However, the BCSB has not been investigated or validated among patients with a biological AD diagnosis, which could enhance the evidence for its clinical use.

The present study aimed to investigate the BCSB for diagnosing the AD continuum and the association between BCSB scores and CSF biomarker concentrations.

METHODS

Our institution’s research ethics committee approved the study.

Participants

The sample was divided into AD (i.e., AD continuum), non-AD and control groups. Individuals with schooling levels of less than four years or with scores below 20 points in the Mini-Mental State Examination (MMSE)1313. Folstein M, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975 Nov;12(3):189-98. https://doi.org/10.1016/0022-3956(75)90026-6
https://doi.org/10.1016/0022-3956(75)900...
,1414. Bertolucci PHF, Brucki SMD, Campacci SR, Juliano Y. The Mini-Mental State Examination in a general population: impact of educational status. Arq Neuropsiquiatr. 1994 Mar;52(1):1-7. https://doi.org/10.1590/S0004-282X1994000100001
https://doi.org/10.1590/S0004-282X199400...
were excluded.

AD and non-AD patients presented a clinical diagnosis of mild cognitive impairment (MCI) or mild dementia. All patients underwent CSF biomarker analysis, with concentration measurements on Aβ42, T-tau and P-tau. The diagnostic categorization of AD and non-AD was purely biological, independent of the cognitive results. Thus, two diagnostic classifications were established: 1) clinical, in accordance with consensual criteria for AD1515. Albert MS, DeKosky ST, Dickson DW, Dubois B, Feldman HH, Fox NC, et al. The diagnosis of mild cognitive impairment due to Alzheimer's disease: recommendations by the National Institute on Aging-Alzheimer's Association working groups on diagnostic guidelines for alzheimer's disease. Alzheimers Dement. 2011 May;7(3):270-9. https://doi.org/10.1016/j.jalz.2011.03.008
https://doi.org/10.1016/j.jalz.2011.03.0...
,1616. McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack Jr CR, Kawas CH, et al. The diagnosis of dementia due to alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for alzheimer's disease. Alzheimers Dement. 2011 May;7(3):263-9. https://doi.org/10.1016/j.jalz.2011.03.005
https://doi.org/10.1016/j.jalz.2011.03.0...
behavioral variant frontotemporal dementia1717. Rascovsky K, Hodges JR, Knopman D, Mendez MF, Kramer JH, Neuhaus J, et al. Sensitivity of revised diagnostic criteria for the behavioural variant of frontotemporal dementia. Brain. 2011 Sep;134(9):2456-77. https://doi.org/10.1093/brain/awr179
https://doi.org/10.1093/brain/awr179...
, vascular dementia1818. Román GC. Defining dementia: clinical criteria for the diagnosis of vascular dementia. Acta Neurol Scand Suppl. 2002 Dec;106(178):6-9. https://doi.org/10.1034/j.1600-0404.106.s178.2.x
https://doi.org/10.1034/j.1600-0404.106....
,1919. Wetterling T, Kanitz RD, Borgis KJ. Clinical evaluation of the ICD-10 criteria for vascular dementia. Eur Arch Psychiatry Clin Neurosci. 1993 Jul;243(1):33-40. https://doi.org/10.1007/BF02191521
https://doi.org/10.1007/BF02191521...
, primary progressive aphasia2020. Gorno-Tempini ML, Hillis AE, Weintraub S, Kertesz A, Mendez M, Cappa SF, et al. Classification of primary progressive aphasia and its variants. Neurology. 2011 Mar 15;76(11):1006-14. https://doi.org/10.1212/WNL.0b013e31821103e6
https://doi.org/10.1212/WNL.0b013e318211...
and dementia with Lewy bodies2121. McKeith IG, Galasko D, Kosaka K, Perry EK, Dickson DW, Hansen LA, et al. Consensus guidelines for the clinical and pathologic diagnosis of Dementia with Lewy Bodies (DLB): report of the consortium on DLB international workshop. Neurology. 1996 Nov 1;47(5):1113-24. https://doi.org/10.1212/WNL.47.5.1113
https://doi.org/10.1212/WNL.47.5.1113...
,2222. Geser F, Wenning GK, Poewe W, McKeith I. How to diagnose Dementia with Lewy Bodies: state of the art. Mov Disord. 2005 Aug;20(12 Suppl 12):S11-20. https://doi.org/10.1002/mds.20535
https://doi.org/10.1002/mds.20535...
; and 2) biological, based on CSF biomarkers and on the AT(N) classification. The clinical and biological classifications were performed by independent researchers.

The cognitively healthy controls used in this study did not have any history of neurological or psychiatric disorders, or depression according to clinical assessment, were not taking medications with cognitive effects and presented normal MMSE1313. Folstein M, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975 Nov;12(3):189-98. https://doi.org/10.1016/0022-3956(75)90026-6
https://doi.org/10.1016/0022-3956(75)900...
,1414. Bertolucci PHF, Brucki SMD, Campacci SR, Juliano Y. The Mini-Mental State Examination in a general population: impact of educational status. Arq Neuropsiquiatr. 1994 Mar;52(1):1-7. https://doi.org/10.1590/S0004-282X1994000100001
https://doi.org/10.1590/S0004-282X199400...
scores for their age and education2323. Amaral-Carvalho V, Caramelli P. Normative data for healthy middle-aged and elderly performance on the Addenbrooke Cognitive Examination-Revised. Cogn Behav Neurol. 2012 Jun;25(2):72-6. https://doi.org/10.1097/WNN.0b013e318259594b
https://doi.org/10.1097/WNN.0b013e318259...
. CSF biomarkers were not available for controls.

Instruments

The participants underwent MMSE and BCSB assessments. The BCSB comprises three tests: 1. Figure memory test (FMT)2424. Nitrini R, Lefèvre BH, Mathias SC, Caramelli P, Carrilho PE, Sauaia N, et al. Neuropsychological tests of simple application for diagnosing dementia. Arq Neuropsiquiatr. 1994 Dec;52(4):457‐65. https://doi.org/10.1590/S0004-282X1994000400001
https://doi.org/10.1590/S0004-282X199400...
, including naming, incidental memory, immediate memory, learning, delayed recall (DR) and recognition; 2. Verbal fluency (VF) test, in animals/minute2525. Brucki SM, Malheiros SM, Okamoto IH, Bertolucci PH. Normative data on the verbal fluency test in the animal category in our milieu. Arq Neuropsiquiatr. 1997 Mar;55(1):56-61. https://doi.org/10.1590/S0004-282X1997000100009
https://doi.org/10.1590/S0004-282X199700...
3. Clock drawing test (CDT)2626. Shulman K, Gold DP, Cohen CA, Zuchero CA. Clock design and dementia in the community: a longitudinal study. Int J Geriatr Psych. 1993 Jun;8(6):487-96. https://doi.org/10.1002/gps.930080606
https://doi.org/10.1002/gps.930080606...
.

In the FMT, a board with 10 drawings is presented to participants, who are asked to name them; then, without the board, these subjects are asked to evoke the drawings (incidental memory). Subsequently, the board is shown twice for 30 seconds, for two recalls (immediate memory and learning). VF and CDT are administered as interference tests, followed by DR of the drawings and recognition. BCSB administration usually takes eight to 10 minutes.

Total scores were calculated for each task separately and were transformed into z scores based on BCSB1111. Nitrini R, Caramelli P, Porto CS, Charchat-Fichman H, Formigoni AP, Carthery-Goulart MT, et al. Brief cognitive battery in the diagnosis of mild alzheimer's disease in subjects with medium and high levels of education. Dement Neuropsychol. 2007 Jan-Mar;1(1):32-6. https://doi.org/10.1590/S1980-57642008DN10100006
https://doi.org/10.1590/S1980-57642008DN...
normative data, stratified according to age and education.

Biological analysis

CSF analyses were conducted in two laboratories, following the same procedures. CSF samples were centrifuged at 3,000 revolutions per minute for 10 minutes, at 4ºC, no more than four hours after collection. CSF aliquots were frozen in polypropylene tubes at -80ºC until analysis. Biomarkers were measured by means of the enzyme-linked immunosorbent assay (ELISA) technique using INNOTEST hTAU Ag, PHOSPHO-TAU (181P) and β-Amyloid (1-42) kits (Fujirebio Europe NV, Gent, Belgium), following the manufacturer’s instructions. The reference values for AD diagnosis were Aβ42 < 700 pg/mL, T-tau > 375 pg/mL and P-tau > 60 pg/mL. The reference values for non-AD diagnoses were Aβ42 ≥ 700 pg/mL, T-tau ≤ 375 pg/mL, P-tau ≤ 60 pg/mL2727. Lehmann S, Schraen S, Quadrio I, Paquet C, Bombois S, Dalaby C, et al. Impact of harmonization of collection tubes on alzheimer's disease diagnosis. Alzheimers Dement. 2014 Oct;10(5 Suppl 5):S390-94.e2. https://doi.org/10.1016/j.jalz.2013.06.008
https://doi.org/10.1016/j.jalz.2013.06.0...
.

Statistical analysis

First, we conducted descriptive analysis on the sociodemographic data and on the raw scores from the cognitive tests. Then, we used the Kruskal-Wallis test with z-scores controlled according to age and education, to investigate differences in BCSB subtests between AD vs. non-AD vs. controls. Effect sizes were calculated. The Kendall method, with Bonferroni corrections, was used to explore correlations between biomarkers and cognitive performance. The sensitivity and specificity of BCSB subtests for diagnosing clinical groups were determined through receiver operating characteristic (ROC) curves. Lastly, logistic regression analysis was used to investigate the likelihood of identifying clinical cases using BCSB subtests.

RESULTS

The AD group included 45 participants (57.7% women), with a mean age of 65.3 years (SD = 6.5) and mean schooling of 13.1 years (SD = 5.1) [34 A+T+(N)+; 2 A+T+(N)-; 9 A+T-(N)-]. The AD patients had a mean symptom duration of 2.7 years (SD = 1.8). The non-AD group included 27 participants (37.0% women), with a mean age of 64.5 years (SD = 6.4) and mean schooling of 11.9 years (SD = 4.6) [21 A-T-(N)-; 1 A-T-(N)+; 1 A-T+(N)-; 4 A-T+(N)+]. The non-AD group included 13 participants with behavioral variant temporal dementia, eight patients with MCI, three with semantic variant-primary progressive aphasia, one with vascular dementia, one with dementia with Lewy bodies and one with dementia of undefined etiology. The non-AD patients had a mean symptom duration of 2.1 years (SD = 1.1). The control group included 45 participants (44.4% women), with a mean age of 68.9 years (SD = 5.6) and mean schooling of 10.0 years (SD = 5.1). Table 1 presents sociodemographic and cognitive performance data for each group.

Table 1.
Sociodemographic and cognitive data of the AD, non-AD and control groups.

The AD patients performed significantly worse than both the non-AD patients and the controls only in the DR subtest. In the incidental memory subtest, the AD patients displayed significantly lower performance than the controls, but performed similarly to the non-AD patients. In the VF subtest, the AD patients performed better than the non-AD participants, but worse than the controls. In immediate memory, learning and recognition, the AD and non-AD groups performed significantly worse than the controls, although AD and non-AD performances were similar.

Regarding BCSB total scores, the AD and non-AD groups displayed significantly lower performance than the controls. Figure 1 shows the dispersion of cases according to age, total BCSB score and group.

Figure 1.
Dispersion according to age and total BCSB score.

The area under the ROC curve (AUC), confidence interval, sensitivity, specificity and best cutoff scores were calculated for each BCSB variable for differential diagnoses between AD, non-AD and controls (Table 2).

Table 2.
Data from ROC curves for comparisons between clinical groups (AD and non-AD) and controls, and between AD and non-AD patients.

As can be seen in Figure 2 (A, B), naming did not present satisfactory AUC in any of the comparisons. The DR subtest and total BCSB score presented the best AUC values for comparisons between clinical groups and controls, and between AD and controls. None of the BCSB subtests displayed good AUC for differentiation between AD and non-AD (Figure 2C).

Figure 2.
ROC curves for comparisons between groups.

In the logistic regression analysis, DR and total BCSB scores displayed the best results regarding diagnostic prediction of clinical groups. The learning subtest of the FMT was the only test that significantly differentiated AD from non-AD cases (Table 3).

Table 3.
Results from logistic regression comparisons between groups.

Correlations between CSF biomarkers and performance in the BCSB among AD and non-AD patients were weak, but significant between biomarkers and DR. A positive correlation between DR and Aβ42 (K = 0.17; p < 0.03), and negative correlations between DR and T-tau (K = - 0.24; p < 0.003) and P-tau (k = - 0.24; p < 0.004) were observed.

DISCUSSION

The BCSB proved to be a good screening instrument for identifying AD continuum and non-AD patients, as defined through the CSF biomarkers and AT(N) classification system, in MCI or mild dementia stages, with good sensitivity and specificity. In most subtests, AD patients performed worse than controls. Moreover, the DR subtest displayed good specificity for differentiating AD from non-AD, although with low sensitivity.

The sensitivity and specificity in our study were lower than those found in previous investigations using the BCSB1212. Fichman-Charchat H, Miranda CV, Fernandes CS, Mograbi D, Oliveira RM, Novaes R, et al. Brief Cognitive Screening Battery (BCSB) is a very useful tool for diagnosis of probable mild Alzheimer´s disease in a geriatric clinic. Arq Neuropsiquiatr. 2016 Feb;74(2):149-54. https://doi.org/10.1590/0004-282X20150202
https://doi.org/10.1590/0004-282X2015020...
,1313. Folstein M, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975 Nov;12(3):189-98. https://doi.org/10.1016/0022-3956(75)90026-6
https://doi.org/10.1016/0022-3956(75)900...
,1616. McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack Jr CR, Kawas CH, et al. The diagnosis of dementia due to alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for alzheimer's disease. Alzheimers Dement. 2011 May;7(3):263-9. https://doi.org/10.1016/j.jalz.2011.03.005
https://doi.org/10.1016/j.jalz.2011.03.0...
. It is possible that inclusion of non-amnestic AD patients, together with FTD patients with possible memory changes in the non-AD group, may have decreased BCSB accuracy. Furthermore, the increased diagnostic precision determined by biomarkers may also have influenced the results. It should also be considered that the AT(N) classification does not encompass the full spectrum of possible pathophysiological changes associated with aging. Accordingly, new CSF biomarkers (e.g. neurofilament light chain and neurogranin) have been used to optimize dementia diagnoses2828. Hampel H, Toschi N, Baldacci F, Zetterberg H, Blennow K, Kilimann I, et al. Alzheimer's disease biomarker-guided diagnostic workflow using the added value of six combined cerebrospinal fluid candidates: Aβ1-42, total-tau, phosphorylated-tau, NFL, neurogranin, and YKL-40. Alzheimers Dement. 2018 Apr;14(4):492-501. https://doi.org/10.1016/j.jalz.2017.11.015
https://doi.org/10.1016/j.jalz.2017.11.0...
. In addition, cognitive deficits are not specific for each clinical condition and usually overlap across different diseases2929. Bertoux M, Cassagnaud P, Lebouvier T, Lebert F, Sarazin M, Le Ber I, et al. Does amnesia specifically predict Alzheimer's pathology? A neuropathological study. Neurobiol Aging. 2020 Nov;95:123-30. https://doi.org/10.1016/j.neurobiolaging.2020.07.011
https://doi.org/10.1016/j.neurobiolaging...
. In sum, our results confirm that cognitive tests are sensitive tools for MCI/dementia screening, but the correspondence between clinical and underlying pathological features is not linear.

The BCSB displayed good diagnostic accuracy, thus corroborating previous results1111. Nitrini R, Caramelli P, Porto CS, Charchat-Fichman H, Formigoni AP, Carthery-Goulart MT, et al. Brief cognitive battery in the diagnosis of mild alzheimer's disease in subjects with medium and high levels of education. Dement Neuropsychol. 2007 Jan-Mar;1(1):32-6. https://doi.org/10.1590/S1980-57642008DN10100006
https://doi.org/10.1590/S1980-57642008DN...
,1212. Fichman-Charchat H, Miranda CV, Fernandes CS, Mograbi D, Oliveira RM, Novaes R, et al. Brief Cognitive Screening Battery (BCSB) is a very useful tool for diagnosis of probable mild Alzheimer´s disease in a geriatric clinic. Arq Neuropsiquiatr. 2016 Feb;74(2):149-54. https://doi.org/10.1590/0004-282X20150202
https://doi.org/10.1590/0004-282X2015020...
,1313. Folstein M, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975 Nov;12(3):189-98. https://doi.org/10.1016/0022-3956(75)90026-6
https://doi.org/10.1016/0022-3956(75)900...
,3030. Bertoux M, Cassagnaud P, Lebouvier T, Lebert F, Sarazin M, Le Ber I, et al. Does amnesia specifically predict alzheimer's pathology? A neuropathological study. Neurobiol Aging. 2020 Nov;95:123-30. https://doi.org/10.1016/j.neurobiolaging.2020.07.011
https://doi.org/10.1016/j.neurobiolaging...
. DR was the best BCSB subtest, in comparing AD and controls. Previous studies3131. Nitrini R, Caramelli P, Herrera Júnior E, Porto CS, Charchat-Fichman H, Carthery MT, et al. Performance of illiterate and literate nondemented elderly subjects in two tests of long-term memory. J Int Neuropsychol Soc. 2004 Jul 1;10(4):634-8. https://doi.org/10.1017/S1355617704104062
https://doi.org/10.1017/S135561770410406...
,3232. Takada LT, Caramelli P, Fichman HC, Porto CS, Bahia VS, Anghinah R, et al. Comparison between two tests of delayed recall for the diagnosis of dementia. Arq Neuropsiquiatr. 2006 Mar;64(1):35-40. https://doi.org/10.1590/S0004-282X2006000100008
https://doi.org/10.1590/S0004-282X200600...
identified that the BCSB DR test was superior to CERAD DR among illiterate individuals3333. Morris JC, Heyman A, Mohs RC, Hughes JP, van Belle G, Fillenbaum G, et al. The Consortium to Establish a Registry for Alzheimer's disease (CERAD): Part 1. Clinical and neuropsychological assessment of alzheimer's disease. Neurology. 1989 Sep 1;39(9):1159-65. https://doi.org/10.1590/s0004-282x2006000100008
https://doi.org/10.1590/s0004-282x200600...
,3434. Bertolucci PH, Okamoto IH, Brucki SM, Siviero MO, Toniolo Neto J, Ramos LR. Applicability of the CERAD neuropsychological battery to Brazilian elderly. Arq Neuropsiquiatr. 2001 Sep;59(3-A):532-6. https://doi.org/10.1590/S0004-282X2001000400009
https://doi.org/10.1590/S0004-282X200100...
DR, while these tests had similar accuracy among literate people.

Interestingly, the learning subtest of FMT was the only significant variable in the logistic regression to discriminate between AD and non-AD. However, DR was only marginally significant, and the results suggest that this test was also able to discriminate between AD and non-AD patients. The ROC curve analysis showed that DR was slightly superior to learning, with similar sensitivity, but with greater specificity. Thus, caution is needed in interpreting these results, because our non-AD group included patients with different etiologies and also with episodic memory deficits.

Negative correlations were found between DR and CSF T-tau and P-tau concentrations, and a positive correlation between DR and Aβ42. However, all these correlations were weak. It is important to highlight that elevated T-tau levels in the CSF, indicative of neurodegeneration or (N+), were observed in 3/4 of AD patients, but in less than 10% of non-AD cases.

Investigation of CSF biomarkers in association with cognitive testing contributes to understanding deficits that may be attributable to the biological substrates of AD. In two studies that investigated CSF biomarkers in relation to cognition, Rolstad et al. observed that Aβ42 levels correlated with episodic memory deficits, starting from the onset of the disease3535. Rolstad S, Berg AI, Bjerke M, Blennow K, Johansson B, Zetterberg H, et al. Amyloid-β₄₂ is associated with cognitive impairment in healthy elderly and subjective cognitive impairment. J Alzheimers Dis. 2011;26(1):135-42. https://doi.org/10.3233/JAD-2011-110038
https://doi.org/10.3233/JAD-2011-110038...
, while T-tau levels had a small to moderate influence on all cognitive domains, except for visuospatial abilities, in patients with MCI3636. Rolstad S, Berg AI, Bjerke M, Johansson B, Zetterberg H, Wallin A. Cerebrospinal fluid biomarkers mirror rate of cognitive decline. J Alzheimers Dis. 2013;34(4):949-56. https://doi.org/10.3233/JAD-121960
https://doi.org/10.3233/JAD-121960...
. Some studies3737. Radanovic M, Oshiro CA, Freitas TQ, Talib LL, Forlenza OV. Correlation between biomarkers in the CSF of Alzheimer's disease and global cognition in a cohort of psychogeriatric clinic. Braz J Psychiatry. 2019 Nov-Dec;41(6):479-84. https://doi.org/10.1590/1516-4446-2018-0296
https://doi.org/10.1590/1516-4446-2018-0...
,3838. Mazzeo S, Santangelo R, Bernasconi MP, Cecchetti G, Fiorino A, Pinto P, et al. Combining cerebrospinal fluid biomarkers and neuropsychological assessment: a simple and economical algorithm to predict the progression of cognitive impairment leading to Alzheimer's disease dementia. J Alzheimers Dis. 2016 Oct 18;54(4):1495-508. https://doi.org/10.3233/JAD-160360
https://doi.org/10.3233/JAD-160360...
correlated biomarkers and cognition in a temporal pattern, such that cognitive performance correlated first with Aβ42, then with T-tau and P-tau. This suggested that combination of neuropsychological assessment with CSF biomarkers is useful for making AD differential diagnoses. Additionally, the concentrations of P-tau have greater specificity for AD diagnosis, showing good discrimination between AD and frontotemporal dementia, since the levels of this biomarker are more associated with cognition in AD and correlate with disease stage3939. Ferreira D, Perestelo-Pérez L, Westman E, Wahlund L-O, Sarría A, Serrano-Aguilar P. Meta-review of central CSF biomarkers in Alzheimer's disease: the state of the art after the new diagnostic criteria reviewed. Front Aging Neurosci. 2014 Mar 24;6:47. https://doi.org/10.3389/fnagi.2014.00047
https://doi.org/10.3389/fnagi.2014.00047...
.

The BCSB cutoff scores presented in our study indicate high precision in identifying AD and non-AD, since the diagnoses were based on CSF biomarkers. However, the present study was limited by the lack of biomarker data among the controls and by small sample sizes. In addition, although biomarker analyses were carried out using the same diagnostic kit, the tests were conducted in two laboratories, which might have skewed the biomarker measurements.

Combination of less invasive and more accessible tests makes it possible to overcome the financial and structural challenges of the healthcare system, without neglecting diagnostic reliability. In view of the growing demand for differential diagnoses of dementia, it is necessary to use validated instruments to assist in diagnostic investigation. We conclude that the BCSB displays good accuracy for differentiation between patients with a biological diagnosis of AD, non-AD patients and controls, thus confirming its value as a cognitive screening tool for clinical practice.

ACKNOWLEDGEMENTS

We are very grateful to the patients and controls for their participation in this study. We thank Drs. Antônio Lúcio Teixeira, Izabela Guimarães Barbosa, Micheli Figueiró, Natália Pessoa Rocha and Nayara Braz for their assistance in the CSF analyses.

References

  • 1. Ferri CP, Prince M, Brayne C, Brodaty H, Fratiglioni L, Ganguli M, et al. Global prevalence of dementia: a Delphi consensus study. Lancet. 2005 Dec 17;366(9503):2112-7. https://doi.org/10.1016/S0140-6736(05)67889-0
    » https://doi.org/10.1016/S0140-6736(05)67889-0
  • 2. Fiest KM, Jetté N, Roberts JI, Maxwell CJ, Smith EE, Black SE, et al. The prevalence and incidence of dementia: a systematic review and meta-analysis. Can J Neurol Sci. 2016 Apr;43 Suppl 1:S3-50. https://doi.org/10.1017/cjn.2016.18
    » https://doi.org/10.1017/cjn.2016.18
  • 3. The Lancet. Alzheimer's disease: expedition into the unknown. Lancet. 2016 Dec 3;388(10061):2713. https://doi.org/10.1016/S0140-6736(16)32457-6
    » https://doi.org/10.1016/S0140-6736(16)32457-6
  • 4. Herrera Jr E, Caramelli P, Silveira ASB, Nitrini R. Epidemiologic survey of dementia in a community-dwelling Brazilian population. Alzheimer Dis Assoc Disord. 2002 Apr-Jun;16(2):103-8. https://doi.org/10.1097/00002093-200204000-00007
    » https://doi.org/10.1097/00002093-200204000-00007
  • 5. Nitrini R, Bottino CM, Albala C, Capuñay NSC, Ketzoian C, Rodriguez JJL, et al. Prevalence of dementia in Latin America: a collaborative study of population-based cohorts. Int Psychogeriatr. 2009 Aug;21(4):622‐30. https://doi.org/10.1017/S1041610209009430
    » https://doi.org/10.1017/S1041610209009430
  • 6. Callahan CM, Tu W, Stump TE, Clark DO, Unroe KT, Hendrie HC. Errors in self-reports of health services use: impact on alzheimer disease clinical trial designs. Alzheimer Dis Assoc Disord. 2015 Jan-Mar;29(1):75‐81. https://doi.org/10.1097/WAD.0000000000000048
    » https://doi.org/10.1097/WAD.0000000000000048
  • 7. Jack Jr CR, Albert MS, Knopman DS, McKhann GM, Sperling RA, Carrillo MC, et al. Introduction to the recommendations of the National Institute on Aging-Alzheimer's Association working groups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement. 2011 May;7(3):257-62. https://doi.org/10.1016/j.jalz.2011.03.004
    » https://doi.org/10.1016/j.jalz.2011.03.004
  • 8. Nitrini R, Caramelli P, Bottino CMC, Damasceno BP, Brucki SMD, Anghinah R, Academia Brasileira de Neurologia. Diagnosis of Alzheimer's disease in Brazil: diagnostic criteria and auxiliary tests. Recommendations of the Scientific Department of Cognitive Neurology and Aging of the Brazilian Academy of Neurology. Arq Neuropsiquiatr. 2005 Sep;63(3A):713-9. https://doi.org/10.1590/S0004-282X2005000400033
    » https://doi.org/10.1590/S0004-282X2005000400033
  • 9. Nitrini R, Lefèvre BH, Mathias SC, Caramelli P, Carrilho PE, Sauaia N, et al. Neuropsychological tests of simple application for diagnosing dementia. Arq Neuropsiquiatr. 1994 Dec;52(4):457-65. https://doi.org/10.1590/S0004-282X1994000400001
    » https://doi.org/10.1590/S0004-282X1994000400001
  • 10. Yassuda MS, Silva HS, Lima-Silva TB, Cachioni M, Falcão DVS, Lopes A, et al. Normative data for the brief cognitive screening battery stratified by age and education. Dement Neuropsychol. 2017 Jan-Mar;11(1):48-53. https://doi.org/10.1590/1980-57642016dn11-010008
    » https://doi.org/10.1590/1980-57642016dn11-010008
  • 11. Nitrini R, Caramelli P, Porto CS, Charchat-Fichman H, Formigoni AP, Carthery-Goulart MT, et al. Brief cognitive battery in the diagnosis of mild alzheimer's disease in subjects with medium and high levels of education. Dement Neuropsychol. 2007 Jan-Mar;1(1):32-6. https://doi.org/10.1590/S1980-57642008DN10100006
    » https://doi.org/10.1590/S1980-57642008DN10100006
  • 12. Fichman-Charchat H, Miranda CV, Fernandes CS, Mograbi D, Oliveira RM, Novaes R, et al. Brief Cognitive Screening Battery (BCSB) is a very useful tool for diagnosis of probable mild Alzheimer´s disease in a geriatric clinic. Arq Neuropsiquiatr. 2016 Feb;74(2):149-54. https://doi.org/10.1590/0004-282X20150202
    » https://doi.org/10.1590/0004-282X20150202
  • 13. Folstein M, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975 Nov;12(3):189-98. https://doi.org/10.1016/0022-3956(75)90026-6
    » https://doi.org/10.1016/0022-3956(75)90026-6
  • 14. Bertolucci PHF, Brucki SMD, Campacci SR, Juliano Y. The Mini-Mental State Examination in a general population: impact of educational status. Arq Neuropsiquiatr. 1994 Mar;52(1):1-7. https://doi.org/10.1590/S0004-282X1994000100001
    » https://doi.org/10.1590/S0004-282X1994000100001
  • 15. Albert MS, DeKosky ST, Dickson DW, Dubois B, Feldman HH, Fox NC, et al. The diagnosis of mild cognitive impairment due to Alzheimer's disease: recommendations by the National Institute on Aging-Alzheimer's Association working groups on diagnostic guidelines for alzheimer's disease. Alzheimers Dement. 2011 May;7(3):270-9. https://doi.org/10.1016/j.jalz.2011.03.008
    » https://doi.org/10.1016/j.jalz.2011.03.008
  • 16. McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack Jr CR, Kawas CH, et al. The diagnosis of dementia due to alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for alzheimer's disease. Alzheimers Dement. 2011 May;7(3):263-9. https://doi.org/10.1016/j.jalz.2011.03.005
    » https://doi.org/10.1016/j.jalz.2011.03.005
  • 17. Rascovsky K, Hodges JR, Knopman D, Mendez MF, Kramer JH, Neuhaus J, et al. Sensitivity of revised diagnostic criteria for the behavioural variant of frontotemporal dementia. Brain. 2011 Sep;134(9):2456-77. https://doi.org/10.1093/brain/awr179
    » https://doi.org/10.1093/brain/awr179
  • 18. Román GC. Defining dementia: clinical criteria for the diagnosis of vascular dementia. Acta Neurol Scand Suppl. 2002 Dec;106(178):6-9. https://doi.org/10.1034/j.1600-0404.106.s178.2.x
    » https://doi.org/10.1034/j.1600-0404.106.s178.2.x
  • 19. Wetterling T, Kanitz RD, Borgis KJ. Clinical evaluation of the ICD-10 criteria for vascular dementia. Eur Arch Psychiatry Clin Neurosci. 1993 Jul;243(1):33-40. https://doi.org/10.1007/BF02191521
    » https://doi.org/10.1007/BF02191521
  • 20. Gorno-Tempini ML, Hillis AE, Weintraub S, Kertesz A, Mendez M, Cappa SF, et al. Classification of primary progressive aphasia and its variants. Neurology. 2011 Mar 15;76(11):1006-14. https://doi.org/10.1212/WNL.0b013e31821103e6
    » https://doi.org/10.1212/WNL.0b013e31821103e6
  • 21. McKeith IG, Galasko D, Kosaka K, Perry EK, Dickson DW, Hansen LA, et al. Consensus guidelines for the clinical and pathologic diagnosis of Dementia with Lewy Bodies (DLB): report of the consortium on DLB international workshop. Neurology. 1996 Nov 1;47(5):1113-24. https://doi.org/10.1212/WNL.47.5.1113
    » https://doi.org/10.1212/WNL.47.5.1113
  • 22. Geser F, Wenning GK, Poewe W, McKeith I. How to diagnose Dementia with Lewy Bodies: state of the art. Mov Disord. 2005 Aug;20(12 Suppl 12):S11-20. https://doi.org/10.1002/mds.20535
    » https://doi.org/10.1002/mds.20535
  • 23. Amaral-Carvalho V, Caramelli P. Normative data for healthy middle-aged and elderly performance on the Addenbrooke Cognitive Examination-Revised. Cogn Behav Neurol. 2012 Jun;25(2):72-6. https://doi.org/10.1097/WNN.0b013e318259594b
    » https://doi.org/10.1097/WNN.0b013e318259594b
  • 24. Nitrini R, Lefèvre BH, Mathias SC, Caramelli P, Carrilho PE, Sauaia N, et al. Neuropsychological tests of simple application for diagnosing dementia. Arq Neuropsiquiatr. 1994 Dec;52(4):457‐65. https://doi.org/10.1590/S0004-282X1994000400001
    » https://doi.org/10.1590/S0004-282X1994000400001
  • 25. Brucki SM, Malheiros SM, Okamoto IH, Bertolucci PH. Normative data on the verbal fluency test in the animal category in our milieu. Arq Neuropsiquiatr. 1997 Mar;55(1):56-61. https://doi.org/10.1590/S0004-282X1997000100009
    » https://doi.org/10.1590/S0004-282X1997000100009
  • 26. Shulman K, Gold DP, Cohen CA, Zuchero CA. Clock design and dementia in the community: a longitudinal study. Int J Geriatr Psych. 1993 Jun;8(6):487-96. https://doi.org/10.1002/gps.930080606
    » https://doi.org/10.1002/gps.930080606
  • 27. Lehmann S, Schraen S, Quadrio I, Paquet C, Bombois S, Dalaby C, et al. Impact of harmonization of collection tubes on alzheimer's disease diagnosis. Alzheimers Dement. 2014 Oct;10(5 Suppl 5):S390-94.e2. https://doi.org/10.1016/j.jalz.2013.06.008
    » https://doi.org/10.1016/j.jalz.2013.06.008
  • 28. Hampel H, Toschi N, Baldacci F, Zetterberg H, Blennow K, Kilimann I, et al. Alzheimer's disease biomarker-guided diagnostic workflow using the added value of six combined cerebrospinal fluid candidates: Aβ1-42, total-tau, phosphorylated-tau, NFL, neurogranin, and YKL-40. Alzheimers Dement. 2018 Apr;14(4):492-501. https://doi.org/10.1016/j.jalz.2017.11.015
    » https://doi.org/10.1016/j.jalz.2017.11.015
  • 29. Bertoux M, Cassagnaud P, Lebouvier T, Lebert F, Sarazin M, Le Ber I, et al. Does amnesia specifically predict Alzheimer's pathology? A neuropathological study. Neurobiol Aging. 2020 Nov;95:123-30. https://doi.org/10.1016/j.neurobiolaging.2020.07.011
    » https://doi.org/10.1016/j.neurobiolaging.2020.07.011
  • 30. Bertoux M, Cassagnaud P, Lebouvier T, Lebert F, Sarazin M, Le Ber I, et al. Does amnesia specifically predict alzheimer's pathology? A neuropathological study. Neurobiol Aging. 2020 Nov;95:123-30. https://doi.org/10.1016/j.neurobiolaging.2020.07.011
    » https://doi.org/10.1016/j.neurobiolaging.2020.07.011
  • 31. Nitrini R, Caramelli P, Herrera Júnior E, Porto CS, Charchat-Fichman H, Carthery MT, et al. Performance of illiterate and literate nondemented elderly subjects in two tests of long-term memory. J Int Neuropsychol Soc. 2004 Jul 1;10(4):634-8. https://doi.org/10.1017/S1355617704104062
    » https://doi.org/10.1017/S1355617704104062
  • 32. Takada LT, Caramelli P, Fichman HC, Porto CS, Bahia VS, Anghinah R, et al. Comparison between two tests of delayed recall for the diagnosis of dementia. Arq Neuropsiquiatr. 2006 Mar;64(1):35-40. https://doi.org/10.1590/S0004-282X2006000100008
    » https://doi.org/10.1590/S0004-282X2006000100008
  • 33. Morris JC, Heyman A, Mohs RC, Hughes JP, van Belle G, Fillenbaum G, et al. The Consortium to Establish a Registry for Alzheimer's disease (CERAD): Part 1. Clinical and neuropsychological assessment of alzheimer's disease. Neurology. 1989 Sep 1;39(9):1159-65. https://doi.org/10.1590/s0004-282x2006000100008
    » https://doi.org/10.1590/s0004-282x2006000100008
  • 34. Bertolucci PH, Okamoto IH, Brucki SM, Siviero MO, Toniolo Neto J, Ramos LR. Applicability of the CERAD neuropsychological battery to Brazilian elderly. Arq Neuropsiquiatr. 2001 Sep;59(3-A):532-6. https://doi.org/10.1590/S0004-282X2001000400009
    » https://doi.org/10.1590/S0004-282X2001000400009
  • 35. Rolstad S, Berg AI, Bjerke M, Blennow K, Johansson B, Zetterberg H, et al. Amyloid-β₄₂ is associated with cognitive impairment in healthy elderly and subjective cognitive impairment. J Alzheimers Dis. 2011;26(1):135-42. https://doi.org/10.3233/JAD-2011-110038
    » https://doi.org/10.3233/JAD-2011-110038
  • 36. Rolstad S, Berg AI, Bjerke M, Johansson B, Zetterberg H, Wallin A. Cerebrospinal fluid biomarkers mirror rate of cognitive decline. J Alzheimers Dis. 2013;34(4):949-56. https://doi.org/10.3233/JAD-121960
    » https://doi.org/10.3233/JAD-121960
  • 37. Radanovic M, Oshiro CA, Freitas TQ, Talib LL, Forlenza OV. Correlation between biomarkers in the CSF of Alzheimer's disease and global cognition in a cohort of psychogeriatric clinic. Braz J Psychiatry. 2019 Nov-Dec;41(6):479-84. https://doi.org/10.1590/1516-4446-2018-0296
    » https://doi.org/10.1590/1516-4446-2018-0296
  • 38. Mazzeo S, Santangelo R, Bernasconi MP, Cecchetti G, Fiorino A, Pinto P, et al. Combining cerebrospinal fluid biomarkers and neuropsychological assessment: a simple and economical algorithm to predict the progression of cognitive impairment leading to Alzheimer's disease dementia. J Alzheimers Dis. 2016 Oct 18;54(4):1495-508. https://doi.org/10.3233/JAD-160360
    » https://doi.org/10.3233/JAD-160360
  • 39. Ferreira D, Perestelo-Pérez L, Westman E, Wahlund L-O, Sarría A, Serrano-Aguilar P. Meta-review of central CSF biomarkers in Alzheimer's disease: the state of the art after the new diagnostic criteria reviewed. Front Aging Neurosci. 2014 Mar 24;6:47. https://doi.org/10.3389/fnagi.2014.00047
    » https://doi.org/10.3389/fnagi.2014.00047
  • Support:

    This study was partly supported by grants from CNPq and FAPEMIG, Brazil. Larissa Salvador is funded by CNPq, Brazil (bolsa de pós-doutorado). Leonardo Cruz de Souza and Paulo Caramelli are funded by CNPq, Brazil (bolsa de produtividade em pesquisa).

Publication Dates

  • Publication in this collection
    19 Nov 2021
  • Date of issue
    Jan 2022

History

  • Received
    18 Jan 2021
  • Reviewed
    05 Mar 2021
  • Accepted
    18 Mar 2021
Academia Brasileira de Neurologia - ABNEURO R. Vergueiro, 1353 sl.1404 - Ed. Top Towers Offices Torre Norte, 04101-000 São Paulo SP Brazil, Tel.: +55 11 5084-9463 | +55 11 5083-3876 - São Paulo - SP - Brazil
E-mail: revista.arquivos@abneuro.org