Acessibilidade / Reportar erro

Evaluation of sensitivity and specificity of the INECO Frontal Screening and the Frontal Assessment Battery in mild cognitive impairment

AVALIAÇÃO DA SENSIBILIDADE E ESPECIFICIDADE DO TESTE DE RASTREIO FRONTAL DO INECO E DA BATERIA DE AVALIAÇÃO FRONTAL NO COMPROMETIMENTO COGNITIVO LEVE

ABSTRACT.

The Frontal Assessment Battery (FAB) and the INECO Frontal Screening (IFS) are two instruments frequently used to explore cognitive deficits in different diseases. However, studies reporting their use in patients with mild cognitive impairment (MCI) are limited.

Objective:

To compare the sensitivity and specificity of FAB and IFS in mild cognitive impairment (multiple-domain amnestic MCI subtype — md-aMCI).

Methods:

IFS and FAB were administered to 30 md-aMCI patients and 59 healthy participants. Sensitivity and specificity were investigated using the Receiver Operating Characteristic (ROC) analysis.

Results:

The area under the ROC curve (AUC) of IFS for MCI patients was .82 (sensitivity=0.96; specificity=0.76), whereas the AUC of FAB was 0.74 (sensitivity=0.73; specificity=0.70).

Conclusions:

In comparison to FAB, IFS showed higher sensitivity and specificity for the detection of executive dysfunctions in md-aMCI subtype. The use of IFS in everyday clinical practice would allow detecting the frontal dysfunctions in MCI patients with greater precision, enabling the early intervention and impeding the transition to more severe cognitive alterations.

Keywords:
mild cognitive impairment; cognitive assessment screening instrument; sensitivity; specificity

RESUMO.

A Bateria de Avaliação Frontal (FAB) e o teste de rastreio frontal do INECO (IFS) são dois instrumentos frequentemente utilizados para explorar déficits cognitivos em diferentes doenças. No entanto os estudos que relatam seu uso em pacientes com comprometimento cognitivo leve (MCI) são limitados.

Objetivo:

Comparar a sensibilidade e especificidade da FAB e IFS em comprometimento cognitivo leve (subtipo amnéstico de múltiplos domínios [md-aMCI]).

Métodos:

O IFS e FAB foram administrados a 30 pacientes md-aMCI e 59 participantes saudáveis. A sensibilidade e a especificidade foram exploradas usando a análise ROC.

Resultados:

A área sob a curva ROC (AUC) do IFS para pacientes com MCI foi de 0,82 (sensibilidade=0,96; especificidade=0,76), enquanto a AUC de FAB foi de 0,74 (sensibilidade=0,73; especificidade=0,70).

Conclusões:

Em comparação com o FAB, o IFS apresentou maior sensibilidade e especificidade para detecção de disfunções executivas no subtipo md-aMCI. O uso do INECO Frontal Screening (IFS) na prática clínica cotidiana, permitiria detectar com maior precisão as disfunções frontais em pacientes com deficiência cognitiva leve, possibilitando a intervenção precoce, impedindo a transição para alterações cognitivas mais graves.

Palavras-chave:
disfunção cognitiva; testes de estado mental e demência; sensibilidade; especificidade

INTRODUCTION

Mild cognitive impairment (MCI) is considered a transition phase between normal cognition and Alzheimer's disease (AD).11. Hansen A, Caselli RJ, Schlosser-Covell G, Golafshar MA, Dueck AC, Woodruf BK, et al. Neuropsychological comparison of incident MCI and prevalent MCI. Alzheimers Dement (Amst). 2018;10:599-603. https://doi.org/10.1016/j.dadm.2018.08.009
https://doi.org/10.1016/j.dadm.2018.08.0...
The prevalence of MCI in people aged over 65 years ranges from 7 to 47.9%, with a global prevalence of 18.9% per one thousand people.22. Petersen RC, Caracciolo B, Brayne C, Gauthier S, Jelic V, Fratiglioni L. Mild cognitive impairment: a concept in evolution. J Intern Med. 2014;275(3):214-28. https://doi.org/10.1111/joim.12190
https://doi.org/10.1111/joim.12190...
MCI patients can be classified in two main categories: amnestic MCI (aMCI), if patients show a poor performance on the episodic memory test, but functioning in other cognitive domains is preserved; and non-amnestic MCI (naMCI), if patients show a poor performance on cognitive evaluation covering domains other than memory such as language, visuospatial abilities, or executive functions.22. Petersen RC, Caracciolo B, Brayne C, Gauthier S, Jelic V, Fratiglioni L. Mild cognitive impairment: a concept in evolution. J Intern Med. 2014;275(3):214-28. https://doi.org/10.1111/joim.12190
https://doi.org/10.1111/joim.12190...
Additionally, aMCI patients could be classified in one of two possible clinical subtypes: (i) single-domain aMCI (sd-aMCI), when memory is the only impaired domain; and (ii) multiple-domain aMCI (md-aMCI), when besides the memory deficit, at least another cognitive domain is impaired (e.g., executive function, language, or visuospatial abilities).33. Oltra-Cucarella J, Ferrer-Cascales R, Alegret M, Gasparini R, Díaz-Ortiz LM, Ríos R, et al. Risk of progression to Alzheimer's disease for different neuropsychological Mild Cognitive Impairment subtypes: A hierarchical meta-analysis of longitudinal studies. Psychol Aging. 2018;33(7):1007-21. https://doi.org/10.1037/pag0000294
https://doi.org/10.1037/pag0000294...

The annual conversion of MCI to AD is estimated between 10 and 15%.44. Roberts R, Knopman DS. Classification and Epidemiology of MCI. Clin Geriatr Med. 2013;29(4):753-72. https://doi.org/10.1016/j.cger.2013.07.003
https://doi.org/10.1016/j.cger.2013.07.0...
Approximately 50% of people with MCI will be diagnosed with AD in the following 4 years.11. Hansen A, Caselli RJ, Schlosser-Covell G, Golafshar MA, Dueck AC, Woodruf BK, et al. Neuropsychological comparison of incident MCI and prevalent MCI. Alzheimers Dement (Amst). 2018;10:599-603. https://doi.org/10.1016/j.dadm.2018.08.009
https://doi.org/10.1016/j.dadm.2018.08.0...
. However, the specific conversion prognoses for each subtype may differ. In this sense, md-aMCI patients had more severe deficit in working memory and problem solving than sd-aMCI patients, leading to the assumption that this subtype, not pure amnestic MCIs, are at highest risk of dementia.55. Brandt J, Aretouli E, Neijstrom E, Samek J, Manning K, Albert MS, et al. Selectivity of executive function deficits in mild cognitive impairment. Neuropsychology. 2009;23(5):607-18. https://doi.org/10.1037/a0015851
https://doi.org/10.1037/a0015851...
,66. Jung YH, Park S, Jang H, Cho SH, Kim SJ, Kim JP, et al. Frontal-executive dysfunction affects dementia conversion in patients with amnestic mild cognitive impairment. Sci Rep. 2020;10(1):772. https://doi.org/10.1038/s41598-020-57525-6
https://doi.org/10.1038/s41598-020-57525...
Another study sought to more systematically and comprehensively investigate predictors of rate of cognitive decline in a longitudinal sample of individuals with MCI, including age, genetic vulnerability, baseline cognitive performance, and baseline neuropsychiatric severity.77. Cerbone B, Massman PJ, Kulesz PA, Woods SP, York MK. Predictors of rate of cognitive decline in patients with amnestic mild cognitive impairment. Clin Neuropsychol. 2020:1-27. https://doi.org/10.1080/13854046.2020.1773933
https://doi.org/10.1080/13854046.2020.17...
The results showed that participants with composite scores for lower executive functions and greater severity of memory impairment at baseline predicted faster decline on dementia severity measures.

Recently, a meta-analytic study was conducted to explore inhibitory control (IC) in patients with aMCI, using a battery of well-validated inhibition tasks.88. Rabi R, Vasquez BP, Alain C, Hasher L, Belleville S, Anderson ND. Inhibitory Control Deficits in Individuals with Amnestic Mild Cognitive Impairment: a Meta-Analysis. Neuropsychol Rev. 2020;30(1):97-125. https://doi.org/10.1007/s11065-020-09428-6
https://doi.org/10.1007/s11065-020-09428...
According to the findings, patients with aMCI showed a generalized IC deficit, suggesting that inhibition paradigms should be routinely included in neuropsychological evaluations to obtain a more detailed overview of executive functioning in MCI patients.

Hence, early diagnosis of pathological cognitive decline becomes increasingly important in providing patients with the necessary interventions.99. Wang B, Ou Z, Gu X, Wei C, Xu J, Shi J. Validation of the Chinese version of Addenbrooke's Cognitive Examination III for diagnosing dementia. Int J Geriatr Psychiatry. 2017;32(12):e173-9. https://doi.org/10.1002/gps.4680
https://doi.org/10.1002/gps.4680...
Global neuropsychological batteries, such as the Montreal Cognitive Assessment (MoCA), the Mini-Mental State Examination (MMSE), and the Mattis Dementia Rating Scale second edition (DRS-2), are frequently used for neuropsychological evaluation. These screening batteries are helpful for obtaining a global cognitive performance approximation; however, they do not allow researchers to delve into executive functioning.

In this sense, the Frontal Assessment Battery (FAB) and the INECO Frontal Screening (IFS) are two frequently used instruments to explore frontal dysfunctions in different pathologies.1010. Moreira HS, Costa AS, Castro SL, Lima CF, Vicente SG. Assessing Executive Dysfunction in Neurodegenerative Disorders: A Critical Review of Brief Neuropsychological Tools. Front Aging Neurosci. 2017;9:369. https://doi.org/10.3389/fnagi.2017.00369
https://doi.org/10.3389/fnagi.2017.00369...
FAB was designed for brief investigation of executive functioning and consists of six subtests that evaluate mental flexibility, conceptualization, inhibitory control, motor programming, resistance to interference, and environmental autonomy.1111. Dubois B, Slachevsky A, Litvan I, Pillon B. The FAB: A frontal assessment battery at bedside. Neurology. 2000;55(11):1621-6. https://doi.org/10.1212/wnl.55.11.1621
https://doi.org/10.1212/wnl.55.11.1621...
This instrument is fundamentally used for two purposes:1212. Kopp B, Rosser N, Tabeling S, Stürenburg HJ, de Haan B, Karnath HO, Wessel K. Performance on the Frontal Assessment Battery is sensitive to frontal lobe damage in strokepatients. BMC Neurol. 2013;13:179. https://doi.org/10.1186/1471-2377-13-179
https://doi.org/10.1186/1471-2377-13-179...

  1. early identification of neurodegenerative diseases, and

  2. detection of executive dysfunctions in different diseases that affect the frontostriatal brain circuits.

On the other hand, IFS is a brief neuropsychological test designed to explore executive functions across neurodegenerative pathologies such as AD,1313. Moreira HS, Lima CF, Vicente SG. Examining executive dysfunction with the institute of cognitive neurology (INECO) frontal screening (IFS): Normative values from a healthy sample and clinical utility in Alzheimer's disease. J Alzheimers Dis. 2014;42(1):261-73. https://doi.org/10.3233/JAD-132348
https://doi.org/10.3233/JAD-132348...
behavioral variant frontotemporal dementia,1414. Torralva T, Roca M, Gleichgerrcht E, Bekinschtein T, Manes F. A Neuropsychological battery to detect specifc executive and social cognitive impairments in early frontotemporal dementia. Brain. 2009;132(Pt 5):1299-309. https://doi.org/10.1093/brain/awp041
https://doi.org/10.1093/brain/awp041...
Multiple Sclerosis (relapsing-remitting phase),1515. Bruno D, Torralva T, Marenco V, Torres-Ardilla J, Baez S, Gleichgerrcht E, et al. Utility of the INECO frontal screening (IFS) in the detection of executive dysfunction in patients with relapsing-remitting multiple sclerosis (RRMS). Neurol Sci. 2015;36(11):2035-41. https://doi.org/10.1007/s10072-015-2299-6
https://doi.org/10.1007/s10072-015-2299-...
MCI,1616. Moreira HS, Costa AS, Machado A, Castro SL, Lima CF, Vicente SG. Distinguishing mild cognitive impairment from healthy aging and Alzheimer's Disease: the contribution of the INECO Frontal Screening (IFS). PLoS One. 2019;14(9):e0221873. https://doi.org/10.1371/journal.pone.0221873
https://doi.org/10.1371/journal.pone.022...
and MCI in Parkinson's disease.1717. Broche-Pérez Y, Bartuste-Marrero D, Batule-Dominguez M, Toledano-Toledano F. Clinical utility of the INECO Frontal Screening for detecting mild cognitive impairment in Parkinson's disease. Dement Neuropsychol. 2019;13(4):394-402. https://doi.org/10.1590/1980-57642018dn13-040005
https://doi.org/10.1590/1980-57642018dn1...
IFS is composed of eight subtests, organized into three main executive domains:1818. Ihnen J, Antivilo A, Muñoz-Neira C, Slachevsky A. Chilean version of the INECO Frontal Screening (IFS-Ch). Dement Neuropsychol. 2013;7(1):40-7. https://doi.org/10.1590/S1980-57642013DN70100007
https://doi.org/10.1590/S1980-57642013DN...

  1. inhibition and change,

  2. working memory, and

  3. capacity for abstraction.

Some studies have compared the clinical utility of FAB and IFS. For example, Gleichgerrcht et al.1919. Gleichgerrcht E, Roca M, Manes F, Torralva T. Comparing the clinical usefulness of the Institute of Cognitive Neurology (INECO) Frontal Screening (IFS) and the Frontal Assessment Battery (FAB) in frontotemporal dementia. J Clin Exp Neuropsychol. 2011 Nov;33(9):997-1004. https://doi.org/10.1080/13803395.2011.589375.
https://doi.org/10.1080/13803395.2011.58...
evaluated the usefulness of FAB and IFS in a group of 25 patients diagnosed with behavioral variant frontotemporal dementia (bvFTD) and 25 patients with AD. Compared with FAB, IFS showed a better capacity to discriminate between both dementia subtypes, a greater sensitivity and specificity for the detection of executive dysfunctions, and a high correlation with frequently used executive tests such as the Trail Making Test (part B) and the Wisconsin Card Sorting Test.

This result was confirmed by another study carried out on Peruvian patients.2020. Custodio N, Herrera-Pérez E, Lira D, Roca M, Manes F, Báez S, et al. Evaluation of the INECO Frontal Screening and the Frontal Assessment Battery in Peruvian patients with Alzheimer's disease and behavioral variant Frontotemporal dementia. eNeurologicalSci. 2016;5:25-29. https://doi.org/10.1016/j.ensci.2016.11.001.
https://doi.org/10.1016/j.ensci.2016.11....
In this investigation, the diagnostic capacity of FAB and IFS was compared in a sample of 117 participants (35 AD patients, 34 patients with bvFTD, and 48 healthy controls [HC]). IFS showed a greater sensitivity to discriminate between AD and bvFTD, compared with FAB. The objective of the present study is to compare the sensitivity and specificity of FAB and IFS in patients with multiple-domain aMCI subtype (md-aMCI). Considering previous studies that have used both instruments, the authors’ hypothesis is oriented towards a better sensitivity of IFS compared with FAB.

METHODS

Participants

A total of 89 participants were evaluated: 59 cognitively healthy controls and 30 patients with MCI (multiple-domain aMCI subtype). The groups were selected according to the following criteria:

Healthy control group

The following criteria were used to select the control group: scoring more than 85 points on the Addenbrooke's Cognitive Examination Revised (ACE-R),2121. Broche-Pérez Y, López-Pujol HA. Validation of the Cuban Version of Addenbrooke's Cognitive Examination-Revised for Screening Mild Cognitive Impairment. Dement Geriatr Cogn Disord. 2017;44(5-6):320-27. https://doi.org/10.1159/000481345.
https://doi.org/10.1159/000481345...
no subjective complaints of memory, and preserved functioning in the activities of daily living. Psychiatric history was reported by the participants during the initial interview (conducted by an experienced psychiatrist) and an experienced neurologist performed the neurological examination.

Mild cognitive impairment Group (multiple-domain aMCI subtype)

MCI patients were classified using the criteria proposed by Petersen:22. Petersen RC, Caracciolo B, Brayne C, Gauthier S, Jelic V, Fratiglioni L. Mild cognitive impairment: a concept in evolution. J Intern Med. 2014;275(3):214-28. https://doi.org/10.1111/joim.12190
https://doi.org/10.1111/joim.12190...
objective impairment in formal neuropsychological measures (total score in ACE-R of at least 1.5 standard deviation [SD]below the demographically corrected mean)2121. Broche-Pérez Y, López-Pujol HA. Validation of the Cuban Version of Addenbrooke's Cognitive Examination-Revised for Screening Mild Cognitive Impairment. Dement Geriatr Cogn Disord. 2017;44(5-6):320-27. https://doi.org/10.1159/000481345.
https://doi.org/10.1159/000481345...
and preservation of activities of daily living (Barthel index>95).2222. Fernández-Fleites Z, Broche-Pérez Y. Moduladores psicológicos relacionados con el progreso de la capacidad funcional en pacientes afectados por accidente cerebrovascular. Fisioterapia. 2018;40(1):11-8. https://doi.org/10.1016/j.ft.2017.07.002
https://doi.org/10.1016/j.ft.2017.07.002...
Patients with potential causes of cognitive deficits different than neurodegenerative or cerebrovascular disease (e.g., Schizophrenia, alcoholism, epilepsy, depression, head injury) were excluded. According to the standardized neuropsychological assessment, the sample was classified as multiple-domain aMCI subtype.

Patients with MCI who showed clinical signs of depression (Geriatric Depression Scale<5)2323. Yesavage JA. Geriatric Depression Scale. Psychopharmcol Bull. 1988;24(4):709-11. or anxiety (Zung Self-Rating Depression Scale<51) were excluded from the study.2424. Zung WW. A rating instrument for anxiety disorders. Psychosomatics. 1971;12(6):371-9. https://doi.org/10.1016/s0033-3182(71)71479-0
https://doi.org/10.1016/s0033-3182(71)71...
The presence of severe sensory deficits (vision and hearing) was also considered an exclusion criterion.

Instruments

Frontal Assessment Battery

The FAB1111. Dubois B, Slachevsky A, Litvan I, Pillon B. The FAB: A frontal assessment battery at bedside. Neurology. 2000;55(11):1621-6. https://doi.org/10.1212/wnl.55.11.1621
https://doi.org/10.1212/wnl.55.11.1621...
is a test battery easy to administer and sensitive to frontal dysfunction. FAB consists of six subtests evaluating similarities (conceptualization), motor programming, inhibitory control, verbal fluency (mental flexibility), resistance to interference, and environmental autonomy. Each subtest is scored on a maximum of three points, with a total score of 18. High scores indicate preservation of the executive functions.

INECO Frontal Screening

INECO Frontal Screening (IFS)1414. Torralva T, Roca M, Gleichgerrcht E, Bekinschtein T, Manes F. A Neuropsychological battery to detect specifc executive and social cognitive impairments in early frontotemporal dementia. Brain. 2009;132(Pt 5):1299-309. https://doi.org/10.1093/brain/awp041
https://doi.org/10.1093/brain/awp041...
is a brief neuropsychological test battery to explore executive functioning in neurodegenerative diseases. The subtests included in IFS are Luria's Fist-Edge-Palm task (three points), Conflicting instructions (sensitivity to interference) (three points), Inhibitory control (three points), Months backwards (verbal working memory) (two points), Digit Span Task (six points), Corsi Block Tapping Test (four points), Proverb interpretation (abstraction capacity) (three points), and Verbal inhibitory control (modified Hayling Test) (six points). IFS has a maximum possible score of 30 points. High scores indicate preservation of the executive functions.2525. Florentino N, Gleichgerrcht E, Roca M, Cetkovich M, Manes F, Torralva T. The INECO Frontal Screening tool differentiates behavioral variant -frontotemporal dementia (bv-FTD) from major depression. Dement Neuropsychol. 2013;7(1):33-39. https://doi.org/10.1590/S1980-57642013DN70100006
https://doi.org/10.1590/S1980-57642013DN...

Procedure and Analysis of Data

All participants were informed of the objectives of the study and signed the informed consent form. All cognitive evaluations were done blindly (HC vs MCI) and independently by one neuropsychologist who applied the IFS and FAB tests to all the participants. IFS and FAB were applied in different sessions to reduce fatigue and potential learning effects.

Data were obtained following the regulations of the ethics committee of the Department of Psychology of Universidad Central “Marta Abreu” de Las Villas and in accordance with the Declaration of Helsinki. Data were processed using the Statistical Package for the Social Sciences (SPSS) for Windows, version 21. Descriptive statistics were used to explore participants’ characteristics. An independent-sample Student's t-test was conducted to compare the executive functioning between groups. In all analyses, the homogeneity of variances was considered (by using the Levene's test for homogeneity of variances). The Cohen's d effect size was calculated to estimate effect sizes in all comparisons. Values above 0.2, 0.5, and 0.8 were considered as small, medium, and large effect size, respectively.2626. Cohen J. Statistical power analysis for the behavioral Sciences. 2nd ed. New York: Acad Press; 1988. Linear regression was used to evaluate age and education effects over total scores of FAB and IFS. To investigate the sensitivity and specificity of FAB and IFS, the Receiver Operating Characteristic (ROC) curve analysis was performed.

RESULTS

Demographics of mild cognitive impairment patients and Control Group

The present study was conducted with 59 healthy participants and 30 patients with MCI diagnosis (multiple-domain aMCI subtype). The results of the comparison of demographics are summarized in Table 1. There are no significant differences in age, education years, and sex between groups. Significant differences were found between groups regarding the Addenbrooke's Cognitive Examination Revised (ACE-R).

Table 1
Demographic and neuropsychological characteristics of Healthy Controls and Mild Cognitive Impairment patients.

Overall, age had no influence on FAB (r=-0.086, p=0.27) and IFS (r=-0.082, p=0.18), whereas years of education had a positive linear influence on FAB (r=0.32, p<0.001) and IFS (r=0.29, p=0.004).

Subtests shared by both INECO Frontal Screening and Frontal Assessment Battery

FAB and IFS shared three subtests:1919. Gleichgerrcht E, Roca M, Manes F, Torralva T. Comparing the clinical usefulness of the Institute of Cognitive Neurology (INECO) Frontal Screening (IFS) and the Frontal Assessment Battery (FAB) in frontotemporal dementia. J Clin Exp Neuropsychol. 2011 Nov;33(9):997-1004. https://doi.org/10.1080/13803395.2011.589375.
https://doi.org/10.1080/13803395.2011.58...
Luria's Fist-Edge-Palm task, Conflicting instructions, and Inhibitory control (Go/No-go task) (Table 2). Two subtests showed differences between groups. Resistance to interference (Conflicting instructions) showed differences between groups. The MCI group showed lower scores than the HC group. The means of the scores in the Inhibitory control (Go/No-go task) also showed significant differences between groups. Patients with MCI performed worse than healthy controls. No differences between HC group and MCI patients were found in Luria's Fist-Edge-Palm task.

Table 2
Performance of healthy controls and mild cognitive impairment patients in the Frontal Assessment Battery.

Frontal Assessment Battery

The results of HC participants and MCI patients concerning the FAB test is summarized in Table 2. In addition to the test shared by both instruments, the subtests Conceptualization, Mental flexibility, and Total score differed between groups. In all cases, MCI patients showed lower scores than HC participants. In Conceptualization and Mental Flexibility subtests, the effect size of the differences was medium (d>0.5). For Total Score in FAB, differences between means was large (d>0.8). No differences between MCI patients and the HC group were found in the Environmental Autonomy domain.

INECO Frontal Screening

The executive functioning of MCI patients and HC participants according to IFS is summarized in Table 3. In Backward months (Verbal working memory), Corsi Block Tapping Test (Spatial working memory), Modified Hayling Test (Verbal inhibitory control), and IFS total score showed significant differences between groups. In all cases, MCI patients showed poorer performance than HC participants. In verbal and spatial working memory domains, the effect size of the differences in the means was medium (d>0.5). For Verbal inhibitory control (Modified Hayling Test) and IFS total score, differences between means was large (d>0.8). No differences between MCI patients and the HC group group were found in the Working memory (Digit Span Task), and Abstraction capacity (Proverb interpretation) domains.

Table 3
Performance of healthy controls and mild cognitive impairment patients in the INECO Frontal Screening.

Sensitivity and specificity of Frontal Assessment Battery and INECO Frontal Screening

Figure 1 shows ROC curves of IFS (total score) and FAB (total score) for detecting MCI (multiple-domain aMCI subtype). The results showed that the area under the curve (AUC) of IFS for MCI patients was .82 (cutoff=20/21; sensitivity=0.90; specificity=0.76), whereas the AUC for FAB was 0.74 (cutoff=13/14; sensitivity=0.96; specificity=0.70) (Table 4).

Figure 1
Receiver Operating Characteristic curves show INECO Frontal Screening (total score) and Frontal Assessment Battery (total score) for distinguishing between healthy controls and mild cognitive impairment patients.
Table 4
Sensitivity, specificity, area under the curve, and cutoff of Frontal Assessment Battery and INECO Frontal Screening for mild cognitive impairment patients vs. healthy controls.

DISCUSSION

The objective of the present study was to compare the sensitivity and specificity of FAB and IFS in patients with amnestic MCI multiple-domain subtype (md-aMCI). First, it was found that years of education showed a positive effect on FAB and IFS, whereas the age of participants did not show a significant effect.

The absence of the effect of age on the IFS score has been previously reported,1818. Ihnen J, Antivilo A, Muñoz-Neira C, Slachevsky A. Chilean version of the INECO Frontal Screening (IFS-Ch). Dement Neuropsychol. 2013;7(1):40-7. https://doi.org/10.1590/S1980-57642013DN70100007
https://doi.org/10.1590/S1980-57642013DN...
,2727. Sierra-Sanjurjo N, Belén-Saraniti A, Gleichgerrcht E, Roca M, Manes F, Torralva T. The IFS (INECO Frontal Screening) and level of education: Normative data. Appl Neuropsychol Adult. 2019;26(4):331-9. https://doi.org/10.1080/23279095.2018.1427096
https://doi.org/10.1080/23279095.2018.14...
although other authors have found opposite results.1616. Moreira HS, Costa AS, Machado A, Castro SL, Lima CF, Vicente SG. Distinguishing mild cognitive impairment from healthy aging and Alzheimer's Disease: the contribution of the INECO Frontal Screening (IFS). PLoS One. 2019;14(9):e0221873. https://doi.org/10.1371/journal.pone.0221873
https://doi.org/10.1371/journal.pone.022...
Thus, it is worth developing more studies aimed at verifying the effect of age on IFS scores. The present results did not show an effect of age on the total FAB score, which does not correspond to the results reported in other studies that suggest an inverse effect of age on FAB performance.2828. Appollonio I, Leone M, Isella V, Piamarta F, Consoli T, Villa ML, et al. The Frontal Assessment Battery (FAB): Normative values in an Italian population sample. Neurol Sci. 2005;26(2):108-16. https://doi.org/10.1007/s10072-005-0443-4
https://doi.org/10.1007/s10072-005-0443-...
3030. Iavarone A, Ronga B, Pellegrino L, Lore E, Vitaliano S, Galeone F, et al. The Frontal Assessment Battery (FAB): Normative data from an Italian sample and performances of patients with Alzheimer's disease and frontotemporal dementia. Funct Neurol. 2004;19(3):191-6.

On the other hand, a positive effect of years of education on the global and dimensional scores of FAB and IFS was verified. This result is related to some studies reporting that a higher education level has a positive influence on the performance of various tests that evaluate executive functioning.3131. Acevedo A, Loewenstein DA, Agrón J, Duara R. Influence of sociodemographic variables on neuropsychological test performance in Spanish-speaking older adults. J Clin Exp Neuropsychol. 2007;29(5):530-44. https://doi.org/10.1080/13803390600814740
https://doi.org/10.1080/1380339060081474...
3333. Matute E, Leal L, Zarobozo D, Robles A, Cedillo C. Does literacy have an effect on stick constructions tasks? J Int Neuropsychol Soc. 2000;6(6):668-72. https://doi.org/10.1017/s1355617700666043
https://doi.org/10.1017/s135561770066604...
In the particular case of IFS, previous research showed significant effects of education and no significant effects for age on the scores of this instrument.2727. Sierra-Sanjurjo N, Belén-Saraniti A, Gleichgerrcht E, Roca M, Manes F, Torralva T. The IFS (INECO Frontal Screening) and level of education: Normative data. Appl Neuropsychol Adult. 2019;26(4):331-9. https://doi.org/10.1080/23279095.2018.1427096
https://doi.org/10.1080/23279095.2018.14...
In another study carried out with patients with dementia, compared with healthy controls, age did not show associations with IFS scores, but with years of education.1818. Ihnen J, Antivilo A, Muñoz-Neira C, Slachevsky A. Chilean version of the INECO Frontal Screening (IFS-Ch). Dement Neuropsychol. 2013;7(1):40-7. https://doi.org/10.1590/S1980-57642013DN70100007
https://doi.org/10.1590/S1980-57642013DN...

The present findings also illustrate that IFS shows better sensitivity than the FAB for distinguishing between healthy controls and MCI patients. In this study, IFS showed higher precision compared with FAB to discriminate between MCI patients and healthy participants. In a recent study, the usefulness of IFS to discriminate between healthy controls and MCI patients was also verified.1616. Moreira HS, Costa AS, Machado A, Castro SL, Lima CF, Vicente SG. Distinguishing mild cognitive impairment from healthy aging and Alzheimer's Disease: the contribution of the INECO Frontal Screening (IFS). PLoS One. 2019;14(9):e0221873. https://doi.org/10.1371/journal.pone.0221873
https://doi.org/10.1371/journal.pone.022...
The cutoff point reported by the authors is very similar to that found in our study (cutoff =20; sensitivity=0.92; specificity=0.81).

In the specific case of Cuba, we did not find any previous study that explored the clinical utility of FAB; conversely, to date, only one study in the country has investigated the sensitivity and specificity of IFS in detecting cognitive deficits in MCI patients (md-aMCI).1717. Broche-Pérez Y, Bartuste-Marrero D, Batule-Dominguez M, Toledano-Toledano F. Clinical utility of the INECO Frontal Screening for detecting mild cognitive impairment in Parkinson's disease. Dement Neuropsychol. 2019;13(4):394-402. https://doi.org/10.1590/1980-57642018dn13-040005
https://doi.org/10.1590/1980-57642018dn1...
Contrary to results of the present study, the previous study showed that IFS had a low capacity for discriminating between md-aMCI patients and healthy controls. This discrepancy accounts for differences in the cognitive profiles of the MCI patients included in both studies. In the study conducted by Broche-Pérez et al.1717. Broche-Pérez Y, Bartuste-Marrero D, Batule-Dominguez M, Toledano-Toledano F. Clinical utility of the INECO Frontal Screening for detecting mild cognitive impairment in Parkinson's disease. Dement Neuropsychol. 2019;13(4):394-402. https://doi.org/10.1590/1980-57642018dn13-040005
https://doi.org/10.1590/1980-57642018dn1...
the md-aMCI patients did not differ from healthy controls in the following subtests: Conflicting instructions (sensitivity to interference), Months backward, and Digit Span Task (working memory). In this sense, the md-aMCI patients of the present study show a greater executive deficit, which increases the sensitivity of IFS.

It is worth noting that although the existence of executive dysfunctions in MCI patients has been previously published,3434. Huey ED, Manly JJ, Tang M-X, Schupf N, Brickman AM, Manoochehri M. Course and etiology of dysexecutive MCI in a community sample. Alzheimers Dement. 2013;9(6):632-9. https://doi.org/10.1016/j.jalz.2012.10.014
https://doi.org/10.1016/j.jalz.2012.10.0...
the evidence for the utility of brief screening neuropsychological instruments to evaluate them is limited.1616. Moreira HS, Costa AS, Machado A, Castro SL, Lima CF, Vicente SG. Distinguishing mild cognitive impairment from healthy aging and Alzheimer's Disease: the contribution of the INECO Frontal Screening (IFS). PLoS One. 2019;14(9):e0221873. https://doi.org/10.1371/journal.pone.0221873
https://doi.org/10.1371/journal.pone.022...

In spite of this limitation, the results of this study are related to other research carried out on different neurodegenerative diseases, according to which a greater discriminative capacity of IFS is evidenced compared with FAB. For example, when compared with FAB, IFS has shown greater discriminatory capacity in frontotemporal dementia,1919. Gleichgerrcht E, Roca M, Manes F, Torralva T. Comparing the clinical usefulness of the Institute of Cognitive Neurology (INECO) Frontal Screening (IFS) and the Frontal Assessment Battery (FAB) in frontotemporal dementia. J Clin Exp Neuropsychol. 2011 Nov;33(9):997-1004. https://doi.org/10.1080/13803395.2011.589375.
https://doi.org/10.1080/13803395.2011.58...
AD, and behavioral variant frontotemporal dementia.2020. Custodio N, Herrera-Pérez E, Lira D, Roca M, Manes F, Báez S, et al. Evaluation of the INECO Frontal Screening and the Frontal Assessment Battery in Peruvian patients with Alzheimer's disease and behavioral variant Frontotemporal dementia. eNeurologicalSci. 2016;5:25-29. https://doi.org/10.1016/j.ensci.2016.11.001.
https://doi.org/10.1016/j.ensci.2016.11....
Probably, the superior psychometric properties of IFS in comparison with FAB in the evaluation of MCI patients (md-aMCI subtype) results from the addition of subtest that had demonstrated a high sensitivity to detect subtle executive dysfunctions.1919. Gleichgerrcht E, Roca M, Manes F, Torralva T. Comparing the clinical usefulness of the Institute of Cognitive Neurology (INECO) Frontal Screening (IFS) and the Frontal Assessment Battery (FAB) in frontotemporal dementia. J Clin Exp Neuropsychol. 2011 Nov;33(9):997-1004. https://doi.org/10.1080/13803395.2011.589375.
https://doi.org/10.1080/13803395.2011.58...

The study had some limitations. First, the MCI group is rather small. In future studies, large samples are needed to confirm statistically significant differences between diagnostic instruments. Furthermore, future studies must delve into the effect of education on performance in FAB and IFS. It is crucial to obtain normative data on the Cuban population according to different years of education in order to prevent biased interpretations and to avoid false-positive or false-negative cases. Additionally, future research should also explore the relationship between results of cognitive screening tests and the structural and functional aspects of brain activity.

In conclusion, the present findings showed that, in comparison with FAB, the IFS presented higher sensitivity for the detection of MCI patients (md-aMCI subtype) with executive dysfunctions. We recommend the inclusion of such test in screening protocols for dementia for the early detection of executive dysfunctions in MCI patients, in all levels of the Cuban Public Health System. The use of IFS in everyday clinical practice would allow detecting frontal dysfunctions in MCI patients with greater precision, facilitating early intervention and impeding the transition to more severe cognitive dysfunctions.

  • This study was conducted at the Universidad Central “Marta Abreu” de Las Villas, Santa Clara, Cuba
  • Funding: none.

ACKNOWLEDGMENTS

The authors thank Angela María Manso Gramatges for the suggestions and linguistic corrections made to the manuscript.

REFERENCES

  • 1
    Hansen A, Caselli RJ, Schlosser-Covell G, Golafshar MA, Dueck AC, Woodruf BK, et al. Neuropsychological comparison of incident MCI and prevalent MCI. Alzheimers Dement (Amst). 2018;10:599-603. https://doi.org/10.1016/j.dadm.2018.08.009
    » https://doi.org/10.1016/j.dadm.2018.08.009
  • 2
    Petersen RC, Caracciolo B, Brayne C, Gauthier S, Jelic V, Fratiglioni L. Mild cognitive impairment: a concept in evolution. J Intern Med. 2014;275(3):214-28. https://doi.org/10.1111/joim.12190
    » https://doi.org/10.1111/joim.12190
  • 3
    Oltra-Cucarella J, Ferrer-Cascales R, Alegret M, Gasparini R, Díaz-Ortiz LM, Ríos R, et al. Risk of progression to Alzheimer's disease for different neuropsychological Mild Cognitive Impairment subtypes: A hierarchical meta-analysis of longitudinal studies. Psychol Aging. 2018;33(7):1007-21. https://doi.org/10.1037/pag0000294
    » https://doi.org/10.1037/pag0000294
  • 4
    Roberts R, Knopman DS. Classification and Epidemiology of MCI. Clin Geriatr Med. 2013;29(4):753-72. https://doi.org/10.1016/j.cger.2013.07.003
    » https://doi.org/10.1016/j.cger.2013.07.003
  • 5
    Brandt J, Aretouli E, Neijstrom E, Samek J, Manning K, Albert MS, et al. Selectivity of executive function deficits in mild cognitive impairment. Neuropsychology. 2009;23(5):607-18. https://doi.org/10.1037/a0015851
    » https://doi.org/10.1037/a0015851
  • 6
    Jung YH, Park S, Jang H, Cho SH, Kim SJ, Kim JP, et al. Frontal-executive dysfunction affects dementia conversion in patients with amnestic mild cognitive impairment. Sci Rep. 2020;10(1):772. https://doi.org/10.1038/s41598-020-57525-6
    » https://doi.org/10.1038/s41598-020-57525-6
  • 7
    Cerbone B, Massman PJ, Kulesz PA, Woods SP, York MK. Predictors of rate of cognitive decline in patients with amnestic mild cognitive impairment. Clin Neuropsychol. 2020:1-27. https://doi.org/10.1080/13854046.2020.1773933
    » https://doi.org/10.1080/13854046.2020.1773933
  • 8
    Rabi R, Vasquez BP, Alain C, Hasher L, Belleville S, Anderson ND. Inhibitory Control Deficits in Individuals with Amnestic Mild Cognitive Impairment: a Meta-Analysis. Neuropsychol Rev. 2020;30(1):97-125. https://doi.org/10.1007/s11065-020-09428-6
    » https://doi.org/10.1007/s11065-020-09428-6
  • 9
    Wang B, Ou Z, Gu X, Wei C, Xu J, Shi J. Validation of the Chinese version of Addenbrooke's Cognitive Examination III for diagnosing dementia. Int J Geriatr Psychiatry. 2017;32(12):e173-9. https://doi.org/10.1002/gps.4680
    » https://doi.org/10.1002/gps.4680
  • 10
    Moreira HS, Costa AS, Castro SL, Lima CF, Vicente SG. Assessing Executive Dysfunction in Neurodegenerative Disorders: A Critical Review of Brief Neuropsychological Tools. Front Aging Neurosci. 2017;9:369. https://doi.org/10.3389/fnagi.2017.00369
    » https://doi.org/10.3389/fnagi.2017.00369
  • 11
    Dubois B, Slachevsky A, Litvan I, Pillon B. The FAB: A frontal assessment battery at bedside. Neurology. 2000;55(11):1621-6. https://doi.org/10.1212/wnl.55.11.1621
    » https://doi.org/10.1212/wnl.55.11.1621
  • 12
    Kopp B, Rosser N, Tabeling S, Stürenburg HJ, de Haan B, Karnath HO, Wessel K. Performance on the Frontal Assessment Battery is sensitive to frontal lobe damage in strokepatients. BMC Neurol. 2013;13:179. https://doi.org/10.1186/1471-2377-13-179
    » https://doi.org/10.1186/1471-2377-13-179
  • 13
    Moreira HS, Lima CF, Vicente SG. Examining executive dysfunction with the institute of cognitive neurology (INECO) frontal screening (IFS): Normative values from a healthy sample and clinical utility in Alzheimer's disease. J Alzheimers Dis. 2014;42(1):261-73. https://doi.org/10.3233/JAD-132348
    » https://doi.org/10.3233/JAD-132348
  • 14
    Torralva T, Roca M, Gleichgerrcht E, Bekinschtein T, Manes F. A Neuropsychological battery to detect specifc executive and social cognitive impairments in early frontotemporal dementia. Brain. 2009;132(Pt 5):1299-309. https://doi.org/10.1093/brain/awp041
    » https://doi.org/10.1093/brain/awp041
  • 15
    Bruno D, Torralva T, Marenco V, Torres-Ardilla J, Baez S, Gleichgerrcht E, et al. Utility of the INECO frontal screening (IFS) in the detection of executive dysfunction in patients with relapsing-remitting multiple sclerosis (RRMS). Neurol Sci. 2015;36(11):2035-41. https://doi.org/10.1007/s10072-015-2299-6
    » https://doi.org/10.1007/s10072-015-2299-6
  • 16
    Moreira HS, Costa AS, Machado A, Castro SL, Lima CF, Vicente SG. Distinguishing mild cognitive impairment from healthy aging and Alzheimer's Disease: the contribution of the INECO Frontal Screening (IFS). PLoS One. 2019;14(9):e0221873. https://doi.org/10.1371/journal.pone.0221873
    » https://doi.org/10.1371/journal.pone.0221873
  • 17
    Broche-Pérez Y, Bartuste-Marrero D, Batule-Dominguez M, Toledano-Toledano F. Clinical utility of the INECO Frontal Screening for detecting mild cognitive impairment in Parkinson's disease. Dement Neuropsychol. 2019;13(4):394-402. https://doi.org/10.1590/1980-57642018dn13-040005
    » https://doi.org/10.1590/1980-57642018dn13-040005
  • 18
    Ihnen J, Antivilo A, Muñoz-Neira C, Slachevsky A. Chilean version of the INECO Frontal Screening (IFS-Ch). Dement Neuropsychol. 2013;7(1):40-7. https://doi.org/10.1590/S1980-57642013DN70100007
    » https://doi.org/10.1590/S1980-57642013DN70100007
  • 19
    Gleichgerrcht E, Roca M, Manes F, Torralva T. Comparing the clinical usefulness of the Institute of Cognitive Neurology (INECO) Frontal Screening (IFS) and the Frontal Assessment Battery (FAB) in frontotemporal dementia. J Clin Exp Neuropsychol. 2011 Nov;33(9):997-1004. https://doi.org/10.1080/13803395.2011.589375
    » https://doi.org/10.1080/13803395.2011.589375
  • 20
    Custodio N, Herrera-Pérez E, Lira D, Roca M, Manes F, Báez S, et al. Evaluation of the INECO Frontal Screening and the Frontal Assessment Battery in Peruvian patients with Alzheimer's disease and behavioral variant Frontotemporal dementia. eNeurologicalSci. 2016;5:25-29. https://doi.org/10.1016/j.ensci.2016.11.001
    » https://doi.org/10.1016/j.ensci.2016.11.001
  • 21
    Broche-Pérez Y, López-Pujol HA. Validation of the Cuban Version of Addenbrooke's Cognitive Examination-Revised for Screening Mild Cognitive Impairment. Dement Geriatr Cogn Disord. 2017;44(5-6):320-27. https://doi.org/10.1159/000481345
    » https://doi.org/10.1159/000481345
  • 22
    Fernández-Fleites Z, Broche-Pérez Y. Moduladores psicológicos relacionados con el progreso de la capacidad funcional en pacientes afectados por accidente cerebrovascular. Fisioterapia. 2018;40(1):11-8. https://doi.org/10.1016/j.ft.2017.07.002
    » https://doi.org/10.1016/j.ft.2017.07.002
  • 23
    Yesavage JA. Geriatric Depression Scale. Psychopharmcol Bull. 1988;24(4):709-11.
  • 24
    Zung WW. A rating instrument for anxiety disorders. Psychosomatics. 1971;12(6):371-9. https://doi.org/10.1016/s0033-3182(71)71479-0
    » https://doi.org/10.1016/s0033-3182(71)71479-0
  • 25
    Florentino N, Gleichgerrcht E, Roca M, Cetkovich M, Manes F, Torralva T. The INECO Frontal Screening tool differentiates behavioral variant -frontotemporal dementia (bv-FTD) from major depression. Dement Neuropsychol. 2013;7(1):33-39. https://doi.org/10.1590/S1980-57642013DN70100006
    » https://doi.org/10.1590/S1980-57642013DN70100006
  • 26
    Cohen J. Statistical power analysis for the behavioral Sciences. 2nd ed. New York: Acad Press; 1988.
  • 27
    Sierra-Sanjurjo N, Belén-Saraniti A, Gleichgerrcht E, Roca M, Manes F, Torralva T. The IFS (INECO Frontal Screening) and level of education: Normative data. Appl Neuropsychol Adult. 2019;26(4):331-9. https://doi.org/10.1080/23279095.2018.1427096
    » https://doi.org/10.1080/23279095.2018.1427096
  • 28
    Appollonio I, Leone M, Isella V, Piamarta F, Consoli T, Villa ML, et al. The Frontal Assessment Battery (FAB): Normative values in an Italian population sample. Neurol Sci. 2005;26(2):108-16. https://doi.org/10.1007/s10072-005-0443-4
    » https://doi.org/10.1007/s10072-005-0443-4
  • 29
    Lima CF, Meireles LP, Fonseca R, Castro SL, Garrett C. The frontal assessment battery (FAB) in Parkinson's disease and correlations with formal measures of executive functioning. J Neurol. 2008;255(11):1756-61. https://doi.org/10.1007/s00415-008-0024-6
    » https://doi.org/10.1007/s00415-008-0024-6
  • 30
    Iavarone A, Ronga B, Pellegrino L, Lore E, Vitaliano S, Galeone F, et al. The Frontal Assessment Battery (FAB): Normative data from an Italian sample and performances of patients with Alzheimer's disease and frontotemporal dementia. Funct Neurol. 2004;19(3):191-6.
  • 31
    Acevedo A, Loewenstein DA, Agrón J, Duara R. Influence of sociodemographic variables on neuropsychological test performance in Spanish-speaking older adults. J Clin Exp Neuropsychol. 2007;29(5):530-44. https://doi.org/10.1080/13803390600814740
    » https://doi.org/10.1080/13803390600814740
  • 32
    Ganguli M, Snitz BE, Lee CW, Vanderbilt J, Saxton JA, Chang CCH. Age and education effects and norms on a cognitive test battery from a population-based cohort: The Monongahela–Youghiogheny healthy aging team. Aging Ment Health. 2010;14(1):100-7. https://doi.org/10.1080/13607860903071014
    » https://doi.org/10.1080/13607860903071014
  • 33
    Matute E, Leal L, Zarobozo D, Robles A, Cedillo C. Does literacy have an effect on stick constructions tasks? J Int Neuropsychol Soc. 2000;6(6):668-72. https://doi.org/10.1017/s1355617700666043
    » https://doi.org/10.1017/s1355617700666043
  • 34
    Huey ED, Manly JJ, Tang M-X, Schupf N, Brickman AM, Manoochehri M. Course and etiology of dysexecutive MCI in a community sample. Alzheimers Dement. 2013;9(6):632-9. https://doi.org/10.1016/j.jalz.2012.10.014
    » https://doi.org/10.1016/j.jalz.2012.10.014

Publication Dates

  • Publication in this collection
    09 Apr 2021
  • Date of issue
    Jan-Mar 2021

History

  • Received
    27 July 2020
  • Accepted
    26 Oct 2020
Academia Brasileira de Neurologia, Departamento de Neurologia Cognitiva e Envelhecimento R. Vergueiro, 1353 sl.1404 - Ed. Top Towers Offices, Torre Norte, São Paulo, SP, Brazil, CEP 04101-000, Tel.: +55 11 5084-9463 | +55 11 5083-3876 - São Paulo - SP - Brazil
E-mail: revistadementia@abneuro.org.br | demneuropsy@uol.com.br