Brief cognitive tests validated in Peru for detection of cognitive impairment A systematic mapping of the scientific literature

Testes cognitivos breves validados no Peru para detecção de comprometimento cognitivo: um mapeamento sistemático da literatura científica

Abstract.

Brief cognitive tests (BCTs) are necessary for early detection of cognitive impairment, particularly in primary care settings.

Objective:

This report describes a systematic review of BCTs evaluated in Peruvian populations.

Methods:

We used systematic mapping techniques to identify articles on screening tests for cognitive impairment involving Peruvian subjects. We included studies published in English and Spanish up to 2018. We reviewed 6 reference databases within the Virtual Health Library network, as well as the Web of Science, Scopus (MEDLINE), and EMBASE databases.

Results:

Ten out of 447 articles met the inclusion criteria. Studies included both outpatient (9) and community-based (2) samples. Eligibility criteria of the studies were similar. Although different protocols were applied, the diagnostic criteria were standardized. For discrimination between dementia and controls, IFS (AUC: 0.99) and ACE (AUC: 0.95 to 1.00) showed superior performance, as did the M@T (AUC: 1.00) and CDT-Mv (AUC: 0.94 to 1.00) for discriminating between Alzheimer’s disease (AD) and controls.

Conclusion:

The available evidence is limited. However, our analysis of national data suggests that the ACE may be a good choice whenever it can be applied to Peruvian patients. Alternatively, the M@T and IFS can be used for screening patients with suspected AD or FTD, respectively.

Key words:
cognitive impairment; dementia; Alzheimer’s disease; frontotemporal dementia; brief cognitive tests

Resumo.

Testes cognitivos breves (TCBs) são necessários para a detecção precoce do comprometimento cognitivo, particularmente nos serviços de atenção primária.

Objetivo:

Este artigo descreve uma revisão sistemática dos TCBs avaliados em populações peruanas.

Métodos:

Utilizamos técnicas de mapeamento sistemático para identificar artigos sobre testes de triagem para comprometimento cognitivo envolvendo indivíduos peruanos. Incluímos estudos publicados em inglês e espanhol até 2018. Revisamos 6 bancos de dados de referência na rede da Biblioteca Virtual em Saúde e no Web of Science; Scopus (MEDLINE) e banco de dados EMBASE.

Resultados:

Dez dos 447 artigos preencheram os critérios de inclusão. Os estudos incluíram amostras ambulatoriais (9) e comunitárias (2). Os critérios de elegibilidade entre os estudos foram semelhantes. Embora os diferentes protocolos tenham sido aplicados, os critérios diagnósticos foram padronizados. Para a discriminação entre demência e controles, INECO Frontal Screening (IFS) (AUC: 0.99), Addenbrooke’s Cognitive Examination (ACE) (AUC: 0.95 to 1.00) mostraram desempnho superior, assim como o Memory Alteration Test (M@T) (AUC: 1.00) o Desenho do relógio (CDT-Mv) (AUC: 0,94 a 1,00) para discriminação entre a doença de Alzheimer (DA) e os controles.

Conclusão:

As evidências disponíveis são limitadas. No entanto, nossa análise com dados nacionais sugere que o ACE pode ser uma boa opção sempre que possível com pacientes peruanos. Alternativamente, o M @ T e o IFS podem ser usados ​​para rastrear pacientes com suspeita de DA ou DFT, respectivamente.

Palavras-chave:
comprometimento cognitivo; demência; doença de Alzheimer; demência frontotemporal; testes cognitivos breves

Dementia is defined as a marked decline in cognitive function that is severe enough to affect social and occupational functioning.¹ The most common form of dementia is Alzheimer’s disease, although many other conditions can cause dementia, including vascular dementia, Frontotemporal dementia (FTD), dementia with Lewy bodies, Parkinson’s with dementia, and mixed dementia. Other less common disorders can also cause symptoms of dementias.²

At the end of 2010, there were 35.6 million people with dementia globally; 58% of whom were in middle-income countries. Dementia is projected to rapidly increase in the near future, by nearly 63% (relative to 2010 levels; i.e. to 65.7 million cases) in 2030 and by 71% (relative to 2010 levels; i.e. to 115.4 million cases) in 2050.³ Dementia is therefore a growing global health concern, especially in low- and middle-income countries (LMIC) where there are major gaps in the availability of services. In Latin America, population ageing further adds to poor socioeconomic conditions in producing a critical scenario.⁴

Early identification of cognitive impairment can allow for timely intervention, thereby slowing down the progression of the disease. This can be especially beneficial in cases where the treatment does not modify the natural course of the disease.⁵ Thus, the need for further research on early diagnosis of Alzheimer’s disease, as well as on identifying the root cause of neurodegeneration and cognitive impairment, has been stressed in various studies as a means of prevention and control of disease progression globally.^6,7

A study reported that generalists detect <40% of patients with cognitive impairment, with failure rates proving highest in preclinical and prodromal stages than in patients with established dementia (56% versus 19%).⁸ In this context, access to brief cognitive tests (BCTs) is essential to increase detection in outpatient consultations, whether as a screening test or to confirm a diagnosis in persons suspected of having cognitive impairment.^9-11

One of the main drivers behind this study was to inform the medical community of existing validated BCTs for cognitive impairment. Understanding which BCTs have been validated would also help to identify existing research gaps and hence the research needs which might be prioritized in the future.

The study objective was to create a systematic map to identify and describe the properties of BCTs in Peru.

METHODS

Study design

We conducted a systematic mapping review of scientific articles on BCTs published in indexed journals based on a protocol that addressed the overarching objective of the study with the following research questions:

• RQ1. What are the BCTs validated in Peruvian populations according to scientific literature in both English and Spanish from inception to 2018?

• RQ2. What type of research is being conducted on BCTs in relation to screening and diagnosis for cognitive impairment (e.g. methodology, type of disorder, age, sex, education)?

The properties of BCTs are: 1) ease of use, simplicity and short administration time (no more than 5-10 minutes for primary care doctors and specialists, respectively) and training; 2) objective evaluation, unequivocal (free of complex instructions) and straightforward assessment (without the need for additional instruments); 3) user-friendly and ecologically friendly (does not generate rejection in the individual being evaluated; 4) validated within the context in which it will be applied (independent of personal , sociodemographic, ethnic, or cultural characteristics); and 5) flexible to be adapted for use in other contexts.¹²

For the purpose of this study, the following BCTs were considered: 1) Addenbrooke’s Cognitive Examination (ACE);¹³ Eurotest¹⁴ and its South-American versions as the Peruvian monetary test¹⁵ or Chilean monetary test;¹⁶Executive Battery 25 (EB25) and its abbreviated version AEB12;¹⁷Free and Cued Selective Reminding Test (FCSRT);¹⁸Frontal Assessment Battery (FAB);¹⁹INECO Frontal Screening (IFS);²⁰Memory Alteration Test (M@T);²¹Memory Impairment Screen (MIS);²²Memory, Fluency, and Orientation (MEFO);²³Mini-Mental State Examination (MMSE);²⁴Montreal Cognitive Assessment (MoCA);²⁵ Clock Drawing Test (CDT);²⁶ and Test Your Memory (TYM).²⁷

Data collection

The following databases were queried: Web of Science (primarily including MEDLINE and SciELO Citation Index), Scopus, MEDLINE, Excerpta Medica dataBASE (EMBASE), and Virtual Health Library (including LILACS, IBECS, CUMECS, BINACIS, PERNAL and MINSA). We used a broad set of search terms as follows: (root “Peru”) AND (complete and abbreviated search terms of each of the BCTs considered in this study) OR (“cognitive impairment” OR “cognitive decline” OR “dementia”). The latter terms were used in order to avoid excluding studies that evaluated different BCTs to those identified a priori. No temporal limitations were applied.

Search process

The following search string was used on each of the reference databases. A total of 883 articles were obtained. Search results were put into an electronic database and duplicate articles eliminated. The remaining articles were reviewed by two independent researchers - a neurologist specialized in cognitive disorders (NC) and an epidemiologist specialized in systematic reviews (EHP), through the screening of title, abstract, and keywords.

At this point, the same two researchers filtered the 17 references, independently screening them for the full content of each paper. A final set of 15 references were produced and included in the study.

The following data were collected: a) study subjects (population, participant eligibility criteria, sample and comparison group); b) methodology (study design type); c) diagnostic procedures (ruling out other causes of cognitive impairment, tests, procedures and diagnostic criteria utilized; and d) BCT performance according to comparison groups (cut-off points, area under the ROC curve, sensitivity, specificity, % correctly classified, probability coefficient, predictive values, Cronbach’s alpha, and Pearson’s coefficient).

The Pfeffer Functional Activities Questionnaire (PFAQ) was also included for evaluating functioning and for the screening of dementia.^28,29

Statistical analysis

All studies selected and relevant information extracted was put into a database and further analyzed using STATA version 15. With the goal of comparing BCT performance, we utilized the area under the receiving operating characteristic (ROC) curve (AUC).

Ethical aspects

The protocol was approved by the ethics committee of the Instituto de Medicina Tropical “Daniel Alcides Carrión” of the Universidad Nacional Mayor de San Marcos under approval number CIEI-2018-020.

RESULTS

Study selection

The search resulted in the retrieval of 883 articles, of which 436 duplicates were removed. A further 432 were excluded based on screening of the title and abstract. A total of 15 eligible articles were reviewed using the full-text version of the papers. Of these, five were subsequently excluded (two for insufficient information and three that were not focused on evaluating psychometric test performance). A total of 10 studies were thus selected for inclusion in the systematic mapping [Figure 1]. These studies assessed only seven BCTs, namely, the MMSE, ACE, CDT-Mv, FAB, IFS, M@T, and the Peruvian monetary test (PMT).

Figure 1
Flowchart of study selection process

Study sample characteristics

Of the total studies included, two were secondary analyses from databases produced for other studies with different objectives. The studies included involved clinical samples from outpatient settings, where all but two were conducted using community-based residential samples³⁹ or in elderly day care centers, all of which were located in the capital city of Lima. Differential diagnosis included dementia, dementia of the Alzheimer type (DAT), frontotemporal dementia (FTD), Parkinson’s disease dementia (PPD), mild cognitive impairment (MCI), and depression (Table 1).

Table 1
General study characteristics.

Author	Study participants	Study group	Control group	Intergroup homogeneity
Oscanoa T, 200448	Patients	AD (31)	No AD (31)	Yes: Age and education No: Sex**
Custodio N, 201149	Patients	Dementia (103)	Negative controls (107)	Yes: Age and sex No: Education
Custodio N, 201250	Patients Healthy subjects	DAT (40) FTD (18)	Healthy	Yes: Sex and education No: Age
Herrera-Pérez E, 2013†51	Patients Healthy subjects	Dementia (102): DAT (53), FTD (26), and PDD (23)	Healthy (70) Depression (21)	Yes: Sex and education No: Age
Custodio N, 201452	Patients	DAT (90) MCI (45)	Negative controls (180)*	Yes: Sex and education No: Age
Custodio N, 201553	Patients Healthy subjects	bvFTD (28)	Healthy (20)	Yes: Age, sex and education
Oscanoa T, 201615	Sick Patients Healthy subjects	Dementia (42)	Without dementia (42)	Yes: Age, sex and education
Custodio N, 2016 [A]54	Patients Healthy subjects	DAT (35) FTD (34)	Healthy (48)	Yes: Age, sex and education
Custodio N, 2016 [B]†‡55	General population	Dementia (103)	Negative controls (107)	Not evaluated
Custodio N, 2017‡56	General population	early DAT (81) aMCI (45)	Negative controls (121)	Yes: Sex and education No: Age

• ^†
  secondary analysis studies;
• ^‡
  community-based sample;
• ^*
  subjects recruited in non-neurological consultations;
• ^**
  based on calculations made by authors for the purpose of this study; AD: Alzheimer's disease; MCI: mild cognitive impairment; aMCI: amnestic mild cognitive impairment; DAT: dementia of the Alzheimer type; PDD: Parkinson's disease dementia; FTD: frontotemporal dementia; bvFTD: behavioral variant frontotemporal dementia; negative controls: subjects with negative results after applying diagnostic protocol used to identify study subjects.

We characterized studies in terms of the type of controls: 1) healthy participants; 2) participants who did not have the study disease; and 3) participants that had the study disease ruled-out (negative controls). We evaluated whether the comparison groups within each study were “comparable” in relation to basic criteria of sociodemographic variables (“intergroup homogeneity”). Results revealed that some study groups were not “comparable” in terms of age (four studies), sex (one study), and educational level (one study). However, for three studies, the comparison groups were comparable for all of these sociodemographic variables (Table 1).

Eligibility criteria common to the included studies were: age (particularly >60 years of age), years of education received, the absence of disorders that could affect performance in executing the psychometric tests applied in each of the studies, sensory disorders (vision and hearing) or non-sensory disorders (motor or physical). Only one study included as exclusion criteria use of medications that affect cognitive performance (analgesic opioids, decongestants, anti-spasmodics, anticholinergics, antidepressants, antiarrhythmics, antipsychotics, antiemetics, anxiolytics, and valproate) (Table 2).

Table 2
Study eligibility criteria.

		Oscanoa 2004	Custodio 2011	Custodio 2012	Herrera- Pérez 2013	Custodio 2014	Custodio 2015	Oscanoa 2016	Custodio 2016 [A]	Custodio 2016 [B]	Custodio 2017
Age (years)		≥ 60	> 65	> 65	> 55	> 60	≥ 50	≥ 60	> 60	> 60	> 60
Education (years)		≥ 1	≥ 1	≥ 4	≥ 6	≥ 6	≥ 4	NR	≥ 4	≥= 0	≥ 4
Language		NR	Spanish	Spanish	Spanish	Spanish	Spanish	NR	Spanish	Spanish	Spanish
Lack of:	Visual impairment*	✓	✓	✓	✓	✓	✓	✓	✓	✓	✓
	Auditory impairment*	NR	✓	✓	✓	✓	✓	✓	✓	✓	✓
	Motor impairment	hands**	NR	NR	NR	NR	NR	NR	NR	NR	NR
	Physical impairment*	NR	NR	✓	✓	✓	✓	NR	✓	✓	✓

• ^*
  affects ability to conduct the evaluation;
• ^**
  impedes writing or reading tasks;
• ü: reported. NR: not reported; NS: reported, but not specified.

With regard to the diagnostic protocols applied in each of the studies included, the presence of ruling out potential causes for secondary cognitive impairment was reviewed, revealing the Beck’s Depression Inventory as the main tool used to rule out depression. Similarly, study protocols for carrying out laboratory tests, neuroimaging, and specialized evaluations were reviewed. One of the studies failed to report information on these data tests. Serological testing for syphilis and ELISA-HIV was also included. Likewise, a standardized neuropsychological battery included the Rey Auditory Verbal Learning Test, Logical Memory Subtest of the revised Wechsler Memory Scale, Trail Making Test A and B, the Rey-Osterrieth Complex Figure test, the Boston naming test, Wisconsin Card Sorting Test, Letter-Number (subtest of the Wechsler Adult Intelligent Scale III) and Digit Span (Table 3).

Table 3
Diagnostic protocol applied in studies selected.

	Oscanoa 2004	Custodio 2011	Custodio 2012	Herrera-Pérez 2013	Custodio 2014	Custodio 2015	Oscanoa 2016	Custodio 2016 [A]	Custodio 2016 [B]	Custodio 2017
Ruling out causes of secondary cognitive deficits
• Depression	GDS ≤11	NR	BDI ≥13	BDI ≥ 13	NR	BDI ≥13	NR	BDI≥ 13	BDI≥ 13	BDI ≥ 13
• Delirium	✓	NR	NR	NR	NR	NR	NR	NR	NR	NR
• Sensory disorder	✓	NR	NR	NR	NR	NR	NR	NR	NR	NR
• Addiction/substance abuse	NR	NR	✓	✓	✓	✓	NR	✓	✓	NR
• Use of medications that impair cognitive performance	NR	NR	NR	NR	NR	NR	NR	NR	NR	✓
• Cerebrovascular pathology	✓	NR	✓	✓	✓	✓	NR	✓	✓	✓
• Subdural hematoma	NR	NR	✓	✓	✓	✓	NR	✓	✓	✓
• Severe TBI	NR	NR	✓	✓	✓	✓	NR	✓	✓	✓
• Neuroinfections*	NR	✓	✓	✓	✓	✓	NR	✓	✓	✓
• Vitamin B12 deficiency	NR	✓	✓	✓	✓	✓	NR	✓	✓	✓
• Hypothyroidism	NR	✓	✓	✓	✓	✓	NR	✓	✓	✓
• Liver disease	NR	NS	✓	✓	✓	✓	NR	✓	✓	✓
• Chronic kidney disease	NR	✓	✓	✓	✓	✓	NR	✓	✓	✓
• Dementia of vascular origin	NR	NA	HIS > 4	HIS > 4	HIS > 4	HIS > 4	NR	HIS > 4	NR	HIS > 4
• Laboratory tests	NR	✓	✓	NS	NR	✓	NR	✓	NS	✓
• Imaging tests	CAT, all	NCCAT, all	CAT and/or MRI, all	CAT and/or MRI, all	NR	CAT and/or MRI, all	NR	CAT and/or MRI, all	CAT and/or MRI, all	CAT and/or MRI, all
Functional capacity assessments	Katz ADL	PFAQ	PFAQ	PFAQ	PFAQ	PFAQ	NR	PFAQ	PFAQ	PFAQ
Specialized neuropsychological assessment techniques
• Medical	Neurologic	NR	Neurologic	Neurologic	Neurologic	Neurologic	Geriatric	Neurologic	Neurologic	Neurologic
• Neuropsychological	✓	✓	✓	✓	✓	✓	✓	✓	✓	✓
• Neuropsychological test battery	NS	NR	✓	✓	NR	✓	NR	✓	✓	✓
• Executive function battery	NR	NR	NR	NR	NR	✓	NR	NR	NR	NR
• Neuropsychiatric assessment battery	NR	NR	NPI	NPI	NR	NPI	NR	NPI	NR	NR

Regarding the diagnostic criteria applied in each of the studies, the DSM-IV and the National Institute of Neurological and Communicative Disorders and Stroke-Alzheimer's Disease and Related Disorders Association (NINCDS-ADRDA) were the standards for diagnosing dementia and Alzheimer’s disease. Similarly, we report the criteria utilized in a consistent manner for diagnosing other types of dementia. In this respect, the criteria utilized to classify the severity of the patients were the Clinical Dementia Rating (CDR), Alzheimer’s Disease Assessment Scale-cognitive subscale (ADAS-cog), and the Global Deterioration Scale (GDS) (Table 4).

Table 4
Diagnosis and severity criteria applied in studies selected.

	Oscanoa 2004	Custodio 2011	Custodio 2012	Herrera-Pérez 2013	Custodio 2014	Custodio 2015	Oscanoa 2016	Custodio 2016 [A]	Custodio 2016 [B]	Custodio 2017
Diagnostics
• Dementia	DSM-IV	NE	DSM-IV	DSM-IV	NR	DSM-IV	DSM-IV	DSM-IV	DSM-IV	DSM-IV
• Mild cognitive impairment	NA	NA	NA	AAN	Petersen Criteria	NA	NA	NA	NA	Petersen Criteria
• Alzheimer's disease	NINCDS-ADRDA	NINCDS-ADRDA	NINCDS-ADRDA	NINCDS-ADRDA	NINCDS-ADRDA	NA	NA	NINCDS-ADRDA	NINCDS-ADRDA	NINCDS-ADRDA
• Vascular dementia	NA	NINDS-AIREN	NA	NA	NA	NA	NA	NA	NINDS-AIREN	NA
• Frontotemporal dementia	NA	Neary Criteria	Neary Criteria	Neary Criteria	NA	Neary Criteria	NA	Neary Criteria	Neary Criteria	NA
• Lewy body dementia		McKeith Consortium	NA	NA	NA	NA	NA	NA	McKeith Consortium	NA
• Parkinson's disease	NA	NA	NA	UK-PDSBB	NA	NA	NA	NA	NA	NA
Severity
• Criteria	CDR	NR	ADAScog	ADAScog	GDS	CDR	GDS	CDR	CDR	CDR
• Results	CDR 1: 32.3% CDR 2: 38.7% CDR 3: 29.0%	NR	ADAScog mild-moderate	ADAScog mild-moderate	GDS 4-5	CDR 0.5-1	GDS 3-5	NS	CDR 1: 39.8% CDR 2: 34.9% CDR 3: 25.0%	NS

• NR: not reported; NS: reported, but not specified; NA: Not applicable; AAN: American Academy of Neurology for diagnosing mild cognitive impairment; ADAScog: Alzheimer's Disease Assessment Scale-cognitive subscale; CDR: Clinical Dementia Rating; Neary Criteria: Clinical consensus criteria for diagnosing frontotemporal dementia; Petersen Criteria: diagnostic criteria for mild cognitive impairment; DSM-IV: Diagnostic and Mental Statistical Manual of Disorders, 4^th edition; GDS: Global Deterioration Scale; McKeith Consortium: diagnostic criteria for dementia with Lewy bodies; NINCDS-ADRDA: National Institute of Neurological and Communicative Disorders and Stroke-Alzheimer's Disease and Related Disorders Association; NINDS-AIREN: National Institute of Neurological Disorders and Stroke - Association Internationale pour la Recherche et l'Enseignement en Neurosciences for diagnosing vascular dementia; and UK-PDSBB: United Kingdom Parkinson's Disease Society Brain Bank for diagnosing Parkinson's disease.

BCT performance analysis

With regards to the BCTs evaluated, we observed that for discriminating between dementia and controls, the IFS (AUC: 0.99) and ACE (ABC: 0.95 to 1.00) showed superior performance to that observed by the FAB (AUC: 0.95), CDT-Mv (AUC: 0.94), and MMSE (AUC: 0.74 to 0.97). For discrimination between dementia of the Alzheimer type and controls, the M@T (AUC: 1.00) and CDT-Mv (AUC: 0.94 to 1.00) showed superior performance to that observed for the MMSE (AUC: 0.72 to 1.00). For discriminating between FTD and controls, the IFS (AUC: 0.98) showed superior performance to that of the FAB (AUC: 0.73) (Table 5).

Table 5
Psychometric properties of brief cognitive tests evaluated in studies selected.

		Study group	Reference group	Cut-off point	AUC	Sensitivity (%)	Specificity (%)	Correctly classified (%)	LR+	LR-	PPV (%)	NPV (%)	Cronbach's alpha	Pearson's coefficient
ACE †	Custodio, 2012	Dementia (AD+FTD)	Control	86/100	1.000	100	100	NR	NR	NR	NR	NR	0.82	0.85‡
	Herrera-Pérez, 2013	Dementia	Depression	85/100	0.997	90.00	100	98.37	NR	NR	NR	NR	NR	NR
		Dementia	Control	90/100	0.948	97.00	67.00	NR	NR	NR	NR	NR	NR	NR
VLOM/ACE	Custodio, 2012	FTD	AD+Control	2.84	NR	100	100	NR	NR	NR	NR	NR	NR	NR
		FTD+Control	AD	4.92	NR	100	100	NR	NR	NR	NR	NR	NR	NR
MMSE	Custodio, 2011	Dementia	Control	25/30	0.972	100	85.40	92.70	6.87	0.00	NR	NR	NR	NR
	Herrera-Pérez, 2013	Dementia	Depression	27/30	0.887	67	88.00	NR	NR	NR	NR	NR	NR	NR
		Dementia	Control	28/30	0.895	97	67.00	NR	NR	NR	NR	NR	NR	NR
	Custodio, 2014	MCI	Control	28/30	0.8456	83.89	68.89	80.89	NR	NR	NR	NR	NR	NR
		DAT	Control	24/30	1.000	100	96.67	98.89	NR	NR	NR	NR	NR	NR
		DAT	MCI	24/30	1.000	100	96.67	97.78	NR	NR	NR	NR	NR	NR
	Custodio, 2016 [B]	Dementia	Control	≥ 18‡/30	0.74	64.10	84.10	NR	4.00	0.40	24.40	96.70	NR	NR
		AD	Control	≥ 18‡/30	0.72	60.00	84.10	NR	3.80	0.50	23.20	96.30	NR	NR
	Custodio, 2017	MCI	Control	21/30	0.6536	90.91	13.33	69.88	1.05	0.68	NR	NR	NR	NR
		DAT	Control	21/30	0.8820	90.91	75.31	84.65	3.68	0.12	NR	NR	NR	NR
		DAT	MCI	21/30	0.8278	86.67	75.31	79.37	3.51	2.07	NR	NR	NR	NR
CDT-Mv	Oscanoa, 2004	AD	Control	6/10‡	NR	83.90	93.50	NR	NR	NR	92.90	85.30	NR	NR
	Custodio, 2011	Dementia	Control	7/10	0.9437	99.03	83.50	91.30	6.00	0.01	83.00	99.00	0.82	0.85‡
	Custodio, 2016 [B]	Dementia	Control	7/10	0.94	89.30	98.10	NR	47.79	0.11	79.30	99.10	NR	NR
	Custodio, 2016 [B]	AD	Control	7/10	0.94	90.00	98.10	NR	48.20	0.10	79.04	99.20	NR	NR
	Custodio, 2017	MCI	Control	8/10	0.687	95.04	31.11	77.71	1.38	0.16	NR	NR	NR	NR
		DAT	Control	5/10	1.000	100	87.65	95.05	8.10	0.00	NR	NR	NR	NR
		DAT	MCI	5/10	1.000	100	87.65	92.06	8.10	0.00	NR	NR	NR	NR
FAB	Custodio, 2016 [A]	Dementia (AD+bvFTD)	Control	14.5/18	0.95	97.90	81.10	NR	NR	NR	NR	NR	NR	NR
		bvFTD	DAT	13/18	0.73	82.30	48.5	NR	NR	NR	NR	NR	NR	NR
IFS	Custodio, 2015	FTD	NR	NR	NR	NR	NR	NR	NR	NR	NR	NR	NR	NR
	Custodio, 2016 [A]	Dementia (AD+bvFTD)	Control	23.5/30	0.99	97.10	97.90	NR	NR	NR	NR	NR	NR	NR
		bvFTD	DAT	17.5/30	0.98	94.12	94.20	NR	NR	NR	NR	NR	NR	NR
M@T	Custodio, 2014	MCI	Control	37/50	0.999	98.33	97.78	98.22	NR	NR	NR	NR	NR	NR
		DAT	Control	27/50	1.00	100	98.89	99.63	NR	NR	NR	NR	NR	NR
		DAT	MCI	27/50	1.00	100	98.89	99.26	40.50	0.000	NR	NR	NR	NR
	Custodio, 2017	MCI	Control	35/50	0.996	99.17	91.11	96.99	11.16	0.009	NR	NR	NR	NR
		DAT	Control	29/50	1.000	100	98.77	99.50	81.00	0.00	NR	NR	NR	NR
		DAT	MCI	26/50	0.996	100	97.53	98.41	NR	NR	NR	NR	0.79	0.79‡
PMT	Oscanoa, 2016	Dementia	Control	24/31	NR	90.50	83.30	NR	NR	NR	NR	NR	NR	NR

• ACE: Addenbrooke's cognitive examination; AD: Alzheimer's disease; AUC: area under the ROC curve; bvFTD: behavioral variant frontotemporal dementia; CDT-Mv: clock drawing test, Manos version; DAT: dementia of the Alzheimer type; FAB: frontal assessment battery; FTD: frontotemporal dementia; PMT: Peruvian money test; IFS: INECO frontal screening test; LR+: positive likelihood ratio; LR-: negative likelihood ratio; M@T: memory alteration test; MCI: mild cognitive impairment; MMSE: mini-mental state exam; NPV: negative predictive value; NR: not reported; PPV: positive predictive value; VLOM: verbal-language/orientation-memory ratio;
• ^†
  Peruvian version of ACE test, an adaptation of original version developed for Mathuranath and colleagues;
• ^‡
  In relation to MMSE.

Comparing performance in discriminating between MCI and controls, the M@T (AUC: 0.99) proved better than both the CDT-Mv (AUC: 0.69) and MMSE (AUC: 0.65 to 0.85). For discriminating between MCI and dementia of the Alzheimer type (DAT), the CDT-Mv (AUC: 1.00) and M@T (ABC: 1.00) had better performance than the MMSE (AUC: 0.83 to 1.00). Finally, for discriminating between dementia and depression, the ACE (AUC: 1.00) performed better than the MMSE (AUC: 0.89) (Table 5).

DISCUSSION

Implications

This study assessed seven BCTs (the MMSE, ACE, CDT-Mv, FAB, IFS, M@T, and the PMT). According to our results, the IFS, ACE, M@T and CDT-Mv showed acceptable performance levels for the discrimination of various types of cognitive impairment. Likewise, a data comparison reported in a recently published systematic review³⁰ observed that the performance of the ACE in Peruvian samples was similar for the discrimination between DAT and controls (AUC: 0.98).

The majority of the BCTs included evaluate global cognitive efficiency (MMSE, ACE, CDT-Mv and PMT), which have a distinct value in LMICs such as Peru given that the prevalence of cognitive impairment of vascular origin and mixed dementia tends to be greater in these countries.³¹ In turn, the remaining tests focus on evaluating executive functions (FAB and IFS), that better discriminate cases of FTD and vascular dementia or on memory function (M@T) that best discriminate typical cases of DAT.³²

The level of scientific evidence suggests that in Andean countries such as Peru, there is a lack of community-based studies. Of the total number of studies included, only one was conducted in a community setting, including persons with low levels of education. This represents a valuable opportunity to improve future studies in that diagnostic accuracy for BCTs varies in community and clinical settings.³³

We evaluated for homogeneity with regard to key sociodemographic variables. Six out of 10 studies were heterogeneous for one of these variables, primarily age - which is considered a direct reflection of age and dementia prevalence.³⁴ We considered that the heterogeneity observed for other variables does not compromise validity in the studies given that sex is not a determinant of cognitive performance and that education effects can be adjusted for (in the case of CDT-Mv).^35-36

It has been recommended that after a cognitive complaint suggesting the presence of dementia, a generalist should conduct a physical exam, request bloodwork and urine testing to rule out reversible causes for cognitive impairment, all in addition to applying a BCT. In countries like Canada³⁷ and Chile,³⁸ the primary care physician has a major role in diagnosing dementia. In the case of clinical specialists, their initial evaluation includes a neurologic evaluation and applying a BCT.³⁹ In this regard, it is fundamentally important to report the evidence available to help support decision-making in selecting a BCT.

The NICE guide, an international reference, considers a specific BCT set for the initial diagnostic evaluation of a patient suspected of having dementia that includes the 10-point Cognitive Screener (10-CS), 6-item Cognitive Impairment Test (6CIT), 6-item screener, Memory Impairment Screen (MIS), Mini-Cog, and the Test Your Memory (TYM) assessment.³⁹ None of these tests have been evaluated in communities of Andean countries, probably due to the fact that they were not designed to be used in settings with zero to low levels of education in different cultural settings, such as is the case with Peru.

Even though there is limited evidence, data suggests that given the broad spectrum of global cognitive tests and their performance observed, the ACE can be a first line option in screening for cognitive impairment, particularly when the optimal time to administer the test is available (around 20 minutes).^40,41 Moreover, the M@T can be a good option to confirm suspected cases of AD, whereas the IFS is suited for detecting FTD or vascular disease.⁴²

The clinical utility of the BCTs needs to be analyzed in a rigorous manner. It is indeed a valuable tool for opportune identification of cognitive impairment in primary care settings. It is also important to rule out that obtaining normal results after conducting a BCT should not be considered the only input to rule out a diagnosis of dementia.³⁹ This is particularly important in individuals with high levels of education and a good cognitive reserve, or even in cases of recurring depression where a complete neuropsychological evaluation and longitudinal follow-up tend to be clues for establishing a diagnostic.

Limitations

Akin to all systematic investigations, we faced the challenge of a lack of data in the original studies available.³⁰ Consequently, we cannot rely on the validity of the results for rural populations or populations whose native language is not Spanish, since original studies did not include these populations. Additionally, the studies selected did not report data about the reliability (inter-observer and test-retest) and practicality (training demand, administration time, implementation costs) of the tests assessed. Finally, another means of improvement relates to the uniformity of the data reported, since none of the studies covered all the information required for this systematic mapping (see tables).

Strengths

A recently published systematic review addressed the BCT topic for cognitive impairment,^30,33 but does not comprise publications conducted in the Spanish language or indexed in databases such as LILACS. Another distinguishing point in our study is the performance mapping of a BCT set in different subtypes of dementia. Another strength is in reference to the inclusion criteria and detailed evaluation of the rates of diagnostic accuracy, an observation made in other publications.^30,43

Conclusions

Our investigation further supports evidence for the IFS, ACE, M@T and CDT-Mv as viable options for discriminating various types of cognitive decline and identified the ACE as potentially the best alternative screening test evaluating global cognitive impairment. However, more reliable studies are needed that incorporate the diversity of the local setting in Andean countries to provide sound recommendations.

Recommendations

We stress that there is no assessed BCT providing optimal diagnostic performance to discriminate between the different forms of cognitive impairment. Therefore, primary care physicians should focus on the strategies of selection and prioritization of the BCTs based on their clinical suspicions. Considering the available data, in the Peruvian setting we recommend starting with the ACE whenever possible, subsequently opting for the M@T and IFS in cases of suspected AD or FTD, respectively.

This first recommendation is particularly valid for urban contexts in Peru. For environments outside the Peruvian context, its validity depends on the similarity in sociodemographic conditions. Thus, according to previous reports, we anticipate better validity for Andean countries and Mexico.^44,45 Additionally, further investigation on this topic is necessary, particularly for adapting, validating and assessing the several BCTs in each region.⁴⁶

Taking into account the Latin-American context, future investigations should collect data on subjects with different levels of education (including low- educated and illiterate individuals), geographical location (including rural zones),⁴⁷ and mother tongue (including indigenous languages),⁴³ as well as report all data about the psychometric properties of BCTs (performance, reliability and practicality). Our study could be used as the basis for generating a checklist for research protocols.

In settings with limited resources for the administration and scoring of BCTs, it is recommended to have digital assessment tools in place that can be self-administered.⁴³ Unfortunately, none of the studies included had applied BCTs with these characteristics. Given their greater usability potential for population-based screening, it is necessary to evaluate the performance of computerized BCTs, such as the Computer Assessment of Mild Cognitive Impairment or the UCSF Brain Health Assessment, as well as those that are not yet computerized may be administered with the use of information technology such as the IFS, ACE, or the M@T.

• This study was conducted at the Unidad de investigación de deterioro cognitivo y prevención de demencia, Instituto Peruano de Neurociencias. Lima, Perú.

REFERENCES

• ¹
  American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition: DSM-IV-TR®. American Psychiatric Association; 2000. 996 p.
• ²
  Plassman BL, Langa KM, Fisher GG, Heeringa SG, Weir DR, Ofstedal MB, et al. Prevalence of dementia in the United States: the aging, demographics, and memory study. Neuroepidemiology. 2007;29(1-2):125-32.
• ³
  Prince M, Bryce R, Albanese E, Wimo A, Ribeiro W, Ferri CP. The global prevalence of dementia: a systematic review and metaanalysis. Alzheimers Dement. 2013;9(1):63-75.e2.
• ⁴
  Redondo N, Garay S. (Coord.). El envejecimiento en América Latina. Evidencia empírica y cuestiones metodológicas. Asociación Latinoamericana de Población (ALAP). Serie Investig nº 13, 1a. Edición, Río de Janeiro, Brasil; 2012.
• ⁵
  Plassman BL, Williams JW, Burke JR, Holsinger T, Benjamin S. Systematic review: factors associated with risk for and possible prevention of cognitive decline in later life. Ann Intern Med. 2010;153(3):182-93.
• ⁶
  Barnett JH, Hachinski V, Blackwell AD. Cognitive health begins at conception: addressing dementia as a lifelong and preventable condition. BMC Medicine. 2013;11(1):1.
• ⁷
  Richard E, Andrieu S, Solomon A, Mangialasche F, Ahtiluoto S, van Charante EPM, et al. Methodological challenges in designing dementia prevention trials-The European Dementia Prevention Initiative (EDPI). J Neurol Sci. 2012;322(1):64-70.
• ⁸
  Chodosh J, Petitti DB, Elliott M, Hays RD, Crooks VC, Reuben DB, et al. Physician recognition of cognitive impairment: evaluating the need for improvement. J Am Geriatr Soc. 2004;52(7):1051-9.
• ⁹
  Velayudhan L, Ryu S-H, Raczek M, Philpot M, Lindesay J, Critchfield M, et al. Review of brief cognitive tests for patients with suspected dementia. Int Psychogeriatr. 2014;26(8):1247-62.
• ¹⁰
  Brown J. The use and misuse of short cognitive tests in the diagnosis of dementia. J Neurol Neurosurg Psychiatry. 2015;86(6):680-5.
• ¹¹
  Hansen EC, Hughes C, Routley G, Robinson AL. General practitioners' experiences and understandings of diagnosing dementia: Factors impacting on early diagnosis. Soc Sci Med. 2008;67(11):1776-83.
• ¹²
  Carnero-Pardo C. Should the mini-mental state examination be retired? Neurologia (Spain). 2014;29(8):473-81.
• ¹³
  Mathuranath PS, Nestor PJ, Berrios GE, Rakowicz W, Hodges JR. A brief cognitive test battery to differentiate Alzheimer's disease and frontotemporal dementia. Neurology 2000;1613-20.
• ¹⁴
  Carnero-Pardo C, Montoro-Ríos MT. [Preliminary evaluation of a new screening test for dementia (Eurotest)]. Rev Neurol. 2004;38(3):201-9.
• ¹⁵
  Oscanoa TJ, Cieza E, Parodi JF, Paredes N. [Evaluation of peruvian money test in screening of cognitive impairment among older adults]. Rev Peru Med Exp Salud Publica. marzo de 2016;33(1):67-73.
• ¹⁶
  Iturra-mena AM. Adaptation and preliminary validation of a screening test for dementia in Chile: The eurotest. Rev Chil Neuro-Psiquiat. 2007;45(4): 296-304.
• ¹⁷
  Serrani Azcurra DJL. Spanish translation and validation of an Executive Battery 25 (EB25) and its shortened version (ABE12) for executive dysfunction screening in dementia. Neurologia. 2013;28(8):457-476.
• ¹⁸
  Delgado C, Muñoz-Neira C, Soto A, Martínez M, Henríquez F, Flores P, et al. Comparison of the Psychometric Properties of the "word" and "picture" Versions of the Free and Cued Selective Reminding Test in a Spanish-Speaking Cohort of Patients with Mild Alzheimer's Disease and Cognitively Healthy Controls. Arch Clin Neuropsychol. 2015; 31(2):165-75.
• ¹⁹
  Dubois B, Slachevsky A, Litvan I, Pillon B. The FAB: a Frontal Assessment Battery at bedside. Neurology. 2000;55(11):1621-6.
• ²⁰
  Torralva T, Roca M, Gleichgerrcht E, López P, Manes F. INECO Frontal Screening (IFS): a brief, sensitive, and specific tool to assess executive functions in dementia. J Int Neuropsychol Soc JINS. 2009;15(5):777-86.
• ²¹
  Rami L, Molinuevo JL, Sanchez-Valle R, Bosch B, Villar A. Screening for amnestic mild cognitive impairment and early Alzheimer's disease with M@T (Memory Alteration Test) in the primary care population. Int J Geriatr Psychiatry. 2007;22(4):294-304.
• ²²
  Buschke H, Kuslansky G, Katz M, Stewart WF, Sliwinski MJ, Eckholdt HM, et al. Screening for dementia with the memory impairment screen. Neurology. 1999;52(2):231-8.
• ²³
  Delgado Derio C, Guerrero Bonnet S, Troncoso Ponce M, Araneda Yañez A, Slachevsky Chonchol A, Behrens Pellegrino MI. Memory, fluency, and orientation (MEFO): A five-minute screening test for cognitive decline. Neurología. 2013;28(7):400-407.
• ²⁴
  Folstein MF, Folstein SE, McHugh PR. "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189-98.
• ²⁵
  Rossetti HC, Lacritz LH, Cullum CM, Weiner MF. Normative data for the Montreal Cognitive Assessment (MoCA) in a population-based sample. Neurology. 2011;77(13):1272-5.
• ²⁶
  Ferrucci L, Cecchi F, Guralnik JM, Giampaoli S, Noce CL, Salani B, et al. Does the Clock Drawing Test Predict Cognitive Decline in Older Persons Independent of the Mini-Mental State Examination? J Am Geriatr Soc. 1996;44(11):1326-31.
• ²⁷
  Ozer S, Noonan K, Burke M, Young J, Barber S, Forster A, et al. The validity of the Memory Alteration Test and the Test Your Memory test for community-based identification of amnestic mild cognitive impairment. Alzheimers Dement J Alzheimers Assoc. 2016;12(9):987-95.
• ²⁸
  Brown PJ, Devanand DP, Liu X, Caccappolo E. Functional impairment in elderly patients with mild cognitive impairment and mild Alzheimer disease. Arch Gen Psychiatry. 2011;68(6):617-26.
• ²⁹
  Aprahamian I, Martinelli JE, Cecato J, Yassuda MS. Screening for Alzheimer's disease among illiterate elderly: accuracy analysis for multiple instruments. J Alzheimers Dis. 2011;26(2):221-9.
• ³⁰
  De Roeck EE, De Deyn PP, Dierckx E, Engelborghs S. Brief cognitive screening instruments for early detection of Alzheimer's disease: a systematic review. Alzheimers Res Ther. 2019;11(1):21.
• ³¹
  Babulal GM, Quiroz YT, Albensi BC, Arenaza-Urquijo E, Astell AJ, Babiloni C, et al. Perspectives on ethnic and racial disparities in Alzheimer's disease and related dementias: Update and areas of immediate need. Alzheimers Dement. 2019;15(2):292-312.
• ³²
  Ihara M, Okamoto Y, Takahashi R. Suitability of the Montreal cognitive assessment versus the mini-mental state examination in detecting vascular cognitive impairment. J Stroke Cerebrovasc. 2013;22(6):737-41.
• ³³
  Paddick S-M, Gray WK, McGuire J, Richardson J, Dotchin C, Walker RW. Cognitive screening tools for identification of dementia in illiterate and low-educated older adults, a systematic review and meta-analysis. Int Psychogeriatr. 2017;29(6):897-929.
• ³⁴
  Nitrini R, Bottino CMC, Albala C, Custodio Capuñay NS, Ketzoian C, Llibre Rodriguez JJ, et al. Prevalence of dementia in Latin America: a collaborative study of population-based cohorts. Int Psychogeriatr. 2009;21(4):622-30.
• ³⁵
  Custodio N, Wheelock A, Thumala D, Slachevsky A. Dementia in Latin America: Epidemiological Evidence and Implications for Public Policy. Front Aging Neurosci. 2017;9:221.
• ³⁶
  Parra MA, Baez S, Allegri R, Nitrini R, Lopera F, Slachevsky A, et al. Dementia in Latin America. Neurology. 2018;90(5):222-31.
• ³⁷
  Moore A, Frank C, Chambers LW. Role of the family physician in dementia care. Can Fam Physician. 2018;64(10):717-9.
• ³⁸
  Burns A, Robert P. Dementia Care: International Perspectives. Oxford University Press; 2019.
• ³⁹
  Pink J, O'Brien J, Robinson L, Longson D, Guideline Committee. Dementia: assessment, management and support: summary of updated NICE guidance. BMJ. 2018;361:k2438.
• ⁴⁰
  Muñoz-Neira C, Henríquez Ch F, Ihnen J J, Sánchez C M, Flores M P, Slachevsky Ch A. Psychometric properties and diagnostic usefulness of the Addenbrooke's Cognitive Examination-revised in a Chilean elderly sample. Rev Médica Chile. 2012;140(8):1006-13.
• ⁴¹
  Torralva T, Roca M, Gleichgerrcht E, Bonifacio A, Raimondi C, Manes F. Validation of the Spanish Version of the Addenbrooke's Cognitive Examination-Revised (ACE-R). Neurologia (Spain). 2011;26(6):351-6.
• ⁴²
  Custodio N, Montesinos R, Lira D, Herrera-Perez E, Bardales Y, Valeriano-Lorenzo L. Evolution of short cognitive test performance in stroke patients with vascular cognitive impairment and vascular dementia: Baseline evaluation and follow-up. Dement Neuropsychol. 2017;11(4): 381-8.
• ⁴³
  Magklara E, Stephan BCM, Robinson L. Current approaches to dementia screening and case finding in low- and middle-income countries: Research update and recommendations. Int J Geriatr Psychiatry. 2019;34(1):3-7.
• ⁴⁴
  Rojas Aravena F, Guzmán Leójn J, Facultad Latinoamericana de Ciencias Sociales (San José), Agencia Española de Cooperación Internacional para el Desarrollo. La confianza, requisito de la convicencia política. San José: FLACSO; 2013.
• ⁴⁵
  Bebbington A, d'Angelo JE, Soloaga I, Tomaselli A. Trampas territoriales de pobreza, desigualdad y baja movilidad social: los casos de Chile, México y Perú. Centro de Estudios Espinosa Yglesias; 2016.
• ⁴⁶
  Dua T, Barbui C, Clark N, Fleischmann A, Poznyak V, van Ommeren M, et al. Evidence-Based Guidelines for Mental, Neurological, and Substance Use Disorders in Low- and Middle-Income Countries: Summary of WHO Recommendations. PLoS Med. 2011;8(11): e1001122.
• ⁴⁷
  Carnero-Pardo C. Should the Mini-Mental State Examination be retired? Neurologia. 2014;29(8):473-81.
• ⁴⁸
  Oscanoa Espinoza TJ. Evaluación de la prueba del reloj en el tamizaje de enfermedad de Alzheimer. Fac Med Perú. 2004;65(1):42-8.
• ⁴⁹
  Custodio N, García A, Montesinos R, Lira D, Bendezú L. [Validation of the clock drawing test - Manos' version - as a screening test for detection of dementia in older persons of Lima, Peru]. Rev Peru Med Exp Salud Publica. 2011;28(1):29-34.
• ⁵⁰
  Custodio N, Lira D, Montesinos R, Gleichgerrcht E, Manes F. [Usefulness of the Addenbrooke's Cognitive Examination (Spanish version) in Peruvian patients with Alzheimer's disease and Frontotemporal Dementia]. Vertex. 2012;23(103):165-72.
• ⁵¹
  Herrera-Pérez E, Custodio N, Lira D, Montesinos R, Bendezu L. Validity of Addenbrooke's Cognitive Examination to Discriminate between Incipient Dementia and Depression in Elderly Patients of a Private Clinic in Lima, Peru. Dement Geriatr Cogn Disord Extra. 2013;3(1):333-41.
• ⁵²
  Custodio N, Lira D, Herrera-Perez E, Nuñez Del Prado L, Parodi J, Guevara-Silva E, et al. The Memory Alteration Test Discriminates between Cognitively Healthy Status, Mild Cognitive Impairment and Alzheimer's Disease. Dement Geriatr Cogn Disord Extra. 2014;4(2):314-21.
• ⁵³
  Custodio N, Herrera-Pérez E, Lira D, Montesinos R, Alva-Diaz C, Cortijo P, et al. Utilidad de la batería ejecutiva y cognición social de INECO en la evaluación de funciones ejecutivas de una serie de pacientes peruanos con demencia fronto-temporal, variante conductual. Rev Neuropsiquiatr. 2015;78(4):211-20.
• ⁵⁴
  Custodio N, Herrera-Perez E, Lira D, Roca M, Manes F, Báez S, et al. Evaluation of the INECO Frontal Screening and the Frontal Assessment Battery in Peruvian patients with Alzheimer's disease and behavioral variant Frontotemporal dementia. eNeurologicalSci. 2016;5:25-9.
• ⁵⁵
  Custodio N, Alva-Diaz C, Becerra-Becerra Y, Montesinos R, Lira D, Herrera-Pérez E, et al. [Performance of cognitive brief test in elderly patients with dementia in advanced stage living in an urban community of Lima, Peru]. Rev Peru Med Exp Salud Publica. 2016;33(4):662-9.
• ⁵⁶
  Custodio N, Montesinos R, Lira D, Herrera-Perez E, Bardales Y, Valeriano-Lorenzo L. Evolution of short cognitive test performance in stroke patients with vascular cognitive impairment and vascular dementia: Baseline evaluation and follow-up. Dement Neuropsychol. 2017;11(4): 381-8.

Publication Dates

• Publication in this collection
  12 June 2020
• Date of issue
  Apr-Jun 2020

History

• Received
  22 Dec 2019
• Accepted
  31 Mar 2020