Acessibilidade / Reportar erro

Floor and ceiling effects on the Montreal Cognitive Assessment in patients with Parkinson’s disease in Brazil

Efeitos solo e teto na Avaliação Cognitiva de Montreal em pacientes com doença de Parkinson no Brasil

ABSTRACT

Parkinson’s disease (PD) is a common neurodegenerative disease associated with cognitive impairment. The Montreal Cognitive Assessment (MoCA) has been used as a recommended global cognition scale for patients with PD, but there are some concerns about its application, partially due to the floor and ceiling effects.

Objective:

To explore the floor and ceiling effects on the MoCA in patients with PD in Brazil.

Methods:

Cross-sectional study with data from patients with PD from five Brazilian Movement Disorders Clinics, excluding individuals with a possible diagnosis of dementia. We analyzed the total score of the MoCA, as well as its seven cognitive domains. The floor and ceiling effects were evaluated for the total MoCA score and domains. Multivariate analyses were performed to detect factors associated with floor and ceiling effects.

Results:

We evaluated data from 366 patients with PD and approximately 19% of individuals had less than five years of education. For the total MoCA score, there was no floor or ceiling effect. There was a floor effect in the abstraction and delayed memory recall domains in 20% of our sample. The ceiling effect was demonstrated in all domains (80.8% more common in naming and 89% orientation), except delayed recall. Education was the main factor associated with the floor and ceiling effects, independent of region, sex, age at evaluation, and disease duration.

Conclusion:

The floor and ceiling effects are present in specific domains of the MoCA in Brazil, with a strong impact on education. Further adaptations of the MoCA structure for underrepresented populations may reduce these negative effects.

Keywords:
Mental Status and Dementia Tests; Parkinson Disease; Data Accuracy; Brazil

RESUMO

A doença de Parkinson (DP) é uma doença neurodegenerativa comum associada ao declínio cognitivo. A Avaliação Cognitiva de Montreal (Montreal Cognitive Assessment — MoCA) tem sido usada como uma escala de cognição global recomendada para pacientes com DP, mas existem algumas preocupações sobre sua aplicação, em parte pelos efeitos solo e teto.

Objetivo:

Explorar os efeitos solo e teto na MoCA em pacientes com DP no Brasil.

Métodos:

Estudo transversal com dados de pacientes com DP oriundos de cinco Clínicas de Distúrbios de Movimento no Brasil, excluindo-se pessoas com possível diagnóstico de demência. Nós analisamos a pontuação total da MoCA, assim como a de seus sete domínios cognitivos. Os efeitos solo e teto foram avaliados para a pontuação total da MoCA e seus domínios. Foram feitas análises multivariadas para a detecção de fatores associados os efeitos solo e teto.

Resultados:

Nós avaliamos dados de 366 pacientes com DP, e aproximadamente 19% das pessoas tinham menos que cinco anos de escolaridade. Para a pontuação total do MoCA, não houve efeito solo ou teto. Houve efeito solo nos domínios abstração e memória de evocação tardia em 20% de nossa amostra. O efeito teto foi demonstrado em todos os domínios (80,8% mais comum em nomeação e 89% orientação), com exceção de memória de evocação tardia. A educação foi o principal fator associado aos efeitos solo e teto, independentemente de região, sexo, idade na avaliação e duração da doença.

Conclusão:

Os efeitos solo e teto estão presentes em domínios específicos da MoCA no Brasil, com forte impacto da educação. Adaptações adicionais à estrutura da MoCA para populações vulneráveis podem reduzir esses efeitos negativos.

Palavras-chave:
Testes de Estado Mental e Demência; Doença de Parkinson; Confiabilidade dos Dados; Brasil

INTRODUCTION

Parkinson’s disease (PD) is a neurodegenerative disease with rising incidence and prevalence worldwide and is the fastest-growing neurological condition11 Dorsey ER, Sherer T, Okun MS, Bloem BR. The emerging evidence of the Parkinson pandemic. J Parkinsons Dis. 2018;8(s1):S3-S8. https://doi.org/10.3233/jpd-181474
https://doi.org/10.3233/jpd-181474...
. PD is characterized by progressive motor and non-motor symptoms, causing disability, negative impacts on quality of life, and elevated costs for public health systems22 Schiess N, Cataldi R, Okun MS, Fothergill-Misbah N, Ray Dorsey E, Bloem BR, et al. Six action steps to address global disparities in Parkinson disease: a World Health Organization priority. JAMA Neurol. 2022;79(9):929-36. https://doi.org/10.1001/jamaneurol.2022.1783
https://doi.org/10.1001/jamaneurol.2022....
. Cognitive impairment is a common issue in PD, with approximately 23–55% of patients having mild cognitive impairment (MCI)33 Aarsland D, Bronnick K, Williams-Gray C, Weintraub D, Marder K, Kulisevsky J, et al. Mild cognitive impairment in Parkinson disease: a multicenter pooled analysis. Neurology. 2010;75(12):106-9. https://doi.org/10.1212/WNL.0b013e3181f39d0e
https://doi.org/10.1212/WNL.0b013e3181f3...
, which is a risk factor for dementia33 Aarsland D, Bronnick K, Williams-Gray C, Weintraub D, Marder K, Kulisevsky J, et al. Mild cognitive impairment in Parkinson disease: a multicenter pooled analysis. Neurology. 2010;75(12):106-9. https://doi.org/10.1212/WNL.0b013e3181f39d0e
https://doi.org/10.1212/WNL.0b013e3181f3...
.

The Mini-Mental State Examination (MMSE) is the most widely used cognitive screening instrument for elderly people. Unfortunately, MMSE presents some limitations in detecting MCI, probably due to the lack of tasks involving a more complex memory test, executive functions, higher-level language abilities, and visual-spatial processing44 Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695-9. https://doi.org/10.1111/j.1532-5415.2005.53221.x
https://doi.org/10.1111/j.1532-5415.2005...
. The Montreal Cognitive Assessment (MoCA) was developed to increase the sensitivity to detecting MCI, including cognitive domains less tested in the MMSE44 Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695-9. https://doi.org/10.1111/j.1532-5415.2005.53221.x
https://doi.org/10.1111/j.1532-5415.2005...
. Afterward, the MoCA was proposed as a superior tool for detecting cognitive impairment than the MMSE when applied in patients with PD55 Gill DJ, Freshman A, Blender JA, Ravina B. The Montreal Cognitive Assessment as a screening tool for cognitive impairment in Parkinson’s disease. Mov Disord. 2008;23(7):1043-6. https://doi.org/10.1002/mds.22017
https://doi.org/10.1002/mds.22017...
. A memory test with more words and a longer delay to recall and inclusion of executive functions and visual-spatial tasks supposedly converted the MoCA into a cognitive screening better fitted for PD than the MMSE55 Gill DJ, Freshman A, Blender JA, Ravina B. The Montreal Cognitive Assessment as a screening tool for cognitive impairment in Parkinson’s disease. Mov Disord. 2008;23(7):1043-6. https://doi.org/10.1002/mds.22017
https://doi.org/10.1002/mds.22017...
. Currently, the MoCA is a recommended global cognition scale for PD by the International Parkinson and Movement Disorder Society66 Skorvanek M, Goldman JG, Jahanshahi M, Marras C, Rektorova I, Schmand B, et al. Global scales for cognitive screening in Parkinson’s disease: critique and recommendations. Mov Disord. 2018;33(2):208-18. https://doi.org/10.1002/mds.27233
https://doi.org/10.1002/mds.27233...
.

However, studies with low-educated populations showed that the MoCA requires literacy abilities and is strongly influenced by age and education77 Gómez F, Zunzunegui M, Lord C, Alvarado B, García A. Applicability of the MoCA-S test in populations with little education in Colombia. Int J Geriatr Psychiatry. 2013;28(8):813-20. https://doi.org/10.1002/gps.3885
https://doi.org/10.1002/gps.3885...
1010 Cesar KG, Yassuda MS, Porto FHG, Brucki SMD, Nitrini R. MoCA Test: normative and diagnostic accuracy data for seniors with heterogeneous educational levels in Brazil. Arq Neuropsiquiatr. 2019;77(11):775-81. https://doi.org/10.1590/0004-282X20190130
https://doi.org/10.1590/0004-282X2019013...
. The cut-off score for cognitive decline varies across its numerous official language versions1111 Federico A, Tinazzi M, Tamburin S. MoCA for cognitive screening in Parkinson’s disease: beware of floor effect. Mov Disord. 2018;33(3):499. https://doi.org/10.1002/mds.27329
https://doi.org/10.1002/mds.27329...
, and the 1-point addition to the score for individuals with less than 13 years of education may not be sufficient as a correction factor for different cultural and educational settings1212 O’Driscoll C, Shaikh M. Cross-cultural applicability of the Montreal Cognitive Assessment (MoCA): a systematic review. J Alzheimers Dis. 2017;58(3):789-801. https://doi.org/10.3233/JAD-161042
https://doi.org/10.3233/JAD-161042...
.

Floor and ceiling effects are present in a test when a substantial proportion of individuals register the minimum or maximum score, respectively, impairing the test’s property to discriminate between subjects according to their true abilities1313 Liu Q, Wang L. t-Test and ANOVA for data with ceiling and/or floor effects. Behav Res Methods. 2021;53(1):264-77. https://doi.org/10.3758/s13428-020-01407-2
https://doi.org/10.3758/s13428-020-01407...
. Floor and ceiling effects may introduce bias in mean and variance estimates, which cause distortions in analytic methods.

The ceiling effect has been described for the MMSE, which impairs the discrimination of MCI in people with higher education and mild PD55 Gill DJ, Freshman A, Blender JA, Ravina B. The Montreal Cognitive Assessment as a screening tool for cognitive impairment in Parkinson’s disease. Mov Disord. 2008;23(7):1043-6. https://doi.org/10.1002/mds.22017
https://doi.org/10.1002/mds.22017...
. For the MoCA, the ceiling effect was not found in patients with PD55 Gill DJ, Freshman A, Blender JA, Ravina B. The Montreal Cognitive Assessment as a screening tool for cognitive impairment in Parkinson’s disease. Mov Disord. 2008;23(7):1043-6. https://doi.org/10.1002/mds.22017
https://doi.org/10.1002/mds.22017...
, but there is evidence of the floor effect in specific domains in these patients1414 Tumas V, Borges V, Ballalai-Ferraz H, Zabetian CP, Mata IF, Brito MMC, et al. Some aspects of the validity of the Montreal Cognitive Assessment (MoCA) for evaluating cognitive impairment in Brazilian patients with Parkinson’s disease. Dement Neuropsychol. 2016;10(4):333-8. https://doi.org/10.1590/s1980-5764-2016dn1004013
https://doi.org/10.1590/s1980-5764-2016d...
. The present study aimed to explore the floor and ceiling effects on the MoCA in patients with PD in Brazil, a developing country with marked cultural diversity between regions. Furthermore, we evaluated if floor and ceiling effects were influenced by factors like education, regional diversity, sex, age, and disease duration.

METHODS

Study design and ethical approval

We conducted a multicentric, observational, and cross-sectional study with data from Brazilian patients with PD to evaluate the floor and ceiling effects on the MoCA. We included patients followed at four Movement Disorders Clinics in Brazil (Ribeirão Preto, São Paulo, Porto Alegre, and Belém), which are part of the Latin American Research Consortium on the Genetics of Parkinson’s Disease (LARGE-PD). Some patients from Ribeirão Preto were described in a previous study1414 Tumas V, Borges V, Ballalai-Ferraz H, Zabetian CP, Mata IF, Brito MMC, et al. Some aspects of the validity of the Montreal Cognitive Assessment (MoCA) for evaluating cognitive impairment in Brazilian patients with Parkinson’s disease. Dement Neuropsychol. 2016;10(4):333-8. https://doi.org/10.1590/s1980-5764-2016dn1004013
https://doi.org/10.1590/s1980-5764-2016d...
. We also included patients from a fifth Movement Disorders Clinic (Brasília, Federal District). We enrolled patients between May 2007 and July 2022. The study was approved by the Ethics Committee from Hospital das Clínicas de Ribeirão Preto, and all participants provided written informed consent.

Inclusion and exclusion criteria

All patients met the UK Parkinson’s Disease Society Brain Bank clinical diagnostic criteria for PD1515 Gibb WR, Lees AJ. The relevance of the Lewy body to the pathogenesis of idiopathic Parkinson’s disease. J Neurol Neurosurg Psychiatry. 1988;51(6):745-52. https://doi.org/10.1136/jnnp.51.6.745
https://doi.org/10.1136/jnnp.51.6.745...
and were native Brazilian Portuguese speakers. To avoid including patients with a possible diagnosis of dementia, we excluded participants according to the MoCA cutoff scores recommended by the Scientific Department of Cognitive Neurology and Aging of the Brazilian Academy of Neurology, stratified by education level (no formal education: ≤8; 1–4 years: ≤15; 5–8 years: ≤16; 9–11 years: ≤19; ≥12 years: ≤21)1010 Cesar KG, Yassuda MS, Porto FHG, Brucki SMD, Nitrini R. MoCA Test: normative and diagnostic accuracy data for seniors with heterogeneous educational levels in Brazil. Arq Neuropsiquiatr. 2019;77(11):775-81. https://doi.org/10.1590/0004-282X20190130
https://doi.org/10.1590/0004-282X2019013...
,1616 Smid J, Studart-Neto A, César-Freitas KG, Dourado MCN, Kochhann R, Barbosa BJAP, et al. Subjective cognitive decline, mild cognitive impairment, and dementia – syndromic approach: recommendations of the Scientific Department of Cognitive Neurology and Aging of the Brazilian Academy of Neurology. Dement Neuropsychol. 2022;16(3 Suppl 1):1-17. https://doi.org/10.1590/1980-5764-DN-2022-S101EN
https://doi.org/10.1590/1980-5764-DN-202...
.

The Montreal Cognitive Assessment

The MoCA is a brief assessment that measures seven cognitive domains: visual-spatial/executive functions (0–5 points), naming (0–3 points), attention (0–6 points), language (0–3 points), abstraction (0–2 points), delayed memory recall (0–5 points), and orientation (0–6 points)44 Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695-9. https://doi.org/10.1111/j.1532-5415.2005.53221.x
https://doi.org/10.1111/j.1532-5415.2005...
. The total MoCA score ranges from 0 to 30, with lower scores indicating inferior cognitive performance. We added one point to the total score when individuals had less than 13 years of education. There is a validated version of the MoCA for Brazilian Portuguese1717 Memória CM, Yassuda MS, Nakano EY, Forlenza OV. Brief screening for mild cognitive impairment: validation of the Brazilian version of the Montreal Cognitive Assessment. Int J Geriatr Psychiatry. 2013;28(1):34-40. https://doi.org/10.1002/gps.3787
https://doi.org/10.1002/gps.3787...
.

Definitions of floor and ceiling effect

For the present study, we defined the floor effect when 15% or more of individuals from the sample achieved the score’s worst level and the ceiling effect when 15% or more of individuals had the best score1818 McHorney CA, Tarlov AR. Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res. 1995;4(4):293-307. https://doi.org/10.1007/BF01593882
https://doi.org/10.1007/BF01593882...
. The floor and ceiling effects were evaluated for the total MoCA score and their domains.

Statistical analysis

To evaluate potential factors associated with floor and ceiling effects, we performed a multivariate logistic regression model and defined the presence of floor and ceiling as dependent variables. We selected site of origin, sex, age at evaluation, disease duration, and education (in years) as independent clinical variables. We used the Pearson’s chi-square test to compare categorical variables and the Kruskal-Wallis test for continuous variables. All analyses were performed using Statistical Package for Social Sciences (SPSS) for Windows, version 23.0 (SPSS Inc., Chicago, USA), and graphical representations were generated using the R software version 4.0.4 and the R package ggplot2.

RESULTS

Clinical characteristics of the sample

We recruited 573 patients with PD from five Brazilian centers and excluded 127 for possible dementia and 80 due to missing data. A total of 366 patients were eligible for analysis (Table 1). There was a high clinical heterogeneity between participants from each of the five centers according to sex, disease duration, and education level (Table 1). Approximately 80% of them had mild disease (Hoehn & Yahr stages 1 and 2), and less than 7% were in advanced stages (Hoehn & Yahr stages 4 and 5).

Table 1
Sample characterization and distribution of total score of the Montreal Cognitive Assessment of patients with Parkinson’s disease in five Brazilian centers.

Participants had a median of 11 years of education (high school level). The frequency of individuals with less than five years of formal education was 19.7%, with 3% of illiterate individuals (no formal education). In Brasilia, the median number of years of education (16 years) was two times higher than that of the other three centers (8 years; Ribeirão Preto, São Paulo, and Porto Alegre), with only 3.3% of individuals with less than five years of education.

Distribution of the total score and domains of the Montreal Cognitive Assessment between Brazilian centers

The distribution of the total score of the MoCA had a similar pattern in Belém, Ribeirão Preto, São Paulo, and Porto Alegre, with a peak density between 20–25 points (Table 1 and Figure 1). Brasília, the center with the highest frequency of individuals with education over 12 years, had a peak density close to 27 points. Regarding the domains of the MoCA, the scores varied significantly between centers and education levels (Table 2).

Figure 1
Distribution of the total score of the Montreal Cognitive Assessment in five Brazilian centers.
Table 2
Domains scores of the Montreal Cognitive Assessment in patients with Parkinson’s disease from five Brazilian centers, by education level.

Floor and ceiling effect for the total score and domains of the Montreal Cognitive Assessment in patients with Parkinson’s disease in Brazilian centers

For the total MoCA score, there was no ceiling effect (only 21 patients scored 30/30; 3.27%) in our sample, neither was detected floor effect due to the exclusion of patients with possible dementia. According to the domains of the MoCA, there was an overall floor effect in abstraction (20.2%) and delayed memory recall (19.3%) and an overall ceiling effect for all domains except delayed recall (10.3%), which was more common in naming (80.8%) and orientation (89%) (Figure 2).

Figure 2
Proportion of floor and ceiling effects on the Montreal Cognitive Assessment domains in five Brazilian centers.

Among centers, the floor effect in abstraction was detected in three of them (Belém 23.3%; Ribeirão Preto 31%; São Paulo 27%), as well as in delayed recall (Belém 28.8%; São Paulo 24.3%; Porto Alegre 20.4%). Brasilia was the unique center with a ceiling effect in all domains (Figure 2), probably due to the participants’ high level of education.

Factors associated with floor and ceiling effect for domains of the Montreal Cognitive Assessment in patients with Parkinson’s disease

After adjustment for the site of origin, sex, age at evaluation, and disease duration, the multivariate analysis showed that education was inversely associated with the floor effect for visual-spatial/executive functions, language, abstraction, delayed memory recall, and orientation (Table 3). Also, education was directly associated with the ceiling effect for all domains after adjustment, and female sex was associated with the floor effect for abstraction and with the ceiling effect for orientation (Table 3).

Table 3
Associations between clinical variables and presence of floor and ceiling effect on domains of the Montreal Cognitive Assessment in patients with Parkinson’s disease.

DISCUSSION

This multicentric study with patients with PD without dementia in Brazil showed that the floor effect in the MoCA was present in abstraction and delayed memory recall domains in approximately 20% of our sample. The ceiling effect was demonstrated in almost all evaluated domains, with the exception of delayed recall. These effects were not detected in the total score of the MoCA. Education was the main factor associated with the floor and ceiling effect in most domains, independent of region, sex, age at evaluation, and disease duration. Only one-fifth of individuals had less than five years of formal education, including illiteracy.

As described previously, our results showed a higher prevalence of the ceiling than floor effect in specific domains of the MoCA score1818 McHorney CA, Tarlov AR. Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res. 1995;4(4):293-307. https://doi.org/10.1007/BF01593882
https://doi.org/10.1007/BF01593882...
. The floor effect in abstraction and delayed memory recall domains was already described in Southeastern Brazil, but also in the subtopics of attention and language1414 Tumas V, Borges V, Ballalai-Ferraz H, Zabetian CP, Mata IF, Brito MMC, et al. Some aspects of the validity of the Montreal Cognitive Assessment (MoCA) for evaluating cognitive impairment in Brazilian patients with Parkinson’s disease. Dement Neuropsychol. 2016;10(4):333-8. https://doi.org/10.1590/s1980-5764-2016dn1004013
https://doi.org/10.1590/s1980-5764-2016d...
. The authors suggest that emphasizing the instructions for patients and including adaptations for our population could reduce the number of individuals scoring zero. The same pattern was reported for the ceiling effect affecting all domains, except delayed memory.

Floor/ceiling effects on cognitive tests may cause adverse impacts because the measurement of part of the sample’s true cognition (ability) is represented by censored data (observations partially known). Censoring reduces the capacity to highlight differences among lower- and higher-scoring individuals, concealing the proper range and variability of the measured cognitive function. Therefore, the exact levels of cognition are unknown due to these detrimental effects. Furthermore, floor/ceiling effects lead to a non-normal distribution of scores, artificial means and standard deviations, and weaken the reliability and validity of the analysis. Most used statistical tests are not adjusted for the censoring caused by floor/ceiling effects1313 Liu Q, Wang L. t-Test and ANOVA for data with ceiling and/or floor effects. Behav Res Methods. 2021;53(1):264-77. https://doi.org/10.3758/s13428-020-01407-2
https://doi.org/10.3758/s13428-020-01407...
,1919 Uttl B. Measurement of individual differences: lessons from memory assessment in research and clinical practice. Psychol Sci. 2005;16(6):460-7. https://doi.org/10.1111/j.0956-7976.2005.01557.x
https://doi.org/10.1111/j.0956-7976.2005...
.

Classically, floor/ceiling effects are described in total test scores, not in domains/subscales. As a neuropsychological battery, the MoCA may also be interpreted according to its specific domains. Compared to the MMSE, the MoCA was conceived to increase the detection of mild cognitive impairment, mainly based on visual-spatial/executive functions and delayed memory recall. Thus, it is reasonable to explore the presence of floor/ceiling effects in each domain.

Delayed memory recall is a crucial domain for neuropsychological batteries commonly used to diagnose cognitive decline in clinical practice. In the development of the MoCA, the authors proposed a memory test with more words, fewer learning trials, and a longer delay before recall than the MMSE44 Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695-9. https://doi.org/10.1111/j.1532-5415.2005.53221.x
https://doi.org/10.1111/j.1532-5415.2005...
. According to our data, these adaptations may explain the floor effect in this domain.

In a sample of elderly individuals without PD from Tremembé, Brazil, with 68% of individuals having less than five years of education, the mean delayed memory recall subscores were lower than those seen in our results (no education: 0.8; 1–4 years: 0.94; 5–8 years: 1.79; 9–11 years: 1.6; ≥12 years: 2.13)1010 Cesar KG, Yassuda MS, Porto FHG, Brucki SMD, Nitrini R. MoCA Test: normative and diagnostic accuracy data for seniors with heterogeneous educational levels in Brazil. Arq Neuropsiquiatr. 2019;77(11):775-81. https://doi.org/10.1590/0004-282X20190130
https://doi.org/10.1590/0004-282X2019013...
. In the Colombian city of Manizales, the authors also reported low mean delayed memory recall subscores in a sample with 49% of aged individuals without PD with less than five years of education (<5 years of education: 1.2; 5 years: 0.89; >5 years: 1.53)77 Gómez F, Zunzunegui M, Lord C, Alvarado B, García A. Applicability of the MoCA-S test in populations with little education in Colombia. Int J Geriatr Psychiatry. 2013;28(8):813-20. https://doi.org/10.1002/gps.3885
https://doi.org/10.1002/gps.3885...
.

Aiming to enhance frontal lobe-related tasks in the MoCA, the abstraction domain is based on similarity questions. Our low mean abstraction subscores were similar to data from Tremembé, Brazil, and Manizales, Colombia (Brazil — no education: 0.2; 1–4 years: 0.57; 5–8 years: 1.02; 9–11 years: 1.18; ≥12 years: 1.46; Colombia — <5 years of education: 0.57; 5 years: 0.87; >5 years: 1.3)77 Gómez F, Zunzunegui M, Lord C, Alvarado B, García A. Applicability of the MoCA-S test in populations with little education in Colombia. Int J Geriatr Psychiatry. 2013;28(8):813-20. https://doi.org/10.1002/gps.3885
https://doi.org/10.1002/gps.3885...
,1010 Cesar KG, Yassuda MS, Porto FHG, Brucki SMD, Nitrini R. MoCA Test: normative and diagnostic accuracy data for seniors with heterogeneous educational levels in Brazil. Arq Neuropsiquiatr. 2019;77(11):775-81. https://doi.org/10.1590/0004-282X20190130
https://doi.org/10.1590/0004-282X2019013...
.

This is the first study where the MoCA and its domains were evaluated in patients with PD from four Brazilian regions (North, Midwest, Southeast, and South). Brazil’s socioeconomic, cultural, and linguistic diversity is represented in our sample, exploring the impact that cultural background may have on cognitive tests. Except for Brasilia, the regional diversity of included centers had a low impact on the MoCA total score and domains. We consider that the specific pattern of high scores and ceiling effects in all MoCA domains in Brasilia is probably due to the higher education level of its participants. Multivariate analyses showed no association between region heterogeneity and the presence of floor and ceiling effects.

Our sample had a low proportion of participants in the intermediate and advanced stages of disease (Hoehn & Yahr stages 3 to 5; 20.4%). Therefore, the impact of motor impairments on visual-spatial/executive functions domain-associated tasks (such as the trail-making test, copy of the cube, and clock drawing test) was probably limited.

Regarding the impact of education on the MoCA score, a recent study reinforced that high accuracy in discriminating normal individuals from people with dementia depends on the use of specific cutoff values stratified by education level1010 Cesar KG, Yassuda MS, Porto FHG, Brucki SMD, Nitrini R. MoCA Test: normative and diagnostic accuracy data for seniors with heterogeneous educational levels in Brazil. Arq Neuropsiquiatr. 2019;77(11):775-81. https://doi.org/10.1590/0004-282X20190130
https://doi.org/10.1590/0004-282X2019013...
. For domains, our data from multivariate analyses showed a strong association of floor and ceiling effects with years of education, regardless of the socioeconomic and cultural diversity of Brazilian regions. In the MMSE, education is associated with floor/ceiling effects. The floor effect is frequent in people with low education, and the ceiling effect occurs mainly in highly educated individuals2020 Franco-Marina F, García-González JJ, Wagner-Echeagaray F, Gallo J, Ugalde O, Sánchez-García S, et al. The Mini-mental State Examination revisited: ceiling and floor effects after score adjustment for educational level in an aging Mexican population. Int Psychogeriatr. 2010;22(1):72-81. https://doi.org/10.1017/s1041610209990822
https://doi.org/10.1017/s104161020999082...
.

Considering that approximately 16% of the global population may be illiterate and the low levels of education in developing countries, such as Brazil, the MoCA-Basic was designed to be applied to elderly adults in low-education settings, eliminating literacy-dependent tasks and adapting other tasks less dependent on education2121 Julayanont P, Tangwongchai S, Hemrungrojn S, Tunvirachaisakul C, Phanthumchinda K, Hongsawat J, et al. The Montreal Cognitive Assessment-Basic: a screening tool for mild cognitive impairment in illiterate and low-educated elderly adults. J Am Geriatr Soc. 2015;63(12):2550-4. https://doi.org/10.1111/jgs.13820
https://doi.org/10.1111/jgs.13820...
. The MoCA-Basic scores did not differ according to educational level, without association with education or age2121 Julayanont P, Tangwongchai S, Hemrungrojn S, Tunvirachaisakul C, Phanthumchinda K, Hongsawat J, et al. The Montreal Cognitive Assessment-Basic: a screening tool for mild cognitive impairment in illiterate and low-educated elderly adults. J Am Geriatr Soc. 2015;63(12):2550-4. https://doi.org/10.1111/jgs.13820
https://doi.org/10.1111/jgs.13820...
. There is no validation or normative data for the Brazilian Portuguese MoCA-Basic.

As a limitation, the absence of a formal cognitive status for all Brazilian centers did not assure the exclusion of all patients with dementia. Further, including individuals without PD would help understand the role of floor/ceiling effects in people with PD and controls. Also, we had a small sample of people with less than five years of education compared to previous works in underrepresented regions77 Gómez F, Zunzunegui M, Lord C, Alvarado B, García A. Applicability of the MoCA-S test in populations with little education in Colombia. Int J Geriatr Psychiatry. 2013;28(8):813-20. https://doi.org/10.1002/gps.3885
https://doi.org/10.1002/gps.3885...
,1010 Cesar KG, Yassuda MS, Porto FHG, Brucki SMD, Nitrini R. MoCA Test: normative and diagnostic accuracy data for seniors with heterogeneous educational levels in Brazil. Arq Neuropsiquiatr. 2019;77(11):775-81. https://doi.org/10.1590/0004-282X20190130
https://doi.org/10.1590/0004-282X2019013...
, which could have affected our analyses. The low number of participants with less than five years of education was also reported in other studies with MoCA in PD2222 Kim JI, Sunwoo MK, Sohn YH, Lee PH, Hong JY. The MMSE and MoCA for screening cognitive impairment in less educated patients with Parkinson’s disease. J Mov Disord. 2016;9(3):152-9. https://doi.org/10.14802/jmd.16020
https://doi.org/10.14802/jmd.16020...
,2323 Almeida KJ, Carvalho LCLS, Monteiro THOH, Gonçalves PCJ, Campos-Sousa RN. Cut-off points of the Portuguese version of the Montreal Cognitive Assessment for cognitive evaluation in Parkinson’s disease. Dement Neuropsychol. 2019;13(2):210-5. https://doi.org/10.1590/1980-57642018dn13-020010
https://doi.org/10.1590/1980-57642018dn1...
, which may be related to a selection bias favoring high-educated people. The lack of a control group without PD and the low proportion of people with less than five years of education impair the generalizability of our findings on the floor and ceiling effects to a larger population. The strengths of our study were the large sample size and the socioeconomic and cultural diversity of individuals from different Brazilian regions.

In conclusion, the present study showed the presence of floor and ceiling effects in all domains of the MoCA, with a strong impact on education. Further adaptations of the MoCA structure, based on statistical methods such as item response theory, may reduce the floor/ceiling effects.

  • Funding: none.

ACKNOWLEDGEMENTS

We thank all the individuals who participated in the LARGE-PD.

REFERENCES

  • 1
    Dorsey ER, Sherer T, Okun MS, Bloem BR. The emerging evidence of the Parkinson pandemic. J Parkinsons Dis. 2018;8(s1):S3-S8. https://doi.org/10.3233/jpd-181474
    » https://doi.org/10.3233/jpd-181474
  • 2
    Schiess N, Cataldi R, Okun MS, Fothergill-Misbah N, Ray Dorsey E, Bloem BR, et al. Six action steps to address global disparities in Parkinson disease: a World Health Organization priority. JAMA Neurol. 2022;79(9):929-36. https://doi.org/10.1001/jamaneurol.2022.1783
    » https://doi.org/10.1001/jamaneurol.2022.1783
  • 3
    Aarsland D, Bronnick K, Williams-Gray C, Weintraub D, Marder K, Kulisevsky J, et al. Mild cognitive impairment in Parkinson disease: a multicenter pooled analysis. Neurology. 2010;75(12):106-9. https://doi.org/10.1212/WNL.0b013e3181f39d0e
    » https://doi.org/10.1212/WNL.0b013e3181f39d0e
  • 4
    Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695-9. https://doi.org/10.1111/j.1532-5415.2005.53221.x
    » https://doi.org/10.1111/j.1532-5415.2005.53221.x
  • 5
    Gill DJ, Freshman A, Blender JA, Ravina B. The Montreal Cognitive Assessment as a screening tool for cognitive impairment in Parkinson’s disease. Mov Disord. 2008;23(7):1043-6. https://doi.org/10.1002/mds.22017
    » https://doi.org/10.1002/mds.22017
  • 6
    Skorvanek M, Goldman JG, Jahanshahi M, Marras C, Rektorova I, Schmand B, et al. Global scales for cognitive screening in Parkinson’s disease: critique and recommendations. Mov Disord. 2018;33(2):208-18. https://doi.org/10.1002/mds.27233
    » https://doi.org/10.1002/mds.27233
  • 7
    Gómez F, Zunzunegui M, Lord C, Alvarado B, García A. Applicability of the MoCA-S test in populations with little education in Colombia. Int J Geriatr Psychiatry. 2013;28(8):813-20. https://doi.org/10.1002/gps.3885
    » https://doi.org/10.1002/gps.3885
  • 8
    Sobreira E, Pena-Pereira MA, Eckeli AL, Sobreira-Neto MA, Chagas MHN, Foss MP, et al. Screening of cognitive impairment in patients with Parkinson’s disease: diagnostic validity of the Brazilian versions of the Montreal Cognitive Assessment and the Addenbrooke’s Cognitive Examination-Revised. Arq Neuropsiquiatr. 2015;73(11):929-33. https://doi.org/10.1590/0004-282X20150156
    » https://doi.org/10.1590/0004-282X20150156
  • 9
    Apolinario D, Dos Santos MF, Sassaki E, Pegoraro F, Pedrini AVA, Cestari B, et al. Normative data for the Montreal Cognitive Assessment (MoCA) and the Memory Index Score (MoCA-MIS) in Brazil: adjusting the nonlinear effects of education with fractional polynomials. Int J Geriatr Psychiatry. 2018;33(7):893-9. https://doi.org/10.1002/gps.4866
    » https://doi.org/10.1002/gps.4866
  • 10
    Cesar KG, Yassuda MS, Porto FHG, Brucki SMD, Nitrini R. MoCA Test: normative and diagnostic accuracy data for seniors with heterogeneous educational levels in Brazil. Arq Neuropsiquiatr. 2019;77(11):775-81. https://doi.org/10.1590/0004-282X20190130
    » https://doi.org/10.1590/0004-282X20190130
  • 11
    Federico A, Tinazzi M, Tamburin S. MoCA for cognitive screening in Parkinson’s disease: beware of floor effect. Mov Disord. 2018;33(3):499. https://doi.org/10.1002/mds.27329
    » https://doi.org/10.1002/mds.27329
  • 12
    O’Driscoll C, Shaikh M. Cross-cultural applicability of the Montreal Cognitive Assessment (MoCA): a systematic review. J Alzheimers Dis. 2017;58(3):789-801. https://doi.org/10.3233/JAD-161042
    » https://doi.org/10.3233/JAD-161042
  • 13
    Liu Q, Wang L. t-Test and ANOVA for data with ceiling and/or floor effects. Behav Res Methods. 2021;53(1):264-77. https://doi.org/10.3758/s13428-020-01407-2
    » https://doi.org/10.3758/s13428-020-01407-2
  • 14
    Tumas V, Borges V, Ballalai-Ferraz H, Zabetian CP, Mata IF, Brito MMC, et al. Some aspects of the validity of the Montreal Cognitive Assessment (MoCA) for evaluating cognitive impairment in Brazilian patients with Parkinson’s disease. Dement Neuropsychol. 2016;10(4):333-8. https://doi.org/10.1590/s1980-5764-2016dn1004013
    » https://doi.org/10.1590/s1980-5764-2016dn1004013
  • 15
    Gibb WR, Lees AJ. The relevance of the Lewy body to the pathogenesis of idiopathic Parkinson’s disease. J Neurol Neurosurg Psychiatry. 1988;51(6):745-52. https://doi.org/10.1136/jnnp.51.6.745
    » https://doi.org/10.1136/jnnp.51.6.745
  • 16
    Smid J, Studart-Neto A, César-Freitas KG, Dourado MCN, Kochhann R, Barbosa BJAP, et al. Subjective cognitive decline, mild cognitive impairment, and dementia – syndromic approach: recommendations of the Scientific Department of Cognitive Neurology and Aging of the Brazilian Academy of Neurology. Dement Neuropsychol. 2022;16(3 Suppl 1):1-17. https://doi.org/10.1590/1980-5764-DN-2022-S101EN
    » https://doi.org/10.1590/1980-5764-DN-2022-S101EN
  • 17
    Memória CM, Yassuda MS, Nakano EY, Forlenza OV. Brief screening for mild cognitive impairment: validation of the Brazilian version of the Montreal Cognitive Assessment. Int J Geriatr Psychiatry. 2013;28(1):34-40. https://doi.org/10.1002/gps.3787
    » https://doi.org/10.1002/gps.3787
  • 18
    McHorney CA, Tarlov AR. Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res. 1995;4(4):293-307. https://doi.org/10.1007/BF01593882
    » https://doi.org/10.1007/BF01593882
  • 19
    Uttl B. Measurement of individual differences: lessons from memory assessment in research and clinical practice. Psychol Sci. 2005;16(6):460-7. https://doi.org/10.1111/j.0956-7976.2005.01557.x
    » https://doi.org/10.1111/j.0956-7976.2005.01557.x
  • 20
    Franco-Marina F, García-González JJ, Wagner-Echeagaray F, Gallo J, Ugalde O, Sánchez-García S, et al. The Mini-mental State Examination revisited: ceiling and floor effects after score adjustment for educational level in an aging Mexican population. Int Psychogeriatr. 2010;22(1):72-81. https://doi.org/10.1017/s1041610209990822
    » https://doi.org/10.1017/s1041610209990822
  • 21
    Julayanont P, Tangwongchai S, Hemrungrojn S, Tunvirachaisakul C, Phanthumchinda K, Hongsawat J, et al. The Montreal Cognitive Assessment-Basic: a screening tool for mild cognitive impairment in illiterate and low-educated elderly adults. J Am Geriatr Soc. 2015;63(12):2550-4. https://doi.org/10.1111/jgs.13820
    » https://doi.org/10.1111/jgs.13820
  • 22
    Kim JI, Sunwoo MK, Sohn YH, Lee PH, Hong JY. The MMSE and MoCA for screening cognitive impairment in less educated patients with Parkinson’s disease. J Mov Disord. 2016;9(3):152-9. https://doi.org/10.14802/jmd.16020
    » https://doi.org/10.14802/jmd.16020
  • 23
    Almeida KJ, Carvalho LCLS, Monteiro THOH, Gonçalves PCJ, Campos-Sousa RN. Cut-off points of the Portuguese version of the Montreal Cognitive Assessment for cognitive evaluation in Parkinson’s disease. Dement Neuropsychol. 2019;13(2):210-5. https://doi.org/10.1590/1980-57642018dn13-020010
    » https://doi.org/10.1590/1980-57642018dn13-020010

Publication Dates

  • Publication in this collection
    04 Dec 2023
  • Date of issue
    2023

History

  • Received
    14 Mar 2023
  • Reviewed
    10 July 2023
  • Accepted
    30 July 2023
Academia Brasileira de Neurologia, Departamento de Neurologia Cognitiva e Envelhecimento R. Vergueiro, 1353 sl.1404 - Ed. Top Towers Offices, Torre Norte, São Paulo, SP, Brazil, CEP 04101-000, Tel.: +55 11 5084-9463 | +55 11 5083-3876 - São Paulo - SP - Brazil
E-mail: revistadementia@abneuro.org.br | demneuropsy@uol.com.br