Applicability of an immersive virtual reality system for assessing route learning in older adults

APLICABILIDADE DE UM SISTEMA DE REALIDADE VIRTUAL IMERSIVO PARA AVALIAÇÃO DA APRENDIZAGEM DE ROTAS EM IDOSOS

ABSTRACT.

Spatial orientation is defined as the ability to find one’s way around an environment, follow familiar routes, recognize places, and learn new routes. Spatial disorientation is one of the early symptoms of Alzheimer’s disease (AD), and traditional cognitive evaluation lacks ecological validity. Therefore, new assessment methods are needed for the early identification of this cognitive impairment.

Objective:

This study aimed to compare the applicability and stability of an immersive virtual reality (VR) system developed to assess route learning between older adults with and without mild cognitive impairment (MCI).

Methods:

The study sample included 43 older adults: 22 without MCI and 23 with MCI. Applicability was assessed based on the recording of adverse events and the sense of presence reported through questionnaires. The Mann–Whitney U test was applied to compare the applicability of the Spatial Orientation in Immersive Virtual Environment Test (SOIVET)-Route task between older adults with and without MCI. Both short- and long-term stabilities of the task were evaluated using the intraclass correlation coefficient (ICC).

Results:

The mean age of participants was 71.4 years (SD=5.5). A minimum number of adverse events (mean=1.46; SD=2.11) and high levels of presence (mean=138.04; SD=14.80) were reported, and there was no difference between groups with and without MCI. A good to excellent correlation was found for short-term stability (CCI 0.78) and a reasonable correlation was found for long-term stability (CCI 0.58).

Conclusions:

The VR system was applicable for older adults and showed a good to excellent correlation for short-term stability.

Keywords:
Orientation, Spatial; Aged; Virtual Reality; Technology; Validation Study

RESUMO.

Orientação espacial é a capacidade de encontrar um caminho em um ambiente, seguir rotas familiares, reconhecer lugares e aprender novas rotas. A desorientação espacial é um dos primeiros sintomas da doença de Alzheimer, e a avaliação cognitiva tradicional carece de validade ecológica. Diante disso, novos métodos de avaliação são necessários para a identificação precoce desse comprometimento cognitivo.

Objetivo:

Este estudo teve como objetivo comparar a aplicabilidade e a estabilidade de um sistema de realidade virtual imersivo desenvolvido para avaliar a aprendizagem de rotas entre idosos com e sem comprometimento cognitivo leve (CCL).

Métodos:

Participaram do estudo 43 idosos: 22 sem CCL e 23 com CCL. A aplicabilidade foi avaliada por meio do registro de eventos adversos e pela sensação de presença relatados. O teste de Mann-Whitney foi aplicado para comparar a aplicabilidade da tarefa SOIVET-Route entre idosos com e sem CCL. A estabilidade da tarefa em curto e longo prazo foi avaliada pelo coeficiente de correlação intraclasse (ICC).

Resultados:

A idade média dos participantes foi de 71,4 anos (desvio padrão — DP=5,5). Em relação à aplicabilidade, encontramos mínimo relato de sintomas adversos (média=1,46; DP=2,11) e altos níveis de sensação de presença (média 138,04; DP=14,80), e não houve diferença entre os grupos com e sem CCL. Ao analisarmos a estabilidade, encontramos de boa a excelente correlação em curto prazo (CCI=0,78) e uma correlação razoável em longo prazo (CCI=0,58).

Conclusões:

O sistema de realidade virtual foi aplicável em idosos e mostrou boa correlação na estabilidade de curto prazo.

Palavras-chave:
Orientação Espacial; Idoso; Realidade Virtual; Tecnologia; Estudo de Validação

INTRODUCTION

Topographical orientation, or spatial orientation, is the ability to find one’s way around an environment, follow familiar routes, recognize places, and learn new routes, and it is an essential skill for a person’s autonomy¹,². The main spatial orientation strategies are egocentric and allocentric³.

Along with these strategies, the individual needs to remember a series of motion directions at decision points to walk on a path at a greater distance than can be viewed in a single time, in other words, the direction of the destination¹,⁴. A sense of direction leads to learning a new route, where the subject, within the environment itself, incorporates information through repeated visualizations of the environment and continuous changes in the egocentric orientation, being able to, when walking this path again, go from your origin to your destination¹.

Spatial disorientation is a common finding in Alzheimer’s disease (AD), even in its early stages and, since the neurodegenerative process of AD precedes the clinical signs for diagnosis, it is believed that the detection of spatial disorientation in patients with mild cognitive impairment (MCI) is a predictor of higher risk of conversion of these patients⁵. Thus, the assessment of spatial orientation associated with other clinical assessments in patients with MCI can be a cognitive marker of AD⁶,⁷.

There is no consensus on the best way to assess spatial orientation, and the traditionally used pen and paper tests are not sufficiently sensitive and ecological to detect spatial disorientation⁶. An assessment is considered ecological when it investigates the patient’s skills and difficulties as close as possible to their reality, exposing them to their daily life problems⁸. Non-ecological assessments do not adequately evaluate the impairment of spatial orientation experienced by the patient in the real world⁹.

New computerized methods have been developed to assess spatial orientation¹⁰,¹¹. The use of virtual reality (VR) allows the patient to interact in environments like real ones through projection in three-dimensional (3D) scenarios and the use of one’s sensory channels to interact with the visual and auditory stimuli of virtual systems⁶,¹²,¹³. The sense of presence and immersion experienced by the patient in an immersive virtual environment is greater, and the individual can interact with its elements, favoring their behavior as if they were acting in the real world¹⁴,¹⁵. Thus, immersive VR could simulate more realistic environments when compared to paper and pencil assessments and, therefore, more accurately reproduce the difficulties of spatial orientation and identify more subtle deficits¹⁵,¹⁶.

With the lack of a reference standard to assess spatial orientation and the advantages of evaluating this cognitive domain through ecological tasks, our research group developed a system called Spatial Orientation in Immersive Virtual Environment Test (SOIVET)⁷,¹⁷. This system contains a task called Route (SOIVET-Route), which focuses on route learning.

In 2021, Costa et al.¹⁸ analyzed the concurrent validity of the SOIVET-Route, concluding that it is a valid tool for assessing the spatial orientation of older adults, but its applicability and stability have not yet been analyzed. Therefore, this study aimed to compare the applicability of the SOIVET-Route in older adults with and without MCI. Besides, we assessed the short- and long-term stability of its assessments.

METHODS

Study sample

This study was conducted by following the guidelines and regulatory standards for research involving human beings (resolution 466/12 of the National Health Council), consubstantiated opinion no. 2.580.187, with the Certificate of Presentation for Ethical Appreciation (CAAE) no. 84904018.6.0000.0065, approved by the Ethics and Research Committee of the Faculdade de Medicina, Universidade de São Paulo.

Data collection started in February 2019 and ended in March 2020 involving the participation of 45 older adults: 22 were elderly residents in the community without objective evidence of cognitive impairment verified through a screening test – the Addenbrooke’s Cognitive Examination – Revised (ACE-R)¹⁹ and 23 elderly individuals with a diagnosis of MCI referred from the Hospital das Clínicas of the Faculdade de Medicina of the Universidade de São Paulo.

Eligibility criteria included age ≥60 years; absence of a history of vertigo and/or labyrinthopathy; normal or corrected visual and auditory acuity; written informed consent form (ICF) for participation in the study; a score of >82 on the ACE-R for the control group; and a diagnosis of MCI according to Petersen’s criteria²⁰ for the MCI group. Participants with incapacity to understand the instructions and interact with the tasks were excluded. In addition, participants who presented any limiting adverse events during the experience with the immersive system were excluded. Finally, older adults who abandoned the study before completing all its stages were excluded (dropouts).

Data collection

The project was presented to the participants who met the eligibility criteria of the study. After agreeing to participate and signing the ICF, the participants were assessed in two different moments with an interval of 7–14 days between the sessions.

In the first moment, data collection started with the application of the ACE-R. Later, the sociodemographic characterization, motion sickness screening, and technology use profile questionnaires were applied.

After completing the questionnaires, the participants were guided to perform the tasks. Finally, immediately after completing the VR task, the Witmer and Singer Presence Questionnaire²¹ and the questionnaire to identify adverse symptoms were applied.

In the second moment, only the task in a virtual environment was reapplied.

Research procedures

Sample characterization, cognitive screening, and motion sickness screening

A sociodemographic questionnaire and a questionnaire describing familiarization with the use of technology, both developed by the study authors, were applied to characterize the sample⁷. Scoring on the technology use profile questionnaire varies from 0 to 40 points; with the higher the score, the greater the familiarity of participants with technology.

The ACE-R was applied for cognitive screening. Individuals with ACE-R score of >82 were included in the group of older adults without cognitive impairment. This score is considered a cutoff value for older adults with cognitive impairment without dementia²².

The absence of a history of vertigo and labyrinthopathy was assessed through self-report. Participants were also assessed using a motion sickness screening questionnaire, prepared by the study authors, with scores ranging from 0 to 6 points, with the higher the score, the greater the discomfort prior to task performance.

SOIVET-Route task

The task performed is an adaptation of the Route subitem of the Rivermead Behavioral Memory Test (RBMT)²³. The test can be conducted in a wide variety of locations and does not establish a minimum or maximum distance between them.

In this study, we used the main entrance of the Hospital das Clínicas of the Faculdade de Medicina of the Universidade de São Paulo (ICHC-FMUSP) as a reference for the development of the task in a virtual environment, using similar dimensions to simulate the virtual environment task as realistically as possible, and it occurred in the following four stages:

• The avatar took the route together with the participant stopping at five different places with time to observe the surroundings. The stop points were the reception, a newsstand outside the building, a cafeteria, a table, and the entrance to the study center in this order (Figure 1).

• After completing the route with the avatar, the participants were invited to retrace the route alone stopping at the same places (immediate recall task).

• After 20 min, the individual was asked to recreate the route once again (late recall task).

• The participants were invited to return to the data collection place between 7 and 14 days to perform the abovementioned items 1–3 (Figure 2).

Figure 1
Route in the real and virtual tasks (aerial view of the virtual task).

Figure 2
Reproduction of the real environment in virtual reality.

The system was developed using the Oculus Rift® head-mounted display and its controller.

The system automatically extracts the number of locations visited in the correct (correct) or incorrect (errors) sequence. The score, which can vary from 0 to 5 points, is assigned according to the participant’s performance and the number of correct answers (places visited in the correct sequence).

Assessment of the system applicability in older adults with and without mild cognitive impairment

Applicability was evaluated based on the report of adverse symptoms triggered by the task, such as general discomfort, headache, nausea, pallor, vomiting, sweating, and fatigue. The occurrence of these symptoms was assessed through a self-report questionnaire in which the higher the score, the lower the tolerability of the task performed, with a maximum score of 64 points⁷.

The sense of presence was assessed using the Witmer and Singer Presence Questionnaire²¹. This questionnaire aims to measure the degree that individuals experience immersion in an environment, depending on the attentional resources existing in the environment to be explored. The questionnaire comprises 22 items, totaling 154 points. In the end, the higher the score, the greater the sense of presence and immersion, that is, the task applicability.

Assessment of short- and long-term stability

Stability is the degree to which similar results are obtained at two different times, and for that, two correlations were made between the participant’s performance in the SOIVET-Route task at two different times: correlation between immediate recall and late recall (short-term stability) and correlation between the first and second test days (long-term stability).

Statistical analysis

The collected data were processed using the SPSS version 20.0 software. The participants’ clinical and sociodemographic characteristics were expressed as mean, standard deviation (SD), and 95% confidence interval (95%CI) for the numerical variables, whereas the categorical variables were expressed as absolute and relative frequencies.

Short- and long-term stabilities were analyzed using the intraclass correlation coefficient (ICC) between the first and second evaluation days and between the immediate and late recall evaluations performed on the same day using the following analysis criteria: ICC<0.4: poor, 0.4–6: reasonable, 0.6–0.75: good, and 0.75–1.0: excellent. We adopted an alpha of 0.05 as statistical significance²⁴.

The Mann-Whitney U test was applied to compare the applicability measures of the SOIVET-Route task between older adults with and without MCI. Hedge’s g test was used to calculate the effect size considering the following results: large ≥0.8, medium 0.8–0.2, and small <0.2²⁵.

RESULTS

The mean age of participants was 71.4 years (SD=5.5), and there was a predominance of females (n=28; 62%). Most participants had completed their higher education (n=29; 65%) and reported having some comorbidity (n=33; 75%). The most common comorbidities were systemic arterial hypertension, diabetes mellitus, and osteoporosis.

Among the 45 older adults who participated in the study, 23 (51%) met MCI diagnostic criteria and the other participants presented no complaints or evidence of having cognitive impairment, which verified through higher scores on the ACE-R, with a statistically significant difference in relation to those with MCI (p<0.001) (Table 1).

Table 1
Characterization of the total elderly sample and comparison between older adults with and without mild cognitive impairment.

		Total sample (n=45)	Elderly people without MCI (n=22)	Elderly people with MCI (n=23)	p-value
Age (years)		71.4±5.5	71.0±5.7	71.8±5.4	0.53a
Gender, n (%)	Female	28 (62)	14 (64)	14 (61)	1.00c
	Male	17 (37)	8 (36)	9 (39)
Education, n (%)	First grade completed	2 (4)	2 (9)	0 (0)	0.005c
	Second grade completed	12 (27)	2 (9)	10 (43)
	Higher education	29 (65)	18 (82)	11 (48)
	Graduate course	2 (4)	0 (0)	2 (9)
ACE-R		90.5±6.3	94.9±2.8	86.3±5.8	<0.001b
Motion sickness screening		0.55±1.13	0.40±1.18	0.69±1.10	0.08a
Familiarity with the technology		17.8±8.4	20.4±8.3	15.3±8.0	0.034a
Comorbidities, n (%)	Yes	33 (75)	17 (77)	16 (73)	1.00c
	No	12 (25)	5 (23)	6 (27)

• Numerical values represented by average±standard deviation and absolute number (%).
• ^a
  p-value referring to the Mann-Whitney U test;
• ^b
  p-value referring to the Student’s t-test for independent samples;
• ^c
  p-value referring to Fisher’s exact test. MCI: mild cognitive impairment; ACE-R: Addenbrooke’s Cognitive Examination – Revised.

Assessment of applicability

The elderly participants reported a small number of adverse events (mean=1.46; SD=2.11), with mild dizziness and nausea as the most frequent, and high levels of sense of presence and immersion (mean=138.04; SD=14.80). There was no difference between groups with and without MCI (Table 2).

Table 2
Tolerability and sense of presence of the SOIVET-Route in the total sample of older adults and comparison between older adults with and without mild cognitive impairment.

	Total sample (n=45)	Elderly people without MCI (n=22)	Elderly people with MCI (n=23)	p-value	Hedge’s g
Cybersickness	1.46±2.11	1.13±1.93	1.78±2.27	0.29	0.30
Sense of presence and immersion	138.04±14.80	137.81±14.62	138.26±15.30	0.73	0.03

• Numerical values represented by average±standard deviation; p-value referring to the Mann-Whitney U test; effect size (Hedge’s g): large ≥0.8, medium 0.8–0.2, small <0.2. MCI: mild cognitive impairment; D1: day 1; D2: day 2.

However, 17% of participants were unable to complete the task due to complaints of nausea and severe dizziness: 5 (23%) elderly people without MCI and 4 (17%) with MCI. These participants were not included in the analyses, keeping 45 elderly graduating.

There was no correlation between the participants’ scores in the questionnaires of adverse symptoms or sense of presence with age, gender, education, screening for motion sickness, and technology usage profile.

Assessment of short- and long-term stability

Assessment of short- and long-term stability showed an excellent correlation for short-term stability (immediate and late recall, performed with an interval of 20 min) with effect size of 80% power, but poor to reasonable correlation for long-term stability (performed with an interval of 7–14 days) (Table 3).

Table 3
Intraclass correlation coefficients between the first and second assessment days and between immediate and late recall performed on the same day of the SOIVET-Route task.

	ICC D1×D2		ICC Immediate×late
Total sample (n=45)	Immediate recall (virtual)	0.58b	D1	0.78b
	Late recall (virtual)	0.37a	D2	0.81b
Elderly people without MCI (n=22)	Immediate recall (virtual)	0.28	D1	0.60b
	Late recall (virtual)	0.03	D2	0.73b
Elderly people with MCI (n=23)	Immediate recall (virtual)	0.63b	D1	0.80b
	Late recall (virtual)	0.44	D2	0.85b

• ICC<0.4: poor; 0.4–0.6: reasonable; 0.6–0.75: good; 0.75–1.0: excellent; effect size with 80% power: ICC≥0.5. ICC: intraclass correlation coefficient; MCI: mild cognitive impairment; D1: day 1; D2: day 2
• ^a
  p<0.05
• ^b
  p≤0.01.

DISCUSSION

This study analyzed the applicability of the SOIVET-Route task and its respective stability in older adults with and without MCI.

For a VR assessment to be applicable in the elderly population, a low rate of adverse symptoms is necessary¹⁵,²⁶. In this study, the elderly participants had good tolerability to perform the task, and there were minimal reports of adverse symptoms among those who managed to complete the assessment. There was no difference between groups and the incidence of dropouts because tolerability was 17%, which is considered low compared with the rates of 30–80% found in the literature²⁷. There was also no correlation between the scores of the adverse symptoms’ questionnaire and age, gender, education level, or familiarity with technology. This indicates that these factors did not influence the applicability of immersive VR in the elderly population. Nevertheless, the immersive system needs to be accurate in capturing the patient’s movements and the lowest latency possible in relation to the image displacement so that there is no sensory conflict and occurrence of possible adverse events¹⁵,²⁷. These findings corroborate the study conducted by Kim et al.¹⁵, who used the Oculus Rift® to assess elderly people with and without Parkinson’s disease and obtained the results similar to this research. The studies that identified higher incidence rates of adverse events used immersive VR devices with lower visual processing speed, which induced delays between movement and simulation, increasing the occurrence of possible adverse symptoms.

The sense of presence experienced by the patients was another important aspect of the applicability of immersive VR. The greater the sense of presence in a VR task, the more the individuals experience actions and emotions similar to real-life situations, making it more environmentally friendly⁷,²⁸. In this study, the high sense of presence scores were verified, and there was no statistically significant difference between the groups, suggesting that the SOIVET-Route task can be an ecological task despite having fewer sensory cues compared with the same task performed in a real environment.

Regarding the short- and long-term stability of the SOIVET-Route task, the analysis showed a good to excellent correlation in short-term stability (immediate and late recall, performed with a 20-min interval) and a poor to reasonable correlation in long-term stability (between the first and second test days, performed with an interval of 7–14 days). Bearing in mind that the system itself provides the orientation regarding the proposed activity during the task and registers the score, no performance bias from the evaluators is expected. This difference in short- and long-term stability could be explained by improved performance as a result of practice, as the participants were repeatedly exposed to the task, especially in the group of elderly people with MCI.

Among the studies that have investigated spatial orientation in elderly people through VR¹⁰,²⁹–³⁴, only Pouya et al.³² addressed test stability. Pouya et al.³² obtained strong correlations in their analyses, but the participants repeated the VR assessment after 6 and 12 months of the first assessment, which may have prevented a possible learning effect and/or memorization of the task because of the long gap between exposures.

To better generalize the results, considering that the elderly performed better as they were repeatedly exposed to the task, it would be interesting to have more time for them to become familiarized with the system before recording their performance. A variation in the location of the five stop points during the route—in case there was a need to reapply the task at shorter intervals—would be interesting to avoid possible route memorization.

Finally, transposition of the immersive VR task to a tablet with a rotation sensor could be an alternative for the elderly people who presented adverse symptoms in immersion. However, the task would most likely have a lower sense of presence compared with immersive VR, but it would still be advantageous for elderly people with greater sensitivity to motion sickness.

The VR system developed to assess the route learning was applicable for older adults with and without MCI. The assessments showed good short-term stability. These results encourage the use of innovative tasks and immersive virtual environments for the assessment of cognition in older adults.

• This study was conducted by the Physiotherapy, Speech Therapy and Occupational Therapy Department, Faculdade de Medicina, Universidade de São Paulo – São Paulo, SP, Brazil.
• Funding: This work was carried out with the support of the Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) – Brazil, through a grant to the first author. This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – Brasil (CAPES) – Finance Code 001, through a grant to the second author. This research was conducted with support from the Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP), process nos. 16/04984-3 and 14/22348-1, through scholarships granted to the third and last authors, respectively.

REFERENCES

• ¹
  Guariglia CC. Orientação topográfica na doença de Alzheimer. São Paulo. Dissertation [thesis]. São Paulo: Faculdade de Medicina, Universidade de São Paulo; 2006.
• ²
  Brandt T, Zwergal A, Glasauer S. 3-D Spatial memory and navigation: functions and disorders. Curr Opin Neurol. 2017;30(1):90-7. https://doi.org/10.1097/WCO.0000000000000415
  » https://doi.org/10.1097/WCO.0000000000000415
• ³
  Guariglia CC, Nitrini R. Topographical disorientation in Alzheimer’s disease. Arq Neuro-Psiquiatr. 2009;67(4):967-72. https://doi.org/10.1590/S0004-282X2009000600001
  » https://doi.org/10.1590/S0004-282X2009000600001
• ⁴
  Hartmeyer S, Grzeschik R, Wolbers T, Wiener JM. The effects of attentional engagement on route learning performance in a virtual environment: an aging study. Front Aging Neurosci. 2017;9:235. https://doi.org/10.3389/fnagi.2017.00235
  » https://doi.org/10.3389/fnagi.2017.00235
• ⁵
  Gazova I, Vlcek K, Laczó J, Nedelska Z, Hyncicova E, Mokrisova I, Sheardova K, Hort J. Spatial navigation - a unique window into physiological and pathological aging. Front Aging Neurosci. 2012;4:16. https://doi.org/10.3389/fnagi.2012.00016
  » https://doi.org/10.3389/fnagi.2012.00016
• ⁶
  Lithfous S, Dufour A, Després O. Spatial navigation in normal aging and the prodromal stage of Alzheimer’s disease: Insights from imaging and behavioral studies. Ageing Res Rev. 2013;12(1):201-13. https://doi.org/10.1016/j.arr.2012.04.007
  » https://doi.org/10.1016/j.arr.2012.04.007
• ⁷
  Costa RQ, Pompeu JE, Mello DD, Moretto E, Rodrigues FZ, Santos MD, et al. Two new virtual reality tasks for the assessment of spatial orientation: preliminary results of tolerability, sense of presence and usability. Dement Neuropsychol. 018;12(2):196-204. https://doi.org/10.1590/1980-57642018dn12-020013
  » https://doi.org/10.1590/1980-57642018dn12-020013
• ⁸
  Morganti F, Gaggioli A, Strambi L, Rusconi ML, Riva G. A virtual reality extended neuropsychological assessment for topographical disorientation: a feasibility study. J Neuroeng Rehabil. 2007;4:26. https://doi.org/10.1186/1743-0003-4-26
  » https://doi.org/10.1186/1743-0003-4-26
• ⁹
  Hegarty M, Montello DR, Richardson AE, Ishikawa T, Lovelace K. Spatial abilities at different scales: Individual differences in aptitude-test performance and spatial-layout learning. Intelligence. 2006;34(2):151-76. https://doi.org/10.1016/j.intell.2005.09.005
  » https://doi.org/10.1016/j.intell.2005.09.005
• ¹⁰
  Cushman LA, Duffy CJ. Detecting navigational deficits in cognitive aging and Alzheimer disease using virtual reality. Neurology. 2008;71(12):888-95. https://doi.org/10.1212/01.wnl.0000326262.67613.fe
  » https://doi.org/10.1212/01.wnl.0000326262.67613.fe
• ¹¹
  Allison SL, Fagan AM, Morris JC, Head D. Spatial navigation in preclinical Alzheimer’s disease. J Alzheimers Dis. 2016;52(1):77-90. https://doi.org/10.3233/JAD-150855
  » https://doi.org/10.3233/JAD-150855
• ¹²
  Kim J, Filho J, Ko N, Yoon B. Unsupervised virtual reality-based exercise program improves hip muscle strength and balance control in older adults: a pilot study. Arch Phys Med Rehabil. 2013;94(5):937-43. https://doi.org/10.1016/j.apmr.2012.12.010
  » https://doi.org/10.1016/j.apmr.2012.12.010
• ¹³
  Lin CS, Jeng MY, Yeh TM. The elderly perceived meanings and values of virtual reality leisure activities: a means-end chain approach. Int J Environ Res Public Health. 2018;15(4):663. https://doi.org/10.3390/ijerph15040663
  » https://doi.org/10.3390/ijerph15040663
• ¹⁴
  Oliveira CR, Lopes Filho BJ, Sugarman MA, Esteves CS, Lima MM, Moret-Tatay C, et al. Development and Feasibility of a Virtual Reality Task for the Cognitive Assessment of Older Adults: The ECO-VR. Span J Psychol. 2016;19:E95. https://doi.org/10.1017/sjp.2016.96
  » https://doi.org/10.1017/sjp.2016.96
• ¹⁵
  Kim A, Darakjian N, Finley JM. Walking in fully immersive virtual environments: an evaluation of potential adverse effects in older adults and individuals with Parkinson’s disease. J Neuroeng Rehabil. 2017;14(1):16. https://doi.org/10.1186/s12984-017-0225-2
  » https://doi.org/10.1186/s12984-017-0225-2
• ¹⁶
  Davison SM, Deeprose C, Terbeck S. A comparison of immersive virtual reality with traditional neuropsychological measures in the assessment of executive functions. Acta Neuropsychiatr. 2018;30(2):79-89. https://doi.org/10.1017/neu.2017.14
  » https://doi.org/10.1017/neu.2017.14
• ¹⁷
  Costa RQ, Pompeu JE, Bruck SM. Avaliação da orientação espacial em um ambiente de realidade virtual em pacientes com comprometimento cognitivo leve. [thesis]. São Paulo: Faculdade de Medicina, Universidade de São Paulo; 2020.
• ¹⁸
  Costa RQ, Pompeu JE, Moretto E, Silva JM, Santos MD, Nitrini R, et al. Two immersive virtual reality tasks for the assessment of spatial orientation in older adults with and without cognitive impairment: concurrent validity, group comparison, and accuracy results. J Int Neuropsychol Soc. 2021;1-13. https://doi.org/10.1017/S1355617721000655
  » https://doi.org/10.1017/S1355617721000655
• ¹⁹
  Carvalho VA, Caramelli P. Brazilian adaptation of the Addenbrooke’s Cognitive Examination-Revised (ACE-R). Dement Neuropsychol. 2007;1(2):212-6. https://doi.org/10.1590/s1980-57642008dn10200015
  » https://doi.org/10.1590/s1980-57642008dn10200015
• ²⁰
  Petersen RC. Mild cognitive impairment as a diagnostic entity. J Intern Med. 2004;256(3):183-94. https://doi.org/10.1111/j.1365-2796.2004.01388.x
  » https://doi.org/10.1111/j.1365-2796.2004.01388.x
• ²¹
  Witmer BG, Singer MJ. Measuring presence in virtual environments: a presence questionnaire. Presence. 1998;7(3):225-40. https://doi.org/10.1162/105474698565686
  » https://doi.org/10.1162/105474698565686
• ²²
  Mioshi E, Dawson K, Mitchell K, Arnold R, Hodges JR. The Addenbrooke’s Cognitive Examination Revised (ACE-R): a brief cognitive test battery for dementia screening. Int J Geriatr Psychiatry. 2006;21(11):1078-85. https://doi.org/10.1002/gps.1610
  » https://doi.org/10.1002/gps.1610
• ²³
  Wilson B, Cockburn J, Baddeley A, Hiorns R. The development and validation of a test battery for detecting and monitoring everyday memory problems. J Clin Exp Neuropsychol. 1989;11(6):855-70. https://doi.org/10.1080/01688638908400940
  » https://doi.org/10.1080/01688638908400940
• ²⁴
  Bujang MA, Baharum N. A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: a review. Arch Orofac Sci. 2017;12(1):1-11.
• ²⁵
  Lindenau JD, Guimarães LS. Calculando o tamanho de efeito no SPSS. Rev HCPA. 2012;32(3):363-81. ISSN: 2357-9730
• ²⁶
  Weech S, Kenny S, Cowan MB. Presence and Cybersickness in virtual reality are negatively related: a review. Front Psychol. 2019;10:158. https://doi.org/10.3389/fpsyg.2019.00158
  » https://doi.org/10.3389/fpsyg.2019.00158
• ²⁷
  Rebenitsch L, Owen C. Review on cybersickness in applications and visual displays. Virtual Reality. 2016;(20):101-25. https://doi.org/10.1007/s10055-016-0285-9
  » https://doi.org/10.1007/s10055-016-0285-9
• ²⁸
  De Leo G, Diggs LA, Radici E, Mastaglio TW. Measuring sense of presence and user characteristics to predict effective training in an online simulated virtual environment. Simul Healthc. 2014;9(1):1-6. https://doi.org/10.1097/SIH.0b013e3182a99dd9
  » https://doi.org/10.1097/SIH.0b013e3182a99dd9
• ²⁹
  Morganti F, Marrakchi S, Urban PP, Iannoccari GA, Riva G. A virtual reality based tool for the assessment of “survey to route’’ spatial organization ability in elderly population: preliminary data. Cogn Process. 2009;10 Suppl 2:S257-9. https://doi.org/10.1007/s10339-009-0284-9
  » https://doi.org/10.1007/s10339-009-0284-9
• ³⁰
  Byagowi A, Moussavi Z. Design of a virtual reality navigational (VRN) experiment for assessment of egocentric spatial cognition. Conf Proc IEEE Eng Med Biol Soc. 2012;4812-5. https://doi.org/10.1109/EMBC.2012.6347070
  » https://doi.org/10.1109/EMBC.2012.6347070
• ³¹
  Serino S, Morganti F, Stefano FD, Riva G. Detecting early egocentric and allocentric impairments deficits in Alzheimer’s disease: an experimental study with virtual reality. Front Aging Neurosci. 2015;7(88). https://doi.org/10.3389/fnagi.2015.00088
  » https://doi.org/10.3389/fnagi.2015.00088
• ³²
  Poyua OR, Byagowi A, Kelly DM, Moussavi Z. Introducing a new age-and-cognition-sensitive measurement for assessing spatial orientation using a landmark-less virtual reality navigational task. Q J Exp Psychol (Hove). 2017;70(7):1406-19. https://doi.org/10.1080/17470218.2016.1187181
  » https://doi.org/10.1080/17470218.2016.1187181
• ³³
  Mohammadi A, Kargar M, Hesami E. Using virtual reality to distinguish subjects with multiple- but not single-domain amnestic mild cognitive impairment from normal elderly subjects. Psychogeriatrics. 2018;18(2):132-42. https://doi.org/10.1111/psyg.12301
  » https://doi.org/10.1111/psyg.12301
• ³⁴
  Tascón L, Castillo J, Cimadevilla JM. Walking and non-walking space in an equivalent virtual reality task: Sexual dimorphism and aging decline of spatial abilities. Behav Brain Res. 2018;347:201-8. https://doi.org/10.1016/j.bbr.2018.03.022
  » https://doi.org/10.1016/j.bbr.2018.03.022

Publication Dates

• Publication in this collection
  29 Apr 2022
• Date of issue
  Apr-Jun 2022

History

• Received
  01 Nov 2021
• Accepted
  19 Nov 2021