Acessibilidade / Reportar erro

Two new virtual reality tasks for the assessment of spatial orientation Preliminary results of tolerability, sense of presence and usability

Duas Novas Tarefas de Realidade Virtual para Avaliação da Orientação Espacial: Resultados Preliminares de Tolerabilidade, Sensação de Presença e Usabilidade

Abstract

Spatial orientation is a cognitive domain frequently impaired in Alzheimer's Disease and can be one of its earliest symptoms.

Objective:

This paper describes the results of tolerability, sense of presence and usability of two immersive virtual reality tasks for the assessment of spatial orientation, using VR headset in adults.

Methods:

31 healthy adults recruited from university and the local community performed two experimental immersive virtual reality tasks of spatial orientation: the SOIVET-Maze for the assessment of allocentric to egocentric spatial abilities and the SOIVET-Route for the assessment of spatial memory and landmark recognition. Participants completed questionnaires about sense of presence, cybersickness symptoms, technology use profile and motion sickness history. Usability measures were assessed by spontaneous feedback from participants.

Results:

All participants were able to understand the task instructions and how to interact with the system. Both tasks seemed to induce a strong sense of presence, as assessed by the Witmer and Singer Presence Questionnaires (M=128 and 143 for SOIVET-Maze and SOIVET-Route, respectively). The SOIVET-Route had a small numeric advantage over the SOIVET-Maze tolerability scores assessed by the Cybersickness Questionnaire (M=4.19, SD=5.576 and M=3.52, SD=6.418 for SOIVET-Maze and SOIVET-Route respectively). Also, there were no drop-outs on the SOIVET-Route due to tolerability issues, unlike the SOIVET-Maze, which had two drop-outs. However, this difference was not statistically significant (Z= -.901, p= 0.368, Wilcoxon signed-rank test).

Key words:
spatial orientation; ecological momentary assessment; immersive virtual reality; technology assessment; biomedical; user-computer interface

Resumo

A orientação espacial é um domínio cognitivo freqüentemente comprometido na doença de Alzheimer e pode ser um dos primeiros sintomas manifestados.

Objetivo:

Este artigo descreve os resultados de tolerabilidade, sensação de presença e usabilidade de duas tarefas imersivas de realidade virtual para avaliação da orientação espacial, utilizando óculos de RV em adultos.

Métodos:

31 adultos saudáveis, ​​recrutados entre estudantes universitários e da comunidade local, realizaram duas tarefas de realidade virtual imersiva para avaliação da orientação espacial: A tarefa SOIVET-Maze para avaliação da capacidade de transposição da orientação alocêntrica para egocêntrica e a tarefa SOIVET-Route para avaliação da memória espacial e reconhecimento de pontos de referência. Os participantes também responderam questionários sobre Sensação de Presença, Sintomas de cybersickness, Perfil de Uso de Tecnologia e Histórico de cinetose. Feedback espontâneo dos participantes foi utilizado como medida de usabilidade.

Resultados:

Todos os participantes conseguiram compreender as instruções da tarefa e como interagir com o sistema. Ambas tarefas parecem induzir forte sensação de presença, avaliada pelo Questionário de Presença de Witmer e Singer (M=128 e 143 para SOIVET-Maze e SOIVET-Route, respectivamente). A tarefa SOIVET-Route teve uma pequena vantagem numérica em relação à tarefa SOIVET-Maze na pontuação de tolerabilidade avaliada pelo Questionário de Cybersickness (M=4,19, SD=5,576 e M=3,52, SD=6,418 para SOIVET-Maze e SOIVET-Route respectivamente). Além disso, não houve desistências na SOIVET-Route devido a problemas de tolerabilidade, ao contrário da SOIVET-Maze, que teve dois drop-outs. No entanto, essa diferença não foi estatisticamente significativa (Z= -901, p=0,368, teste de postos sinalizados de Wilcoxon)

Palavras-chave:
orientação espacial; avaliação momentânea ecológica; realidade virtual imersiva; avaliação de tecnologias em saúde; interface usuário-computador

Spatial orientation is the ability of finding our way in familiar or unfamiliar surroundings.11 Guariglia CC, Nitrini R. Topographical Disorientation in Alzheimer's Disease. Arq Neuropsiquiatr. 2009;67:967-72. It involves two major aspects of spatial cognition: Egocentric orientation, which provides spatial information from the viewpoint of the navigator, and Allocentric orientation, involving focus on the spatial relationship between landmarks, independent of the navigator's position.11 Guariglia CC, Nitrini R. Topographical Disorientation in Alzheimer's Disease. Arq Neuropsiquiatr. 2009;67:967-72. Deficits in spatial orientation are a common manifestation of Alzheimer's Disease (AD) and can be one of its earliest symptoms.11 Guariglia CC, Nitrini R. Topographical Disorientation in Alzheimer's Disease. Arq Neuropsiquiatr. 2009;67:967-72.

Several studies have described spatial orientation deficits in patients with a measurable decline in cognitive abilities, yet without impairment in daily functioning, a condition known as Mild Cognitive Impairment (MCI).22 Weniger G, Ruhleder M, Lange C, Wolf S, Irle E. Egocentric and allocentric memory as assessed by virtual reality in individuals with amnestic mild cognitive impairment. Neuropsychologia. 2011;49(3):518-27.

3 Vlcek K, Laczó J. Neural correlates of spatial navigation changes in mild cognitive impairment and Alzheimer's disease. Front Behav Neurosci. 2014;8:89.

4 Moodley K, Minati L, Contarino V, Prioni S, Wood R, Cooper R, et al. Diagnostic differentiation of mild cognitive impairment due to Alzheimer's disease using a hippocampus-dependent test of spatial memory. Hippocampus. 2015;25(8):939-51.
-55 Lithfous S, Dufour A, Després O. Spatial navigation in normal aging and the prodromal stage of Alzheimer's disease: Insights from imaging and behavioral studies. Ageing Res Rev. 2013;12(1):201-13. These deficits have been shown to correlate with hippocampal and parietal atrophy in AD and MCI patients, as well as with a greater risk of progression from MCI to AD.22 Weniger G, Ruhleder M, Lange C, Wolf S, Irle E. Egocentric and allocentric memory as assessed by virtual reality in individuals with amnestic mild cognitive impairment. Neuropsychologia. 2011;49(3):518-27.

3 Vlcek K, Laczó J. Neural correlates of spatial navigation changes in mild cognitive impairment and Alzheimer's disease. Front Behav Neurosci. 2014;8:89.

4 Moodley K, Minati L, Contarino V, Prioni S, Wood R, Cooper R, et al. Diagnostic differentiation of mild cognitive impairment due to Alzheimer's disease using a hippocampus-dependent test of spatial memory. Hippocampus. 2015;25(8):939-51.
-55 Lithfous S, Dufour A, Després O. Spatial navigation in normal aging and the prodromal stage of Alzheimer's disease: Insights from imaging and behavioral studies. Ageing Res Rev. 2013;12(1):201-13. Such findings suggest that a decline in spatial abilities may represent a prodromal stage of an underlying degenerative process, and studies have supported the inclusion of spatial orientation assessment in elderly and MCI patients.66 Lim T-S, Iaria G, Moon SY. Topographical disorientation in mild cognitive impairment: a voxel-based morphometry study. J Clin Neurol. 2010;6(4):204-11.

7 Iachini I, Iavarone A, Senese VP, Ruotolo F, Ruggiero G. Visuospatial memory in healthy elderly, AD and MCI: a review. Curr Aging Sci. 2009;2(1):43-59.
-88 Devier DJ, Villemarette-Pittman N, Brown P, Pelton G, Stern Y, Sano M, et al. Predictive utility of type and duration of symptoms at initial presentation in patients with mild cognitive impairment. Dement Geriatr Cogn Disord. 2010;30(3):238-44.

However, there is still no gold standard for the assessment of spatial orientation abilities and several new tasks have been proposed over the years.22 Weniger G, Ruhleder M, Lange C, Wolf S, Irle E. Egocentric and allocentric memory as assessed by virtual reality in individuals with amnestic mild cognitive impairment. Neuropsychologia. 2011;49(3):518-27.,99 Rusconi ML, Suardi A, Zanetti M, Rozzini L. Spatial navigation in elderly healthy subjects, amnestic and non amnestic MCI patients. J Neurol Sci. 2015;359(1-2):430-7.,1010 Laczó J, Andel R, Vyhnalek M, Vlcek K, Magerova H, Varjassyova A, et al. Human analogue of the morris water maze for testing subjects at risk of Alzheimer's Disease. Neurodegener Dis. 2010;7(1-3):148-52. Traditional paper-and-pencil testing usually lacks ecological validity to assess different spatial orientation components, such as landmark recognition, mental rotation, egocentric and allocentric abilities, that can be diversely impaired in elderly and MCI patients.55 Lithfous S, Dufour A, Després O. Spatial navigation in normal aging and the prodromal stage of Alzheimer's disease: Insights from imaging and behavioral studies. Ageing Res Rev. 2013;12(1):201-13.,1111 Cushman LA, Stein K, Duffy CJ. Detecting navigational deficits in cognitive aging and Alzheimer disease using virtual reality. Neurology. 2008;16;71(12):888-95.,1212 Tu S, Wong S, Hodges JR, Irish M, Piguet O, Hornberger M. Lost in spatial translation - A novel tool to objectively assess spatial disorientation in Alzheimer's disease and frontotemporal dementia. Cortex. 2015;67:83-94. Moreover, patient performance on small-scale spatial orientation tasks correlates only partially with performance on large-scale spatial tasks.1111 Cushman LA, Stein K, Duffy CJ. Detecting navigational deficits in cognitive aging and Alzheimer disease using virtual reality. Neurology. 2008;16;71(12):888-95. This may indicate that different cognitive abilities are recruited depending on different scale perceptions.55 Lithfous S, Dufour A, Després O. Spatial navigation in normal aging and the prodromal stage of Alzheimer's disease: Insights from imaging and behavioral studies. Ageing Res Rev. 2013;12(1):201-13.

Recently, virtual reality (VR) environments have provided new possibilities for the ecological assessment and rehabilitation of cognitive deficits in the elderly population.1212 Tu S, Wong S, Hodges JR, Irish M, Piguet O, Hornberger M. Lost in spatial translation - A novel tool to objectively assess spatial disorientation in Alzheimer's disease and frontotemporal dementia. Cortex. 2015;67:83-94.

13 Cogné M, Taillade M, N'Kaoua B, Tarruella A, Klinger E, Larrue F, et al. The contribution of virtual reality to the diagnosis of spatial navigation disorders and to the study of the role of navigational aids: A systematic literature review. Ann Phys Rehabil Med. 2017;60(3):164-76.
-1414 García-Betances RI, Jiménez-Mixco V, Arredondo MT, Cabrera-Umpiérrez MF. Using Virtual Reality for Cognitive Training of the Elderly. Am J Alzheimer's Dis Other Dementias. 2015;30(1):49-54. In particular, VR tasks for the assessment of spatial orientation have shown to be a valid and feasible tool, but most of these tasks were not developed for immersive environments.1111 Cushman LA, Stein K, Duffy CJ. Detecting navigational deficits in cognitive aging and Alzheimer disease using virtual reality. Neurology. 2008;16;71(12):888-95.,1212 Tu S, Wong S, Hodges JR, Irish M, Piguet O, Hornberger M. Lost in spatial translation - A novel tool to objectively assess spatial disorientation in Alzheimer's disease and frontotemporal dementia. Cortex. 2015;67:83-94.,1515 Morganti F, Marrakchi S, Urban PP, Iannoccari G, Riva G. A virtual reality based tool for the assessment of "survey to route" spatial organization ability in elderly population?: preliminary data. Cogn Neurosci. 2009;10(Suppl 2):257-9. Among VR environments, immersive interactive tasks appear to have advantages for ecological cognitive assessment and rehabilitation, as they can reproduce real-world sensory perceptions.1414 García-Betances RI, Jiménez-Mixco V, Arredondo MT, Cabrera-Umpiérrez MF. Using Virtual Reality for Cognitive Training of the Elderly. Am J Alzheimer's Dis Other Dementias. 2015;30(1):49-54.,1616 Freeman D, Reeve S, Robinson A, Ehlers A, Clark D, Spanlang B, et al. Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychol Med. 201722:1-8. Immersive environments are becoming increasingly available and have shown some promising results for different age-related declines, such as sensory, motor and cognitive decline.1717 Shelton BE, Uz C. Immersive Technology and the Elderly: A Mini-Review. Gerontology. 2014;61(2):175-85.

18 Arias P, Robles-García V, Sanmartín G, Flores J, Cudeiro J. Virtual Reality as a Tool for Evaluation of Repetitive Rhythmic Movements in the Elderly and Parkinson's Disease Patients. PLoS One. 2012;7(1):e30021.
-1919 Benoit M, Guerchouche R, Petit PD, Chapoulie E, Manera V, Chaurasia G, et al. Is it possible to use highly realistic virtual reality in the elderly? A feasibility study with image-based rendering. Neuropsychiatr Dis Treat. 2015;11:557-63. However, the focus of most immersive virtual reality tasks used with elderly has been on motor or cognitive rehabilitation rather than assessment.1414 García-Betances RI, Jiménez-Mixco V, Arredondo MT, Cabrera-Umpiérrez MF. Using Virtual Reality for Cognitive Training of the Elderly. Am J Alzheimer's Dis Other Dementias. 2015;30(1):49-54.,1616 Freeman D, Reeve S, Robinson A, Ehlers A, Clark D, Spanlang B, et al. Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychol Med. 201722:1-8.,1919 Benoit M, Guerchouche R, Petit PD, Chapoulie E, Manera V, Chaurasia G, et al. Is it possible to use highly realistic virtual reality in the elderly? A feasibility study with image-based rendering. Neuropsychiatr Dis Treat. 2015;11:557-63.

One remaining restriction of immersive virtual reality - whether for therapeutic or entertainment purposes - is cybersickness, a form of motion sickness that promotes a dizzy feeling that occurs while performing or after stopping the task or game; in some cases leading to nausea, vertigo and vomiting.1919 Benoit M, Guerchouche R, Petit PD, Chapoulie E, Manera V, Chaurasia G, et al. Is it possible to use highly realistic virtual reality in the elderly? A feasibility study with image-based rendering. Neuropsychiatr Dis Treat. 2015;11:557-63. Cybersickness is one of the reasons why fewer studies have focused on immersive virtual environments for elderly, along with greater difficulty coping with computerized systems, engagement in rigid procedures and age-related physical and cognitive limitations.1919 Benoit M, Guerchouche R, Petit PD, Chapoulie E, Manera V, Chaurasia G, et al. Is it possible to use highly realistic virtual reality in the elderly? A feasibility study with image-based rendering. Neuropsychiatr Dis Treat. 2015;11:557-63.

Following the current progression of spatial orientation assessment and the advantages of immersive virtual interactive tasks, our group has focused on developing two virtual reality tasks using a new proposed system, the Spatial Orientation in an Immersive Virtual Environment Test (SOIVET): SOIVET-Maze task and SOIVET-Route task. In order to evaluate User Experience, this study aims to describe preliminary results of the SOIVET: tolerability, sense of presence, and usability of both tasks in adults.

Methods

Study sample

This pilot study was a cross-sectional observational study conducted at the Reference Center for Cognitive Disturbances of the University of São Paulo Clinicas Hospital, in São Paulo, Brazil and approved by the institution's Ethics Committee (Comitê de Ética do Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo - CEP USP, reference number 2.319.633). A total of 31 healthy adults recruited from both university and the local community participated in this study. Eligible participants had to be 18-59 years old, have normal or corrected eyesight and no history of cognitive or hearing impairment. None of the participants had previously performed any of the proposed tasks. Technology use profile (Box 1) and motion sickness history (Box 2) were assessed with specific questionnaires developed by our research group, and were not used for eligibility. Physical comorbidities were scored using the Charlson Comorbidity Index (CCI). Informed consent was given by all participants.

Box 1
Questions of the Technology Use Profile Questionnaire.
Box 2
Questions of the Motion Sickness Screening Questionnaire* * To be administered prior to VR task performance. .

User Experience outcomes

Tolerability results were assessed with a self-report cybersickness questionnaire based on the validated Brazilian Portuguese version of the Simulator Sickness Questionnaire, which included 16 adverse events related to motion and virtual sickness - including nausea, headache, blurred vision, vertigo - on a 4-item Likert scale of intensity (Not at all - a Little - Somewhat and Very much)2020 Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. Int J Aviat Psychol. 1993;3(3):203-20.,2121 Carvalho M, Costa R, Nardi A. Simulator Sickness Questionnaire: tradução e adaptação transcultural; Simulator Sickness Questionnaire: translation and cross-cultural adaptation. J Bras Psiquiatr. 2011;60(4): 247-52. (Box 3). Participants completed the questionnaire after each task. In order to investigate the possibility of an individual vulnerability component for cybersickness, participants were given a short screening questionnaire for motion sickness history, prior to task performance. The screening questionnaire was developed by our research group and included 6 questions to screen situations that could induce motion sickness: “Do you feel dizzy or nauseous while reading in a moving car or bus?” or “Do you prefer to be the driver rather than the passenger, because otherwise you feel dizzy or nauseous?” (Box 2).

Box 3
Cybersickness Questionnaire* * Based on the Brazilian version of the Simulator Sickness Questionnaire21. .

Sense of presence was investigated using the Witmer and Singer Presence Questionnaire.2222 Witmer BG, Singer MJ. Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoper Virtual Environ. 1998; 7(3):225-40. This questionnaire was proposed in 1998 by Bob G. Witmer and Michael J. Singer and was based on the hypothesized factors that contribute to one's sense of presence: control, sensory, distraction and realism factors.2222 Witmer BG, Singer MJ. Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoper Virtual Environ. 1998; 7(3):225-40. Participants were asked to complete the questionnaire immediately after each task.

To investigate usability, our research group collected spontaneous feedback and observation from participants' understanding of task instructions and interaction. In addition, the profile for technology use among participants was investigated using a Technology Use Profile Questionnaire (Box 1) developed by our research group. The questionnaire included 10 questions regarding routine use of technology devices and programs, such as smartphones, computers and video-games. This questionnaire was given to participants prior to task performance in order to investigate a possible influence of technology familiarity on the understanding and performance of both tasks and was not used for sample selection.

The SOIVET system

The SOIVET system is a computer-based information system that utilizes an easy-to-use and low cost device for immersive virtual reality - the Samsung Gear VR™ headset, which is a mobile virtual reality headset developed by Samsung Electronics, in collaboration with Oculus, and manufactured by Samsung. It is compatible with the smartphone Galaxy S6/S6 Edge®, which acted as the headset's display and processor, while the Gear VR unit itself acted as the controller, which contains the high field of view, as well as a custom inertial measurement unit (IMU), for rotational tracking, and connects to the smartphone via micro-USB. For commands and movements used in the tasks, a Bluetooth joystick compatible with the Samsung smartphone was used. Both SOIVET-Maze and SOIVET-Route tasks, as well as the system's home menu were developed using the Unity® platform.

Proposed tasks

Two immersive virtual reality tasks for the assessment of spatial orientation were proposed: the SOIVET-Maze, which focuses on the evaluation of allocentric to egocentric spatial ability; and the SOIVET-Route, which focuses on visuospatial memory and topographical landmark recognition. Participants were invited to use the system with the headset, which could be adjusted to properly fit the participant's head and focus eyesight accordingly. All participants performed the tasks in a quiet room, sitting in a mid-back office chair with adjustable seat height. Participants were able to interact with and to move around the virtual environment using a Bluetooth compatible joystick. An investigator was present at all times during the experiment.

SOIVET-Maze

The SOIVET-Maze was inspired by and is a continuation of the work of Morganti et al., who developed a non-immersive virtual reality maze for the ecological assessment of spatial orientation abilities in the elderly population.2323 Morganti F, Stefanini S, Riva G. From allo- to egocentric spatial ability in early Alzheimer's disease: a study with virtual reality spatial tasks. Cogn Neurosci. 2013;4:171-80. The task is based on the traditional Money Road Map Test (MRMT) of sense of direction and was designed to investigate the transition from allocentric to egocentric spatial orientation - a crucial aspect of one's orientation in real life - which has shown to be specifically impaired in Alzheimer's Disease and not in healthy elderly.2323 Morganti F, Stefanini S, Riva G. From allo- to egocentric spatial ability in early Alzheimer's disease: a study with virtual reality spatial tasks. Cogn Neurosci. 2013;4:171-80.,2424 Rainville C, Marchand N, Passini R. Performances of patients with a dementia of the Alzheimer type in the Standardized Road-Map test of Direction Sense. Neuropsychologia. 2002;40(5):567-73. The SOIVET-Maze aimed to transfer the 3D interaction display for the Samsung Gear VR™ immersive interaction system and to apply automatically recorded and extractable data to the originally designed task.

In the MRMT, participants are required to describe verbally each right or left turn from a depicted route on a paper map. A total of 32 turning points are presented in the MRMT' map, and all participants performed the original paper version prior to the VR experience. In SOIVET-Maze, participants are able to see the original route depicted on the map within the immersive virtual environment, but also to experience, from a first-person perspective, each turn in the maze (Figure 1). Participants are supposed to find their way in the VR maze, using the original MRMT map as the reference. The maze does not present any distinguishable landmarks, and participants can only use the map for orientation (Figure 1). A green point marks the last correct turn on the map, in order to reduce working memory effort.

Figure 1
Participant's view in practice trial of SOIVET-Maze.

Participants could not choose a wrong turn more than three times, and each mistake led back to the last turning point. All participants were able to perform a practice trial prior to task performance and to repeat the task once. The scoring system was based on the total of correct turns of participant's last trial performance. Akin to the MRMT scoring system, the maximum possible score is 32 points. There was no time limit.

SOIVET-Route

The SOIVET-Route task is based on the “Route” subtest from the Rivermead Behavioral Memory Test (RBMT).2525 Kurtz MM. Rivermead Behavioral Memory Test. In: Encyclopedia of Clinical Neuropsychology. New York, NY: Springer New York; 2011:2184-5. In the original version, the subtest requires participants to perform, and then recall, a route inside a health professional's office. The route includes five different landmarks: two chairs, a window, a table and a door. This particular subtest involves spatial orientation abilities, especially visuospatial memory, and has proven to be sensitive for detecting differences between Alzheimer's Disease patients, MCI patients, and healthy elderly.2626 Yassuda MS, Flaks MK, Viola LF, Pereira FS, Memória CM, Nunes PV, et al. Psychometric characteristics of the Rivermead Behavioural Memory Test (RBMT) as an early detection instrument for dementia and mild cognitive impairment in Brazil. Int Psychogeriatr. 2010;22(6): 1003-11. In SOIVET-Route, participants were instructed to follow an avatar and to perform, from a first-person perspective, a similar route, but in a larger area in the form of the entrance hall of a hospital building. After route performance following the avatar in the Instructions phase (Figure 2), participants were asked to perform the same route alone, immediately and after a 20-minute interval (delayed). All participants were allowed to repeat the instructions phase once if they wished. Akin to the original RBMT, the scoring system was based on the total of correct locations performed by the participants in the correct order. There was no time limit.

Figure 2
Participant's view of the avatar in Instructions phase of SOIVET-Route.

Statistical analysis

To analyze User Experience outcomes data, a normal distribution analysis was performed, using skewness and kurtosis values as well as histogram visual checks. For additional evaluation, a Kolmogorov-Smirnov normality test was performed. Once the type of distribution was established, a paired sample t-test was used to compare means of parametric data and a Wilcoxon signed-ranked test to compare means of non-parametric data. To investigate correlation between data results, the Spearman correlation test (for non-normal distributed data) was used.

RESULTS

Sample characteristics

Participants were aged 18 to 59 years (M=32, ± 10.39 y), 54.8% women. All 31 participants had at least 12 years of education and 13 participants (41.9%) had 16 years or more. Mean years of education was 16.06 (±2.22), ranging from 12 to 20 years. None of the participants had auditory impairment and 61.3% had a visual refractive error (myopia or astigmatism), corrected with eyeglasses. Most participants (93.54% n=29) had a CCI of zero, two participants (6.45%) had a CCI of one, and one participant (3.22%) had a CCI of two. Technology use profile scores ranged from 18 to 39 (M=27.75, SD=5.967), where 40 was the maximum possible score. All 31 participants fulfilled inclusion criteria and no participants were excluded from the study prior to task performance.

Tolerability

No significant tolerability differences were found between the SOIVET Maze task (mean value of 4.19±5.57) and the SOIVET Route task (3.52±6.42); Wilcoxon signed-rank test (Z= -.901, p= 0.368) - despite a small numeric difference in favor of the SOIVET-Route - as measured by the Cybersickness Questionnaire after each task performance. In addition, two (6.45%) participants were unable to complete the SOIVET-Maze task due to tolerability issues, while all participants were able to complete the SOIVET-Route task.

Cybersickness scores, from the Cybersickness Questionnaire (Box 3), on both tasks appeared to be significantly related to personal vulnerability and motion sickness history, since a positive correlation was found between the SOIVET-Maze and SOIVET-Route cybersickness scores (r=0.552, n=31, p=0.001) and between cybersickness scores on both tasks and our Motion Sickness Screening Questionnaire scores (r=0.533, p=0.002 and r=0.365, p=0.043 for SOIVET-Maze and SOIVET-Route, respectively). Cybersickness scores did not yield a significant correlation with gender (r= -0.341, p=0.061 and r= -0.116, p=0.533 for SOIVET-Maze and SOIVET-Route), age (r= 0.250, p=0.176 and r= -0.018, p=0.924 for SOIVET-Maze and SOIVET-Route) or technology use profile (r= -0.183, p=0.323 and r= -0.153, p=0.413 for SOIVET-Maze and SOIVET-Route).

Sense of presence

Results indicated high levels of presence for both tasks, as measured by the Witmer and Singer Presence Questionnaire2222 Witmer BG, Singer MJ. Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoper Virtual Environ. 1998; 7(3):225-40. (Median scores of 128 and 143 for SOIVET-Maze and SOIVET-Route, respectively). Additionally, all 22 items from the questionnaire showed a median of 5 or higher on a 7-point Likert Scale for both tasks, where 7 indicates the highest sense of presence. Presence scores did not correlate with sex (r= -0.050, p=0.798 and r= -0.189, p=0.309 for SOIVET-Maze and SOIVET-Route, respectively), age (r= 0.007, p=0.971 and r= 0.175, p=0.348 for SOIVET-Maze and SOIVET-Route) or technology use profile (r= 0.016, p=0.936 and r= -0.036, p=0.846 for SOIVET-Maze and SOIVET-Route). Participants that were unable to complete the SOIVET-Maze due to tolerability issues (n=2, 6.45%) were excluded from the SOIVET-Maze presence score.

Usability - understanding of task instructions and interaction

All participants were able to understand both task instructions and how to interact with the virtual environments using the controller joystick. The majority of participants required a second trial for performing the SOIVET-Maze task and a second trial for the SOIVET-Route instructions phase, due to an attention bias of novelty within the virtual environment. None of the participants required a second trial for the phases of immediate and delayed route recall in the SOIVET-Route. Additionally, technology use profile, as measured by the scores on our Technology use profile Questionnaire (Box 1) showed no correlation with performance on either task (r= -0.075, p=0.699; r= -0.286, p=0.118 and r= -0.265, p=0.150 for SOIVET-Maze and SOIVET-Route immediate and delayed recall, respectively).

Discussion

The advantages of immersive virtual environments for the ecological assessment of cognitive processes hinge on the capacity of this technology to reproduce real-world sensory perceptions and to engage brain activation closely related to real life.1414 García-Betances RI, Jiménez-Mixco V, Arredondo MT, Cabrera-Umpiérrez MF. Using Virtual Reality for Cognitive Training of the Elderly. Am J Alzheimer's Dis Other Dementias. 2015;30(1):49-54.,1616 Freeman D, Reeve S, Robinson A, Ehlers A, Clark D, Spanlang B, et al. Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychol Med. 201722:1-8. It has been discussed that spatial orientation involves cognitive processes that are not engaged in traditional vista scale spatial assessments.2727 Wolbers T, Wiener JM, Mallot HA, Büchel C. Differential recruitment of the hippocampus, medial prefrontal cortex, and the human motion complex during path integration in humans. J Neurosci. 2007;27(35):9408-16. Ecological evaluation - as proposed in VR tasks - may, therefore, reproduce neuronal mechanisms involved in everyday spatial orientation and closer resemble real-life. However, when seeking this kind of cognitive engagement, it is important to investigate whether patients experience a significant sense of presence in the virtual environment. This study was able to demonstrate that, besides being able to easily understand task instructions and interact with the virtual environments, both SOIVET-Maze and SOIVET-Route tasks seem to induce a strong sense of presence, which is important for ecological tasks.

Cybersickness, described as a type of motion or simulator sickness, is believed to result from a conflict between visual stimuli - which are highly enhanced within immersive virtual environments - and other sensory stimuli such as auditory, vestibular and proprioceptive information.2828 Joseph J. LaViola Jr. A Discussion of Cybersickness in Virtual Environments. SIGCHI Bull. 2000;32(1).

29 Kiryu T, So RH. Sensation of presence and cybersickness in applications of virtual reality for advanced rehabilitation. J Neuroeng Rehabil. 2007;4(1):34.
-3030 Mazloumi Gavgani A, Hodgson DM, Nalivaiko E. Effects of visual flow direction on signs and symptoms of cybersickness. PLoS One. 2017;12(8):e0182790. The involvement of different sensory inputs, in particular, the vestibular system, has led to the use of VR environments for vestibular disorder rehabilitation.3131 Bergeron M, Lortie CL, Guitton MJ. Use of Virtual Reality Tools for Vestibular Disorders Rehabilitation: A Comprehensive Analysis. Adv Med. 2015; 30:1-9. An important approach to prevent cybersickness in virtual environments is the ability to track the user's head position and to represent it accurately in the virtual space.2828 Joseph J. LaViola Jr. A Discussion of Cybersickness in Virtual Environments. SIGCHI Bull. 2000;32(1). Head-mounted displays, akin to that used in this study, have developed over the years, and are now able to provide this kind of information to the VR system. However, head-mounted displays can add other conflicting visual information that may worsen cybersickness, such as lags between actions performed and reproduced in the VR environment, position tracking errors, and conflicting depth perception.2828 Joseph J. LaViola Jr. A Discussion of Cybersickness in Virtual Environments. SIGCHI Bull. 2000;32(1).

Apparently, different factors related to the individual, such as age, sex and ethnicity, can also contribute to one's susceptibility to motion sickness, as well as affective states such as anxiety.3030 Mazloumi Gavgani A, Hodgson DM, Nalivaiko E. Effects of visual flow direction on signs and symptoms of cybersickness. PLoS One. 2017;12(8):e0182790.,3232 Klosterhalfen S, Kellermann S, Pan F, Stockhorst U, Hall G, Enck P. Effects of ethnicity and gender on motion sickness susceptibility. Aviat Space Environ Med. 2005;76(11):1051-7.,3333 Gianaros PJ, Muth ER, Mordkoff JT, Levine ME, Stern RM. A questionnaire for the assessment of the multiple dimensions of motion sickness. Aviat Space Environ Med. 2001;72(2):115-9. Interestingly, results of a strong correlation between tolerability scores from both tasks and a moderate correlation with motion sickness history found in this study points to the impact of an individual vulnerability factor.3434 John F.Golding. Motion sickness susceptibility. Auton Neurosci. 2006;129(1-2):67-76. Since the SOIVET-Maze had a higher correlation score with motion sickness history, it is likely that this task in particular was causing motion sickness related effects. An individual vulnerability factor supports the need to carry out an active assessment of motion sickness or cybersickness history of all participants prior to VR tasks performance. Researchers - and perhaps in the future, clinicians - should try to minimize the emergence of severe adverse events by screening susceptible patients. It is important to assess, and as far as possible minimize, tolerability issues in immersive virtual environments, especially when applied to health care. Our results indicate that both tasks had no statistical difference in tolerability profile, but a numeric advantage for the SOIVET-Route was noted. A better understanding of technical features presented in the SOIVET-Maze compared to the SOIVET-Route could help elucidate this tolerability difference and allow some improvements: a major difference between the two tasks is the way participants move around the virtual environment. In the SOIVET-Maze, participants had the perception of moving around the maze inside a vehicle. To turn right or left, they could do so only by using the controller joystick. In contrast, to move around the hospital entrance hall in the SOIVET-Route, participants had the perception of walking and were only able to turn right or left by rotating their heads in the chosen direction, in addition to the controller. Thus, movement in the SOIVET-Maze was faster and independent of head turns (i.e. independent of head position tracking). Other contributing factors could have been the uncomfortable landscape perception (a tight maze vs a spacious hospital entrance hall), and possible conflicts between the perception of landscape proportion from vista scale (map) vs large scale.

At the initial phase of an immersive task development, it is important to assess User Experience measures for a better understanding of negative features of tasks and ways to refine them.3535 Bernhaupt R. User Experience Evaluation in Entertainment. In Springer, London; 2010:3-7. We believe the present study can provide some examples of tolerability, sense of presence and usability measures, which may be helpful for other research groups focused on health-applied technology assessment. One limitation of this study was the recruitment of younger adults, instead of elderly. Although assessing User Experience with the target group would be ideal, in the case of elderly, we believe it was preferable to obtain these measures in a younger group, in order to adjust and improve task usability and comfort. However, it is important to investigate User Experience measures among elderly, once the tasks are considered ready to use. Results for tolerability profile, as well as understanding of task instructions and operation, could differ in elderly relative to results obtained for adults. Since Sense of Presence did not correlate with age, gender or technology use profile, this aspect is not expected to vary significantly among older participants, but should also be investigated.

In conclusion, the SOIVET-Maze and SOIVET-Route seem to be well-tolerated, engaging and easy-to-use immersive tasks. The present study yielded favorable results that encourage further investigation of the proposed tasks in different population and patient profiles.

  • This study was conducted atDepartamento de Neurologia, Faculdade de Medicina da Universidade de São Paulo, SP, Brazil.
  • Funding sources. This work is part of a project funded by the São Paulo Research Foundation (FAPESP), Grant: 2016/04984-3.

References

  • 1
    Guariglia CC, Nitrini R. Topographical Disorientation in Alzheimer's Disease. Arq Neuropsiquiatr. 2009;67:967-72.
  • 2
    Weniger G, Ruhleder M, Lange C, Wolf S, Irle E. Egocentric and allocentric memory as assessed by virtual reality in individuals with amnestic mild cognitive impairment. Neuropsychologia. 2011;49(3):518-27.
  • 3
    Vlcek K, Laczó J. Neural correlates of spatial navigation changes in mild cognitive impairment and Alzheimer's disease. Front Behav Neurosci. 2014;8:89.
  • 4
    Moodley K, Minati L, Contarino V, Prioni S, Wood R, Cooper R, et al. Diagnostic differentiation of mild cognitive impairment due to Alzheimer's disease using a hippocampus-dependent test of spatial memory. Hippocampus. 2015;25(8):939-51.
  • 5
    Lithfous S, Dufour A, Després O. Spatial navigation in normal aging and the prodromal stage of Alzheimer's disease: Insights from imaging and behavioral studies. Ageing Res Rev. 2013;12(1):201-13.
  • 6
    Lim T-S, Iaria G, Moon SY. Topographical disorientation in mild cognitive impairment: a voxel-based morphometry study. J Clin Neurol. 2010;6(4):204-11.
  • 7
    Iachini I, Iavarone A, Senese VP, Ruotolo F, Ruggiero G. Visuospatial memory in healthy elderly, AD and MCI: a review. Curr Aging Sci. 2009;2(1):43-59.
  • 8
    Devier DJ, Villemarette-Pittman N, Brown P, Pelton G, Stern Y, Sano M, et al. Predictive utility of type and duration of symptoms at initial presentation in patients with mild cognitive impairment. Dement Geriatr Cogn Disord. 2010;30(3):238-44.
  • 9
    Rusconi ML, Suardi A, Zanetti M, Rozzini L. Spatial navigation in elderly healthy subjects, amnestic and non amnestic MCI patients. J Neurol Sci. 2015;359(1-2):430-7.
  • 10
    Laczó J, Andel R, Vyhnalek M, Vlcek K, Magerova H, Varjassyova A, et al. Human analogue of the morris water maze for testing subjects at risk of Alzheimer's Disease. Neurodegener Dis. 2010;7(1-3):148-52.
  • 11
    Cushman LA, Stein K, Duffy CJ. Detecting navigational deficits in cognitive aging and Alzheimer disease using virtual reality. Neurology. 2008;16;71(12):888-95.
  • 12
    Tu S, Wong S, Hodges JR, Irish M, Piguet O, Hornberger M. Lost in spatial translation - A novel tool to objectively assess spatial disorientation in Alzheimer's disease and frontotemporal dementia. Cortex. 2015;67:83-94.
  • 13
    Cogné M, Taillade M, N'Kaoua B, Tarruella A, Klinger E, Larrue F, et al. The contribution of virtual reality to the diagnosis of spatial navigation disorders and to the study of the role of navigational aids: A systematic literature review. Ann Phys Rehabil Med. 2017;60(3):164-76.
  • 14
    García-Betances RI, Jiménez-Mixco V, Arredondo MT, Cabrera-Umpiérrez MF. Using Virtual Reality for Cognitive Training of the Elderly. Am J Alzheimer's Dis Other Dementias. 2015;30(1):49-54.
  • 15
    Morganti F, Marrakchi S, Urban PP, Iannoccari G, Riva G. A virtual reality based tool for the assessment of "survey to route" spatial organization ability in elderly population?: preliminary data. Cogn Neurosci. 2009;10(Suppl 2):257-9.
  • 16
    Freeman D, Reeve S, Robinson A, Ehlers A, Clark D, Spanlang B, et al. Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychol Med. 201722:1-8.
  • 17
    Shelton BE, Uz C. Immersive Technology and the Elderly: A Mini-Review. Gerontology. 2014;61(2):175-85.
  • 18
    Arias P, Robles-García V, Sanmartín G, Flores J, Cudeiro J. Virtual Reality as a Tool for Evaluation of Repetitive Rhythmic Movements in the Elderly and Parkinson's Disease Patients. PLoS One. 2012;7(1):e30021.
  • 19
    Benoit M, Guerchouche R, Petit PD, Chapoulie E, Manera V, Chaurasia G, et al. Is it possible to use highly realistic virtual reality in the elderly? A feasibility study with image-based rendering. Neuropsychiatr Dis Treat. 2015;11:557-63.
  • 20
    Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. Int J Aviat Psychol. 1993;3(3):203-20.
  • 21
    Carvalho M, Costa R, Nardi A. Simulator Sickness Questionnaire: tradução e adaptação transcultural; Simulator Sickness Questionnaire: translation and cross-cultural adaptation. J Bras Psiquiatr. 2011;60(4): 247-52.
  • 22
    Witmer BG, Singer MJ. Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoper Virtual Environ. 1998; 7(3):225-40.
  • 23
    Morganti F, Stefanini S, Riva G. From allo- to egocentric spatial ability in early Alzheimer's disease: a study with virtual reality spatial tasks. Cogn Neurosci. 2013;4:171-80.
  • 24
    Rainville C, Marchand N, Passini R. Performances of patients with a dementia of the Alzheimer type in the Standardized Road-Map test of Direction Sense. Neuropsychologia. 2002;40(5):567-73.
  • 25
    Kurtz MM. Rivermead Behavioral Memory Test. In: Encyclopedia of Clinical Neuropsychology. New York, NY: Springer New York; 2011:2184-5.
  • 26
    Yassuda MS, Flaks MK, Viola LF, Pereira FS, Memória CM, Nunes PV, et al. Psychometric characteristics of the Rivermead Behavioural Memory Test (RBMT) as an early detection instrument for dementia and mild cognitive impairment in Brazil. Int Psychogeriatr. 2010;22(6): 1003-11.
  • 27
    Wolbers T, Wiener JM, Mallot HA, Büchel C. Differential recruitment of the hippocampus, medial prefrontal cortex, and the human motion complex during path integration in humans. J Neurosci. 2007;27(35):9408-16.
  • 28
    Joseph J. LaViola Jr. A Discussion of Cybersickness in Virtual Environments. SIGCHI Bull. 2000;32(1).
  • 29
    Kiryu T, So RH. Sensation of presence and cybersickness in applications of virtual reality for advanced rehabilitation. J Neuroeng Rehabil. 2007;4(1):34.
  • 30
    Mazloumi Gavgani A, Hodgson DM, Nalivaiko E. Effects of visual flow direction on signs and symptoms of cybersickness. PLoS One. 2017;12(8):e0182790.
  • 31
    Bergeron M, Lortie CL, Guitton MJ. Use of Virtual Reality Tools for Vestibular Disorders Rehabilitation: A Comprehensive Analysis. Adv Med. 2015; 30:1-9.
  • 32
    Klosterhalfen S, Kellermann S, Pan F, Stockhorst U, Hall G, Enck P. Effects of ethnicity and gender on motion sickness susceptibility. Aviat Space Environ Med. 2005;76(11):1051-7.
  • 33
    Gianaros PJ, Muth ER, Mordkoff JT, Levine ME, Stern RM. A questionnaire for the assessment of the multiple dimensions of motion sickness. Aviat Space Environ Med. 2001;72(2):115-9.
  • 34
    John F.Golding. Motion sickness susceptibility. Auton Neurosci. 2006;129(1-2):67-76.
  • 35
    Bernhaupt R. User Experience Evaluation in Entertainment. In Springer, London; 2010:3-7.

Publication Dates

  • Publication in this collection
    Apr-Jun 2018

History

  • Received
    13 Mar 2017
  • Accepted
    09 May 2018
Academia Brasileira de Neurologia, Departamento de Neurologia Cognitiva e Envelhecimento R. Vergueiro, 1353 sl.1404 - Ed. Top Towers Offices, Torre Norte, São Paulo, SP, Brazil, CEP 04101-000, Tel.: +55 11 5084-9463 | +55 11 5083-3876 - São Paulo - SP - Brazil
E-mail: revistadementia@abneuro.org.br | demneuropsy@uol.com.br