Virtual Reality and Speech Analysis for the Assessment of Impulsivity and Decision-making

Virtual Reality and Speech Analysis for the Assessment of Impulsivity, Decision-making and Jumping to Conclusions: Comparison With Neuropsychological Tasks and Self-administered Questionnaires

Introduction: Impulsivity is present in a range of mental disorders and has been associated with suicide. Traditional measures of impulsivity have certain limitations, such as the time required for administration or the lack of ecological validity. Virtual Reality (VR) may overcome these issues. This study aims to validate the VR assessment tool "Spheres & Shield Maze Task" and speech analysis by comparing them with traditional measures. The hypothesis is that these innovative tools will be reliable and acceptable by patients, potentially improving the simultaneous assessment of impulsivity, decision-making, and jumping to conclusions. Methods and analysis: The sample consisted of adults divided into three groups: psychiatric outpatients with a history of suicidal thoughts and/or behaviors, psychiatric outpatients without such a history, and healthy volunteers. The sample size required was estimated at 300 participants (100 per group). Participants will complete the Barratt Impulsiveness Scale 11; the Urgency, Premeditation, Perseverance, Sensation Seeking, Positive Urgency, Impulsive Behavior Scale; Iowa Gambling Task; Continuous Performance Test; Stop signal Task, and Go/no-go task, three questions of emotional affect, the Spheres & Shield Maze Task and two satisfaction surveys. During these tasks, participant speech will be recorded. External and internal consistency of the VR environment will be calculated. The association between VR-assessed impulsivity and history of suicidal thoughts and/or behavior, and the association between speech and impulsivity and decision-manking will also be explored. Ethics and dissemination: This study will result in a series of manuscripts that will be submitted to peer-reviewed journals for publication. It is hoped that this VR assessment tool combined with speech analysis can be used regularly in research and/or clinical settings in the near future.

Study Overview

• Status: Not yet recruiting
• Conditions: Suicidal Ideation
• Intervention / Treatment: Diagnostic test: Spheres & Shield Maze Task

Detailed Description

INTRODUCTION Impulsivity is defined as the tendency to act without prior reflection. It implies poor self-control of behavior, leading to quick reactions without regard for consequences. Impulsivity is strongly associated with suicidal behavior and may define a particular suicidal phenotype in which action predominates over ideation.

The dimensional model of impulsivity considers three factors: decision-making, action, and personality traits. The first two factors are the behavioral domains of impulsivity, assessed with neuropsychological tests, while impulsivity as a personality trait is assessed with personality questionnaires.

Among these factors, the one that has been most strongly related to suicidal behavior is decision-making. Decision-making is a complex cognitive function in which learning, previous experience, and sensitivity to feedback interact. It can be intuitive or reflexive, involving different brain structures: intuitive processes are mediated by the amygdala, ventral striatum, and orbitofrontal cortex, while reflexive processes are mediated by the dorsolateral prefrontal cortex, anterior cingulate, and posterior parietal lobe. People with suicidal behavior have difficulty making decisions in risky situations, and their learning to make these decisions does not benefit from feedback. They tend to decide more emotionally than rationally. Studies have found that more than half of all suicide attempts are impulsive. Furthermore, increased impulsivity and aggression have been associated with death by suicide.

Self-administered questionnaires are the most common approach to assess impulsivity. Despite its usefulness, self-report has significant limitations: the cultural influence of the questionnaires hinders their generalizability. Furthermore, impulsive people may find it challenging to describe their personality traits and may thus report unreliably. Computerized neuropsychological tests overcome some of these limitations, as the cultural background does not influence them, and they do not rely on the capacity for introspection and self-awareness, but they are not without limitations, mainly the time it takes to administer and score the tasks. In addition, the situations and stimuli presented to the persons assessed are not very ecological, i.e., they do not usually have a translation to real life, which may compromise their validity. Virtual reality (VR) may overcome these limitations. There is empirical evidence showing that the neural mechanisms that people experience when immersed in a VR environment are similar to those of real-life. Serious VR games have become an innovative, engaging, and customizable way to provide healthcare. VR has been applied in mental health interventions and the field of neuropsychological assessment with good results.

Speech has been increasingly studied for mental health assessment and particularly as a biomarker for mental health. Speech samples can be collected easily and consistently from patients and can help to solve the problem of limited or intermittent assessments due to cost and time to see a clinician while providing ecologically relevant information that is generally not available to clinicians. Combined with machine learning techniques, speech features (textual features and/or acoustic features) are used for automatic assessment of patients and diagnosis of psychiatric disorders.

This study presents the VR assessment tool "Spheres & Shield Maze Task", a virtual maze that participants must go through while overcoming several obstacles, and which can decrease administration time and provides an immersive experience that can approximate real-life conditions, thus increasing ecological validity. The VR tool has been previously evaluated in a non-clinical setting. This work aims to validate the Spheres & Shield Maze Task by comparing it with traditional measures of impulsivity, decision-making, and personality traits in psychiatric patients with or without a history of suicidal thoughts and behaviors and in healthy controls. The secondary objective is to validate the implementation of speech analysis in clinical settings and examine how speech correlates to impulsivity, decision-making, impulsive personality traits, and jumping to conclusions.

The hypothesis is that both the VR assessment tool and speech analysis will be reliable and acceptable by patients, potentially improving the simultaneous assessment of impulsivity and decision making.

METHODS & ANALYSIS This is a cross-sectional study that will be carried out in the Department of Psychiatry of the University Hospital Fundación Jiménez Díaz. Data will be collected over an estimated period of one year.

The estimated sample size is 300 participants, 100 per branch. Psychiatric patients will be recruited by their attending psychiatrist during regular visits. Healthy volunteers will be recruited following the snowball methodology generated from mental health center workers, trainees, and medicine and psychology students.

After signing the informed consent, participants will be scheduled for the assessment session, which will last approximately one hour. They will then be taken to another room and administered the VR task that is recorded by the dual microphones in the Vive Pro Eye VR headset. Trained psychologists will administer the questionnaires and assist the participant during the VR task.

The following assessments will be carried out: 1) collection of socio-demographic and clinical data, 2) self-reported assessment of impulsive personality traits, 3) computerized neuropsychological tests, 4) VR-based impulsivity assessment, 5) assessment of jumping to conclusions, 6) recording of spontaneous speech during both the assessment session and VR task, and 7) satisfaction surveys.

An ad hoc questionnaire will be developed to record sociodemographic variables of interest, including gender, age, marital status, employment status and educational level. History of suicidal behaviour will also be assessed using the Columbia Suicide Severity Rating Scale.

Additional questionnaires will be the patients' health questionnaire-9 (PHQ-9), the PANSS scale -only in case of psychosis-, and the General Anxiety Disorder-7 (GAD-7) questionnaire. Participants will also be inquired about substance use -including alcohol, tobacco, cannabis, cocaine, hallucinogens, and other drugs.

Impulsive personality traits will be measured through the Barratt Impulsivity Scale (BIS-11), and the Urgency, Premeditation, Perseverance, Sensation Seeking, Positive Urgency, Impulsive Behavior Scale (UPPS).

Computerized neuropsychological tests will be the Iowa Gambling Task (IGT), the Continous Performance Test (CPT), the Stop signal Task, and the Go/no-go Task.

For speech analysis, the Emotional Affective Questions Good News Question and the Sadness Characteristic Question will be used. Additionally, the patient is asked to respond for two minutes and the interviewing psychologist will refrain from speaking during this period and timestamp the recording. This question is designed to elicit an emotional response related to positive and negative emotions.

The VR environment, called Spheres & Shield Maze Task, has been developed by the Laboratory of Immersive Neurotechnologies (LabLENI) of the Universitat Politècnica de València. To implement the virtual environment, a VIVE pro eye VR headset, a VNET INTEL I7 computer and a Shimmer GSR (galvanic skin response) kit will be used. The game consists of a maze that the user must solve by moving through space. The movement is done by combining a touchpad with front-facing orientation.

Different hazards will present throughout the maze, with time penalty, energy loss, and certain consequences, such as narrow walkways from which the player can fall, lightning clouds that strike in intervals, flying insects, or locked rooms. The user can also make use of a shield that allows moving through lightning and insects without time penalty at the cost of being unable to gather green orbs. Hazards may also be avoided completely by choosing another path through the labyrinth, however completion of the maze requires traversal of a minimum number of hazards.

The screen displays an indicator of the energy which increases by gathering green orbs and decreases with movement. If the energy decreases, the movement is slowed down. These consequences may influence the user's decision-making. Energy can be recharged by consuming green spheres to be found along the route.

The maze will be scored as the time taken to find the exit. Additionally, data will be collected on behavioral and psychophysiological measures during the execution of the task, including distance travelled, number of stops, trajectory, decision making at bifurcations, total energy obtained, number of spheres collected, use of the Shield, and use of the break room.

At the end of the session, participants will complete a quantitative and a qualitative satisfaction survey, which have been used previously.

Statistical analyses will be carried out using SPSS 24.0, R, Matlab and Python statistical software. External consistency of the VR task will be assessed using traditional neuropsychological measures as Gold Standard, and internal consistency will be assessed using Cronbach's alpha and intraclass correlation coefficient. To explore the differences between groups (suicidal patients, non-suicidal patients, and healthy controls), the mean scores obtained in the variables collected will be compared using ANOVA test or its non-parametric equivalent if the distribution is not normal. Audio recordings will be analyzed in OpenSMILE, an open-source offline software for audio analysis. Machine learning techniques will then be used for feature selection and examining the relation between a participant's speech, impulsivity, suicidality, and mental health questionnaires. Additionally, analysis of recorded speech or utterance before and during the VR task will be used to predict satisfaction of the participant. Descriptive statistics from the quantitative satisfaction survey and content analysis for the qualitative satisfaction survey will also be provided. All tests will be two-tailed with statistical significance stablished at p<0.005 and 95% confidence intervals.

DISCUSSION It is expected that the VR-based assessment to be comparable to the traditional self-report and neuropsychological assessment and to be better accepted by the participants. This study will also contribute to increasing knowledge about the association between impulsivity and suicidal behavior and the use of speech analysis in a clinical setting.

This study will result in a series of manuscripts that will be submitted to peer-reviewed journals for publication. Both significant and non-significant results will be reported. The findings will also be presented in the form of oral communications and symposia at national and international psychiatric conferences.

• Study Type: Observational
• Enrollment (Anticipated): 300

Contacts and Locations

• Study Contact: Name: Alejandro Porras-Segovia, PhD; Phone Number: 619042361; Email: alexposeg@gmail.com

Study Locations

• Spain
  • Madrid, Spain, 28040
    • Hospital Universitario Fundacion Jimenez Diaz

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 18 years and older (Adult, Older Adult)
• Accepts Healthy Volunteers: Yes
• Genders Eligible for Study: All

• Sampling Method: Non-Probability Sample

Study Population

Community-dwelling adults. Our sample is divided into three groups:

1. Psychiatric outpatients with a history of suicide thoughts and/or behaviors.
2. Psychiatric outpatients without a history of suicide thoughts and/or behaviors.
3. Community-dwelling healthy volunteers, serving as controls.

Description

Inclusion Criteria:

• Being able to understand and sign the informed consent form.
• Being fluent in Spanish (to be able to understand the information sheet, the consent form, and the questionnaires and tasks)

Exclusion Criteria:

• Inability to understand and sign the informed consent form for any reason.
• History of intellectual disability
• History of dizziness or other balance pathology, hearing impairment, or visual impairment that precludes carrying out the VR assessment.
• Severe upper limb disability that precludes operating the VR game controls.

Study Plan

How is the study designed?

Number of groups / cohorts

3

Cohorts and Interventions

Group / Cohort	Intervention / Treatment
Control group; Healthy volunteers	Diagnostic test: Spheres & Shield Maze Task; A VR environment that consists of a maze that the user must solve by moving through space. The movement is done by combining a touchpad with front-facing orientation. Different hazards will present throughout the maze, with time penalty, energy loss, and certain consequences, such as narrow walkways from which the player can fall (Figure 1) lightning clouds that strike in intervals, flying insects (Figure 2), or locked rooms (Figure 3). The user can also make use of a shield that allows moving through lightning and insects without penalty at the cost of being unable to gather green orbs (Figure 2). When used, the shield requires a recharge time, so it is a limited resource that the player must optimize. Hazards may also be avoided completely by choosing another path through the labyrinth, however completion of the maze requires traversal of a minimum number of hazards.
Suicidal patients; Patients with a history of suicidal thoughts or behaviors	Diagnostic test: Spheres & Shield Maze Task; A VR environment that consists of a maze that the user must solve by moving through space. The movement is done by combining a touchpad with front-facing orientation. Different hazards will present throughout the maze, with time penalty, energy loss, and certain consequences, such as narrow walkways from which the player can fall (Figure 1) lightning clouds that strike in intervals, flying insects (Figure 2), or locked rooms (Figure 3). The user can also make use of a shield that allows moving through lightning and insects without penalty at the cost of being unable to gather green orbs (Figure 2). When used, the shield requires a recharge time, so it is a limited resource that the player must optimize. Hazards may also be avoided completely by choosing another path through the labyrinth, however completion of the maze requires traversal of a minimum number of hazards.
Non-suicidal patients; Patients without a history of suicidal thoughts or behaviors	Diagnostic test: Spheres & Shield Maze Task; A VR environment that consists of a maze that the user must solve by moving through space. The movement is done by combining a touchpad with front-facing orientation. Different hazards will present throughout the maze, with time penalty, energy loss, and certain consequences, such as narrow walkways from which the player can fall (Figure 1) lightning clouds that strike in intervals, flying insects (Figure 2), or locked rooms (Figure 3). The user can also make use of a shield that allows moving through lightning and insects without penalty at the cost of being unable to gather green orbs (Figure 2). When used, the shield requires a recharge time, so it is a limited resource that the player must optimize. Hazards may also be avoided completely by choosing another path through the labyrinth, however completion of the maze requires traversal of a minimum number of hazards.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Decision-making Score in the Iowa Gambling Task	Decision-making measured with the Iowa Gambling Task (Net scores for the gambling task are calculated by subtracting the number of disadvantageous choices (decks A' and B') from the number of advantageous choices (decks C' and D').	30 minutes

Collaborators and Investigators

• Sponsor: Instituto de Investigación Sanitaria de la Fundación Jiménez Díaz
• Investigators: Principal Investigator: Maria L Barrigon, PhD, Instituto de Investigacion Fundacion Jimenez Diaz

Publications and helpful links

General Publications

• Bechara A, Damasio H, Tranel D, Damasio AR. The Iowa Gambling Task and the somatic marker hypothesis: some questions and answers. Trends Cogn Sci. 2005 Apr;9(4):159-62; discussion 162-4. doi: 10.1016/j.tics.2005.02.002.
• Hupen P, Habel U, Schneider F, Kable JW, Wagels L. Impulsivity Moderates Skin Conductance Activity During Decision Making in a Modified Version of the Balloon Analog Risk Task. Front Neurosci. 2019 Apr 15;13:345. doi: 10.3389/fnins.2019.00345. eCollection 2019.
• Bechara A. The role of emotion in decision-making: evidence from neurological patients with orbitofrontal damage. Brain Cogn. 2004 Jun;55(1):30-40. doi: 10.1016/j.bandc.2003.04.001.
• Chamberlain SR, Sahakian BJ. The neuropsychiatry of impulsivity. Curr Opin Psychiatry. 2007 May;20(3):255-61. doi: 10.1097/YCO.0b013e3280ba4989.
• Dai HJ, Su CH, Lee YQ, Zhang YC, Wang CK, Kuo CJ, Wu CS. Deep Learning-Based Natural Language Processing for Screening Psychiatric Patients. Front Psychiatry. 2021 Jan 15;11:533949. doi: 10.3389/fpsyt.2020.533949. eCollection 2020.
• de-Juan-Ripoll C, Soler-Dominguez JL, Chicchi Giglioli IA, Contero M, Alcaniz M. The Spheres & Shield Maze Task: A Virtual Reality Serious Game for the Assessment of Risk Taking in Decision Making. Cyberpsychol Behav Soc Netw. 2020 Nov;23(11):773-781. doi: 10.1089/cyber.2019.0761. Epub 2020 Aug 24.
• de Leon-Martinez S, Ruiz M, Parra-Vargas E, Chicchi-Giglioli I, Courtet P, Lopez-Castroman J, Artes A, Baca-Garcia E, Porras-Segovia AA, Barrigon ML. Virtual reality and speech analysis for the assessment of impulsivity and decision-making: protocol for a comparison with neuropsychological tasks and self-administered questionnaires. BMJ Open. 2022 Jul 13;12(7):e058486. doi: 10.1136/bmjopen-2021-058486.

Study record dates

Study Major Dates

• Study Start (Anticipated): January 1, 2022
• Primary Completion (Anticipated): July 31, 2023
• Study Completion (Anticipated): December 31, 2023

Study Registration Dates

• First Submitted: October 14, 2021
• First Submitted That Met QC Criteria: October 25, 2021
• First Posted (Actual): November 5, 2021

Study Record Updates

• Last Update Posted (Actual): November 12, 2021
• Last Update Submitted That Met QC Criteria: November 5, 2021
• Last Verified: October 1, 2021

More Information

Terms related to this study

• Additional Relevant MeSH Terms: Behavioral Symptoms; Self-Injurious Behavior; Suicide; Suicidal Ideation; Impulsive Behavior
• Other Study ID Numbers: PIC128-21_FJD

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No