CaliBrainVR: Using Psycho-physiological Measures to Calibrate Virtual Reality Training

Abstract

The use of extended reality (XR) in training has surged with technological advancements. To meet the demand for adaptive and effective XR training, biofeedback measures like heart rate, eye gaze, and pupil dilation have become crucial. Even though, XR providers have developed headsets equipped with physiological sensors, the accuracy of interpreting the signals has yet to consider inter-individual differences in physiology. Nevertheless, it is important to measure an individual's responsivity in terms of biometrics (i.e., the degree to which a person's physiological signal changes in response to changes in their cognitive state) to build accurate XR assessment and adaptive XR training. Currently, we present CaliBrainVR, a virtual reality "calibration" application that aims to create tailored user profiles using eye-tracking and heart rate data outlining the individual's responsivity. The present text describes the virtual environment of the application, the data logging and preprocessing and the results of the initial validation stage. Finally, we outline the future development of the application and its current impact on training and assessment.