This clip shows an Instrumented Virtual Replay (iVR) of Participant 10 during the navigation exercise. The red lines indicates the participant's scan. In this segment, the participant has turned in the wrong valley. The valley is uniquely identifiable by a central ridge on the valley floor. The participant views this feature in the out the window scene and then scans this feature on the map. Identifying and correctly matching this key feature allows him to recover from the error and then correctly identify the draw on the left of the valley that defines the next turn point. (Map scan points are somewhat difficult to see in the video capture of the replay application; however the application allows you to adjust your viewpoint to focus on individual portions of the original simulation.)
The iVR application augments the training event; adding important cues that are not observable by instructors in current live or virtual training environments.
Future versions will add dashboard information based on eye tracking metrics (frequency distribution of dwell duration, scan division, out the window and map scan match information, etc.) These will be used to drive iconic display of trainee's cognitive state to guide instruction. The goal will be to provide something simple like an exclamation mark or question mark indicating when the trainee should be confident or uncertain.
