overview
institutions
research
publications
news & events
videos & images
links
contact us
acknowledgements
BASE-IT: Overview
SPONSOR: Office Of Naval Research - ONR (web)
TRANSITION CUSTOMERS:
DESCRIPTION: A primary objective is to develop a state-of-the-art intelligent training system for pre/in/post evaluation using behavior analysis, review, and behavior synthesis as well as a set of training approaches, aimed to support a wide range of training and operational needs in preparing for and conducting the training in MOUT facilities. Our proposed approach is to use an in situ network of automatically-controlled pan, tilt and zoom (PTZ) cameras, and personal position and orientation sensing devices, to create static three-dimensional (3D) environment models, dynamic 3D participant models, and dynamic multi-dimensional participant pose tracks that can be viewed from any perspective. The system will include automatic semantic parsing of the dynamic models and tracks, with interactive and automatic configuration, event detection, and annotation to increase the usefulness and effectiveness of reviewed material. We also plan to devise a novel set of training and instructional approaches specially designed for this set of systems and tools.
The work on this project represents a synergy of computer vision, computer graphics (including virtual reality) and artificial intelligence technologies at the level that has not been attempted before in military domain, and not done with the scale and complexity that is planned in this project. This project also represents an exemplar approach in the way it incorporates human factors considerations for all technological solutions proposed in this research effort, including a design of novel training and instructional approaches to ensure that proposed system solutions are used most effectively by intended users.
Several important issues that we plan to focus in this project effort have not been addressed in an integrated fashion in other S&T solutions available at the moment: cameras positioned between the buildings of an urban training environment (1x1 km), cameras used for 3D data acquisition, cameras and other sensors used to derive high level of precision in movements and posture of individual warfighter, a behavior analysis - a fine level of assessment of actions undertaken by groups of individuals and by individual participants, a notion of semantic analysis of participant motion, availability of systems and tools for immediate feedback provided to the person who orchestrates the training, as well as visual play-back of recorded exercise data and exploration of alternative courses of action at will (free play). All those domains sum up a range of S&T goals we plan to address in this project effort.