|
   
home
teaching
research interests
current projects
portfolio
students
thesis topics
work opportunities
publications
resources
private
|
 | |
3D Display and Capture of Humans for Live-Virtual Training
- web: project web page
- description: We are carrying out research, development, and evaluation of work in both 3D display and sensing, initially aimed at Mixed/Augmented Reality-based live-virtual training, but with potential for broader impact. The first component of the work is aimed at a new idea for creating physically present virtual humans in 3D, without the need for HMDs or special time/phase/wavelength glasses. Our basic approach is to extend our earlier work in projector-based Shader Lamps to dynamically remap the shape and appearance of virtual or real humans onto human-shaped display surfaces. The second component of the work is aimed at a new idea for hybrid global/body-relative and cooperative estimation of full kinematic body and weapon posture, supporting multiple individuals working in close proximity during training exercises, for both kinetic and non-kinetic scenarios. The third component of the work is aimed at obtaining a thorough understanding of a relevant training domain, its actors, and their specific needs (both current and projected). This involves the investigation and reporting on the basic elements of their acting in related environment in the context of the 3D display and sensing efforts.
MOVES segment: domain analysis of three different training environments/domains (fire drills on ships and submarines, urban warfare operations, tactical cultural awareness training), and a series of user studies in a domain of Shader Lamps-based physical avatars.
- sponsor: Office of Naval Research (ONR)
- collaborating institutions: University of North Carolina at Chapel Hill (UNC) - lead, and Naval Postgraduate School (NPS)
- my role: co-PI on joint project (FY09 - FY12: four years project)
|
|
 | |
Behavioral Analysis and Synthesis for Intelligent Training - BASE-IT
- web: project web page ,
concept figure
- description: A primary objective is to develop a state-of-the-art intelligent training system for pre/in/post evaluation using behavior analysis, review, and behavior synthesis as well as a set of training approaches, aimed to support a wide range of training and operational needs in preparing for and conducting the training in MOUT facilities.
Our proposed approach is to use an in situ network of automatically-controlled pan, tilt and zoom (PTZ) cameras, and personal position and orientation sensing devices, to create static three-dimensional (3D) environment models, dynamic 3D participant models, and dynamic multi-dimensional participant pose tracks that can be viewed from any perspective. The system will include automatic semantic parsing of the dynamic models and tracks, with interactive and automatic configuration, event detection, and annotation to increase the usefulness and effectiveness of reviewed material. We also plan to devise a novel set of training and instructional approaches specially designed for this set of systems and tools.
- sponsor: Office of Naval Research (ONR)
- collaborating institutions: Naval Postgraduate School (NPS) - lead, Sarnoff Corporation and University of North Carolina at Chapel Hill (UNC)
- partners: TECOM, PM TRASYS, TTECG
- other NPS faculty members involved: Dr. Chris Darken, Dr. Neil Rowe, Dr. Mathias Kolsch and Delta3D team
- my role: PI for the three institutions team (FY08 - FY11: four years project)
|
|
 | |
Studying the Synergy of Virtual Training Simulations and Novel Training Methodologies
for Training of the Ground Officers, and Evaluation of Training Effectiveness
- web: /
- description: This research effort engages the faculty and students in tackling two groups of
research issues: firstly it is a design of novel training approaches, instructional strategies and
pedagogies specially created to be used in a conjunction with the virtual training simulations with
the goal to maximize the likelihood of getting positive training results in those systems, and secondly the
scientifically based investigation of the effectiveness of the same methodologies when used with selected
virtual training simulations and with specific user population.
The nature of our research, the form of investigation and the data collected in the study will be
designed in a way that ensures the applicability of the same results to all DoD services (Navy,
Marine Corps, Army) and for a wider family of virtual training simulations.
- sponsor: Navy Modeling and Simulation Office (NMSO)
- partners: TECOM, TBS and IOC (Quantico, VA)
- my role: PI (2007, ongoing project)
|
|
 | |
X3D-Earth: Archivable Composed Collaborative Web-Based 3D Visualization with Global
Geospatial Context for Complex Analysis and Evaluation of Intelligence Products
- web: X3D-Earth Workshop (Nov 14-15, 2006, Monterey, CA):
www.web3d.org/news/events/index.php#x3dearth_workshop
- description: The Naval Postgraduate School (NPS) Modeling, Virtual Environments, and
Simulation (MOVES) Institute proposes the X3D-Earth project for creation of a vast
integrated analytical visualization framework not bound to specific devices, data sources,
data formats, or rendering applications, but based on open standards facilitating
interchange and interoperability across diverse systems for collaborating teams of
intelligence analysts.
Studies that I lead: baseline study, user studies (explore novel user metaphors and complex
display solutions in support of specific requirements generated by domain users possible to be
served by X3D solutions), evaluation of the user effectiveness while using X3D solutions.
- sponsor: DTO
- partners: Aniviza, Inc., Intelligraphics, Media Machines, Planet 9, Polished Pixels,
Yumetech, Ping
- my role: co-PI with Dr. Don Brutzman (FY07 - FY09)
|
|
 | |
Evaluation of the Training Effectiveness of Virtual Simulations in Support of
Team Performance and Collective Training Standards: Tactical Decision-Making Training
Situations for Small Units Level
- web: /
- description: The main objectives of the proposed project are firstly to investigate
training effectiveness of virtual training simulations in support of Collective Training
Standards (CTS) and small unit level performance, and secondly to establish a firmer basis
on guidelines, training opportunities and potential that this kind of systems and tools
provides to address growing training needs exhibited by different DoD departments (US Navy,
Army and Marine Corps). Our hypothesis is that the strategic use of virtual training simulations
does contribute towards higher effectiveness in training, affecting the learning results and motivation.
- sponsor: Navy Modeling and Simulation Office (NMSO)
- partners: TECOM, TBS and IOC (Quantico, VA)
- my role: PI (2005-2006)
|
|
 | |
Evaluation of the Training Effectiveness of Virtual Simulations in Support of
Collective Training Standards": Platoon Level Training for Convoy Operations
- web: /
- description: The goal of this study is to evaluate the initial effectiveness of the
use of a virtual training system in support of Collective Training Standards in convoy
operations training situations, when training is introduced to the users/Marines for the
first time. The study will determine if the training simulation, being an added constitutive
part of entire training cycle and preparation for Mojave Viper, brings a better and/or faster
initial improvement in overall skill level for the selected skill set.
- sponsor: Office of Naval Research (ONR), VIRTE program
- partners: USMC TTECG (Twentynine Palms, CA)
- my role: PI (2005-2006)
|
|
 | |
Empirical Benchmark Study of Collective Performance in Combined Arms Training
- web: /
- description: Empirical study of training situation, procedures, metrics and evaluation
of overall preparedness of multiple units within Marine Corps prior to their participation in a
large scale collective training situation. The study includes qualitative and quantitative analysis
of all units performance and establishing a set of benchmarks to be used for future training.
These benchmarks can serve as a reference points when aiming for optimal training environment that
will provide best performance for several kinds of units. A special attention is given to the
role that training simulators have in enhancing unitsŐ performance in collective training
situations.
- sponsor: Office of Naval Research (ONR), VIRTE program
- partners: USMC TTECG (Twentynine Palms, CA)
- my role: PI (2004-2006)
|
|
 | |
Megaconference Jr.
- web: megaconferencejr.cciu.org
- description: The Student Megaconference (Megaconference Jr.) is a new project
designed to give students in elementary and secondary schools around the world the
opportunity to communicate, collaborate and contribute to each other's learning in real
time using advanced multi-point cideo conferencing technology.
- my role: Member of the Steering Committee, Member of the Program Committee,
consultant (2003/04)
|
|
 | |
Distance Learning
- web: www.maritimeaquarium.org
- description: A study of the state of the art technological solutions and educational
projects that use videoconferencing systems in distance learning framework. The study
provided detailed recommendations for the best educational approaches and institutional policies
to be used in future programs to be offered by the Aquarium.
- my role: Co-author of the study, technology consultant (2004)
|
|
 | |
Internet Radio Project
- web: www.projectkir.org
- description: project engages youth in digital opportunities throught active practice and the
act of creation. Through project web site youth can create digital audio content and present it to
their peers world-wide.
- my role: Technology and education consultant (2004-present)
|
|
 | |
ViDe Videoconferencing Cookbook Version 4.0
- web: www.videnet.gatech.edu/cookbook
- description: one of the best and most referenced on-line resources dedicated to IP videoconferencing.
- my role: Lead and major contributor for K-12 section (new section in this version of the
cookbook; 2003/04)
|
|
 | |
Virtual Marine Biology - Seals on Camera
- web: www.wave3software.com/briarcliff.html
Top 10 Innovative Projects
http://www.techlearning.com/story/showArticle.php?articleID=16000694
- description: distance learning project that connected a grup of students from Briarcliff
HS and experts from the Maritime Aquarium at Norwalk. Project explored multidisciplinary
approach and remote collaboration with scientists and staff members from the Aquarium. The
Technology and Learning magazine has selected this project as one of Top 10 innovative
projects in 2003 (listed 2nd in the article).
- my role: Project co-designer and a consultant (2002/03)
|
|
 | |
Exploring the Future of Learning
|
|
 | |
Imagining the Future
|
|
 | |
Internet2: Application Quality of Service (QoS) Needs Design Team
- web: qos.internet2.edu/wq/apps ,
Internet2: www.internet2.edu
- description: the main objective of this design team was to help acquire a better understanding
of QoS needs that advanced Internet2 applications exercise. The design group was an interface
between application people and networking people, helping both to reach better common understanding
of the QoS requirements of various applications and how those requirements could be met using new
network services that are provided (or could realistically be provided) in Internet2 environment.
- my role: Chairperson
|
|
 | |
National Tele-immersion Initiative
- web:
www.advanced.org/teleimmersion.html ,
UNC Office of the Future: www.cs.unc.edu/Research/stc/
article: Jaron Lanier "Virtually There", Scientific American, April 2001
http://www.cs.unc.edu/Research/stc/inthenews/pdf/sciam_2001_0401.pdf
- description: research consortium sponsored by Advanced Network and Services ($10 million investment)
and NSF, formed in collaboration with several US universities. An Internet2
application developed through the work of this research
initiative enabled users at geographically distributed sites to collaborate in real time in a shared,
simulated environment as if they are in the same physical room. This new paradigm of human-computer
interaction represents the ultimate synthesis of broadband networking and media technologies.
- partners: Brown University, University of North Carolina at Chapel Hill, University of
Pennsylvania, Philadelphia, with past participation of the Naval Postgraduate School (NSP)
- my role: Researcher and a technical coordinator of multiple university research teams and the central
NTII laboratory (1999, 2000)
|
|
 | |
Efficient Image Display for Head-Slaved Viewing of Virtual Environments
- description: PhD Thesis, defended in Mar 1999, Computer Science Department, University College London, United Kingdom.
- thesis advisor: Professor Mel Slater
- abstract (a short version): The efficient resolution of visibility in polygonal scenes was and still is one of the most demanding tasks in computer graphics. A need for faster algorithms is becoming even more important to fulfill the requirements of real-time Virtual Reality (VR) systems, and in particular immersive VR systems. The thesis investigates the construction of visibility algorithm that makes use of the resulting viewpoint movement coherence, where visibility information computed with the respect to one viewpoint may be incrementally adjusted for a subsequent viewpoint without the necessity for a full visibility computation for each frame. A special Viewpoint Movement Space (VpMS) data structure and algorithm have been designed, and results of multiple scenes rendering have been elaborated. The experimental results showed improvement in the frame rate when compared to the use of BSP trees. Methods for utilizing the same data structure for collision detection and image based rendering are discussed as well.
|
|
 | |
The Walkthrough Project
- web: www.cs.unc.edu/~walk/
- description: Research into creating interactive computer graphics systems that enable
a viewer to experience an architectural model by simulating a walk through of the model.
- my role: Visiting Researcher - 3 months Summer 1997 internship hosted by Dr. Fred Brooks,
Department of Computer Science, University of North Carolina at Chapel Hill (UNC), NC.
|
|
 | |
COVEN
- web:
www.crg.cs.nott.ac.uk/research/projects/Coven/
System: DIVE: Distributed Interactive Virtual Environment
- description: EC ACTS funded project focused on the development of a computational service for
teleworking and virtual presence. The overall objective of the project is to provide the facilities needed
to support future cooperative teleworking systems. The project is a unique endeavour that brings together
expertise on communications infrastructures; computer supported cooperative work; virtual reality (VR) and
animation to provide support for a European wide distributed virtual environment (VE).
    Partners in the project included: Division Ltd., EPFL - Swiss Federal Institute of Technology,
Integrated Information Systems Ltd, KPN Research, Lancaster University, Swedish Institute of Computer Science,
Thomson-CSF: Laboratoire Central de Recherches, TNO Physics and Electronics, University College London,
University of Geneva: Mira Lab and University of Nottingham.
- my role: Researcher (1996/98)
|
|
 | |
Inhabiting the Web - Inhabit
|
|
| | |
PROGRAPH II
- web: Energoinvest Co.: www.energoinvest.com
PHIGS Standard:
www.itl.nist.gov/iaui/vu/cugini/pvt/hy-std.html
PHIGS (Wikipedia):
http://en.wikipedia.org/wiki/PHIGS
- description: Research program founded by the Bosnian Ministry of Science and Culture,
and Energoinvest Company (Institute for Automatics and Computer Science (IRCA)). The goal of the
program was to design and build a new graphics workstation, with appropriate suite of graphics
applications. PHIGS (ISO standard: ISO/IEC 9592 and ISO/IEC 9593) was one component of that
environment
- my role: Senior Researcher and a team leader responsible for the implementation of PHIGS
(The Programmer's Hierarchical Interactive Graphics System) graphics standard for PROGRAPH II
graphics workstation, including a low level graphics library and drivers (1987-1992)
|
|