• BASE-IT team met for a two days long set of discussions and planning meetings. Major topics discussed: data collection on Kilo2 range in Camp Pendleton, and Year3 Demo.

• BASE-IT project participation in PM TRASYS booth during I/ITSEC 2009 conference (exhibition floor).

• BASE-IT end-of-year technical review and demonstration for the sponsor (ONR) and transition customers (PM TRASYS and TECOM).

Matthew briefing the Marines on simple scenario that will be executed and recorded by the system.		Marines using Virtual Sand Table to plan their mission.
Marines executing their mission.		Mission successfully completed.
After Action Review with 2 1/2 D visualization.		After Action Review with 2 1/2 D visualization.
After Action Review with 2 1/2 D visualization (MapView).		After Action Review on Virtual Sand Table.
After Action Review with 3D visualization and demo of Planning Tool capabilities (Delta3D).		After Action Review with 3D Posture recognition module.
Technical presentation: C. Darken.		Technical presentation: A. Sadagic.

Group photo of our team with Marines, ONR, PM TRASYS and TECOM.

• Team Dress rehearsal in preparation for Year2 Demo.

Bringing in UNCs Virtual Sand Table...		... and setting it up.
Tom and Chris (Sarnoff) installing displays for 2 1/2 D Visualization.		Adrian (UNC) focusing on his automated camera management module.
Drizzle rain just started - need to cover cameras (Jan, UNC).		... and all cameras protected.
Time to calibrate UNC cameras (Jan and Megha)...		... and to calibrate GPS and INS sensors (Sarnoff).
Camera-start-action (Marines and UNC computer vision crew).		Mike and Chris (NPS) fixing 3D live visualization.

• Large part of three-institutions team met at Sarnoff location in Princeton, NJ. The focus was our system integration in support of Year2 demo in September.

Matthew explaining the scenario to the team.		Two rented storage containers simulating the buildings on the lawn at Sarnoff (Sarnoff cameras are installed on the buildings).
UNC camera installation.		UNC camera installation (blue shield added by Herman to protect cameras from blazing sun).
Virtual Sand Table discussion.		Team calibrating GPS and INS sensors.

Group photo on temperature over 90 degrees Fahrenheit (over 32 Celsius)

• NPS faculty members Amela Sadagic, Chris Darken and Mathias Kolsch presented and demonstrated the work on BASE-IT project.

A. Sadagic presenting the overall work on the project.		M. Kolsch introducing the work of Vision Lab at MOVES.
M. Guerrero from Delta3D team demonstrating the work on Behavior Synthesis and Planning Tool modules (PI: Chris Darken).		A. Sadagic demonstrates Virtual Sand Table display platform and Magic Marker in mission planning (work of UNC Chapel Hill, part of BASE-IT project).

• Amela Sadagic made a two day field visit to the range to observe unit's training as well as a new camera system being installed on the range.

Optical sensors (cameras) to be used to record and track the movements of individuals and vehicles through the range.		A Marine in a view of a nearby camera cluster.

• Amela Sadagic, Henry Fuchs and Hui Cheng presented BASE-IT project at the meeting.

• Herman Towles and Tyler Johnson installed UNC virtual sand table at NPS/MOVES. Delta3D team connected BASE-IT 3D visualization application with the sand table software.

Virtual sand table construction.		Virtual sand table construction.
Calibration done.		Positioning the physical model.
Mission planning: Segment of Kilo Two range with annotation done using Magic Marker.		Magic Marker overload.
Herman, Tyler and Delta3D team on NPS campus.		Herman and Tyler at NPS.
First demo: Amela, Herman and Tyler.		First demo: Herman demonstrates virtual sand table and Magic Marker for a group of MOVES students.

• BASE-IT team presented progress of S&T efforts on the project.

Live demo of Posture recognition from 2D video (Juan Wachs, Roy Stripling and Mathias Kolsch)		Demo night at the Naval Postgraduate School

• BASE-IT team met for a two days long set of discussions and planning meetings. Major topics discussed: integration steps on all levels, data collection activities and Year2 Demo.

Sunny California day in Monterey		Heading for lunch in Herrmann Hall
Heading for lunch in Herrmann Hall		Herman in the main NPS ballroom situated in Herrmann Hall

• UNC and NPS teams organized data capture session during which NPS and DLI students conducted different infantry drills. One person wore mocap suit and everyone was recorded with a set of camcorders. Recorded data set will be used as a 'gold standard' reference set when analyzing both good and poor performances that will be captured on future training ranges. During the data capture session 9 camcorders have been used to record everyone's movements inside the circle with approximately 10m large diameter.
  

  Our special thanks go to colleagues and students at the Defense Language Institute (DLI) in Monterey CA, who supported and participated in data capture study on both days.

Jan and Megha seting up the camera set.		The images from each camera (camcorder) will have to be calibrated.
Adrian moving and showing a known calibration pattern in the field of view of each camera.		Ben with mocap suit getting instructions from Matthew and Henry.
Herman conducting calibration of the mocap suit.		DLI students getting instructions from Matthew.
DLI student performing 'single Marine' postures.		A group of DLI students conducting 'danger area crossing' drill under the watchful eye of Matthew Denney.

• BASE-IT team participated and presented our project efforts to a group of external evaluators appointed by the sponsor (ONR), ONR program leadership and the colleagues from other projects in Capable Manpower Program.

• Team presented and discussed the results of the work completed during our first funding year. Apart from meeting with larger PM TRASYS team, we also presented the project results to Col. Frank Kelley, a Program Managed of PM TRASYS. During that meeting we presented our slide set that illustrated the basic concepts and approaches supported by our research effort.

Instead of 2D video stream, the technologies and approaches used and developed in this project allow us to transition to 3D model of training environment captured in real time. Being that all data sets are kept in the data base as 3D data, the user can choose any viewpoint he (she) may be interested to examine.		Sketch of top-down view of 3D model: PTZ camera arrangement and camera coverage. Notice that some areas are not 'covered' by cameras (individual GPS unit will provide positions for Marines in those areas), some areas are covered by one camera (position information will be better than with GPS-only setup), and some areas are covered by 2 or more cameras. Marines' locations in latter are expected to be resolved using computer vision approaches with sub-meter precision.
Sketch of top-down view of 3D model: 3D model and this view provides clear understanding about the positions and arrangement of multiple units across the terrain.		Sketch of top-down view of 3D model: User (viewer) requested automated recognition of training events performed by the units present on the training range. System also added information about the units (segments of the larger unit) identified as performing each event, as well as time during which they were engaged in each event.
Sketch of top-down view of 3D model: User zoomed-in on one training event and selected a single Marine whose performance metrics was requested to be examined by the system.		Sketch of top-down view of 3D model: System warned about 'flagging' incident which occurred (flagging is unintentional pointing of the weapon muzzle in direction of fellow Marine). System also indicated that 15 similar incidents occurred in past 45 minutes.

• Team presented the results of the work completed during our first funding year.

LtCol Yates reviews the results of Behavior Synthesis segment, designed and implemented by Chris and his team at NPS.		Pete Muller commenting 3D real time data acquisition and display solutions designed by UNC team.
Hal Roby discussing the results of Behavior Analysis lead by Sarnoff team.		Soup-buddies - hungry researchers :-)

• Team observed Lane and MRX training events organized by TTECG/UWTC.

• Team presented the results of the work completed until July 2008.

Demo		Demo: video and GPS fusion (Sarnoff)

• Team observed a new set of training events organized by TTECG/UWTC. Collected data will be used for the Baseline Study, as well as Behavior Analysis, 2D Posture Recognition and Behavior Synthesis. The information and understandings acquired during this visit will help us fine-tune our system solutions with the training needs exercised by the domain users.

Briefing before the training run		Establishing vehicle check point (VCP)
Patrol 1		Patrol 2
Security 1		Security 2

• Project Kick-off meeting and progress review with the sponsor (ONR) and representatives from our transition customers (PM TRASYS and TECOM).

Sitting: David McLaughlin (TECOM), Brad Valdyke (PM TRASYS), Ami Bolton (ONR), Roy Stripling (ONR), Pete Muller (ONR)
Standing: Anselmo Lastra (UNC), Henry Fuchs (UNC), Rakesh "Teddy" Kumar (Sarnoff), Hal Roby (PM TRASYS), Amela Sadagic (NPS), Jan-Michael Frahm (UNC), Greg Welch (UNC), Juan Wachs (NPS), Chris Darken (NPS), Chumki Basu (Sarnoff), Mary Whitton (UNC), Neil Rowe (NPS), Herman Towles (UNC), Larry Davis (UCF/NEW-IT).

Selected set of prototype illustrations presented on the day:

Optimal Automatic Camera Control: Greg Welch (UNC)
One Marine Uncovered: Higher Total Cost (hi-res image).	All Marines Covered: Lower Total Cost (hi-res image).

Image 1 (hi-res image).		Image 2

• 17 members strong team observed training in the MOUT training facilities located in two USMC bases. Collected data will be used to bootstrap the work in several research domains.

1st row: Henry Fuchs (UNC), Matthew Denney (retired Maj/USMC, PM TRASYS), Amela Sadagic (NPS), Greg Welch (UNC), Anselmo Lastra (UNC)
2nd row (standing): Brian Clipp (UNC), Chumki Basu (Sarnoff), Herman Towles (UNC), Ajay Divakaran (Sarnoff), Maj Brian Kibel (USMC & NPS), Hui Cheng (Sarnoff), Mike Dunhour (NPS), Neil Rowe (NPS), Chris Darken (NPS), Edward John Custy (SPAWAR), Mathias Kolsch (NPS), Erik Johnson (NPS).

• The team's presentation outlined project objectives, S&T goals, and detailed the plan for three years. TTA (Technology Transition Agreement) document was signed by all parties (sponsor, transition customers, project PI).

Greg Welch (UNC), Henry Fuchs (UNC), Richard Schaffer (Lockheed Martin), LCDR James Patrey (MC, USN, NAVAIR PMA 205), Tyler Johnson (UNC student).

Greg Welch (UNC), Amela Sadagic (NPS), Mary Whitton (UNC), Henry Fuchs (UNC).