Challenges in Developing a Performance Measurement System for the Global Virtual Environment

摘要

The Air Force Research Laboratory, Warfighter Readiness Research Division, is continuously researching technologies to measure and track performance of knowledge and skills from an individual level to the command and control (C2) level, within both high fidelity distributed simulation environments and live training environments. This program initially developed a performance measurement system, the Performance Effectiveness Tracking System (PETS), which successfully captured the objective data necessary for Mission Essential Competency (MEC) evaluations, end-user performance feedback, simulator technology developer validation, and for researcher and program manager evaluation of training techniques and technologies. This report describes the preliminary testing of a new architecturally-structured performance measurement system (PETS), expanded to encompass the need for higher level measurement capabilities within multiple diverse virtual environments. This report describes the initial application of PETS within multi-player, multi-platform virtual exercises; discusses the lessons learned, and talks about the challenges faced in producing effective analysis of training results.