Methods and Design: Measuring Recognition Performance Using Computer-Based andPaper-Based Methods

摘要

Using a within-subject design, we administered to 80 naval pilots and flightofficers computer-based and paper-based tests to access recognition of aircraft silhouettes in order to determine the relative reliability and validities of these two measurement modes. Estimates of internal consistencies, equivalences, and discriminative validities were computed for multiple performance measures. It was established that the relative reliabilities and validities derived for these two assessment schemes were contingent on the employed multivariate measurement criteria, that is, percentage correct responses, average response latency, and average degree of confidence in recognition judgments, as well as the statistical criteria used to ascertain the comparative quality of these two modes of testing.