Providing data indicative of the performance of a competing algorithm and an incumbent algorithm

摘要

A method for providing data indicative of the performance of a competing algorithm and an incumbent algorithm includes evaluating an incumbent-algorithm score indicative of a performance of an incumbent algorithm. The performance of a competing algorithm executing in place of the incumbent algorithm is then simulated. On the basis of the simulation, a competing-algorithm score predictive of a performance of the competing algorithm is evaluated. These scores are then provided to an output device.