VALIDATING ADVERTISEMENT PREDICTIONS USING ADVERTISEMENT EXPERIMENTS

摘要

Experiment performance data associated with a first advertisement campaign is generated during a first advertisement campaign experiment. The experiment performance data includes a first set of experiment performance data and a second set of experiment performance data. A first set of simulated performance data for the first advertisement campaign using first set of auction instances with the advertisement campaign setting having second advertisement campaign value is generated. A second set of simulated performance data for the first advertisement campaign using the second set of auctions instances with the advertisement campaign setting having the first advertisement campaign value is generated. Accuracy of the first set of performance data and the second set of performance data is determined by comparing the first performance data to the second set of experiment performance data, and by comparing the second performance data to the first set of experiment performance data.