Highly scalable internet-based randomized experiment methods and apparatus for obtaining insights from test promotion results

摘要

Methods and apparatus for conducting test promotions in a highly scalable and cost-effective manner using randomized experiment methodology are disclosed. Test promotions of interest are presented to visitors of a website in a randomized experiment manner wherein each page presents one test promotion of interest among other promotions. The other promotions presented in the same page may be randomized. The visitors' responses with respect to the test promotions of interest are then recorded and analyzed to determine the performance of each presented test promotion of interest.