Generating test cases for software configuration testing

摘要

Software configuration testing is used to test a piece of software with all kinds of hardware to ensure that it can run properly on them. This paper generates test cases for configuration testing with several common methods, such as multiple single-factor experiments, uniform design, and orthogonal experiment design used in other fields. This paper analyzes their merits and improves the orthogonal experiment design method with pairwise testing, and decrease the testing risk caused by incomplete testing with a method of multiple-factors-covering. It also presents a simple factor cover method which can cover all the factors and pairwise combinations to the greatest degree. Finally some comparisons of these methods are made on the aspects of test suite scale, coverage, and usability, etc.