期刊
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING
卷 42, 期 3, 页码 264-284出版社
IEEE COMPUTER SOC
DOI: 10.1109/TSE.2015.2478001
关键词
Software quality; verification; validation; quality assessment; oracle problem; lack of system specification; metamorphic testing; user-oriented testing; search engine
资金
- Microsoft Research
- Australian Research Council [LP100200208]
- Australian Research Council [LP100200208] Funding Source: Australian Research Council
Metamorphic testing is a testing technique that can be used to verify the functional correctness of software in the absence of an ideal oracle. This paper extends metamorphic testing into a user-oriented approach to software verification, validation, and quality assessment, and conducts large scale empirical studies with four major web search engines: Google, Bing, Chinese Bing, and Baidu. These search engines are very difficult to test and assess using conventional approaches owing to the lack of an objective and generally recognized oracle. The results are useful for both search engine developers and users, and demonstrate that our approach can effectively alleviate the oracle problem and challenges surrounding a lack of specifications when verifying, validating, and evaluating large and complex software systems.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据