Baital: An adaptive weighted sampling approach for improved t-wise coverage

Eduard Baranov, Axel Legay, Kuldeep S. Meel

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

23 Citations (Scopus)

Abstract

The rise of highly configurable complex software and its widespread usage requires design of efficient testing methodology. t-wise coverage is a leading metric to measure the quality of the testing suite and the underlying test generation engine. While uniform sampling-based test generation is widely believed to be the state of the art approach to achieve t-wise coverage in presence of constraints on the set of configurations, such a scheme often fails to achieve high t-wise coverage in presence of complex constraints. In this work, we propose a novel approach Baital, based on adaptive weighted sampling using literal weighted functions, to generate test sets with high t-wise coverage. We demonstrate that our approach reaches significantly higher t-wise coverage than uniform sampling. The novel usage of literal weighted sampling leaves open several interesting directions, empirical as well as theoretical, for future research.

Original languageEnglish
Title of host publicationESEC/FSE 2020 - Proceedings of the 28th ACM Joint Meeting European Software Engineering Conference and Symposium on the Foundations of Software Engineering
EditorsPrem Devanbu, Myra Cohen, Thomas Zimmermann
Number of pages13
PublisherAssociation for Computing Machinery
Publication date8 Nov 2020
Pages1114-1126
ISBN (Electronic)9781450370431
DOIs
Publication statusPublished - 8 Nov 2020
Event28th ACM Joint Meeting European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2020 - Virtual, Online, United States
Duration: 8 Nov 202013 Nov 2020

Conference

Conference28th ACM Joint Meeting European Software Engineering Conference and Symposium on the Foundations of Software Engineering, ESEC/FSE 2020
Country/TerritoryUnited States
CityVirtual, Online
Period08/11/202013/11/2020
SponsorACM SIGSOFT

Bibliographical note

Funding Information:
This work was supported in part by EU H2020 project Serums (826278-SERUMS-H2020-SC1-FA-DTS-2018-2020) and by National Research Foundation Singapore under its NRF Fellowship Programme [NRF-NRFFAI1-2019-0004 ] and AI Singapore Programme [AISG-RP-2018-005], and NUS ODPRT Grant [R-252-000-685-13]. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not reflect the views of National Research Foundation, Singapore.

Publisher Copyright:
© 2020 ACM.

Keywords

  • Configurable software
  • T-wise coverage
  • Weighted sampling

Fingerprint

Dive into the research topics of 'Baital: An adaptive weighted sampling approach for improved t-wise coverage'. Together they form a unique fingerprint.

Cite this