Abstract
EvoCrash is a recent search-based approach to generate a test case that reproduces reported crashes. The search is guided by a fitness function that uses a weighted sum scalarization to combine three different heuristics: (i) code coverage, (ii) crash coverage and (iii) stack trace similarity. In this study, we propose and investigate two alternatives to the weighted sum scalarization: (i) the simple sum scalarization and (ii) the multi-objectivization, which decomposes the fitness function into several optimization objectives as an attempt to increase test case diversity. We implemented the three alternative optimizations as an extension of EvoSuite, a popular search-based unit test generator, and applied them on 33 real-world crashes. Our results indicate that for complex crashes the weighted sum reduces the test case generation time, compared to the simple sum, while for simpler crashes the effect is the opposite. Similarly, for complex crashes, multi-objectivization reduces test generation time compared to optimizing with the weighted sum; we also observe one crash that can be replicated only by multi-objectivization. Through our manual analysis, we found out that when optimizing the original weighted function gets trapped in local optima, optimization for decomposed objectives improves the search for crash reproduction. Generally, while multi-objectivization is under-explored, our results are promising and encourage further investigations of the approach.
Original language | English |
---|---|
Title of host publication | Search-Baed Software Engineering - 10th International Symposium, SSBSE 2018 - Proceedings |
Editors | Thelma Elita Colanzi, Phil McMinn |
Place of Publication | Cham |
Publisher | Springer |
Pages | 325-340 |
Number of pages | 16 |
ISBN (Electronic) | 978-3-319-99241-9 |
ISBN (Print) | 78-3-319-99240-2 |
DOIs | |
Publication status | Published - 2018 |
Event | SSBSE 2018: 10th International Symposium on Search-Based Software Engineering - Montpellier, France Duration: 8 Sept 2018 → 10 Sept 2018 Conference number: 10 http://ssbse18.irisa.fr/ |
Publication series
Name | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
---|---|
Volume | 11036 LNCS |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Conference
Conference | SSBSE 2018 |
---|---|
Abbreviated title | SSBSE |
Country/Territory | France |
City | Montpellier |
Period | 8/09/18 → 10/09/18 |
Internet address |
Bibliographical note
Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-careOtherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.