Please use this identifier to cite or link to this item:
https://doi.org/10.21256/zhaw-23364| Publication type: | Conference paper |
| Type of review: | Peer review (publication) |
| Title: | SBST tool competition 2021 |
| Authors: | Panichella, Sebastiano Gambi, Alessio Zampetti, Fiorella Riccio, Vincenzo |
| et. al: | No |
| DOI: | 10.1109/SBST52555.2021.00011 10.21256/zhaw-23364 |
| Proceedings: | 2021 IEEE/ACM 14th International Workshop on Search-Based Software Testing (SBST) |
| Page(s): | 20 |
| Pages to: | 27 |
| Conference details: | 14th International Workshop on Search-Based Software Testing (SBST), Madrid, Spain, 31 May 2021 |
| Issue Date: | 2021 |
| Publisher / Ed. Institution: | IEEE |
| ISBN: | 978-1-6654-4571-9 |
| Language: | English |
| Subject (DDC): | 005: Computer programming, programs and data |
| Abstract: | We report on the organization, challenges, and results of the ninth edition of the Java Unit Testing Competition as well as the first edition of the Cyber-Physical Systems Testing Tool Competition. Java Unit Testing Competition. This year, five tools, Randoop, UtBot, Kex, Evosuite, and EvosuiteDSE, were executed on a benchmark with (i) new classes under test, selected from three open-source software projects, and (ii) the set of classes from three projects considered in the eighth edition. We relied on an improved Docker infrastructure to execute the tools and the subsequent coverage and mutation analysis. Given the high number of participants, we considered only two time budgets for test case generation: thirty seconds and two minutes. Cyber-Physical Systems Testing Tool Competition. Five tools, Deeper, Frenetic, GABExplore, GABExploit, and Swat, competed on testing self-driving car software by generating simulationbased tests using our new testing infrastructure. We considered two experimental settings to study test generators’ transitory and asymptotic behaviors and evaluated the tools’ test generation effectiveness and the exposed failures’ diversity. This paper describes our methodology, the statistical analysis of the results together with the contestant tools, and the challenges faced while running the competition experiments. |
| Further description: | © 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
| URI: | https://digitalcollection.zhaw.ch/handle/11475/23364 |
| Fulltext version: | Accepted version |
| License (according to publishing contract): | Licence according to publishing contract |
| Departement: | School of Engineering |
| Organisational Unit: | Institute of Computer Science (InIT) |
| Published as part of the ZHAW project: | COSMOS – DevOps for Complex Cyber-physical Systems of Systems |
| Appears in collections: | Publikationen School of Engineering |
Files in This Item:
| File | Description | Size | Format | |
|---|---|---|---|---|
| 2021_Panichella-etal_JUnit-tool-competition_SBST.pdf | Accepted Version | 384.89 kB | Adobe PDF |  View/Open |
Show full item record
Panichella, S., Gambi, A., Zampetti, F., & Riccio, V. (2021). SBST tool competition 2021 [Conference paper]. 2021 IEEE/ACM 14th International Workshop on Search-Based Software Testing (SBST), 20–27. https://doi.org/10.1109/SBST52555.2021.00011
Panichella, S. et al. (2021) ‘SBST tool competition 2021’, in 2021 IEEE/ACM 14th International Workshop on Search-Based Software Testing (SBST). IEEE, pp. 20–27. Available at: https://doi.org/10.1109/SBST52555.2021.00011.
S. Panichella, A. Gambi, F. Zampetti, and V. Riccio, “SBST tool competition 2021,” in 2021 IEEE/ACM 14th International Workshop on Search-Based Software Testing (SBST), 2021, pp. 20–27. doi: 10.1109/SBST52555.2021.00011.
PANICHELLA, Sebastiano, Alessio GAMBI, Fiorella ZAMPETTI und Vincenzo RICCIO, 2021. SBST tool competition 2021. In: 2021 IEEE/ACM 14th International Workshop on Search-Based Software Testing (SBST). Conference paper. IEEE. 2021. S. 20–27. ISBN 978-1-6654-4571-9
Panichella, Sebastiano, Alessio Gambi, Fiorella Zampetti, and Vincenzo Riccio. 2021. “SBST Tool Competition 2021.” Conference paper. In 2021 IEEE/ACM 14th International Workshop on Search-Based Software Testing (SBST), 20–27. IEEE. https://doi.org/10.1109/SBST52555.2021.00011.
Panichella, Sebastiano, et al. “SBST Tool Competition 2021.” 2021 IEEE/ACM 14th International Workshop on Search-Based Software Testing (SBST), IEEE, 2021, pp. 20–27, https://doi.org/10.1109/SBST52555.2021.00011.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.