Please use this identifier to cite or link to this item: https://doi.org/10.21256/zhaw-30115
Publication type: Conference paper
Type of review: Peer review (publication)
Title: SBFT tool competition 2024 : CPS-UAV test case generation track
Authors: Khatiri, Sajad
Saurabh, Prasun
Zimmermann, Timothy
Munasinghe, Charith
Birchler, Christian
Panichella, Sebastiano
et. al: No
DOI: 10.21256/zhaw-30115
Conference details: 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024
Issue Date: 2024
Publisher / Ed. Institution: ZHAW Zürcher Hochschule für Angewandte Wissenschaften
ISBN: 979-8-4007-0562-5
Language: English
Subjects: Tool competition; Software testing; Test case generation; Unmanned aerial vehicle; Search based software engineering
Subject (DDC): 005: Computer programming, programs and data
Abstract: While simulation-based testing is critical for ensuring the safety of autonomous Unmanned Aerial Vehicles (UAVs), it has not been adequately researched yet. The UAV Testing Competition organized by the Search-Based and Fuzz Testing (SBFT) workshop is an initiative designed to inspire and encourage the software testing Community to direct their attention toward UAVs as a rapidly emerging and crucial domain. It provides a simple software platform and case study to facilitate their onboarding in the UAV domain and help them develop their first test generation tools for UAVs. In this first edition of the competition, 7 tools were submitted, evaluated, and compared extensively against each other and the baseline approach. We evaluated their test generation performance for 6 different case studies using our novel benchmarking infrastructure. The generated test suites were scored and ranked based on the number and severity of the revealed faults, and the complexity, diversity, and execution time of the test cases. This paper describes the competition context, its platform, the competing tools, and the evaluation process and results.
URI: https://digitalcollection.zhaw.ch/handle/11475/30115
Related research data: https://github.com/skhatiri/UAV-Testing-Competition
Fulltext version: Accepted version
License (according to publishing contract): Licence according to publishing contract
Departement: School of Engineering
Organisational Unit: Institute of Computer Science (InIT)
Published as part of the ZHAW project: COSMOS – DevOps for Complex Cyber-physical Systems of Systems
Appears in collections:Publikationen School of Engineering

Files in This Item:
File Description SizeFormat 
2024_Khatiri-etal_SBST-tool-competition-reports-5.pdf158.88 kBAdobe PDFThumbnail
View/Open
Show full item record
Khatiri, S., Saurabh, P., Zimmermann, T., Munasinghe, C., Birchler, C., & Panichella, S. (2024). SBFT tool competition 2024 : CPS-UAV test case generation track. 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024. https://doi.org/10.21256/zhaw-30115
Khatiri, S. et al. (2024) ‘SBFT tool competition 2024 : CPS-UAV test case generation track’, in 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024. ZHAW Zürcher Hochschule für Angewandte Wissenschaften. Available at: https://doi.org/10.21256/zhaw-30115.
S. Khatiri, P. Saurabh, T. Zimmermann, C. Munasinghe, C. Birchler, and S. Panichella, “SBFT tool competition 2024 : CPS-UAV test case generation track,” in 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024, 2024. doi: 10.21256/zhaw-30115.
KHATIRI, Sajad, Prasun SAURABH, Timothy ZIMMERMANN, Charith MUNASINGHE, Christian BIRCHLER und Sebastiano PANICHELLA, 2024. SBFT tool competition 2024 : CPS-UAV test case generation track. In: 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024. Conference paper. ZHAW Zürcher Hochschule für Angewandte Wissenschaften. 2024. ISBN 979-8-4007-0562-5
Khatiri, Sajad, Prasun Saurabh, Timothy Zimmermann, Charith Munasinghe, Christian Birchler, and Sebastiano Panichella. 2024. “SBFT Tool Competition 2024 : CPS-UAV Test Case Generation Track.” Conference paper. In 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024. ZHAW Zürcher Hochschule für Angewandte Wissenschaften. https://doi.org/10.21256/zhaw-30115.
Khatiri, Sajad, et al. “SBFT Tool Competition 2024 : CPS-UAV Test Case Generation Track.” 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024, ZHAW Zürcher Hochschule für Angewandte Wissenschaften, 2024, https://doi.org/10.21256/zhaw-30115.


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.