Bitte benutzen Sie diese Kennung, um auf die Ressource zu verweisen: https://doi.org/10.21256/zhaw-30116
Publikationstyp: Konferenz: Paper
Art der Begutachtung: Peer review (Publikation)
Titel: SBFT tool competition 2024 : Python test case generation track
Autor/-in: Erni, Nicolas
Al-Ameen, Mohammed
Birchler, Christian
Derakhshanfar, Pouria
Lukasczyk, Stephan
et. al: No
DOI: 10.48550/arXiv.2401.15189
10.21256/zhaw-30116
Angaben zur Konferenz: 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024
Erscheinungsdatum: 2024
Verlag / Hrsg. Institution: ZHAW Zürcher Hochschule für Angewandte Wissenschaften
ISBN: 979-8-4007-0562-5
Sprache: Englisch
Schlagwörter: Tool competition; Software testing; Test case Generation; Python; Search based software engineering
Fachgebiet (DDC): 005: Computerprogrammierung, Programme und Daten
Zusammenfassung: Test case generation (TCG) for Python poses distinctive challenges due to the language’s dynamic nature and the absence of strict type information. Previous research has successfully explored automated unit TCG for Python, with solutions outperforming random test generation methods. Nevertheless, fundamental issues persist, hindering the practical adoption of existing test case generators. To address these challenges, we report on the organization, challenges, and results of the first edition of the Python Testing Competition. Four tools, namely UTBotPython, Klara, Hypothesis Ghostwriter, and Pynguin were executed on a benchmark set consisting of 35 Python source files sampled from 7 open-source Python projects for a time budget of 400 seconds. We considered one configuration of each tool for each test subject and evaluated the tools’ effectiveness in terms of code and mutation coverage. This paper describes our methodology, the analysis of the results together with the competing tools, and the challenges faced while running the competition experiments.
URI: https://digitalcollection.zhaw.ch/handle/11475/30116
Zugehörige Forschungsdaten: https://zenodo.org/records/10559329
Volltext Version: Akzeptierte Version
Lizenz (gemäss Verlagsvertrag): CC BY 4.0: Namensnennung 4.0 International
Departement: School of Engineering
Organisationseinheit: Institut für Informatik (InIT)
Publiziert im Rahmen des ZHAW-Projekts: COSMOS – DevOps for Complex Cyber-physical Systems of Systems
Enthalten in den Sammlungen:Publikationen School of Engineering

Dateien zu dieser Ressource:
Datei Beschreibung GrößeFormat 
2024_Erni-etal_SBFT-tool-competition-python-TCG.pdfAccepted Version127.71 kBAdobe PDFMiniaturbild
Öffnen/Anzeigen
Zur Langanzeige
Erni, N., Al-Ameen, M., Birchler, C., Derakhshanfar, P., & Lukasczyk, S. (2024). SBFT tool competition 2024 : Python test case generation track. 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024. https://doi.org/10.48550/arXiv.2401.15189
Erni, N. et al. (2024) ‘SBFT tool competition 2024 : Python test case generation track’, in 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024. ZHAW Zürcher Hochschule für Angewandte Wissenschaften. Available at: https://doi.org/10.48550/arXiv.2401.15189.
N. Erni, M. Al-Ameen, C. Birchler, P. Derakhshanfar, and S. Lukasczyk, “SBFT tool competition 2024 : Python test case generation track,” in 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024, 2024. doi: 10.48550/arXiv.2401.15189.
ERNI, Nicolas, Mohammed AL-AMEEN, Christian BIRCHLER, Pouria DERAKHSHANFAR und Stephan LUKASCZYK, 2024. SBFT tool competition 2024 : Python test case generation track. In: 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024. Conference paper. ZHAW Zürcher Hochschule für Angewandte Wissenschaften. 2024. ISBN 979-8-4007-0562-5
Erni, Nicolas, Mohammed Al-Ameen, Christian Birchler, Pouria Derakhshanfar, and Stephan Lukasczyk. 2024. “SBFT Tool Competition 2024 : Python Test Case Generation Track.” Conference paper. In 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024. ZHAW Zürcher Hochschule für Angewandte Wissenschaften. https://doi.org/10.48550/arXiv.2401.15189.
Erni, Nicolas, et al. “SBFT Tool Competition 2024 : Python Test Case Generation Track.” 17th International Workshop on Search-Based and Fuzz Testing (SBFT), Lisbon, Portugal, 14-20 April 2024, ZHAW Zürcher Hochschule für Angewandte Wissenschaften, 2024, https://doi.org/10.48550/arXiv.2401.15189.


Alle Ressourcen in diesem Repository sind urheberrechtlich geschützt, soweit nicht anderweitig angezeigt.