Please use this identifier to cite or link to this item:
https://doi.org/10.21256/zhaw-18598| Publication type: | Article in scientific journal |
| Type of review: | Peer review (publication) |
| Title: | Testing with fewer resources : an adaptive approach to performance-aware test case generation |
| Authors: | Grano, Giovanni Laaber, Christoph Panichella, Annibale Panichella, Sebastiano |
| et. al: | No |
| DOI: | 10.1109/TSE.2019.2946773 10.21256/zhaw-18598 |
| Published in: | IEEE Transactions on Software Engineering |
| Issue Date: | 2019 |
| Publisher / Ed. Institution: | IEEE |
| ISSN: | 0098-5589 1939-3520 |
| Language: | English |
| Subject (DDC): | 005: Computer programming, programs and data |
| Abstract: | Automated test case generation is an effective technique to yield high-coverage test suites. While the majority of research effort has been devoted to satisfying coverage criteria, a recent trend emerged towards optimizing other non-coverage aspects. In this regard, runtime and memory usage are two essential dimensions: less expensive tests reduce the resource demands for the generation process and later regression testing phases. This study shows that performance-aware test case generation requires solving two main challenges: providing a good approximation of resource usage with minimal overhead and avoiding detrimental effects on both final coverage and fault detection effectiveness. To tackle these challenges, we conceived a set of performance proxies-inspired by previous work on performance testing- that provide a reasonable estimation of the test execution costs (i.e., runtime and memory usage). Thus, we propose an adaptive strategy, called aDynaMOSA, which leverages these proxies by extending DynaMOSA, a state-of-the-art evolutionary algorithm in unit testing. Our empirical study-involving 110 non-trivial Java classes- reveals that our adaptive approach generates test suite with statistically significant improvements in runtime (-25%) and heap memory consumption (-15%) compared to DynaMOSA. Additionally, aDynaMOSA has comparable results to DynaMOSA over seven different coverage criteria and similar fault detection effectiveness. Our empirical investigation also highlights that the usage of performance proxies (i.e., without the adaptiveness) is not sufficient to generate more performant test cases without compromising the overall coverage. |
| Further description: | © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
| URI: | https://digitalcollection.zhaw.ch/handle/11475/18598 |
| Fulltext version: | Accepted version |
| License (according to publishing contract): | Licence according to publishing contract |
| Departement: | School of Engineering |
| Organisational Unit: | Institute of Computer Science (InIT) |
| Appears in collections: | Publikationen School of Engineering |
Files in This Item:
| File | Description | Size | Format | |
|---|---|---|---|---|
| 2019_Grano-etal_Testing-with-fewer-resources.pdf | Accepted Version | 399.4 kB | Adobe PDF |  View/Open |
Show full item record
Grano, G., Laaber, C., Panichella, A., & Panichella, S. (2019). Testing with fewer resources : an adaptive approach to performance-aware test case generation. IEEE Transactions on Software Engineering. https://doi.org/10.1109/TSE.2019.2946773
Grano, G. et al. (2019) ‘Testing with fewer resources : an adaptive approach to performance-aware test case generation’, IEEE Transactions on Software Engineering [Preprint]. Available at: https://doi.org/10.1109/TSE.2019.2946773.
G. Grano, C. Laaber, A. Panichella, and S. Panichella, “Testing with fewer resources : an adaptive approach to performance-aware test case generation,” IEEE Transactions on Software Engineering, 2019, doi: 10.1109/TSE.2019.2946773.
GRANO, Giovanni, Christoph LAABER, Annibale PANICHELLA und Sebastiano PANICHELLA, 2019. Testing with fewer resources : an adaptive approach to performance-aware test case generation. IEEE Transactions on Software Engineering. 2019. DOI 10.1109/TSE.2019.2946773
Grano, Giovanni, Christoph Laaber, Annibale Panichella, and Sebastiano Panichella. 2019. “Testing with Fewer Resources : An Adaptive Approach to Performance-Aware Test Case Generation.” IEEE Transactions on Software Engineering. https://doi.org/10.1109/TSE.2019.2946773.
Grano, Giovanni, et al. “Testing with Fewer Resources : An Adaptive Approach to Performance-Aware Test Case Generation.” IEEE Transactions on Software Engineering, 2019, https://doi.org/10.1109/TSE.2019.2946773.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.