TY - GEN
T1 - Automated WAIT for cloud-based application testing
AU - Portillo-Dominguez, A. Omar
AU - Wang, Miao
AU - Murphy, John
AU - Magoni, Damien
PY - 2014
Y1 - 2014
N2 - Cloud computing is causing a paradigm shift in the provision and use of software. This has changed the way of obtaining, managing and delivering computing services and solutions. Similarly, it has brought new challenges to software testing. A particular area of concern is the performance of cloud-based applications. This is because the increased complexity of the applications has exposed new areas of potential failure points, complicating all performance-related activities. This situation makes the performance testing of cloud environments very challenging. Similarly, the identification of performance issues and the diagnosis of their root causes are time-consuming and complex, usually require multiple tools and heavily rely on expertise. To simplify these tasks, hence increasing the productivity and reducing the dependency on human experts, this paper presents a lightweight approach to automate the usage of expert tools in the performance testing of cloud-based applications. In this paper, we use a tool named Whole-system Analysis of Idle Time to demonstrate how our research work solves this problem. The validation involved two experiments, which assessed the overhead of the approach and the time savings that it can bring to the analysis of performance issues. The results proved the benefits of the approach by achieving a significant decrease in the time invested in performance analysis while introducing a low overhead in the tested system.
AB - Cloud computing is causing a paradigm shift in the provision and use of software. This has changed the way of obtaining, managing and delivering computing services and solutions. Similarly, it has brought new challenges to software testing. A particular area of concern is the performance of cloud-based applications. This is because the increased complexity of the applications has exposed new areas of potential failure points, complicating all performance-related activities. This situation makes the performance testing of cloud environments very challenging. Similarly, the identification of performance issues and the diagnosis of their root causes are time-consuming and complex, usually require multiple tools and heavily rely on expertise. To simplify these tasks, hence increasing the productivity and reducing the dependency on human experts, this paper presents a lightweight approach to automate the usage of expert tools in the performance testing of cloud-based applications. In this paper, we use a tool named Whole-system Analysis of Idle Time to demonstrate how our research work solves this problem. The validation involved two experiments, which assessed the overhead of the approach and the time savings that it can bring to the analysis of performance issues. The results proved the benefits of the approach by achieving a significant decrease in the time invested in performance analysis while introducing a low overhead in the tested system.
KW - Automation
KW - Cloud Computing
KW - Expert Tools
KW - Performance Analysis
KW - Performance Testing
UR - https://www.scopus.com/pages/publications/84903648469
U2 - 10.1109/ICSTW.2014.46
DO - 10.1109/ICSTW.2014.46
M3 - Conference contribution
AN - SCOPUS:84903648469
SN - 9780769551944
T3 - Proceedings - IEEE 7th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2014
SP - 370
EP - 375
BT - Proceedings - IEEE 7th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2014
PB - IEEE Computer Society
T2 - 7th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2014
Y2 - 31 March 2014 through 4 April 2014
ER -