An adaptation of an evaluation framework for software testing techniques and tools

Abstract

Software testing is essential for ensuring the quality and reliability of software systems. To make informed decisions about testing techniques, there is a need for suitable evaluation frameworks. How- ever, existing evaluation frameworks may not be applicable in limited scenarios, where conducting a case study and fault injection are not possible. The primary objective of this research is to adapt an existing evaluation framework to enable the evaluation of software testing techniques experimentally. The focus is on redesigning this evaluation framework, which proposes clear metrics to evaluate the effectiveness and efficiency of software testing paradigms and validate the adapted framework to assess its applicability. To validate the framework, a quasi-experiment was conducted, comparing GUI testing paradigms by applying the adapted evaluation framework. Due to limitations in sample size, the quasi-experiment does not provide statistical evidence but offers valuable insights and initial validation of the framework. While statistical significance is not achieved, the findings contribute to understanding the strengths and weaknesses of the redesigned treatment. Further research with larger samples and statistical analysis is recommended to strengthen the validity and generalizability of the findings.