Test Case Understandability Model

Several automated test case generation techniques have been proposed to date, although the adoption of such techniques in the industry remains low. A key factor that has contributed to this low adoption rate is the difficulty experienced by the developer in terms of reading and understanding automat...

Full description

Bibliographic Details
Main Authors: Novi Setiani, Ridi Ferdiana, Rudy Hartanto
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9189803/
id doaj-5b0a4fb63ea942b49609ae79776b964c
record_format Article
spelling doaj-5b0a4fb63ea942b49609ae79776b964c2021-03-30T03:45:10ZengIEEEIEEE Access2169-35362020-01-01816903616904610.1109/ACCESS.2020.30228769189803Test Case Understandability ModelNovi Setiani0https://orcid.org/0000-0002-4953-7904Ridi Ferdiana1https://orcid.org/0000-0001-9961-5205Rudy Hartanto2https://orcid.org/0000-0003-1126-2340Department of Electrical and Information Engineering, Faculty of Engineering, Universitas Gadjah Mada, Yogyakarta, IndonesiaDepartment of Electrical and Information Engineering, Faculty of Engineering, Universitas Gadjah Mada, Yogyakarta, IndonesiaDepartment of Electrical and Information Engineering, Faculty of Engineering, Universitas Gadjah Mada, Yogyakarta, IndonesiaSeveral automated test case generation techniques have been proposed to date, although the adoption of such techniques in the industry remains low. A key factor that has contributed to this low adoption rate is the difficulty experienced by the developer in terms of reading and understanding automatically generated test cases. For this reason, it is essential to construct a test case understandability model for improving the generated test case. In the present paper, we extracted 20 test case metrics, six developer related metrics and two understandability proxies from a white-box test case classification experiment. Based on these metrics, we employed classification and regression algorithms to build test case understandability model. From the experiment, we can conclude that combined metrics always exhibit better discriminatory performance in classification models as well as a higher correlation in regression models when compared to a model that involved only test case metrics or developer metrics.https://ieeexplore.ieee.org/document/9189803/Test caseunderstandability modelautomated test case generation
collection DOAJ
language English
format Article
sources DOAJ
author Novi Setiani
Ridi Ferdiana
Rudy Hartanto
spellingShingle Novi Setiani
Ridi Ferdiana
Rudy Hartanto
Test Case Understandability Model
IEEE Access
Test case
understandability model
automated test case generation
author_facet Novi Setiani
Ridi Ferdiana
Rudy Hartanto
author_sort Novi Setiani
title Test Case Understandability Model
title_short Test Case Understandability Model
title_full Test Case Understandability Model
title_fullStr Test Case Understandability Model
title_full_unstemmed Test Case Understandability Model
title_sort test case understandability model
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description Several automated test case generation techniques have been proposed to date, although the adoption of such techniques in the industry remains low. A key factor that has contributed to this low adoption rate is the difficulty experienced by the developer in terms of reading and understanding automatically generated test cases. For this reason, it is essential to construct a test case understandability model for improving the generated test case. In the present paper, we extracted 20 test case metrics, six developer related metrics and two understandability proxies from a white-box test case classification experiment. Based on these metrics, we employed classification and regression algorithms to build test case understandability model. From the experiment, we can conclude that combined metrics always exhibit better discriminatory performance in classification models as well as a higher correlation in regression models when compared to a model that involved only test case metrics or developer metrics.
topic Test case
understandability model
automated test case generation
url https://ieeexplore.ieee.org/document/9189803/
work_keys_str_mv AT novisetiani testcaseunderstandabilitymodel
AT ridiferdiana testcaseunderstandabilitymodel
AT rudyhartanto testcaseunderstandabilitymodel
_version_ 1724182948611096576