Fault Localization by Comparing Memory Updates between Unit and Integration Testing of Automotive Software in an Hardware-in-the-Loop Environment

During the inspection stage, an integration test is performed on electronic automobile parts that have passed a unit test. The faults found during this test are reported to the developer, who subsequently modifies the source code. If the tester provides the developer with memory usage information (s...

Full description

Bibliographic Details
Main Authors: Ki-Yong Choi, Jung-Won Lee
Format: Article
Language:English
Published: MDPI AG 2018-11-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/8/11/2260
id doaj-f3541296542a4f928cfb84bf9cbb2b24
record_format Article
spelling doaj-f3541296542a4f928cfb84bf9cbb2b242020-11-25T02:24:34ZengMDPI AGApplied Sciences2076-34172018-11-01811226010.3390/app8112260app8112260Fault Localization by Comparing Memory Updates between Unit and Integration Testing of Automotive Software in an Hardware-in-the-Loop EnvironmentKi-Yong Choi0Jung-Won Lee1Department of Electrical and Computer Engineering, Ajou University, Suwon 16499, KoreaDepartment of Electrical and Computer Engineering, Ajou University, Suwon 16499, KoreaDuring the inspection stage, an integration test is performed on electronic automobile parts that have passed a unit test. The faults found during this test are reported to the developer, who subsequently modifies the source code. If the tester provides the developer with memory usage information (such as functional symbol or interface signal), which works differently from normal operation in failed Hardware-in-the-Loop (HiL) testing (even when the tester has no source code), that information will be useful for debugging. In this paper, we propose a fault localization method for automotive software in an HiL environment by comparing the analysis results of updated memory between units and integration tests. Analyzing the memory usage of a normally operates unit test, makes it possible to obtain memory-updated information necessary for the operation of that particular function. By comparing this information to the memory usage when a fault occurs during an integration test, erroneously operated symbols and stored values are presented as potential root causes of the fault. We applied the proposed method to HiL testing for an OSEK/VDX-based electronic control unit (ECU). As a result of testing using fault injection, we confirmed that the fault causes can be found by checking the localized memory symbols with an average of 5.77%. In addition, when applying this methodology to a failure that occurred during a body control module (BCM) (which provides seat belt warnings) test, we could identify a suspicious symbol and find the cause of the test failure with only 8.54% of localized memory symbols.https://www.mdpi.com/2076-3417/8/11/2260electronic control unit (ECU)automotive softwarefault localizationHardware-in-the-Loop (HiL) testmemory update information
collection DOAJ
language English
format Article
sources DOAJ
author Ki-Yong Choi
Jung-Won Lee
spellingShingle Ki-Yong Choi
Jung-Won Lee
Fault Localization by Comparing Memory Updates between Unit and Integration Testing of Automotive Software in an Hardware-in-the-Loop Environment
Applied Sciences
electronic control unit (ECU)
automotive software
fault localization
Hardware-in-the-Loop (HiL) test
memory update information
author_facet Ki-Yong Choi
Jung-Won Lee
author_sort Ki-Yong Choi
title Fault Localization by Comparing Memory Updates between Unit and Integration Testing of Automotive Software in an Hardware-in-the-Loop Environment
title_short Fault Localization by Comparing Memory Updates between Unit and Integration Testing of Automotive Software in an Hardware-in-the-Loop Environment
title_full Fault Localization by Comparing Memory Updates between Unit and Integration Testing of Automotive Software in an Hardware-in-the-Loop Environment
title_fullStr Fault Localization by Comparing Memory Updates between Unit and Integration Testing of Automotive Software in an Hardware-in-the-Loop Environment
title_full_unstemmed Fault Localization by Comparing Memory Updates between Unit and Integration Testing of Automotive Software in an Hardware-in-the-Loop Environment
title_sort fault localization by comparing memory updates between unit and integration testing of automotive software in an hardware-in-the-loop environment
publisher MDPI AG
series Applied Sciences
issn 2076-3417
publishDate 2018-11-01
description During the inspection stage, an integration test is performed on electronic automobile parts that have passed a unit test. The faults found during this test are reported to the developer, who subsequently modifies the source code. If the tester provides the developer with memory usage information (such as functional symbol or interface signal), which works differently from normal operation in failed Hardware-in-the-Loop (HiL) testing (even when the tester has no source code), that information will be useful for debugging. In this paper, we propose a fault localization method for automotive software in an HiL environment by comparing the analysis results of updated memory between units and integration tests. Analyzing the memory usage of a normally operates unit test, makes it possible to obtain memory-updated information necessary for the operation of that particular function. By comparing this information to the memory usage when a fault occurs during an integration test, erroneously operated symbols and stored values are presented as potential root causes of the fault. We applied the proposed method to HiL testing for an OSEK/VDX-based electronic control unit (ECU). As a result of testing using fault injection, we confirmed that the fault causes can be found by checking the localized memory symbols with an average of 5.77%. In addition, when applying this methodology to a failure that occurred during a body control module (BCM) (which provides seat belt warnings) test, we could identify a suspicious symbol and find the cause of the test failure with only 8.54% of localized memory symbols.
topic electronic control unit (ECU)
automotive software
fault localization
Hardware-in-the-Loop (HiL) test
memory update information
url https://www.mdpi.com/2076-3417/8/11/2260
work_keys_str_mv AT kiyongchoi faultlocalizationbycomparingmemoryupdatesbetweenunitandintegrationtestingofautomotivesoftwareinanhardwareintheloopenvironment
AT jungwonlee faultlocalizationbycomparingmemoryupdatesbetweenunitandintegrationtestingofautomotivesoftwareinanhardwareintheloopenvironment
_version_ 1724854927207956480