Test-Case Prioritization Using Adaptive Approach

Sarabjit Kaur,Bhanu Priya 보안공학연구지원센터 2016 International Journal of Hybrid Information Techno Vol.9 No.5

Test-case prioritization provides the way to organize the order of test cases according to the priority. There are many approaches which are used for test case prioritization. Adaptive approach can be used for test case prioritization. At the execution time adaptive approach gives the all information regarding to current execution or previous execution of program. The adaptive approach evaluating the effectiveness of the test cases. This also provides the information regarding to errors. The adaptive approach arrange the priority of each test cases in decreasing order. We have conducted results which are based upon java programs. We are generating 100 test cases based upon java language. In, this paper we are using APSC metric which describe the statement coverage of test cases. The adaptive approach select the test case then execute it, after execution the priority of the test case will be calculated. This paper also gives the information of statement coverage as well as gives information regarding to those statement which are not covered or unselected. The error rate of test case execution will be also described using adaptive approach. As well as we can say that this paper presents the detail study regarding to APSC metric with the help of adaptive approach.

Performance Enhancement in Hill-Climbing Approach for Test Case Prioritization using Functional Dependency Technique

Sarabjit Kaur,Saloni Ghai 보안공학연구지원센터 2016 International Journal of Software Engineering and Vol.10 No.11

Test case prioritization is basically the process of prioritizing the execution order of test cases in order to increase the fault detection rate. If fault detection rate is being gradually improved during regression testing then it will provide faster feedback to system developers which ultimately deliver the software earlier. Many of the existing test case prioritization techniques illustrated that test cases can be executed in any order but the concept of functional dependency plays an important role between test cases. In this paper we have described about testing, its types, test case prioritization and its techniques. Regression testing is normally being used to retest the component of a system that verifies that defects are removed or not from the effected part of the software after modifications. This paper enhances the hill climbing approach for test case prioritization by using functional dependency technique. This prioritization approach schedules test cases based upon functional dependency technique .Our approach is quiet efficient as compare to any other technique. Regression testing is quite popular as it helps to make the system error free after modifications.

A Hybrid Approach of Clustering and Time-Aware Based Novel Test Case Prioritization Technique

Geetanjali Chaurasia,Sonali Agarwal 보안공학연구지원센터 2016 International Journal of Database Theory and Appli Vol.9 No.4

Regression testing is an activity during the maintenance phase to validate the changes made to the software and to ensure that these changes would not affect the previously verified code or functionality. Often, regression testing is performed with limited computing resources and time budget. So, fully comprehensive testing is not possible at this stage. Test-case prioritization techniques are applied to ensure the execution of test cases in some prioritized order and to achieve some specific goals in minimum possible time like, increasing the rate of fault detection, detecting the most critical faults as early as possible etc. The main objective of this paper is to achieve higher value of average percentage of faults detected, execute the higher priority test cases before lower priority test cases and also we target to decrease the execution time for achieving the maximum value of average percentage of faults detected. We proposed a new prioritization technique that uses a clustering approach and also considers various factors like, execution time of every test case, code coverage metric, fault detection ratio, test case failure rate and code complexity metric to reorder the execution of test cases. The results of this research work will show the importance of clustering technique and various factors taken into consideration, for achieving effective prioritization of test cases. The results of implementation will subsequently show that the proposed approach is more effective than the existing coverage and clustering based prioritization techniques. From the experimental results, we found that our proposed approach achieved higher value of average percentage of faults detected than other clustering based and coverage based techniques. Also, this approach reduces the execution time taken by the prioritized test cases.

Improving Test Efficiency through Prioritization Based On Testing Dependency

Na Zhang,Yangqiu Liu,Xiaoan Bao,Xiaoming Xie,Zhongtao Ren,Hui Lin 보안공학연구지원센터 2015 International Journal of u- and e- Service, Scienc Vol.8 No.6

During the various iterations of software development, test case prioritization generally schedules test cases in order to increase test efficiency as soon as possible without reducing the scale of the test. It is noted that currently, many prioritization techniques are usually based on the assumption that the test cases are independent so as to reduce testing effort. However in the actual test, the dependencies and relations exist between the test cases. In this paper, we propose a new type of prioritization technique based on the relationship of dependencies between test cases. We gather the dependency information of a test suite and then put forward a weighted depth-first search algorithm to determine the most effective order. To assess our approach, an academic feasibility study and three industrial experiments are conducted. Evaluation results indicate that our proposed method can be used to improve the fault detection effectiveness when compared with random ordering and some existed prioritization techniques which are based on function coverage.

A Dissimilarity with Dice-Jaro-Winkler Test Case Prioritization Approach for Model-Based Testing in Software Product Line

( R. Aduni Sulaiman ),( Dayang N. A. Jawawi ),( Shahliza Abdul Halim ) 한국인터넷정보학회 2021 KSII Transactions on Internet and Information Syst Vol.15 No.3

The effectiveness of testing in Model-based Testing (MBT) for Software Product Line (SPL) can be achieved by considering fault detection in test case. The lack of fault consideration caused test case in test suite to be listed randomly. Test Case Prioritization (TCP) is one of regression techniques that is adaptively capable to detect faults as early as possible by reordering test cases based on fault detection rate. However, there is a lack of studies that measured faults in MBT for SPL. This paper proposes a Test Case Prioritization (TCP) approach based on dissimilarity and string based distance called Last Minimal for Local Maximal Distance (LM-LMD) with Dice-Jaro-Winkler Dissimilarity. LM-LMD with Dice-Jaro-Winkler Dissimilarity adopts Local Maximum Distance as the prioritization algorithm and Dice-Jaro-Winkler similarity measure to evaluate distance among test cases. This work is based on the test case generated from statechart in Software Product Line (SPL) domain context. Our results are promising as LM-LMD with Dice-Jaro-Winkler Dissimilarity outperformed the original Local Maximum Distance, Global Maximum Distance and Enhanced All-yes Configuration algorithm in terms of Average Fault Detection Rate (APFD) and average prioritization time.

A Comprehensive Review on Regression Test Case Prioritization Techniques for Web Services

( Muhammad Hasnain ),( Imran Ghani ),( Muhammad Fermi Pasha ),( Chern Hong Lim ),( Seung Ryul Jeong ) 한국인터넷정보학회 2020 KSII Transactions on Internet and Information Syst Vol.14 No.5

Test Case Prioritization (TCP) involves the rearrangement of test cases on a prioritized basis for various services. This research work focuses on TCP in web services, as it has been a growing challenge for researchers. Web services continuously evolve and hence require reforming and re-execution of test cases to ensure the accurate working of web services. This study aims to investigate gaps, issues, and existing solutions related to test case prioritization. This study examines research publications within popular selected databases. We perform a meticulous screening of research publications and selected 65 papers through which to answer the proposed research questions. The results show that criteria-based test case prioritization techniques are reported mainly in 41 primary studies. Test case prioritization models, frameworks, and related algorithms are also reported in primary studies. In addition, there are eight issues related to TCP techniques. Among these eight issues, optimization and high effectiveness are most discussed within primary studies. This systematic review has identified that a significant proportion of primary studies are not involved in the use of statistical methods in measuring or comparing the effectiveness of TCP techniques. However, a large number of primary studies use ‘Average Percentage of Faults Detected’ (APFD) or extended APFD metrics to compute the performance of techniques for web services.

가치기반 접근법을 통한 테스트 케이스 우선순위기법

박현철(Hyuncheol Park),류호연(Hoyeon Ryu),백종문(Jongmoon Baik) 한국정보과학회 2009 정보과학회논문지 : 소프트웨어 및 응용 Vol.36 No.5

한번 개발된 소프트웨어는 긴 수명을 가지며, 결함이나 사용자 요구사항의 변경, 환경의 변화 등의 원인으로 인한 수많은 모듈의 수정을 통해 진화한다. 소프트웨어의 진화와 더불어, 이러한 많은 모듈의 추가와 수정에 의한 소프트웨어의 다양한 버전의 생성은 소프트웨어 품질 향상을 가로막는 주요 요인중의 하나이다. 한편 회귀테스트는 이러한 소프트웨어의 변경에 따른 초점을 둔 테스트이지만, 소프트웨어가 여러 버전을 거쳐 진화함에 따라 많은 수의 테스트 케이스의 추가 및 수정과 더불어 테스트 케이스의 전체 숫자가 급격히 증가함에 따라 비용이 많이 들기에 쉽게 수행하지 못하는 테스트이다. 이에 테스트케이스 우선순위화 기법이 등장하여 회귀테스트의 수행을 지원하였다. 그러나, 테스트 케이스 우선순위화기법에서 사용되는 우선순위의 기준이 가치중립적이거나 가치를 고려하더라도 특정한 단일 요인만을 고려하여 그 활용이 제한적이었다. 논문에서, 우리는 비용과 결함 심각도에 기반한 히스토리컬 가치 기반의 접근법을 제시하며, 이는 기존의 비용 인식 테스트 케이스 우선순위화 기법에서의 현재의 비용 및 결함 심각도를 예측하기 위하여 히스토리컬 정보를 사용하는 접근법이다. 본 논문의 공헌으로서, 제안된 접근법은 테스트의 이해관계자들이 어떻게 히스토리컬 가치가 가치의 관점에서 테스트 효과성의 향상을 위해 사용되고 있는가를 알 수 있도록 돕는다는데 있다. 결과적으로, 회귀 테스트를 수행하는 소프트웨어 테스터들은 그들의 테스트 케이스를 보다 더 효과적으로 우선순위화할 수 있기에 그들의 테스트를 통한 테스트 효과성은 향상될 수 있다. Software, once developed, has a long life and evolves through numerous additions and modifications because of the faults, the changes in user requirements, the changes in environments, and so forth. With the evolution of the software, assuring the quality of the software is getting more difficult because of numerous versions of the software. Meanwhile, regression testing has been used to support the software testing activities and assure acquiring appropriate quality through several versions of software. Regression testing, however, is too expensive because it requires lots of test cases executions and the number of test cases increases sharply as the software evolves. For this reason, several techniques are suggested to help conducting regression testing then test case prioritization technique is understood the most effective and efficient technique to support regression testing. In this paper, we propose an approach, Historical Value-Based Approach, which is based on the use of historical information to estimate the current cost and fault severity for cost-cognizant test case prioritization. As a result of the proposed approach, software testers who perform regression testing prioritize their test cases more effectively so that the test effectiveness of them can be improved in terms of APFDc.

Investigating the Regression Analysis Results for Classification in Test Case Prioritization: A Replicated Study

Muhammad Hasnain,Imran Ghani,Muhammad Fermi Pasha,Ishrat Hayat Malik,Shahzad Malik 한국인터넷방송통신학회 2019 International Journal of Internet, Broadcasting an Vol.11 No.2

Research classification of software modules was done to validate the approaches proposed for addressing limitations in existing classification approaches. The objective of this study was to replicate the experiments of a recently published research study and re-evaluate its results. The reason to repeat the experiment(s) and re-evaluate the results was to verify the approach to identify the faulty and non-faulty modules applied in the original study for the prioritization of test cases. As a methodology, weconducted this study to re-evaluate the results of the study. The results showed that binary logistic regression analysis remains helpful for researchers for predictions, as it provides an overall prediction of accuracy in percentage. Our study shows a prediction accuracy of 92.9% for the PureMVC Java open source program, while the original study showed an 82% prediction accuracy for the same Java program classes. It is believed by the authors that future research can refine the criteria used to classify classes of web systemswritten in various programming languages based on the results of this study.

A Review on Prioritization Techniques in Regression Testing

Mohammad Rava,Wan M.N. Wan-Kadir 보안공학연구지원센터(IJSEIA) 2016 International Journal of Software Engineering and Vol.10 No.1

Due to dynamic changing business and operating environment, software evolution is inevitable. As software evolves, there is a need for a retest of the system in order to ensure its validity and thus regression testing assures that this happens. Regression Testing has several research categories, one of the most popular areas is Test Case Prioritization which orders test cases based on a particular criteria to be tested in accordance to available resources, and thus ensuring that the most critical test cases are tested first. In this study we examine the different types of test case prioritization and a description of the techniques presented alongside the issue raised in each study. This will give an insight into the main problems currently plaguing test case prioritization and thus pave way for further research areas to tap into.

변경 메서드 기반의 회귀 테스트 검증 범위 선택 및 검증 항목 우선순위 선정에 관한 연구

정우진(Woo Jin Jung),나상린(Sang Rin Rah),최용락(Yong Lak Choi) 한국IT서비스학회 2015 한국IT서비스학회지 Vol.14 No.2

The purpose of this study is to suggest an effective regression testing method in order to minimize the scope of test resulting from the modification of software and to prevent mismatch of test case and test objects. As a way to improve the efficiency of regression testing which uses a change-centric testing technique, the method flow is analyzed and grasped through a static analysis based on source code in order to identify modified parts. After the order of priority is set according to the results of user action log-based dynamic analysis on identified regression testing objects, test effect can be raised by adjusting the order of priority using code complexity. Quality assurance coverage can be checked using the user action log suggested in this study, and the progress of test and whether or not each function has been verified can be checked, too. In addition, by minimizing test parts and adjusting the order of test, costs and time can be saved, making it possible to conduct regression testing effectively.