데이터 주도 접근법을 활용한 소프트웨어 테스트 자동화 : 온라인 쇼핑몰 결제시스템 사례 = Software Test Automation Using Data-Driven Approach : A Case Study on the Payment System for Online Shopping

다국어 초록 (Multilingual Abstract)

This study examines a data-driven approach for software test automation at an online shopping site. Online shopping sites typically change prices dynamically, offer various discounts or coupons, and provide diverse delivery and payment options such as electronic fund transfer, credit cards, mobile payments (KakaoPay, NaverPay, SyrupPay, ApplePay, SamsungPay, etc.) and so on. As a result, they have to test numerous combinations of possible customer choices continuously and repetitively. The total number of test cases is almost 584 billion. This requires somehow automation of tests in settling payments.
However, the record playback approach has difficulties in maintaining automation scripts due to frequent changes and complicated component identification. In contrast, the data-driven approach minimizes changes in scripts and component identification. This study shows that the data-driven approach to test automation is more effective than the traditional record playback method. In 2014 before the test automation, the monthly average defects were 5.6 during the test and 12.5 during operation. In 2015 after the test automation, the monthly average defects were 9.4 during the test and 2.8 during operation. The comparison of live defects and detected errors during the test shows statistically significant differences before and after introducing the test automation using the data-driven approach.

참고문헌 (Reference)

1 조현, "인터넷 전자상거래 환경에서의 구전효과의 선행 요인에 관한 연구" 한국IT서비스학회 12 (12): 231-242, 2013

2 정우진, "변경 메서드 기반의 회귀 테스트 검증 범위 선택 및 검증 항목 우선순위 선정에 관한 연구" 한국IT서비스학회 14 (14): 129-142, 2015

3 김소담, "모바일 간편결제 서비스에 대한 사용자 수용저항 요인 : 카카오페이 사용자를 중심으로" 한국IT서비스학회 16 (16): 139-156, 2017

4 진정숙, "라이프스타일 유형에 따른 모바일 간편결제 서비스의 이용행태 연구" 한국IT서비스학회 16 (16): 119-138, 2017

5 Meszaros, G., "“Agile Regression Testing Using Record and Playback” In F. Maurer & D. Wells(Eds.), Extreme Programming and Agile Methods-XP/Agile Universe" Springer 2753 : 111-119, 2003

6 Bolt, W., "Transaction Pricing and the Adoption of Electronic Payments : A Cross-Country Comparison" 4 (4): 89-123, 2008

7 Gerrard, P., "Testing GUI Applications" 24-28, 1997

8 Patton, R., "Software Testing" Information publishing Group 2006

9 Damm, L.O., "Results from Introducing Component-level Test Automation and Test-Driven Development" 79 (79): 1001-1014, 2006

10 Lee, J.G., "Record-Playback based Automatic Test Case Generation for GUI Test" 34 (34): 96-100, 2007

11 Elbaum, S., "Prioritizing Test Cases for Regression Testing" 102-112, 2000

12 Kwon, W.I., "Practical Software Testings for the Developers" STA 2010

13 Do, H., "On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques" 32 (32): 733-752, 2006

14 Rothermel, G., "On Test Suite Composition and Cost-Effective Regression Testing" 13 (13): 277-331, 2004

15 Chae, H.S., "Model-based Test-Concepts and Issues" 32 (32): 59-71, 2014

16 Zech, P., "Model-based Regression Testing by OCL" 19 (19): 115-131, 2017

17 Polo, M., "Integrating Techniques and Tools for Testing Automation" 17 (17): 3-39, 2007

18 Hwang, Y., "Electronic Commerce and Online Consumer Behavior Research :A Literature Review" 32 (32): 377-388, 2016

19 w3ii.com, "Data Driven Testing"

20 Schwartz, A., "Cost-effective Regression Testing through Adaptive Test Prioritization Strategies" 115 : 61-81, 2016

21 Memon, A., "Automating Regression Testing for Evolving GUI Software" 17 (17): 27-64, 2005

22 Morris, S., "Automated GUI Testing"

23 Jeong, K.C., "An Efficient Regression Testing Using Testing Automation Tool for Industrial Automation Software" 245-249, 2008

24 Prototech Solutions, "9 Tips for selecting test cases for Regression Testing"

25 DMC Media, "2016 The Market Trends of Mobile Easy Payment Services" DMC 2016