심박변이도 기반 감정예측 인공신경망을 이용한 감정예측 추론과정 메커니즘에 관한 연구 = Emotion prediction neural network to understand how emotion is predicted by using heart rate variability measurements

다국어 초록 (Multilingual Abstract)

Correct prediction of emotion is essential for developing advanced health devices. For this purpose, neural network has been successfully used. However, interpretation of how a certain emotion is predicted through the emotion prediction neural network is very tough. When interpreting mechanism about how emotion is predicted by using the emotion prediction neural network can be developed, such mechanism can be effectively embedded into highly advanced health-care devices. In this sense, this study proposes a novel approach to interpreting how the emotion prediction neural network yields emotion. Our proposed mechanism is based on HRV (heart rate variability) measurements, which is based on calculating physiological data out of ECG (electrocardiogram) measurements. Experiment dataset with 23 qualified participants were used to obtain the seven HRV measurement such as Mean RR, SDNN, RMSSD, VLF, LF, HF, LF/HF. Then emotion prediction neural network was modelled by using the HRV dataset. By applying the proposed mechanism, a set of explicit mathematical functions could be derived, which are clearly and explicitly interpretable. The proposed mechanism was compared with conventional neural network to show validity.

목차 (Table of Contents)

• Abstract
• Ⅰ. Introduction
• Ⅱ. Theoretical background
• Ⅲ. Method
• Ⅳ. Result
• Ⅴ. Concluding Remarks
• Reference

참고문헌 (Reference)

1 강윤정, "멀티 모달 기반의 스마트 감성 주얼리" 한국정보통신학회 20 (20): 1317-1324, 2016

2 Y. L. Zheng, "Unobtrusive sensing and wearable devices for health informatics" 61 (61): 1538-1554, 2014

3 M. Phelan, "Towards a global definition of patient centred care" 322 : 322-444, 2001

4 R. Hecht-Nielsen, "Theory of the Back Propagation Neural Network" 593-605, 1989

5 D. E. Bloom, "The Global Economic Burden of Non-Communicable Diseases" 2011

6 P. S. Kim, "Technology and development trends related to human-friendly emotional robots" 33 (33): 19-27, 2016

7 J. M. Zurada, "Sensitivity analysis for minimization of input data dimension for feedforward neural network" 6 : 447-450, 1994

8 G. Valenza, "Revealing real-time emotional responses: a personalized assessment based on heartbeat dynamics" 4 (4): 1-13, 2014

9 C. N. Moridis, "Prediction of student’s mood during an online test using formula-based and neural network-based method" 53 (53): 644-652, 2009

10 F. A. Russo, "Predicting musically induced emotions from physiological inputs: Linear and neural network models" 4 (4): 2013

11 B. D. Ripley, "Pattern Recognition and Neural Networks" Cambridge University Press 1996

12 C. M. Tucker, "Patient-centered, culturally sensitive health care" 9 (9): 63-77, 2015

13 J. A. Sacristan, "Patient-centered medicine and patient-oriented research: improving health outcomes for individual patients" 13 (13): 6-13, 2013

14 M. Ozkaynak, "Patient-centered care requires a patientoriented workflow model" 20 (20): e14-e16, 2013

15 M. M. Monwar, "Pain recognition using artificial neural network. In Signal Processing and Information Technology" 28-33, 2006

16 P. De Wilde, "Neural network models: theory and projects" Springer Science & Business Media 2013

17 C. M. Bishop, "Neural Networks for Pattern Recognition" Clarendon Press 1995

18 S. Haykin, "Neural Network" Prentice Hall 1994

19 P. A. Kragel, "Multivariate pattern classification reveals autonomic and experiential representations of discrete emotions" 13 (13): 681-690, 2013

20 D. E. Rumelhart, "Learning Internal Representations by Error Propagation" 1 : 318-362, 1986

21 M. P. Tarvainen, "Kubios HRV-heart rate variability analysis software" 113 (113): 210-220, 2014

22 G. D. Garson, "Interpreting neural-network connection weights" 6 : 47-51, 1991

23 L. K. Milne, "Feature selection with neural networks with contribution measures" 1995

24 L. Ma, "Facial expression recognition using constructive feedforward neural networks" 34 (34): 1588-1595, 2004

25 M. Swangnetr, "Emotional state classification in patient-robot interaction using wavelet analysis and statistics-based feature selection" 43 (43): 63-75, 2013

26 B. Freshman, "Emotional intelligence: a core competency for health care administrators" 20 (20): 1-9, 2002

27 Y. F. Birks, "Emotional intelligence and patient-centred care" 100 (100): 368-374, 2007

28 A. Haag, "Emotion recognition using bio-sensors: First steps towards an automatic system" 36-48, 2004

29 Y. S. Seol, "Emotion recognition from text using knowledge-based ANN" 1569-1572, 2008

30 S. W. Byun, "Emotion Recognition Using Tone and Tempo Based on Voice for IoT" 65 (65): 116-121, 2016

31 I. H. Witten, "Data Mining: Practical machine learning tools and techniques" Morgan Kaufmann 2005

32 S. M. Yoon, "Current Status and Prospects of Life Appliance based Healthcare System" 31 (31): 31-37, 2014

33 M. A. Nicolaou, "Continuous prediction of spontaneous affect from multiple cues and modalities in valence-arousal space" 2 (2): 92-105, 2011

34 D. Kukolja, "Comparative analysis of emotion estimation methods based on physiological measurements for real-time applications" 72 (72): 717-727, 2014

35 J. Selvaraj, "Classification of emotional states from electrocardiogram signals: a non-linear approach based on hurst" 12 (12): 2013

36 K. R. Kim, "Analysis on the Status of Korean Major Firms Entering into HT Fusion New Business" 2014

37 F. Stahl, "An overview of use of neural networks for data mining tasks" 193-208, 2012

38 C. D. Katsis, "An integrated system based on physiological signals for the assessment of affective states in patients with anxiety disorders" 6 (6): 261-268, 2011

39 C. D. Katsis, "An integrated system based on physiological signals for the assessment of affective states in patients with anxiety disorders" 6 (6): 261-268, 2011

40 J. A. Anderson, "An Introduction to Neural Networks" MIT press 1995

41 J. Mervis, "Agencies rally to tackle big data" 336 (336): 22-22, 2012

42 A. J. Wearden, "A review of expressed emotion research in health care" 20 (20): 633-666, 2000

43 S. Mann, "A health-care model of emotional labour: an evaluation of the literature and development of a model" 19 (19): 304-317, 2005