Deep Structured Learning: Architectures and Applications

이수욱 국제문화기술진흥원 2018 International Journal of Advanced Culture Technolo Vol.6 No.4

Deep learning, a sub-field of machine learning changing the prospects of artificial intelligence (AI) because of its recent advancements and application in various field. Deep learning deals with algorithms inspired by the structure and function of the brain called artificial neural networks. This works reviews basic architecture and recent advancement of deep structured learning. It also describes contemporary applications of deep structured learning and its advantages over the treditional learning in artificial interlligence. This study is useful for the general readers and students who are in the early stage of deep learning studies.

Identifying depression in the National Health and Nutrition Examination Survey data using a deep learning algorithm

Oh, Jihoon,Yun, Kyongsik,Maoz, Uri,Kim, Tae-Suk,Chae, Jeong-Ho Elsevier 2019 Journal of affective disorders Vol.257 No.-

<P><B>Abstract</B></P> <P><B>Background</B></P> <P>As depression is the leading cause of disability worldwide, large-scale surveys have been conducted to establish the occurrence and risk factors of depression. However, accurately estimating epidemiological factors leading up to depression has remained challenging. Deep-learning algorithms can be applied to assess the factors leading up to prevalence and clinical manifestations of depression.</P> <P><B>Methods</B></P> <P>Customized deep-neural-network and machine-learning classifiers were assessed using survey data from 19,725 participants from the NHANES database (from 1999 through 2014) and 4949 from the South Korea NHANES (K-NHANES) database in 2014.</P> <P><B>Results</B></P> <P>A deep-learning algorithm showed area under the receiver operating characteristic curve (AUCs) of 0.91 and 0.89 for detecting depression in NHANES and K-NHANES, respectively. The deep-learning algorithm trained with serial datasets (NHANES, from 1999 to 2012), predicted the prevalence of depression in the following two years of data (NHANES, 2013 and 2014) with an AUC of 0.92. Machine learning classifiers trained with NHANES could further predict depression in K-NHANES. There, logistic regression had the highest performance (AUC, 0.77) followed by deep learning algorithm (AUC, 0.74).</P> <P><B>Conclusions</B></P> <P>Deep neural-networks managed to identify depression well from other health and demographic factors in both the NHANES and K-NHANES datasets. The deep-learning algorithm was also able to predict depression relatively well on new data set—cross temporally and cross nationally. Further research can delineate the clinical implications of machine learning and deep learning in detecting disease prevalence and progress as well as other risk factors for depression and other mental illnesses.</P> <P><B>Highlights</B></P> <P> <UL> <LI> Estimating epidemiological contributors to depression and predicting the prevalence of depression are still challenging. </LI> <LI> We aimed to estimate factors affecting depression in National Health and Nutrition Examination Survey (NHANES) datasets using deep learning and machine learning algorithms. </LI> <LI> Deep-learning achieved a high performance for identifying depression on the NHANES datasets of both the United States and South Korea. </LI> <LI> Trained deep-learning and machine learning algorithms are useful for estimating the prevalence of depression. </LI> </UL> </P>

딥러닝 관련 발명의 특허법상 보호 방안에 대한 연구

전용철(Jun, Yong-Cheul) 동아대학교 법학연구소 2020 東亞法學 Vol.- No.86

딥러닝 기술은 컴퓨터가 사물 등을 구분하기 위한 개념을 가지기 위해 ‘학습’을 수행하며, ‘학습’을 수행하기 위한 학습 모델이 가지는 구조가 깊은 것을 특징으로 한다. 딥러닝 기술은 인간이 개념을 받아들이기 위한 신경적 구조와 활동을 컴퓨터 기술에 접목한 신경망 기술을 기반으로 한다. 최근 그래픽 카드 등 하드웨어의 연산처리 능력이 높아지고 신경망 기술의 이론적 뒷받침이 이루어지면서 딥러닝 기술의 성과가 두드러지게 나타나게 되었다. 본 논문에서는 딥러닝 기술이 가지는 특성을 파악하기 위해 딥러닝 기술에 관한 변천과 주요 딥러닝 기술에 대한 내용 및 이와 관련된 특허권들의 청구범위를 살펴보았다. 또한, 본 논문에서는 딥러닝 기술이 가지는 특성을 감안하여 딥러닝 모델 구조가 변경된 경우와 기존 딥러닝 모델이 특유 목적에 맞게 접목된 경우로 구분하여 딥러닝 관련 발명의 특허 등록 가능성 확보 방안을 검토하였으며, 특허 등록 후 침해 주장 시 입증 용이성을 확보하기 위한 실무적 방안에 대해 검토하였다. 딥러닝 기술과 관련한 발명의 경우 발명의 성립성과 진보성 요건 등 특허성 요건을 판단함에 있어서 컴퓨터 관련 발명의 일종으로 취급될 수 있다. 최근 컴퓨터 관련 발명의 특허 적격성 판단과 관련하여 미국에서의 Alice 판결 등 주요 판례가 주목받고 있고 이에 따라 미국과 우리나라에서의 심사기준에도 변동이 있어 본 논문에서는 컴퓨터 관련 발명의 특허 적격성 판단에 대한 미국 판례의 변천을 살펴본 후 우리나라의 특허법 규정 및 2019년 3월 개정된 특허청의 특허․실용신안 심사기준을 검토하였다. Deep learning is a technology to perform “learning” so that computers can adopt concepts to distinguish objects and the like. Deep-learning technology is characterized in that the structures of learning models for performing “learning” are “deep”. Deep-learning technology is based on neural-network technology in which neural structures and activities that enable human beings to accommodate concepts are grafted onto the computer technology. Recently, neural network technology has been underpinned by theory owning to the increased operational processing capacity of hardware units such as graphics cards, and remarkable performance of deep-learning technology has been exhibited. In order to understand the properties of deep-learning technology, changes in deep-learning technology, major aspects of deep-learning technology, and the claims of patented inventions relating to deep-learning technology are reviewed in this paper. Also, considering the properties of deep-learning technology, cases are divided into cases where deep-learning model structures are changed and cases where conventional deep-learning models are grafted onto deep-learning technology so as to comply with specific objectives. On this basis, how to secure the patentability of deep-learning-related inventions is reviewed in this paper, and how to easily demonstrate patent infringement after the deep-learning-related inventions are patented is also reviewed in practical terms. In the case of deep-learning-related inventions, they may be handled as a kind of computer-related inventions when the patentability requirements thereof are determined in terms of whether the subject matters thereof establishes inventions and they meet inventiveness requirements, etc.. Recently, with respect to the patent eligibility determination of computer-related inventions, important precedents including the Alice Corp. judgment in the United States have drawn attention, and examination guidelines in the United States and Korea have changed accordingly. In this regard, in this paper I review changes in US precedents on patent eligibility determination of computer-related inventions, and then review the Korean Patent Act and patent and utility model examination guidelines, which were revised in March 2019 by the Korean Intellectual Property Office.

인공지능 딥러닝을 활용한 조류현상 예측기술 개발 및 활용방안

홍한움,조을생,강선아,한국진 한국환경연구원 2020 기본연구보고서 Vol.2020 No.-

Ⅰ. Background and Aims of Research 1. Research outline □ Research title: Development and application of an algal bloom forecast system using artificial intelligence deep learning technology □ Research period: January 1, 2020 ~ December 31, 2020 2. Necessity and purpose of research □ Limitations of the current algal bloom warning system ㅇ The Ministry of Environment and the National Institute of Environmental Research implemented an algal bloom warning system based on the measured values of harmful blue-green algae and the EFDC model. ㅇ Limitations of physics-based models - They have a solid theoretical background but there is a difficulty in securing the detailed data required by the model. - Since algal blooms are living organisms, the law of conservation of mass does not apply to the number of harmful blue-green algae cells. Therefore, the physics-based model has limitations. - Deep learning-based forecasting can be considered as an alternative and a complementary method. Ⅱ. Current Algal Bloom Response Policy 1. Algal bloom warning system □ Year of introduction: 1998 □ Legal basis: Article 21 of the Water Environment Conservation Act □ Target ㅇ 28 branches of water supply sources and hydrophilic activities ㅇ Issuer: Basin Environmental Office and local governments □ Analysis items ㅇ Measured numbers of harmful blue-green algae cells ㅇ Based on water source section - Attention: 1,000 (cells/mL) or more - Alert: 10,000 (cells/mL) or more - Large bloom: 1,000,000 (cells/mL) or more ㅇ Based on hydrophilic activities section - Attention: 20,000 (cells/mL) or more - Alert: 100,000 (cells/mL) or more 2. (Former) Water quality forecast system □ Year of Introduction: 2012 □ Legal basis: Article 21 of the Water Environment Conservation Act □ Target ㅇ 17 branches including 16 barrages and the Bukhan River Sambong-ri of the four major rivers of South Korea ㅇ Issuer: National Institute of Environmental Research □ Analysis items ㅇ Predicted water temperature and chlorophyll-a concentration ㅇ Currently, as the algal bloom warning system and the water quality forecast system are integrated, no forecast is issued although forecasting is performed. □ Providing forecasts for harmful blue-green algae cells ㅇ Twice a week, Monday and Thursday, six branches that are targets of the algal bloom system ㅇ Issuing the predicted number of harmful blue-green algae cells and water temperature predictions 3. Status of the water quality monitoring network □ Legal basis ㅇ Article 22 of the Basic Act on Environmental Policy and Article 9 of the Water Environment Conservation Act □ Organization ㅇ Water quality monitoring network - Target: water quality measurement data in rivers, lakes, agricultural water, urban streams, and industrial rivers - Provided information: water depth, hydrogen ion concentration, dissolved oxygen content, BOD, COD, suspended matter, total nitrogen, total phosphorus, total organic carbon (TOC), water temperature, phenols, electrical conductivity, total coliform group, dissolved total nitrogen, ammonia nitrogen, nitrate nitrogen, dissolved total phosphorus, phosphate phosphorus, chlorophyll a, transparency - Cycle: once a month, once a week for major locations ㅇ Total quantity measurement network - Target: basic data for total amount management in areas subject to the total water pollution rate system - Provided information: water temperature, hydrogen ion concentration, electrical conductivity, dissolved oxygen, BOD, COD, suspended matter, total nitrogen, total phosphorus, TOC, flow rate - Cycle: once a month ㅇ Automatic measurement network - Operated to complement the hand-operated measurements of the water quality monitoring network - Provided information: (Common) water temperature, hydrogen ion concentration, dissolved oxygen content, electrical conductivity, TOC (Optional) Turbidity, chlorophyll a, TN, TP, NH₃-N, NO₃-N, PO₃-P, VOCs (nine types, ten items), phenol, heavy metals, biological monitoring items - Cycle: once a day ㅇ Sediment monitoring network - Purpose: investigation of the physicochemical properties of sediments in public waters subject to water quality conservation of South Korea - Provided information: (Common) water temperature, hydrogen ion concentration, dissolved oxygen content, electrical conductivity, TOC (Optional) maximum depth during collection, surface measurement depth, surface and bottom depth, water temperature, dissolved oxygen content, pH, electrical conductivity, sediment particle size, moisture content, ratio and grade of complete combustion potential, COD, TOC, TN, TN grade, TP, SRP, heavy metals, conservative element concentration - Cycle: (River) twice a year for the first and second halves, (Lake) once a year ㅇ In addition, there are additional measurements of radioactive monitoring networks and biometric networks. Ⅲ. Water Quality Prediction Models 1. Physics-based model □ Example ㅇ EFDC, QUAL2K, WASP, etc. ㅇ The National Institute of Environmental Research is operating an EFDC-based model. □ Organization ㅇ Construct a grid network by dividing the water system into sub-regions and set boundary conditions ㅇ Estimate the water quality in sub-area units within the grid 2. Deep learning algorithm □ Model structure ㅇ Multi-layer perceptron (MLP) - It mimics the neurons and synapses of a neural network. It consists of an input layer, a hidden layer, and an output layer. it has a multi-layered structure with more than one hidden layer. ㅇ Recurrent Neural Network (RNN) - It additionally reflects the feedback effects of previous hidden nodes. - Nowadays, GRU and LSTM models are used. These models utilize the long-term memory based on a simple recurrent neural network. 3. Physics-based model vs. Deep learning algorithm □ Physics-based model ㅇ Based on well-established mathematical/physical laws ㅇ Actual observations are used for model evaluation. ㅇ Prediction can be performed at a more detailed resolution than observed values based on physical equations. ㅇ Disadvantages - Errors due to uncertain initial/boundary conditions - Difficulty in predicting the abnormal phenomena - May not work due to problems such as poor input data, instability of model relations, modeling method, etc. □ Deep learning algorithm ㅇ Establish the relationship between input and output variables through machine learning ㅇ Actual observations are used for model construction. ㅇ Includes error conditions in the model by quantifying the error of the measurements ㅇ Advantages in short-term predictions with greater uncertainties compared to physics-based models ㅇ Disadvantages - Requires a huge amount of data - Cannot be performed at a more detailed resolution than observation resolution - Practical application is limited since the relationship between input and output variables cannot be explained. Ⅳ. Development of an Algal Bloom Forecast Algorithm Based on Deep Learning 1. Data collection and preprocessing □ Model construction target ㅇ Target point: algae observation point in the hydrophilic activity section of the Han River ㅇ Target variable - Direct prediction of the number of harmful blue-green algae cells which is the direct cause of the algal bloom - Differentiated from previous studies that indirectly predicted the algal bloom through chlorophyll a prediction □ Model construction period ㅇ Target period: April 2007 ~ August 2020 ㅇ Data in winter from December to March, which is relatively safe from algal blooms, are excluded. 2. Characteristics of algae data □ Descriptive statistics □ Characteristics ㅇ Extremely right-skewed asymmetric distribution ㅇ Extreme asymmetric distribution is exhibited since algal blooms occur intensively in summer when the temperature is high. ㅇ Because of this, it is difficult to directly predict harmful blue-green algae using physics-based models or traditional statistical models. 3. Development of a predicting algorithm □ RNN model construction ㅇ Target of prediction: the number of harmful blue-green algae cells ㅇ Constructing an LSTM prediction algorithm to utilize the long-term memory information ㅇ Loss function for optimization: least squares function Optimization algorithm: ADAM ㅇ Training data: April 2007 ~ November 2016 Test data: April 2017 ~ June 2020 □ Results ㅇ The increasing and decreasing patterns are well predicted although there is difficulty in predicting using traditional prediction methods due to high data instability, which results from the fact that the hydrophilic activity section is located downstream of the river. ㅇ Well predict the occurrence of the largest extreme value at the same time ㅇ Prediction error Ⅴ. Conclusion and Achievements □ Achievements ㅇ Since the prediction using a physical model is established based on a well-established theory, it is widely used to predict properties of water quality such as water temperature, dissolved oxygen, total phosphorus, and total nitrogen. The prediction using the physical equation based on the law of conservation of mass is well suited for conservative substance. However, there is a limitation in the prediction of algae cells since it is the activity of living organisms. ㅇ Existing algal phenomena prediction studies have not directly predicted the number of harmful blue-green algae cells, which is the direct cause of algal phenomena. It is replaced by using the results of chlorophyll a concentration prediction. ㅇ In this study, a deep learning algorithm based on recurrent neural networks was used as an alternative method to predict the number of harmful blue-green algae cells. It well predicted the increasing or decreasing patterns of algae and the occurrence of abnormal phenomena at the concurrent point. □ Limitations ㅇ Only water quality, upstream water quality, water level, and meteorological information were used as input variables. These variables are already used in the physical model. Taking into account social variables such as population change and the benefits of deep learning analytics can be leveraged to a greater extent. Unstructured information such as satellite images can be additionally considered. ㅇ There is a limitation in the amount of data. In this study, the model was studied using data from a total of 365 weekly data collections from 2007 to 2016, but this amount itself is not sufficient. Whenever new data are added, the predictive model should be updated to increase the prediction efficiency. ㅇ There is a limitation due to the black-box characteristic. The detailed operational process of the prediction model cannot be clearly observed. When implementing a policy, evidence is needed. The black-box characteristic of deep learning prediction models makes it difficult to provide clear evidence. □ Conclusions and suggestions ㅇ Because it is very simple to perform predictions with the model that has already been established, it can be directly used as reference information for current algal bloom forecasts. ㅇ Since predictions using deep learning models and physics-based models both have advantages and disadvantages, it is most desirable to integrate the two prediction methods. Based on the deep learning model, the physical model can be integrated by including the physical equation in the constraint of the objective function. Or, deep learning can be partially performed in the partial module of the physical model prediction.

의약 용기의 다중 카메라 인라인 검사 시스템에서의 품질검사를 위한 딥러닝 네트워크 개발

이태윤,윤석문,이승호 한국전기전자학회 2024 전기전자학회논문지 Vol.28 No.3

본 논문에서는 의약 용기의 다중카메라 인라인 검사 시스템에서의 품질 검사를 위한 딥러닝 네트워크를 제안한다. 제안하는 딥러닝 네트워크는현장에서 생산되는 의약 용기의 데이터를 사용하여 의약 용기에 특화된 딥러닝 네트워크로 더욱 정확하게 품질을 검사한다. 또한, 인라인 검사가가능한 딥러닝 네트워크를 사용하여 품질 검사의 속도를 증대시킬 수 있다. 다중카메라 인라인 검사 시스템에서의 품질 검사를 위한 딥러닝 네트워크의 개발은 3단계로 나뉜다. 첫 번째로 실제 의약 용기 생산 현장에서 1개의 이물검사용 line 카메라, 3개의 치수검사용 area 카메라를 통해 얻은약 10,000장의 이미지로 데이터셋을 구축한다. 두 번째로 의약 용기 데이터 전처리에서는 이물 검사, 치수검사의 용도에 맞게 불량이 일어날 수있는 곳에 ROI를 지정하여 데이터를 전처리한다. 세 번째로 전처리된 데이터를 이용하여 딥러닝 네트워크를 학습한다. 딥러닝 네트워크는 적은채널 수를 적용하여 linear layer를 사용하지 않아 판정 속도를 향상하고, PReLU와 residual learning를 적용하여 정확도를 향상한다. 이를 통해4개의 카메라에서 구축한 데이터셋에 맞는 4개의 딥러닝 모듈을 제작한다. 제안된 의약 용기의 다중카메라 인라인 검사 시스템에서의 품질 검사를위한 딥러닝 네트워크의 성능을 평가하기 위하여 공인시험기관에서 실험한 결과는, 딥러닝 모듈의 판별 정확도가 99.4%로 세계 최고 수준인 95%보다 우수한 성적을 달성하였고, 평균 판별 속도가 0.947초로 측정되어 세계 최고 수준인 1초보다 우수한 성적을 달성하였다. 따라서, 본 논문에서제안한 의약 용기의 다중카메라 인라인 검사 시스템에서의 품질 검사를 위한 딥러닝 네트워크의 효용성이 입증되었다. In this paper, we proposes a deep learning network for quality inspection in a multi-camera inline inspection system forpharmaceutical containers. The proposed deep learning network is specifically designed for pharmaceutical containers by usingdata produced in real manufacturing environments, leading to more accurate quality inspection. Additionally, the use of aninline-capable deep learning network allows for an increase in inspection speed. The development of the deep learning networkfor quality inspection in the multi-camera inline inspection system consists of three steps. First, a dataset of approximately10,000 images is constructed from the production site using one line camera for foreign substance inspection and three areacameras for dimensional inspection. Second, the pharmaceutical container data is preprocessed by designating regions of interest(ROI) in areas where defects are likely to occur, tailored for foreign substance and dimensional inspections. Third, thepreprocessed data is used to train the deep learning network. The network improves inference speed by reducing the number ofchannels and eliminating the use of linear layers, while accuracy is enhanced by applying PReLU and residual learning. Thisresults in the creation of four deep learning modules tailored to the dataset built from the four cameras. The performance of theproposed deep learning network for quality inspection in the multi-camera inline inspection system for pharmaceutical containerswas evaluated through experiments conducted by a certified testing agency. The results show that the deep learning modulesachieved a classification accuracy of 99.4%, exceeding the world-class level of 95%, and an average classification speed of 0.947seconds, which is superior to the world-class level of 1 second. Therefore, the effectiveness of the proposed deep learningnetwork for quality inspection in a multi-camera inline inspection system for pharmaceutical containers has been demonstrated.

A Review of Deep Learning Research

( Ruihui Mu ),( Xiaoqin Zeng ) 한국인터넷정보학회 2019 KSII Transactions on Internet and Information Syst Vol.13 No.4

With the advent of big data, deep learning technology has become an important research direction in the field of machine learning, which has been widely applied in the image processing, natural language processing, speech recognition and online advertising and so on. This paper introduces deep learning techniques from various aspects, including common models of deep learning and their optimization methods, commonly used open source frameworks, existing problems and future research directions. Firstly, we introduce the applications of deep learning; Secondly, we introduce several common models of deep learning and optimization methods; Thirdly, we describe several common frameworks and platforms of deep learning; Finally, we introduce the latest acceleration technology of deep learning and highlight the future work of deep learning.

Deep Learning을 활용한 산사태 결정론 방법의 활용성 고찰

민대홍(Min, Dae-Hong),윤형구(Yoon, Hyung-Koo) 한국방재학회 2021 한국방재학회논문집 Vol.21 No.5

산사태 위험지역을 결정론적인 방법으로 도출할 수 있는 Analytic Hierarchy Process (AHP) 기반의 선행 연구가 2017년도에 제안되었다. 해당 연구의 목적은 기존에 제안된 결정론적인 방법의 활용성을 향상시키고자 deep learning 기법을 적용하여 해당 방법의 신뢰성을 검증하는 것이다. AHP 기반의 결정론적인 방법은 8개 인자인 세립분 함량, 표토층 두께, 간극비, 탄성계수, 전단강도, 투수계수, 포화도 그리고 함수비로 구성되며 이를 통해 안전율을 도출할 수 있다. 대상 지역을 1 m 정사각형의 격자로 구성한 후 현장 및 실내 실험을 통해 8개의 인자를 도출하였다. 안전율은 Mohr-Coulomb의 파괴 이론을 통해 계산하여 deep learning의 출력 값으로 활용하였다. Deep learning 기법 적용 시 입력 값과 출력 값의 학습 능률을 향상시키기 위하여 경사하강법 중 Bayesian regularization을 적용하였으며, 학습 결과 실제 안전율과 deep learning 기법으로 예측된 안전율이 train과 test 단계 모두에서 우수한 신뢰성을 보여준다. 해당 연구에서 활용한 deep learning 기법이 산사태 위험지역 선정에 결정론적 방법으로 유용하게 이용될 것으로 사료된다. A method for estimating landslide susceptibility based on the analytic hierarchy process (AHP) was developed in 2017 as a deterministic method. The objective of this study is to verify the reliability of the proposed method by applying deep learning to improve the applicability of the method. The AHP-based deterministic method comprises eight factors: fines content, soil thickness, porosity, elastic modulus, shear strength, hydraulic conductivity, saturation, and water content. After dividing the testing area into 1 m square grids, eight factors were derived through field and laboratory experiments. The factor of safety was calculated based on the Mohr-Coulomb failure theory. Finally, the input and output values of deep learning were obtained. Bayesian regularization was applied among gradient descents to improve the learning efficiency when applying machine learning. The actual and predicted factors of safety were compared, and they showed excellent reliability in both the training and test phases. This study demonstrates that the AHP-based deterministic method with deep learning is valuable for determining landslide risk areas.

딥러닝 기반 체육활동에 참여한 알파세대 학습경험이 성취도와 메타인지에 미치는 영향

홍선옥,강현욱 여가문화학회 2023 여가학연구 Vol.21 No.3

This study aims to investigate the impact of learning experience on achievement and metacognition, as well as the structural relationship among the alpha generation who participated in deep learning-based physical activities. The purpose of this study was to analyse the structural relationship among learning experience, achievement, and metacognition in alpha generation participating deep learning-based physical activities. Based on deep learning, flying disc, ball throwing, and passing movements were selected as target physical activities. Two physical education teachers modeled each activity using Teachable Machine over three days. Afterwards, during regular physical education classes and after-school sessions, learners' performances of flying disc, ball throwing, and passing movements were analyzed and feedback was provided through Teachable Machine. 350 questionnaires were distributed. To prevent incomplete or incorrect answers, teachers paraphrased the questionnaires into easier words, and enough explanation and modeling were provided. Total 350 answers were considered to be effective samples. SPSS Window Version 28.0 was used to analyze statistical data. Frequency analysis and correlation analysis were conducted. To test the hypothesis, AMOS 28.0 was used for confirmatory factor analysis and structural equation model analysis. The results are as follows; First, the alpha generation’s learning experience in deep learning-based physical activities has a meaningful influence on the achievement they have. Second, the alpha generation’s achievement in deep learning-based physical activities has a meaningful effect on the metacognition they have. Third, the alpha generation’s learning experience in deep learning-based physical activities also affects meaningfully on their metacognition. Collectively, this study confirms deep learning-based physical activities can be beneficial for alpha generation, since they improve achievement, and metacognition of alpha generation. 본 연구는 딥러닝(Deep Learning: DL)을 기반으로 체육활동에 참여한 알파세대의 학습경험과 성취도 및 메타인지의 관계를 구조적으로 알아보고자 한다. 이 연구에서는 총 350개의 설문지를 배포하여 모든 데이터를 최종 사용가능한 표본으로 선정하였다. 딥러닝을 기반으로 한 체육활동으로는 플라잉디스크와 공 던지기 및 패스 동작을 선정하였으며, 체육 교사 2인이 3일에 걸쳐 각 활동별 예시 동작을 Teachable Machine에 학습시켰다. 이후 정규 체육시간 및 방과후수업 시간에 학습자들의 플라잉디스크와 공 던지기 및 패스 동작 수행을 Teachable Machine을 통해 분석하고 피드백을 제공했다. 통계적 분석은 SPSS Window Version 28.0을 이용하여 빈도분석과 상관관계분석을 수행하였다. 또한 AMOS 28.0을 이용하여 확인적 요인분석을 실시하여 연구의 가설을 확인하였다. 마지막으로 구조방정식의 모델을 적용하여 다음과 같은 결론을 얻었다. 첫째, 딥러닝을 기반으로 한 체육활동에 참여한 알파세대의 학습경험은 성취도에 유의한 영향을 미치는 것으로 나타났다. 둘째, 딥러닝을 기반으로 한 체육활동에 참여한 알파세대의 성취도는 메타인지에 유의한 영향을 미치는 것으로 나타났다. 구조적 결과는 학습경험이 많을수록 참가자가 더 높은 수준의 성취도와 메타인지를 가지는 것으로 알 수 있었다. 셋째, 딥러닝을 기반으로 한 체육활동에 참여한 알파세대의 학습경험은 메타인지에 유의한 영향을 미치는 것으로 나타났다. 알파세대에게 딥러닝 기술을 활용한 체육활동은 학습자의 성취도 및 메타인지에 도움을 주는 것을 확인하였다.

딥러닝 예측 결과 정보를 적용하는 복합 미생물배양기를 위한 딥러닝 구조 개발

김홍직,이원복,이승호 한국전기전자학회 2023 전기전자학회논문지 Vol.27 No.1

In this paper, we develop a deep learning structure for a complex microbial incubator that applies deep learning prediction result information. The proposed complex microbial incubator consists of pre-processing of complex microbial data, conversion of complex microbial data structure, design of deep learning network, learning of the designed deep learning network, and GUI development applied to the prototype. In the complex microbial data preprocessing, one-hot encoding is performed on the amount of molasses, nutrients, plant extract, salt, etc. required for microbial culture, and the maximum-minimum normalization method for the pH concentration measured as a result of the culture and the number of microbial cells to preprocess the data. In the complex microbial data structure conversion, the preprocessed data is converted into a graph structure by connecting the water temperature and the number of microbial cells, and then expressed as an adjacency matrix and attribute information to be used as input data for a deep learning network. In deep learning network design, complex microbial data is learned by designing a graph convolutional network specialized for graph structures. The designed deep learning network uses a cosine loss function to proceed with learning in the direction of minimizing the error that occurs during learning. GUI development applied to the prototype shows the target pH concentration (3.8 or less) and the number of cells (10⁸ or more) of complex microorganisms in an order suitable for culturing according to the water temperature selected by the user. In order to evaluate the performance of the proposed microbial incubator, the results of experiments conducted by authorized testing institutes showed that the average pH was 3.7 and the number of cells of complex microorganisms was 1.7 × 10⁸. Therefore, the effectiveness of the deep learning structure for the complex microbial incubator applying the deep learning prediction result information proposed in this paper was proven.

학습률 적용에 따른 흉부영상 폐렴 유무 분류 비교평가

김지율,예수영 한국방사선학회 2022 한국방사선학회 논문지 Vol.16 No.5

This study tried to suggest the most efficient learning rate for accurate and efficient automatic diagnosis of medical images for chest X-ray pneumonia images using deep learning. After setting the learning rates to 0.1, 0.01, 0.001, and 0.0001 in the Inception V3 deep learning model, respectively, deep learning modeling was performed three times. And the average accuracy and loss function value of verification modeling, and the metric of test modeling were set as performance evaluation indicators, and the performance was compared and evaluated with the average value of three times of the results obtained as a result of performing deep learning modeling. As a result of performance evaluation for deep learning verification modeling performance evaluation and test modeling metric, modeling with a learning rate of 0.001 showed the highest accuracy and excellent performance. For this reason, in this paper, it is recommended to apply a learning rate of 0.001 when classifying the presence or absence of pneumonia on chest X-ray images using a deep learning model. In addition, it was judged that when deep learning modeling through the application of the learning rate presented in this paper could play an auxiliary role in the classification of the presence or absence of pneumonia on chest X-ray images. In the future, if the study of classification for diagnosis and classification of pneumonia using deep learning continues, the contents of this thesis research can be used as basic data, and furthermore, it is expected that it will be helpful in selecting an efficient learning rate in classifying medical images using artificial intelligence. 본 연구는 딥러닝을 이용한 흉부 X선 폐렴 영상에 대하여 정확하고 효율적인 의료영상의 자동진단을 위해서 가장 효율적인 학습률을 제시하고자 하였다. Inception V3 딥러닝 모델에 학습률을 0.1, 0.01, 0.001, 0.0001로 각각 설정한 후 3회 딥러닝 모델링을 수행하였다. 그리고 검증 모델링의 평균 정확도 및 손실 함수 값, Test 모델링의 Metric을 성능평가 지표로 설정하여 딥러닝 모델링의 수행 결과로 획득한 결과값의 3회 평균값으로 성능을 비교 평가하였다. 딥러닝 검증 모델링 성능평가 및 Test 모델링 Metric에 대한 성능평가의 결과, 학습률 0.001을 적용한 모델링이 가장 높은 정확도와 우수한 성능을 나타내었다. 이러한 이유로 본 논문에서는 딥러닝 모델을 이용한 흉부 X선 영상에 대한 폐렴 유무 분류 시 학습률을 0.001로 적용할 것을 권고한다. 그리고 본 논문에서 제시하는 학습률의 적용을 통한 딥러닝 모델링 시 흉부 X선 영상에 대한 폐렴 유무 분류에 대한 인력의 보조적인 역할을 수행할 수 있을 거라고 판단하였다. 향후 딥러닝을 이용한 폐렴 유무 진단 분류 연구가 계속해서 진행될 시, 본 논문의 논문 연구 내용은 기초자료로 활용될 수 있다고 여겨지며 나아가 인공지능을 활용한 의료영상 분류에 있어 효율적인 학습률 선택에 도움이 될 것으로 기대된다.