대용량 기후모델자료를 위한 통합관리시스템 구축 = Development of Climate & Environment Data System for Big Data from Climate Model Simulations

다국어 초록 (Multilingual Abstract)

In this paper, we introduce a novel Climate & Environment Database System (CEDS). The CEDS is developed by the National Institute of Meteorological Sciences (NIMS) to provide easy and efficient user interfaces and storage management of climate model data, so improves work efficiency. In uploading the data/files, the CEDS provides an option to automatically operate the international standard data conversion (CMORization) and the quality assurance (QA) processes for submission of CMIP6 variable data. This option increases the system performance, removes the user mistakes, and increases the level of reliability as it eliminates user operation for the CMORization and QA processes. The uploaded raw files are saved in a NAS storage and the Cassandra database stores the metadata that will be used for efficient data access and storage management. The Metadata is automatically generated when uploading a file, or by the user inputs. With the Metadata, the CEDS supports effective storage management by categorizing data/files. This effective storage management allows easy and fast data access with a higher level of data reliability when requesting with the simple search words by a novice.
Moreover, the CEDS supports parallel and distributed computing for increasing overall system performance and balancing the load. This supports the high level of availability as multiple users can use it at the same time with fast system-response. Additionally, it deduplicates redundant data and reduces storage space.

참고문헌 (Reference)

1 Williams, D. N., "The Earth System Grid Federation: Software framework supporting CMIP5data analysis and dissemination" 56 : 40-42, 2011

2 Guilyardi, E., "The CMIP5 model and simulation documentation : a new standard for climate modelling metadata" 56 : 42-46, 2011

3 Meehl, G. A., "Overview of the coupled model intercomparison project" 86 : 89-93, 2005

4 Veronika Eyring, "Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization" Copernicus GmbH 9 (9): 1937-1958, 2016

5 Rew, R., "NetCDF: An interface for scientific data access" 10 : 76-82, 1990

6 Gormley, C., "Elasticsearch: The Definitive Guide: A Distributed Real-Time Search and Analytics Engine"

7 IPCC, "Contribution of Working Group I to The Fifth Assessment Report of The Intergovernmental Panel on Climate Change" Cambridge University Press 1535-, 2013

8 Avinash Lakshman, "Cassandra: A decentralized structured storage system" Association for Computing Machinery (ACM) 44 (44): 35-, 2010

9 Taylor, K. E., "CMIP5 data reference syntax (DRS) and controlled vocabularies"

10 Halili, E. H., "Apache JMeter: A practical beginner’s guide to automated testing and performance measurement for your websites" Packt Publishing 141-, 2008