Research ArticleOpen AccessGoogle Scholar indexed
Application of Integrated Reorganization of Science Specimen Data Using Kettle
Information Network Center, China University of Geosciences, Beijing, China
Institute of Earth Sciences, China University of Geosciences, Beijing, China
- 1 Information Network Center, China University of Geosciences, Beijing, China
- 2 Institute of Earth Sciences, China University of Geosciences, Beijing, China
Intelligent Information Management·Volume 11 (2019)·Pages 24–31·Published 3 January 2019·DOI10.4236/iim.2019.111002
Copy link · social · email
Abstract
Standards and specifications are the premise of integrated reorganization of science specimen data, and data integration is the core of the reorganization. ETL [ 1 ] which is the abbreviation of extract, transform, and load [ 2 ], is very suitable for data integration. Kettle is a kind of ETL software. In this paper, it has been introduced into the integrated reorganization of science specimen data. Multi-source and heterogeneous specimen data are integrated using kettle, and good results have been achieved. It proved the effectiveness of kettle in the integrated reorganization of science specimen data. The application has practical significance, and the method can be referenced when reorganizing other resource data.
KeywordsETLKettleScience SpecimenIntegrated ReorganizationData Integration
- Miao, J.J., Deng, S. and Liu, Q.B. (2004) Overview on ETL Technology. Computer Engineering, 30, 4-6.
- Xu, J.G. and Pei, Y. (2011) Overview of Data Extraction, Transformation and Loading. Computer Science, 38, 15-20.
- Xu, H.H., Lian, L. and Yao, H.L. (2018) Establishment of Meteorological Data Warehouse Based on ETL Tools. Computer Systems & Applications, 27, 224-228.
- Wang, R. and Strong, D. (1996) Beyond Accuracy: What Data Quality Means to Data Consumers. Journal of Management Information System, 12, 5-33. https://doi.org/10.1080/07421222.1996.11518099
- Kimball, R. and Caserta, J. (2007) The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, Cleaning, Conforming, and Delivering Data. Journal of Information Management, 23, 1123.
- Wang, H.M. and Ye, Z.W. (2010) An ETL Services Framework Based on Metadata 2nd International Workshop on Intelligent Systems and Applications, Wuhan, 22-23 May 2010, 1-4. https://doi.org/10.1109/IWISA.2010.5473575
- Borowski, E. (2008) Design of a Workflow System to Improve Data Quality Using Oracle Warehouse Builder. Journal of Applied Quantitative Methods, 3, 198-206.
- Haselden, K. and Baker, B. (2007) Microsoft SQL Server 2005 Integration Services. E’earson Education, Beijing.
- Casters, M, Bouman, R and Dongen, J.V. (2014) Pentaho Kettle. Publishing House of Electronics Industry, Beijing.
- Yin, X.N., Zou, X.T. and Zhang, D. (2013) Kettle-Based Data Extraction and Transformation during Water Sector Census in Beijing. China Water Resources, 21, 57-59.
- Wang, Y.H., Zhang, W. and Shen, X.Y. (2008) Research and Practice on National Infrastructure of Natural Resources for Science and Technology of China. China Science & Technology Resources Review, 40, 16-19.
- He, M.Y., Yang, M. and Wu, Z.Y. (2017) Construction of National Mineral Rock and Fossil Specimen Resource Sharing Infrastructure. e-Science Technology & Application, 8, 24-31.