Designing and Building the National Geo-Environment Monitoring Data Warehouse
-
摘要: 目前由中国地质环境监测院具体实施的国家级地质环境信息化建设工作，以构建国家级地质环境数据中心，实现全国地质环境信息的大综合、大协作和大集成为总体目标.其数据来源多样、数据类型复杂，且体量巨大、结构性和非结构性数据并存.为实现快速、充分地挖掘提炼数据中蕴含的价值，基于大数据思想，运用数据仓库技术，将各类操作型数据面向业务分析整合，形成协同有序的数据中心，按业务进一步划分为地质灾害防治、地下水监测与保护、矿山地质环境监测评价等4个数据集市，每个集市下又包含若干主题或二级主题.应用该数据仓库横向打通了各业务系统的数据，实现了不同维、不同粒度、不同侧面查询和观察数据的功能，为业务分析和决策支持提供了数据保障，为捕获地质环境业务数据价值提出了新模式.Abstract: China Institute of Geo-Environment Monitoring is building a national-level geological environment information platform, as an important part of a national data center aiming to collect, integrate and analyze the national geological environment data characterized by its huge size, multi-source, both structured and unstructured storage. In order to extract valuable information from the data center rapidly, a data warehouse based on the concept of big data is applied to integrate operational data into data center for professional analysis. The system running results show that the data warehouse, which consists of 8 data marts (geo-hazard prevention, underground water monitoring and protection, mining geology environment and etc) and each of them can be divided successively into various subjects and sub-subjects by loading data into star schema in multiple dimensions, different levels of granularities and various perspectives, can provide multi-dimensional data analysis and support decision-making, and therefore presents a new strategy on discovering valuable information from geo-environmental data.
-
Key words:
- big data /
- data warehouses /
- data mining /
- groundwater /
- geo-environment assessment /
- geological hazard /
-
图 1 系统业务流程
Fig. 1. Operation process of the national geo-environment monitoring data warehouse
图 2 系统逻辑模型
Fig. 2. Logic model of the national geo-environment monitoring data warehouse
-
Cohen, S., 1999. NAWQA Results on the Web. Ground Water Monitoring and Remediation, 19(4): 47-49. doi: 10.1111/j.1745-6592.1999.tb00238.x Forbes, S.R., Burke, R.G., Varma, H., 1999. Designing and Building a CHS Bathymetric Data Warehouse. International Hydrographic Review, 76(2): 111-124. http://journals.lib.unb.ca/index.php/ihr/article/view/22942 Hu, G.D., 1999. Several Issues in Design of Geological Data Warehouse. Earth Science—Journal of China University of Geosciences, 24(5): 522-524 (in Chinese with English abstract). http://en.cnki.com.cn/Article_en/CJFDTOTAL-DQKX199905020.htm Hu, G.D., Li, Z.H., 2002. Basic Platform of Land and Resources Information System Based on Data Center and Its Technical Questions. Earth Science—Journal of China University of Geosciences, 27(3): 306-310 (in Chinese with English abstract). Hu, G.D., Li, Z.H., Mei, H.B., et al., 2011. Geohazards Data Warthouse Design and Development of the Three Gorges Reservoir Area. Earth Science—Journal of China University of Geosciences, 36(2): 255-261 (in Chinese with English abstract). http://en.cnki.com.cn/Article_en/CJFDTOTAL-DQKX201102011.htm Inmon, W.H., 1992. Building the Data Warehouse. John Wiley & Sons, Inc, Chichester, 356. Jia, P.H., Zhu, D.K., Ma, J.S., et al., 2007. Spatial Data Warehouse Establishment for "Digital South China Sea". Remote Sensing Information, 4: 66-70 (in Chinese with English abstract). http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5981145 Li, Z.H., Hu, G.D., Chen, J.G., 1999. Geological Data Warehouse Features and Data Organization. Earth Science—Journal of China University of Geosciences, 24(5): 536-538 (in Chinese with English abstract). http://en.cnki.com.cn/Article_en/CJFDTOTAL-DQKX199905024.htm Li, Z.H., Hu, G.D., Wang, S.H., 2002. Preliminary Design and Development of a Geological Data Warehouse. Geology and Exploration, 38(5): 67-70 (in Chinese with English abstract). http://en.cnki.com.cn/Article_en/CJFDTOTAL-DZKT200205013.htm Li, Z.H., Hu, G.D., Zhang, Z.F., 2003. Development of Geological Data Warehouse. Journal of China University of Geosciences, 14(3): 73-76. http://www.cnki.com.cn/Article/CJFDTotal-ZDDY200303014.htm Mahoney, B., 2012. Big Earth—Big Data! In: 2012 Conference on Intelligent Date Understanding. IEEE, U.S. . Rosen, M.R., Lapham, W.W., 2008. Introduction to the US Geological Survey National Water-Quality Assessment (NAWQA) of Ground-Water Quality Trends and Comparison to Other National Programs. Journal of Environmental Quality, 37(5): 190-198. doi: 10.2134/jeq2008.0049 Tripathy, A., 2010. A Multi Dimensional Design Framework for Querying Spatial Data Using Concept Lattice. In: Mishra, L., Patra, P.K., eds., Advance Computing Conference (IACC), 2010 IEEE 2nd International. Browse Conference Publications, India. doi: 10.1109/IADCC.2010.5422922 Wen, W., 2009. Building of Digital South China Sea Infrastructure Geographic Information Platform. China Surveying and Mapping Newspaper, 2009-12-17(2)(in Chinese). White, T., Gray, J., Stack, M., 2009. Hadoop—The Definitive Guide: Map Reduce for the Cloud. O'Reilly Media, Inc, USA. http://www.researchgate.net/publication/220693618_Hadoop_-_The_Definitive_Guide_MapReduce_for_the_Cloud 胡光道, 1999. 地质数据仓库设计中的几个问题. 地球科学——中国地质大学学报, 24(5): 522-524. https://www.cnki.com.cn/Article/CJFDTOTAL-DQKX199905020.htm 胡光道, 李振华, 2002. 基于数据中心的国土资源信息系统基础平台的构建及技术问题. 地球科学——中国地质大学学报, 27(3): 306-310. https://www.cnki.com.cn/Article/CJFDTOTAL-DQKX200203016.htm 胡光道, 李振华, 梅红波, 等, 2011. 三峡库区地质灾害数据仓库的设计与实现. 地球科学——中国地质大学学报, 36(2): 255-261. https://www.cnki.com.cn/Article/CJFDTOTAL-DQKX201102011.htm 贾培宏, 朱大奎, 马劲松, 2007. "数字南海"空间数据仓库构建技术研究. 遥感信息, 4: 66-70. https://www.cnki.com.cn/Article/CJFDTOTAL-YGXX200704017.htm 李振华, 胡光道, 陈建国, 1999. 地质数据仓库的特点及其数据组织. 地球科学——中国地质大学学报, 24(5): 536-538. https://www.cnki.com.cn/Article/CJFDTOTAL-DQKX199905024.htm 李振华, 胡光道, 王淑华, 2002. 一个地学数据仓库的初步设计与实现. 地质与勘探, 38(5): 67-70. https://www.cnki.com.cn/Article/CJFDTOTAL-DZKT200205013.htm 温伟, 2009. 数字南海基础地理信息平台开建. 中国测绘报, 2009-12-17(第2版). -
下载:
点击查看大图
图(5)
计量
- 文章访问数: 3590
- HTML全文浏览量: 41
- PDF下载量: 531
- 被引次数: 0
