会议中文基于异常检测技术的海洋水文信息管理系统的设计与实现素材.doc

基于异常检测技术的海洋水文数据管理系统的设计与实现 黄冬梅 田瑜基 王建 （上海海洋大学信息学院，上海 201306） 摘要 针对大量的海洋水文数据存在多源异构性、数据不一致、数据冗余和数据缺失等问题，为了提高海洋水文数据质量,使用户对大量复杂的海洋水文数据进行有效的管理，本文设计实现了一套基于异常检测技术的海洋水文数据管理系统。该系统主要包括：数据采集，数据预处理，异常检测，数据存储，数据管理和数据展示六部分。本文首先介绍了系统的体系结构，然后对各个功能模块进行了详细的阐述，并对海洋水文数据进行了详细的分析。针对海洋水文数据存在的问题，本文提出了基于累积变化量的时间序列异常点检测方法，有效的检测出海洋水文数据中的异常点，再选择适当的修正方法对异常点进行修正，为海洋水文信息数据库提供干净、准确、简洁的数据，从而建立一套完善的海洋水文数据管理系统，能够快速高效的对海洋水文数据进行管理，为海洋相关部门管理决策提供科学的支持。 关键字 海洋水文数据管理系统；海洋水文数据；数据管理；异常检测 中图法分类号 TP311 Design and Implementation of marine information management system Dongmei Huang , Yuji Tian, Jian Wang （College of Information , Shanghai Ocean University, Shanghai, 201306） Abstract In order to solve the problem of multi-source heterogeneous data, improve the quality of marine data, and efficiently manage a large number of complex marine data, the paper designs and implements marine information management system. The system includes six parts: data acquisition, data preprocessing, anomaly detection, data storage, data management and data display. This paper introduces the architecture of the system, gives a detailed exposition of the various functional modules, and carries on detailed analysis for marine data. Because a large number of marine data exists these problems: data inconsistencies, data gaps and data redundancy and so on . Therefore, the paper makes use of time series anomaly detection method which is based on the cumulative variation and can effectively detect outliers in the marine data. Then the paper selects the appropriate correction method of outliers amendment. The method provides clean, accurate, concise data for marine information database, thereby the paper establishes a comprehensive marine information management system, which effectively manages ocean data, guides the business process of marine relevant departments scientific and standardized and provides strong support for Chinas digital marine construction. Keywords marine information management system; marine data; data management; an