第五章数据管理.pptVIP

第五章 数据管理 龚 斌 山东大学计算机科学与技术学院 山东省高性能计算中心 网格数据库访问和集成服务DAIS Data Grids DataGrid : A dynamic logical namespace that enables coordinated sharing of heterogeneous distributed storage resources and digital entities based on local and global policies across administrative domains in a virtual enterprise. DataGrid Logical name space for location independent identifiers Abstractions for storage repositories, information repositories, and access APIs Latency management Data Characteristics in Grid Mostly unstructured data, heterogeneous resources Images, files, semi-structured, databases, streams, … File systems, SAN, FTP sites, web servers, archives Community-Based Shared amongst one or more communities Meta-data Different meta-data schemas for the same data Different notations, ontologies Sensitive to Sharing Data Grid Transparencies Access data without knowing the type of storage Storage repository abstraction Find data without knowing the identifier Descriptive attributes Access data without knowing the location Logical name space Retrieve data using your preferred API Access abstraction Provide transformations for any data collection Data behavior abstraction Logical Layers (bits,data,information,..) Storage Resource Transparency Standard operations at storage repositories POSIX like operations on all resources Storage specific operations Databases - bulk metadata access Object ring buffers - object based access Hierarchical resource managers - status and staging requests DAIS- Requirements Functionalities Key Access Integration Functionalities: Publication and Discovery Statements (Data Operations) Structured Data Transport Data Transformation Transactions Metadata Management: Operation Performance Data Replication Connections and Sessions Integration DAIS Functional Scoping Publishing and Discovery Service discovery via a registry Data service registry structure and content Data service description Database contents description Logical