Russ Rew, Ed Hartnett, John Caron UCAR Unidata Program 课件.ppt

Russ Rew, Ed Hartnett, John Caron UCAR Unidata Program Center Mike Folk, Robert McGrath, Quincey Kozial NCSA and The HDF Group, Inc. Final Project Review, August 9, 2005 THG, Inc. NetCDF-4: A New Data Model, Programming Interface, and Format Using HDF5 Motivation: Why is this area of work important? While the commercial world has standardized on the relational data model and SQL, no single standard or tool has critical mass in the scientific community. There are many parallel and competing efforts to build these tool suites – at least one per discipline. Data interchange outside each group is problematic. In the next decade, as data interchange among scientific disciplines becomes increasingly important, a common HDF-like format and package for all the sciences will likely emerge. “Scientific Data Management in the Coming Decade,” Jim Gray, David T. Liu, Maria A. Nieto-Santisteban, Alexander S. Szalay, Gerd Heber, David DeWitt, Cyberinfrastructure Technology Watch Quarterly, Volume 1, Number 2, February 2005 Jim Gray, Distinguished Engineer at Microsoft, 1998 Turing Award winner Preservation of scientific data … the ephemeral nature of both data formats and storage media threatens our very ability to maintain scientific, legal, and cultural continuity, not on the scale of centuries, but considering the unrelenting pace of technological change, from one decade to the next. … And thats true not just for the obvious items like images, documents, and audio files, but also for scientific images, … and simulations. In the scientific research community, standards are emerging here and there—HDF (Hierarchical Data Format), NetCDF (network Common Data Form), FITS (Flexible Image Transport System)—but much work remains to be done to define a common cyberinfrastructure. “Eternal Bits: How can we preserve digital files and save our collective memory?,” MacKenzie Smith, IEEE Spectrum, July 2005 MacKenzie Smith, Associate Director for Technology at the MIT Libraries, Project d