并行文件系统的安装与测试.docVIP

并行文件系统的安装与测试 分布式文件系统以其高可靠性、高可扩展性以及高性能和高性价比成为高性能计算平台存储系统的首选，已经在军事技术、天气预报等环境中得到广泛应用。相比其它文件系统，它具有两个特点：一是通过数据的分布存储，来提供更大的存储空间，并利用并行的I／OI／OI／OPeta级大小的存储空间。 Lustre是典型的基于对象存储体系结构的并行文件系统，它起源于卡耐基梅隆大学的Coda项目研究工作，已经成为当前高性能计算领域使用最广泛的并行文件系统之一。Lustre具有良好的大文件I／O性能，但是由于Lustre使用分布式的存储体系结构，文件元数据和数据分开存储，它的小文件I／O 本文以Lustre为研究对象，进行并行文件系统的安装与测试，并与传统的分布式文件系统（NFSLustre的存储结构，研究并行文件系统作为存储系统的好处及其传输速度，提出改进建议。 关键词：分布式文件系统 Lustre I／O ABSTRACT Distributed File System has been widely applied in High Performance Computation fields such as militaris tstrategist，weather forecast．These fields’ speciality needs the distributed file system being of highly throughput and availability. The distributed file system has been the main storage architrave of HPC environment. It has two characteristics: one is the bigger capability and higher aggregation I／O bandwidth by distributed data storage；the other is abundant of the I／O access mode，such as the object—based data pattern by use object-based storage architecture． Lustre is a typical object-based distributed file system. It origins from the coda roject in Carnegie university, and has become one of the widely used distributed file system in HPC filed. It has favourable big file I／Operformance, which has almost Peta degree aggregation I／O bandwidth. Therefore, because of its distributed storage architecture which placing file data and meta data separately.ts small file I／O performance is not so well, even lower than that in the local file system. This paper researches the benefits of distributed file system and its speed of transmission by installing and testing the Lustre file system and comparing with NFS and other kinds of distributed file system. It has also analyzed storage structures of the Lustre and distributed file system. Key words：distributed file system，object—based storage，I／0 performance 并行文件系统的安装与测试 1 一、引言 4 二、研究现状 4 2.1 分类 4 2.2 其余并行文件系统 5 2.2.1 PVFS 5 2.2.2 GPFS 5 2.2.3 PFS 6 2.2.4 DAFS 6 2.3 分布式文件系统中的存储结构 6 2.3.1 对称式虚拟存储系统 7 2.3.2 非对称式虚拟存