Research and Improvement of Database Storage Method.docVIP

Research and Improvement of Database Storage Method 　　Abstract: This paper presents a massive data storage and parallel processing method based on MPP architecture, and put forward full persistent data storage way from the client to request, and the integration the idea of Map/Reduce, the system will be distributed to each data node, the data has high scalability, high availability, high concurrency. And the simulation test and verifies the feasibility of mass data storage mode by building a distributed data node. 　　Keywords: Parallel processing; data storage; distributed database 　　0 Introductions 　　The amount of data is too large and fast growth, storage efficiency decreased, while the business demand and competitive pressure on the real-time data processing and validity put forward higher requirements, in this case, computer technicians gradually began to research on new technologies, including distributed file system, distributed database, distributed cache, based on MPP a variety of NoSQL distributed storage scheme. 　　Centralized relational database faces enormous challenges in dealing with massive data, showing its shortcomings: (1) a single database to store a limited amount of data, when the data expansion to the T level, single database will not be able to meet the demand of data level; (2) the data stored on a single server, once the server fails, the entire data center may be paralyzed, low reliability; (3) the centralized data storage size is too small, can only meet the demand through the promotion of hard disk and disk storage size, will not only meet the bottleneck of storage, and easy to cause problems such as low performance. To sum up, in order to solve the problem of centralized database can be summarized as the following aspects: the first is the huge amount of data storage requirements; followed by storage processing continuous incremental data; finally is to the massive data query processing of high performance and high concurrency. In