集群环境中文件传输调度系统的设计与实现软件工程专业论文.docxVIP

哈尔滨工业大学工程硕士学位论文 哈尔滨工业大学工程硕士学位论文 -II -II- Abstract Cluster system refers to a system that can link a group of computers and work stations in a particular way to accomplish certain tasks collaboratively. In this system, the computer or the work station can be isomorphic or heterogeneous. And within the system, the various computer s and work stations can use Ethernet or private network connection. We can get more computing and processing power than super parallel computer with the help of cluster system. And this is cluster technology. In this study, we discuss a project that is provided to Fujitsu Corporation by Platform Corporation. The project works in a cluster environment, supply the jobs running and file transfering with scheduling policy. With the condition of no conflict of scheduling, enhance the efficient of jobs running and shorten the transmission time. Users submit jobs according to the situation of system, and adjust the system’s running status according to the result returned by the attemper system. Ultimate goal is to make full use of the resources and t o improve the operation of the system efficiency. In this paper, the design and implementation of cluster scheduler module, API module and file staging scheduler module are given. In the cluster scheduler module, there are the ways how users input the data, the management of nodes, the management of jobs and the monitor and scheduling of jobs. The API module contains the management of system and the share memory. The file staging scheduling module contains the functions of synchronization of nodes and jobs and the files’ transferring and scheduling. The key technology includes nodes management, jobs management, jobs monitoring and scheduling, data communication within processes, synchronization between two threads, and ways of jobs scheduling and file staging scheduling . After the research of this paper, we can improve the operation efficiency and increase the reso