Digging deep into the data mine with Data Mining Grid.pdfVIP

V. Stankovski et al., Digging Deep into the Data Mine with DataMiningGrid. Digging Deep into the Data Mine with DataMiningGrid V. Stankovski1,*, M. Swain2, V. Kravtsov3, T. Niessen4, D. Wegener4, M. R?hm5, J. Trnkoczy1, M. May4, J. Franke5, A. Schuster3 and W. Dubitzky2 1 University of Ljubljana, FGG-KGI, SI-1000 Ljubljana, Slovenia 2 University of Ulster, Cromore Road, Coleraine BT52 1SA, Northern Ireland 3 Technion - Israel Institute of Technology, Technion City, 32000 Haifa, Israel 4 Fraunhofer Institute for Intelligent Analysis and Information Systems, D-53754 Sankt Augustin, Germany 5 DaimlerChrysler, Research Center, D-89013 Ulm, Germany *Communicating author University of Ljubljana, FGG-KGI, Jamova cesta 2, SI-1000 Ljubljana, Slovenia Phone: +386-41-200-565, Fax: +386-1-425-0681; E-mail: vlado@ Abstract The growing computerization in modern knowledge and technology sectors is generating huge volumes of electronically stored data. Data mining technology is often employed to make sense of these data. However, as modern data mining applications increase in complexity, so do their demands for resources. Grid computing is one of several emerging networked computing paradigms promising to meet the requirements of heterogeneous, large- scale and distributed data mining applications. Despite this promise, there are still too many issues to be resolved before grid technology is commonly applied to large-scale data mining tasks. To address some of these issues, we developed the DataMiningGrid system, which principally differs from similar systems by its ability to integrate a diverse set of programs and application scenarios within a single framework. The system’s key features include high performance and scalability, sophisticated support for relevant standards, different user types, and flexible extensibility. The software is available as open source. Keywords: Distributed architectures, Distributed applications, Data mining, Middlewar