Skip to Main Content
 

Global Search Box

 
 
 
 

ETD Abstract Container

Abstract Header

Parallelizing Applications With a Reduction Based Framework on Multi-Core Clusters

Ramanathan, Venkatram

Abstract Details

2010, Master of Science, Ohio State University, Computer Science and Engineering.
Data mining has emerged as an important class of high performance applications. At the same time, most parallel platforms today are clusters of multi-core machines. Thus, one of the major challenges today is achieving programmability and performance for data mining applications on multi-core machines and cluster of multi-core machines. FREERIDE (FRamework for Rapid Implementation of Datamining Engines) is a middleware developed based on the observation that the processing structure of a large number of data mining algorithms involves generalized reductions. FREERIDE offers a high-level interface and implements both distributed memory and shared memory parallelization. In this thesis, theWavelet Transformation algorithm is considered and it is shown how it can be modeled as a generalized reduction structure. It is parallelized using the FREERIDE middleware. It is shown that the algorithm can be parallelized in a communication and storage efficient manner. By this method, a good parallel efficiency with a speedup of around 42 on 64 cores is achieved. The second algorithm considered is a challenging new data mining algorithm, information theoretic co-clustering. This algorithm is parallelized using FREERIDE middleware. It is shown that the main processing loops of row clustering and column clustering of the the Co-clustering algorithm essentially fit into a generalized reduction structure. A good parallel efficiency is achieved and a speedup of nearly 21 is reported on 32 cores.
Gagan Agrawal (Advisor)
Radu Teodorescu (Committee Member)
71 p.

Recommended Citations

Citations

  • Ramanathan, V. (2010). Parallelizing Applications With a Reduction Based Framework on Multi-Core Clusters [Master's thesis, Ohio State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=osu1275337592

    APA Style (7th edition)

  • Ramanathan, Venkatram. Parallelizing Applications With a Reduction Based Framework on Multi-Core Clusters. 2010. Ohio State University, Master's thesis. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=osu1275337592.

    MLA Style (8th edition)

  • Ramanathan, Venkatram. "Parallelizing Applications With a Reduction Based Framework on Multi-Core Clusters." Master's thesis, Ohio State University, 2010. http://rave.ohiolink.edu/etdc/view?acc_num=osu1275337592

    Chicago Manual of Style (17th edition)