Skip to Main Content
 

Global Search Box

 
 
 
 

ETD Abstract Container

Abstract Header

Towards Optimal Resource Provisioning for Running MapReduce Programs in Public Clouds

Abstract Details

2011, Master of Science (MS), Wright State University, Computer Science.
Running MapReduce programs in the public cloud introduces the important problem: how to optimize resource provisioning to minimize the financial charge for a specific job? In this thesis, We study the whole process of MapReduce processing and build up a cost function that explicitly models the relationship between the amount of input data, the available system resources (Map and Reduce slots), and the complexity of the Reduce function for the target MapReduce job. The model parameters can be learned from test runs with a small number of nodes on a small amount of data. Based on this cost model, we can solve a number of decision problems, such as the optimal amount of resources that can minimize the financial cost with a time deadline or minimize the time under certain financial budget. Experimental results show that this cost model performs well on tested MapReduce programs.
Keke Chen, PhD (Advisor)
Bin Wang, PhD (Committee Member)
TK Prasad, PhD (Committee Member)
49 p.

Recommended Citations

Citations

  • Tian, F. (2011). Towards Optimal Resource Provisioning for Running MapReduce Programs in Public Clouds [Master's thesis, Wright State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=wright1321894090

    APA Style (7th edition)

  • Tian, Fengguang. Towards Optimal Resource Provisioning for Running MapReduce Programs in Public Clouds. 2011. Wright State University, Master's thesis. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=wright1321894090.

    MLA Style (8th edition)

  • Tian, Fengguang. "Towards Optimal Resource Provisioning for Running MapReduce Programs in Public Clouds." Master's thesis, Wright State University, 2011. http://rave.ohiolink.edu/etdc/view?acc_num=wright1321894090

    Chicago Manual of Style (17th edition)