Performance evaluation of MapReduce using full virtualisation on a departmental cloud

Horacio González-Vélez; Maryam Kontagora

doi:10.2478/v10006-011-0020-3

.blurhash-client-img { display: none !important; }

Performance evaluation of MapReduce using full virtualisation on a departmental cloud

International Journal of Applied Mathematics and Computer Science

Volume 21 (2011): Issue 2 (June 2011)

By: Horacio González-Vélez and Maryam Kontagora

Open Access

|Jun 2011

Anon, E.A. (1998). A measure of transaction processing power,M. Stonebraker and J.M. Hellerstein (Eds.),, 3rd Edn., Morgan Kaufmann, San Francisco, CA, pp. 609-621.
Search in Google Scholar
Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R.H., Konwinski, A., Lee, G., Patterson, D.A., Rabkin, A., Stoica, I. and Zaharia, M. (2010). A view of cloud computing,(4): 50-58.
Open DOI Search in Google Scholar
Bacci, B., Danelutto, M., Pelagatti, S. and Vanneschi, M. (1999). SkIE: A heterogeneous environment for HPC applications,(13): 1827-1852.
Open DOI Search in Google Scholar
Beaumont, O., Casanova, H., Legrand, A., Robert, Y. and Yang, Y. (2005). Scheduling divisible loads on star and tree networks: Results and open problems,(3): 207-218.
Open DOI Search in Google Scholar
Buono, D., Danelutto, M. and Lametti, S. (2010). Map, reduce and MapReduce, the skeleton way,(1): 2089-2097.
Open DOI Search in Google Scholar
Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J. and Brandic, I. (2009). Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility,(6): 599-616.
Open DOI Search in Google Scholar
Buzen, J.P. and Gagliardi, U.O. (1973). The evolution of virtual machine architecture,, ACM, New York, NY, pp. 291-299.
Search in Google Scholar
Cole, M. (1989)., Pitman/MIT Press, London.
Search in Google Scholar
Cole, M. (2004). Bringing skeletons out of the closet: A pragmatic manifesto for skeletal parallel programming,(3): 389-406.
Open DOI Search in Google Scholar
Danelutto, M. (2004). Adaptive task farm implementation strategies,, IEEE, La Coruña, pp. 416-423.
Search in Google Scholar
Dean, J. and Ghemawat, S. (2004). MapReduce: Simplified data processing on large clusters,, Vol. 6, USENIX, San Francisco, CA, pp. 137-150.
Search in Google Scholar
Dean, J. and Ghemawat, S. (2008). MapReduce: Simplified data processing on large clusters,(1): 107-113.
Open DOI Search in Google Scholar
González-Vélez, H. (2006). Self-adaptive skeletal task farm for computational grids,(7-8): 479-490.
Open DOI Search in Google Scholar
González-Vélez, H. and Cole, M. (2010a). Adaptive statistical scheduling of divisible workloads in heterogeneous systems,(4): 427-441.
Open DOI Search in Google Scholar
González-Vélez, H. and Cole, M. (2010b). Adaptive structured parallelism for distributed heterogeneous architectures: A methodological approach with pipelines and farms,(15): 2073-2094.
Open DOI Search in Google Scholar
González-Vélez, H. and Leyton, M. (2010). A survey of algorithmic skeleton frameworks: High-level structured parallel programming enablers,(12): 1135-1160.
Open DOI Search in Google Scholar
Ibrahim, S., Jin, H., Lu, L., Qi, L., Wu, S. and Shi, X. (2009). Evaluating MapReduce on virtual machines: The Hadoop case,M. Jaatun, G. Zhao, and C. Rong (Eds.), Lecture Notes in Computer Science, Vol. 5931, Springer-Verlag, Berlin/Heidelberg, pp. 519-528.
Open DOI Search in Google Scholar
Kontagora, M. and González-Vélez, H. (2010). Benchmarking a MapReduce environment on a full virtualisation platform,L. Barolli, F. Xhafa, S. Vitabile and H.-H. Hsu (Eds.),, IEEE Computer Society, Washington, DC, pp. 433-438.
Open DOI Search in Google Scholar
Kuchen, H. and Striegnitz, J. (2005). Features from functional programming for a C++ skeleton library,(7-8): 739-756.
Open DOI Search in Google Scholar
Mesghouni, K., Hammadi, S. and Borne, P. (2004). Evolutionary algorithms for job-shop scheduling,(1): 91-103.
Search in Google Scholar
Nagarajan, A.B., Mueller, F., Engelmann, C. and Scott, S.L. (2007). Proactive fault tolerance for HPC with Xen virtualization,B. J. Smith (Ed.),, ACM, New York, NY, pp. 23-32.
Open DOI Search in Google Scholar
Nokia Research Center (2009). Disco,, Nokia Research Center
Search in Google Scholar
Pisoni, A. (2007). Skynet,
Search in Google Scholar
Ranger, C., Raghuraman, R., Penmetsa, A., Bradski, G. and Kozyrakis, C. (2007). Evaluating MapReduce for multi-core and multiprocessor systems,, pp. 13-24.
Search in Google Scholar
Robertazzi, T.G. (2003). Ten reasons to use divisible load theory,(5): 63-68.
Open DOI Search in Google Scholar
Sandholm, T. and Lai, K. (2009). MapReduce optimization using regulated dynamic prioritization,J.R. Douceur, A.G. Greenberg, T. Bonald, J. Nieh (Eds.),, ACM, New York, NY, pp. 299-310.
Open DOI Search in Google Scholar
The Apache Software Foundation (2008). Hadoop MapReduce tutorial,, Hadoop Project
Search in Google Scholar
VMware (2007). Understanding full virtualization, paravirtualization, and hardware assist,, VMware, Inc., Palo Alto, CA.
Search in Google Scholar
Whitaker, A., Shaw, M. and Gribble, S.D. (2002). Scale and performance in the Denali isolation kernel,(SI): 195-209.
Open DOI Search in Google Scholar
Youseff, L., Wolski, R., Gorda, B. and Krintz, C. (2006). Paravirtualization for HPC systems,G. Min, B. Di Martino, L.T. Yang, M. Guo and Gudula Rünger (Eds.),, Lecture Notes in Computer Science, Vol. 4331, Springer-Verlag, Berlin/Heidelberg, pp. 474-486.
Open DOI Search in Google Scholar
Zaharia, M., Konwinski, A., Joseph, A., Katz, R. and Stoica, I. (2008). Improving MapReduce performance in heterogeneous environments,R. Draves and R. van Renesse (Eds.),, USENIX Association, Berkeley, CA.
Search in Google Scholar