Type de séminaire
Séminaire
Titre
Towards MapReduce for Desktop Grid Computing
Lieu
Montbonnot-ENSIMAG
Organisateur
Arnaud Legrand
Intervenant
Haiwu He
Date
28/04/2011
Heure
15:00
Résumé

MapReduce is an emerging programming model for data-intensive application proposed by Google, which has attracted a lot of attention recently. MapReduce borrows ideas from functional programming, where programmer defines Map and Reduce tasks to process large set of distributed data.

In this talk, we propose an implementation of the MapReduce programming model. We present the architecture of the prototype based on BitDew, a middleware for large scale data management on Desktop Grid. We describe the set of features which makes our approach suitable for large scale and loosely connected Internet Desktop Grid : massive fault tolerance, replica management, barriers-free execution, latency-hiding optimization as well as distributed result checking. We also present performance evaluation of the prototype both against micro-benchmarks and real MapReduce application. The scalability test shows that we achieve linear speedup on the classic WordCount benchmark. Several scenarios involving lagger hosts and host crashes demonstrate that the prototype is able to cope with an experimental context similar to real-world Internet.

Équipes concernées
MESCAL, MOAIS
Mots clés
Calcul pour les sciences et technologies
Systèmes répartis, Systèmes parallèles, Intergiciels






Langues du site

ou d'autres langues
via la passerelleAXiMAG...






Suivez le LIG sur Twitter


UMR 5217 - Laboratoire LIG - Maison Jean Kuntzmann - 110 av. de la Chimie - Domaine Universitaire de Saint-Martin-d’Hères - BP 53 - 38041 Grenoble cedex 9 - France
Tél. : +33 (0)4 76 51 43 61 - Fax : +33 (0)4 76 51 49 85
CNRS Grenoble INP INRIA UJF UPMF Université Stendhal