| Domaine : |
 |
|
 |
| Titre : |
 |
Multi-objective reinforcement learning for responsive grids |
 |
| Auteur(s) : |
 |
Julien Perez1, Cecile Germain-Renaud ( )1, 2, Balázs Kégl ( )1, 2, 3, Charles Loomis3 |
 |
| Laboratoire : |
 |
|
 |
| Résumé : |
 |
Grids organize resource sharing, a fundamental requirement of large scientific collaborations. Seamless integration of grids into everyday use requires responsiveness, which can be provided by elastic Clouds, in the Infrastructure as a Service (IaaS) paradigm. This paper proposes a model-free resource provisioning strategy supporting both requirements. Provisioning is modeled as a continuous action-state space, multi-objective reinforcement learning (RL) problem, under realistic hypotheses; simple utility functions capture the high level goals of users, administrators, and shareholders. The model-free approach falls under the general program of autonomic computing, where the incremental learning of the value function associated with the RL model provides the so-called feedback loop. The RL model includes an approximation of the value function through an Echo State Network. Experimental validation on a real data-set from the EGEE grid shows that introducing a moderate level of elasticity is critical to ensure a high level of user satisfaction. |
 |
Langue du texte intégral : |
 |
Anglais |
 |
Date de production, écriture : |
 |
27/02/2007 |
 |
|
| Journal : |
 |
| Journal of Grid Computing |
| Publisher |
Springer Verlag (Germany) |
| ISSN |
1570-7873 (eISSN : 1572-9184) |
|
 |
| Audience : |
 |
internationale |
 |
| Type de publication : |
 |
Articles dans des revues avec comité de lecture |
 |
| Date de publication : |
 |
2010 |
 |
| Volume : |
 |
8 |
 |
| Numéro : |
 |
3 |
 |
| Page, identifiant, ... : |
 |
473-492 |
 |
|
| Commentaire : |
 |
The original publication is available at www.springerlink.com |
 |
| Référence interne : |
 |
LAL 10-101 |
 |
|
| Projet(s), collaboration(s) : |
 |
Grid Observatory |
 |
| Contrat, financement : |
 |
DIM-LSC DIGITEO |
 |
| Projet Européen : |
 |
| Numéro Cordis |
222667 |
| Acronyme |
EGEE-III |
| Titre |
Enabling Grids for E-sciencE III |
| Financé par |
INFRA |
| Début |
2008-04-30 |
| Date de fin |
2010-04-30 |
| Identifiant de l'appel |
FP7-INFRASTRUCTURES-2007-2 |
|
 |