Observatorio de I+D+i UPM

Memorias de investigación
Communications at congresses:
Towards Efficient Localization of Dynamic Replicas for Geo-Distributed Data Stores
Year:2016
Research Areas
  • Information technology and adata processing,
  • Computer system
Information
Abstract
Large-scale scienti?c experiments increasingly rely on geo- distributed clouds to serve relevant data to scientists world- wide with minimal latency. State-of-the-art caching systems often require the client to access the data through a caching proxy, or to contact a metadata server to locate the closest available copy of the desired data. Also, such caching sys- tems are inconsistent with the design of distributed hash- table databases such as Dynamo, which focus on allowing clients to locate data independently. We argue there is a gap between existing state-of-the-art solutions and the needs of geographically distributed applications, which require fast access to popular objects while not degrading access latency for the rest of the data. In this paper, we introduce a proba- bilistic algorithm allowing the user to locate the closest copy of the data e?ciently and independently with minimal over- head, allowing low-latency access to non-cached data. Also, we propose a network-e?cient technique to identify the most popular data objects in the cluster and trigger their replica- tion close to the clients. Experiments with a real-world data set show that these principles allow clients to locate the clos- est available copy of data with small memory footprint and low error-rate, thus improving read-latency for non-cached data and allowing hot data to be read locally.
International
Si
Congress
7th Workshop on Scienti?c Cloud Computing (ScienceCloud) 2016, ACM HPDC
960
Place
Kyoto, Japan
Reviewers
Si
ISBN/ISSN
978-1-4503-4353-4
http://dx.doi.org/10.1145/2913712.2913715
Start Date
31/05/2016
End Date
04/06/2016
From page
3
To page
9
Science Cloud 2016
Participants
  • Autor: Pierre Matri (UPM)
  • Autor: Maria de los Santos Perez Hernandez (UPM)
Research Group, Departaments and Institutes related
  • Creador: Grupo de Investigación: Ontology Engineering Group
  • Departamento: Arquitectura y Tecnología de Sistemas Informáticos
S2i 2019 Observatorio de investigación @ UPM con la colaboración del Consejo Social UPM
Cofinanciación del MINECO en el marco del Programa INNCIDE 2011 (OTR-2011-0236)
Cofinanciación del MINECO en el marco del Programa INNPACTO (IPT-020000-2010-22)