Observatorio de I+D+i UPM

Memorias de investigación
Ponencias en congresos:
TýrFS: Improving Small Files Access Performance With Dynamic Metadata Replication
Año:2018
Áreas de investigación
  • Ciencias de la computación y tecnología informática
Datos
Descripción
Small files are known to pose major performance challenges for file systems. Yet, such workloads are increasingly common in a number of Big Data Analytics workflows or large-scale HPC simulations. These challenges are mainly caused by the common architecture of most state-of-the-art file systems needing one or multiple metadata requests before being able to read from a file. Small input file size causes the overhead of this metadata management to gain relative importance as the size of each file decreases. In this paper we propose a set of techniques leveraging consistent hashing and dynamic metadata replication to significantly reduce this metadata overhead. We implement such techniques inside a new file system named TýrFS, built as a thin layer above the Týr object store. We prove that TýrFS increases small file access performance up to one order of magnitude compared to other state-of-the-art file systems, while only causing a minimal impact on file write throughput.
Internacional
Si
Nombre congreso
2018 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
Tipo de participación
960
Lugar del congreso
Washington, DC, EEUU
Revisores
Si
ISBN o ISSN
0-7695-6410-0
DOI
10.1109/CCGRID.2018.00072
Fecha inicio congreso
02/05/2018
Fecha fin congreso
04/05/2018
Desde la página
452
Hasta la página
461
Título de las actas
Proceedings of the 2018 18th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
Esta actividad pertenece a memorias de investigación
Participantes
  • Autor: Pierre Matri (UPM)
  • Autor: Maria de los Santos Perez Hernandez (UPM)
  • Autor: Alexandru Costan (Inria)
  • Autor: Gabriel Antoniu (Inria)
Grupos de investigación, Departamentos, Centros e Institutos de I+D+i relacionados
  • Creador: Grupo de Investigación: Ontology Engineering Group
  • Departamento: Arquitectura y Tecnología de Sistemas Informáticos
S2i 2021 Observatorio de investigación @ UPM con la colaboración del Consejo Social UPM
Cofinanciación del MINECO en el marco del Programa INNCIDE 2011 (OTR-2011-0236)
Cofinanciación del MINECO en el marco del Programa INNPACTO (IPT-020000-2010-22)