Descripción
|
|
---|---|
? Many applications in several domains such as telecommunications, network security, large scale sensor networks, require online processing of continuous data ?ows. They produce very high loads that requires aggregating the processing capacity of many nodes. Current Stream Processing Engines do not scale with the input load due to single-node bottlenecks. Additionally, they are based on static con?gurations that lead to either under or over-provisioning. In this paper, we present StreamCloud, a scalable and elastic stream processing engine for processing large data stream volumes. StreamCloud uses a novel parallelization technique that splits queries into subqueries that are allocated to independent sets of nodes in a way that minimizes the distribution overhead. Its elastic protocols exhibit low intrusiveness, enabling effective adjustment of resources to the incoming load. Elasticity is combined with dynamic load balancing to minimize the computational resources used. The paper presents the system design, implementation and a thorough evaluation of the scalability and elasticity of the fully implemented system. | |
Internacional
|
Si |
JCR del ISI
|
Si |
Título de la revista
|
Ieee Transactions on Parallel And Distributed Systems |
ISSN
|
1045-9219 |
Factor de impacto JCR
|
1,402 |
Información de impacto
|
|
Volumen
|
23 |
DOI
|
10.1109/TPDS.2012.24 |
Número de revista
|
12 |
Desde la página
|
2351 |
Hasta la página
|
2365 |
Mes
|
DICIEMBRE |
Ranking
|
Q1 |