NEO-QE | NEtwork-aware Optimization for Query Executions in Large Systems

Summary
In data-intensive environments such as data warehouses, efficient execution of query operations is crucial for the overall performance of a system. One of the main performance challenges in such scenarios is the network communications. Significant performance improvements have been achieved by using state-of-the-art methods, designed in the data management and data communication domain. However, the proposed techniques in both fields just view each other as a black box, and the additional gains in performance from a co-optimization perspective have not yet been explored. In this project, I will focus on the design and development of a novel query execution system that can bridge the gap of co-optimization between high-level query executions and low-level data communications. Such a system will be highly efficient and robust in the presence of different workloads and network configurations in large systems, and consequently deliver significant performance improvements to the large scale data-analytics community. In the meantime, the success of the project will also aid my career development through an increased research profile and collaboration with industry, and enhance the knowledge and networks of UCD.
Unfold all
/
Fold all
More information & hyperlinks
Web resources: https://cordis.europa.eu/project/id/799066
Start date: 01-07-2018
End date: 30-06-2020
Total budget - Public funding: 187 866,00 Euro - 187 866,00 Euro
Cordis data

Original description

In data-intensive environments such as data warehouses, efficient execution of query operations is crucial for the overall performance of a system. One of the main performance challenges in such scenarios is the network communications. Significant performance improvements have been achieved by using state-of-the-art methods, designed in the data management and data communication domain. However, the proposed techniques in both fields just view each other as a black box, and the additional gains in performance from a co-optimization perspective have not yet been explored. In this project, I will focus on the design and development of a novel query execution system that can bridge the gap of co-optimization between high-level query executions and low-level data communications. Such a system will be highly efficient and robust in the presence of different workloads and network configurations in large systems, and consequently deliver significant performance improvements to the large scale data-analytics community. In the meantime, the success of the project will also aid my career development through an increased research profile and collaboration with industry, and enhance the knowledge and networks of UCD.

Status

TERMINATED

Call topic

MSCA-IF-2017

Update Date

28-04-2024
Geographical location(s)
Structured mapping
Unfold all
/
Fold all
EU-Programme-Call
Horizon 2020
H2020-EU.1. EXCELLENT SCIENCE
H2020-EU.1.3. EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions (MSCA)
H2020-EU.1.3.2. Nurturing excellence by means of cross-border and cross-sector mobility
H2020-MSCA-IF-2017
MSCA-IF-2017