Funded by the European Commission’s Horizon 2020 Programme for Research and Innovation, CloudLightning brings together eight project partners from five countries across Europe.

The project proposes to create a new way of provisioning heterogeneous cloud resources to deliver services, specified by the user, using a bespoke service description language.

Our goal is to address energy inefficiencies particularly in the use of resources and consequently to deliver savings to the cloud provider and the cloud consumer in terms of reduced power consumption and improved service delivery, with hyperscale systems particularly in mind.

EXPECTED BENEFITS


For clouds to be successful they need to continue to provide affordable, reliable, computing and storage services. They must continue to adapt to an ever growing user community whose service needs are unpredictable and rapidly changing. They must embrace heterogeneous hardware as they endeavour to provide specialist services. Furthermore, as they struggle to come to grips with energy usage, they must enact strategies to minimise energy consumption per unit of service.

1.

Benefits to cloud service consumers through increased accessibility to heterogeneous processing resources and reduced development, deployment and optimisation effort.


2.

Benefit to cloud service providers since the increased accessibility lowers the effort required to consume their resources, allowing them to market their offerings more effectively and hence increase turnover.

3.

Improved efficiency of cloud data centres through more effective resource management and the wider uptake of power-efficient heterogeneous processing resources.


4.

Strengthening the competitiveness of the European industry by providing indigenous cloud service providers, particularly SMEs, with new technology which allows them to differentiate themselves in the global cloud market place.

TECHNICAL OBJECTIVES


CloudLightning will develop a software stack for power efficient cloud infrastructure management, based on the principles of self-organisation and self-management. This will be augmented with a declarative cloud delivery model that promotes access to heterogeneous resources.

Use cases from three application domains – Genomics, Oil & Gas Exploration, and Ray Tracing – will be used to validate the CloudLightning management and delivery models. The specific use cases will be augmented with an analysis of dense and sparse matrix analysis techniques that have broad application in a wide variety of fields.

CloudLightning will be designed to manage the ultra- and hyperscale cloud infrastructures of the future. A testbed running the CloudLightning software stack will be used to gather instrumentation data that will form the basis of large-scale simulations of self-organised and self-managed hyperscale heterogeneous clouds.



COMMERCIAL OBJECTIVES


CloudLightning will develop new methods for managing and managing cloud infrastructures such that resulting efficiencies can be translated into operational savings for European cloud service providers.
The CloudLightning declarative service delivery model will provide a new method for interacting with cloud infrastructures and will go beyond the capabilities of extant delivery models. This will facilitate the consumption of cloud resources, generating competitive advantage for those European cloud service providers adopting this new model.
CloudLightning will demonstrate how advances in cloud infrastructure management and delivery can be applied to three commercially important domains: Genomics, Oil & Gas Exploration and Ray Tracing. This work will highlight the opportunities that exist to leverage heterogeneous cloud resources more effectively within these industries.


SOCIETAL OBJECTIVES


CloudLightning will strive to improve the energy efficiency of cloud infrastructures by optimising energy usage through self-management of resources and promoting the use of energy efficient heterogeneous computing resources. This objective is in line with the Europe 2020 societal challenges of efficient energy, climate
action, and resource efficiency.
The current state of the art for cloud service delivery poses challenges for consumers who wish to make use of computing resources. CloudLightning will improve the user experience for consumers who commission cloud services.
By advancing the state of the art for cloud computing, CloudLightning will act as an enabler for other business and scientific activities during the lifetime of the project and beyond.