Funded by the European Commission’s Horizon 2020 Programme for Research and Innovation, CloudLightning brings together eight project partners from five countries across Europe.
The project proposes to create a new way of provisioning heterogeneous cloud resources to deliver services, specified by the user, using a bespoke service description language.
Our goal is to address energy inefficiencies particularly in the use of resources and consequently to deliver savings to the cloud provider and the cloud consumer in terms of reduced power consumption and improved service delivery, with hyperscale systems particularly in mind.
For clouds to be successful they need to continue to provide affordable, reliable, computing and storage services. They must continue to adapt to an ever growing user community whose service needs are unpredictable and rapidly changing. They must embrace heterogeneous hardware as they endeavour to provide specialist services. Furthermore, as they struggle to come to grips with energy usage, they must enact strategies to minimise energy consumption per unit of service.
Benefits to cloud service consumers through increased accessibility to heterogeneous processing resources and reduced development, deployment and optimisation effort.
Benefit to cloud service providers since the increased accessibility lowers the effort required to consume their resources, allowing them to market their offerings more effectively and hence increase turnover.
Improved efficiency of cloud data centres through more effective resource management and the wider uptake of power-efficient heterogeneous processing resources.
Strengthening the competitiveness of the European industry by providing indigenous cloud service providers, particularly SMEs, with new technology which allows them to differentiate themselves in the global cloud market place.
- TO-1: Build prototype management system and delivery model
- TO-2: Validate approach with use case
- TO-3: Demonstrate Scalability
CloudLightning will develop a software stack for power efficient cloud infrastructure management, based on the principles of self-organisation and self-management. This will be augmented with a declarative cloud delivery model that promotes access to heterogeneous resources.
Use cases from three application domains – Genomics, Oil & Gas Exploration, and Ray Tracing – will be used to validate the CloudLightning management and delivery models. The specific use cases will be augmented with an analysis of dense and sparse matrix analysis techniques that have broad application in a wide variety of fields.
CloudLightning will be designed to manage the ultra- and hyperscale cloud infrastructures of the future. A testbed running the CloudLightning software stack will be used to gather instrumentation data that will form the basis of large-scale simulations of self-organised and self-managed hyperscale heterogeneous clouds.
- CO-1: Competitive advantage through infrastructure efficiencies
- CO-2: Competitive advantage through improved accessibility
- CO-3: Opportunities in use cases domains
action, and resource efficiency.