Work Packages

The CloudLightning Project is composed of eight work packages. Each work package is composed of a number of relevant tasks and associated deliverables and milestones. The work packages are described below. Click a work package to read its description and primary objectives.

WP1 deals with the management and governance of the project. It is led by the project coordinator, Prof John Morrison (UCC).

The objectives of this work package are:

  • To ensure progress the efficient control of the overall working plan and monitor its proper implementation
  • To manage the correct distribution of the European Commission (EC) contribution
  • To ensure timely submission of agreed project deliverables, as well as the timely completion of project milestones
  • To enforce the Consortium Agreement signed by all partners
  • To interface between the consortium and the EC, providing it with periodical financial and technical reports and ensuring the appropriate level of coordination between the consortium and the EC
  • To ensure transparency and effectiveness in the communication between the partners by linking together the project components, enhancing communication, and supporting the circulation of relevant information
  • To organise periodic meetings to monitor the progress of the project, enabling consortium members and external stakeholders to be aware of the overall progress, while ensuring a collaborative environment to enable the consortium to make informed and effective decisions
  • To execute a quality plan and perform risk analysis, design and carry out self-assessment activities on a periodic basis, and activate contingency plans as needed
  • To ensure the respect of gender, legal, and ethical issues in all elements of the project.
WP2 investigates relevant use-cases and establishes a small-scale distributed testbed to validate the proposed software stack and to gather data for large-scale simulations. WP2 is led by Maxeler to ensure an appropriate industry perspective is adopted. The objectives of this work package are:

  • For each of the chosen use cases, identify the requirements they will place on the cloud environment identify their key benefits and identify evaluation criteria for effectiveness.
  • Implement each of the use cases as a deployable service.
  • Create a testbed from hardware donated by project partners.
  • Execute the use case applications on the testbed and gather performance metrics.
WP3 deals with the management and coordination of the technical aspects of the project. This work package will result in the creation of the self-organisation, self-management architecture; it is concerned with integrating the technical aspects of the project and with evaluating its results.

WP3 is led by the project coordinator (UCC). The objectives of this work package are:

  • State of the art analysis of technologies that will be potentially applicable within the case studies and the architecture.
  • Specify the overall architecture of the solution, its individual components and the interfaces that will be implemented in the WPs.
  • Verify that all architectural requirements identified in the requirements analysis tasks are fulfilled by the architecture.
  • Define, support and supervise the integration strategy, including the development of necessary connectors.
  • To define the evaluation plan, execute it and analyse evaluation results.
WP4 is concerned with the technical details of self-organisation and self-management. It will result in the development of appropriate algorithms for coalition formation and infrastructure management. It will result in the formation of a specialised software stack. WP4 is led by the project coordinator (UCC). The objectives of this work package are:

  • Define the CloudLightning protocol specification, i.e., the wire protocol used to communicate between compute nodes within the cloud fabric, and between the gateway service and cloud fabric.
  • Develop a programmatic API that will facilitate integration by providing a common interface to the protocol in the form of a software library.
  • Realise the protocol specification as a software stack that can be deployed on compute nodes within the cloud fabric. The protocol implementation will serve three purposes: coalition formation in response to tenders, service deployment to successful coalitions, and the
    management of coalitions for the remainder of the service lifecycle.
  • Identify and evaluate local decision strategies that will influence how nodes within the cloud fabric will communicate with one another in response to lifecycle events.
  • Realise coalition formation functionality so that coalitions heterogeneous cloud resources can be presented to the gateway service as sets of virtual machines.
  • Implement management functionality that deals with the mechanics of bootstrapping services on coalitions, surfacing operational metrics and allows for control over the remainder of the service lifecycle.
WP5 will see the development of a specialised service description language that will be developed and supported by appropriate Gateway Services to enable a declarative approach to creating and using services based on heterogeneous resources. WP5 is led by IeAT. The objectives of this work package are:

  • Identify, use or extend existing service specification languages to accommodate for the abstraction of the requirements for the application description.
  • Develop a gateway service based on the service specification language that will act as a gateway/proxy between the client and the self-organising cloud.
  • Provide a user-friendly web interface for consumers to interact with the cloud.
WP6 will characterise the heterogeneous resources used by the project and will develop appropriate support infrastructures for their inclusion into the CloudLightning software stack. WP6 is led by NTNU. The objectives of this work package are:

  • Characterise and capture behaviour of several resource co-processor types including:
    GPUs (Graphics Processing Units)
    MICs (Intel Many Integrated Core Architecture e.g. Intel Xeon Phi)
    DFEs (Maxeler FPGA-based DataFlow Engine)
  • Provide an infrastructure to allow services to effectively make use of these heterogeneous resources in a generalised fashion.
  • Develop Plug-ins that interface with the self-organisation and self-optimisation management platform developed in WP4.
WP7 will see the development of large scale simulations to demonstrate the CloudLightning approach at scale. It will use empirical data (performance and behavioural characteristics) gathered from earlier experiments on the testbed (WP2) to create realistic simulations of the proposed delivery model running at scale. WP7 is led by CERTH. The objectives of this work package are:

  • To provide a framework for modelling and simulating large scale heterogeneous cloud computing data centres according to the proposed self-organisation and self-optimisation approach.
  • To utilise the performance and behavioural characteristics captured in WP2 in order to build a realistic simulation framework.
  • To simulate the demonstrator applications of WP2 in large scale cloud computing resources.
  • To measure the effectiveness, performance and scalability of the proposed self-organisation and self-optimisation delivery models on large scale cloud infrastructures.
  • To report and evaluate the large-scale simulation results.
  • To provide theoretical estimates on the behaviour of the proposed models on large scale infrastructures.
WP8 is concerned with the dissemination and exploitation of the results of the project. This work package will also interact closely with industry to determine the market need for the technology and results of this interaction will feed into WP2. WP8 is led by DCU. The objectives of this work package are:

  • Develop and implement a strategy for the commercial and academic exploitation of the project’s results by identifying markets, users and areas of innovation where the project’s outputs will provide a competitive advantage.
  • Design and develop the project dissemination plan and communication handbook.
  • Design, develop and maintain the content, channels and communities underlying the project’s dissemination plan including the CloudLightning website, social networking presence and all collateral, print, digital or otherwise, associated with the project.
  • Openly and proactively disseminate and promote CloudLightning progress and results to the relevant scientific communities and a wider group of stakeholders including relevant users, cloud service providers, policy and decision makers and lay audiences, including citizen scientists and students.
  • Raise awareness, build consensus and create visible/measurable impact in terms of the ability of all stakeholders, including those at the political and decision making level, to exploit best practice related to the implementation of the new computing architectures, patterns,
    programming models and services being addressed in the project.
  • Provide a “one stop shop” to access all the information and services relevant to CloudLightning activities.
  • To align and liaise the activities of CloudLightning with standardisation bodies and complementary initiatives at European and International levels.