Services for the European Open Science Cloud

Common services

Transparent data movement from EGI to EUDAT

The main goal of the EOSC-hub project is to synergize the services and infrastructures from major European providers including EGI and EUDAT, enabling researchers to freedom of choice of the services, data and infrastructure necessary for their work.  Users from many communities have reported interest in being able to use resources provisioned by these 2 infrastructures simultaneously in a transparent fashion, i.e.:

  • using single sign on mechanisms between infrastructures
  • being able to transparently transfer data between infrastructures

EOSC-hub WP6 has been endeavoring to enable transparent data access between the infrastructures. The main data management components in EGI and EUDAT are respectively, EGI-DataHub based on Onedata platform and B2SAFE/B2STAGE based on iRODS. Currently no transparent mechanisms allowing users to move data between these infrastructures exists, the only options are manual transfers using such tools as GridFTP.

These two demo videos present the managment of data transfer across EGI, EUDAT, INDIGO data and compute services. 

The first demo video shows the how data can be transparently moved from EGI to EUDAT. It divided into 4 sections:

  • Registration of B2STAGE storage in EGI-DataHub
  • Creation of dsata space in EGI-DataHub supported by the B2STAGE storage
  • Upload of some data to the data space
  • Data access from GUI and command line

The second demo video presents import of existing data from EUDAT to EGI. The demo is divided into the following 4 sections:

  • Registration of B2STAGE storage in EGI-DataHub
  • Creation of data space in EGI-DataHub supported by the B2STAGE storage from which existing data is imported to EGI-DataHub
  • Access of data from B2STAGE using EGI-DataHub user interface
  • Automatic discovery of new data added on the B2STAGE storage

IAM

IAM (Identity and Access Management) service is one of EOSChub AAI solution, and provided by INDIGO-DataCloud project. The IAM service provides a layer where identities, enrolment,  group membership,  attributes  and  policies  to  access  distributed  resources  and services can be managed in a homogeneous and interoperable way.

The linked training was given in the EOSC-hub tech-talk: AAI

TOSCA for Heat

Heat-Translator is an Openstack project and licensed under Apache 2. It is a command line tool which takes non-Heat templates as an input and produces a Heat Orchestration Template (HOT) which can be deployed by Heat. Currently the development and testing is done with an aim to translate OASIS Topology and Orchestration Specification for Cloud Applications (TOSCA) templates to HOT. However, the tool is designed to be easily extended to use with any format other than TOSCA.

EGI Cloud Container Compute Training Material

This training material introduces EGI Cloud Container Compute. What is it about, its features, architecture, how to use it, and examples of using the service

Launching a Kubernetes Cluster using TOSCA and OpenID

This video shows how to use the IM web interface to launch a Kubernetes Cluster using a TOSCA document on a OpenStack on-premise cloud platform using INDIGO IAM OpenID credentials.

EGI Workload Manager

This training introduces the EGI Workload Manager service, also known as DIRAC4EGI, based on DIRAC technology.
The Workload Manager distributes and manages centrally thousands of computational tasks on cloud and HTC.

Additional materials about the EGI Workload Manager service have been used during the Virgo Computing School.

PaaS Orchestrator

This training video introduces the PaaS Orchestrator develped by INDIGO-DataCloud. The service collects high-level deployment requests from the software layer, and coordinates the resource or service deployment over dynamic Mesos clusters or directly over IaaS platforms.

EGI DataHub

This course introduces the EGI DataHub and Open Data Platform and how to exploit their main features such as:

  • creation of distributed filesystems;
  • access to distributed filesystems through POSIX and CDMI interfaces;
  • exploiting DataHub and Open Data Platform features from a cloud VM hosted in the EGI Federated Cloud;
  • publish data in open data catalogues such as OpenAIRE.

B2SHARE

This training repository provides training material and in-depth information in using the B2SHARE service.

B2SAFE and B2STAGE

This training module provides you with instructions on how to deploy B2SAFE and B2STAGE. It also shows you how to use these services. Moreover, the module provides hands-on training on Persistent Identifiers, more specifically Handle v8 and the corresponding B2HANDLE python library.

Pages