Services for the European Open Science Cloud

EOSC_hub Core Service

Transparent data movement from EGI to EUDAT

The main goal of the EOSC-hub project is to synergize the services and infrastructures from major European providers including EGI and EUDAT, enabling researchers to freedom of choice of the services, data and infrastructure necessary for their work.  Users from many communities have reported interest in being able to use resources provisioned by these 2 infrastructures simultaneously in a transparent fashion, i.e.:

  • using single sign on mechanisms between infrastructures
  • being able to transparently transfer data between infrastructures

EOSC-hub WP6 has been endeavoring to enable transparent data access between the infrastructures. The main data management components in EGI and EUDAT are respectively, EGI-DataHub based on Onedata platform and B2SAFE/B2STAGE based on iRODS. Currently no transparent mechanisms allowing users to move data between these infrastructures exists, the only options are manual transfers using such tools as GridFTP.

These two demo videos present the managment of data transfer across EGI, EUDAT, INDIGO data and compute services. 

The first demo video shows the how data can be transparently moved from EGI to EUDAT. It divided into 4 sections:

  • Registration of B2STAGE storage in EGI-DataHub
  • Creation of dsata space in EGI-DataHub supported by the B2STAGE storage
  • Upload of some data to the data space
  • Data access from GUI and command line

The second demo video presents import of existing data from EUDAT to EGI. The demo is divided into the following 4 sections:

  • Registration of B2STAGE storage in EGI-DataHub
  • Creation of data space in EGI-DataHub supported by the B2STAGE storage from which existing data is imported to EGI-DataHub
  • Access of data from B2STAGE using EGI-DataHub user interface
  • Automatic discovery of new data added on the B2STAGE storage

Training on the EOSC-hub AAI--The service provider perspective

This training materilas is provided for the AAI training during EOSC-hub week 2019, 12 Apr 2019, Prague. This material provides an overview of the various integration workflows in support of resource providers’ needs for federated access through the EOSC-hub AAI. These workflows build on standards and open technologies, including SAML 2.0, OpenID Connect, and OAuth 2.0, in order to support the integration of web-based services. The training also covers more advanced workflows for addressing non-web-based access use cases (e.g. command line and API). In this context techniques for obtaining credentials on behalf of the end-user using OAuth tokens and X509 proxy certificates through online authorities will be presented. 

Operations Portal

The Operations Portal is one of EOSC-hub core services. It is the central portal for operations management of the EGI federated infrastructure. The linked training material gives an overview of the service, its architecture and tools. A data aggregation framework used by the Operation Portal is called Lavoisier. More information about Lavoisiter can be found at here

ARGO

ARGO is a lightweight service for Service Level Monitoring designed for medium and large sized Research Infrastructures. The ARGO software stack is comprised of the following components (products). 

SPMT

The Service Portfolio Management Tool (SPMT) is one of EOSC-hub Federation services, which is a tool aimed at facilitating service management in IT service provision, including federated scenarios. It represents a complete list of the services managed by a service provider; some of these services are visible to the customers, while others are internal. The service management system has been designed to be compatible with the FitSM service portfolio management fitsm.eu.

The linked presentation gives an overview introduction of SPMT. More information and code can be found in github: https://grnet.github.io/agora-sp/

IAM

IAM (Identity and Access Management) service is one of EOSChub AAI solution, and provided by INDIGO-DataCloud project. The IAM service provides a layer where identities, enrolment,  group membership,  attributes  and  policies  to  access  distributed  resources  and services can be managed in a homogeneous and interoperable way.

The linked training was given in the EOSC-hub tech-talk: AAI

GOCDB

Grid Configuration Database (GOCDB) is one of EOSC-hub federation services. GOCDB contains general information about the sites participating to the production Grid. Accessed by all the project actors (end-users, sitemanagers, NGI mangers, support teams, VO managers), by other tools and by third party middleware in order to get Grid topology. The portal has a single central installation but interested NGIs can download and install their own instance. The linked wiki provide guides and information for end users

GGUS

GGUS is one of EOSC-hub federation services. The GGUS system creates a trouble ticket to record the request and tracks the ticket from creation through to solve. The  linked document is the user guide  that provides information for users how to submit a ticket using the web interface, and how to brows and modify tickets, etc.

ECAS_notebooks: Summer+Days.ipynb

This notebook computes the Summer Days index: starting from the daily maximum temperature (1980-1990), the Summer Days index is the annual count of days number of days where TX (daily maximum temperature) > 25°C

EGI Workload Manager

This training introduces the EGI Workload Manager service, also known as DIRAC4EGI, based on DIRAC technology.
The Workload Manager distributes and manages centrally thousands of computational tasks on cloud and HTC.

Additional materials about the EGI Workload Manager service have been used during the Virgo Computing School.

Pages