Services for the European Open Science Cloud

Generic/Cross-domain

The Elastic Cloud Computing Cluster (EC3)

Elastic Cloud Computing Cluster (EC3) is a tool to create elastic virtual clusters on top of Infrastructure as a Service (IaaS) providers, either public (such as Amazon Web ServicesGoogle Cloud or Microsoft Azure) or on-premises (such as OpenNebula and OpenStack). We offer recipes to deploy TORQUE (optionally with MAUI), SLURMSGEHTCondorMesosNomad and Kubernetes clusters that can be self-managed with CLUES: it starts with a single-node cluster and working nodes will be dynamically deployed and provisioned to fit increasing load (number of jobs at the LRMS). Working nodes will be undeployed when they are idle. This introduces a cost-efficient approach for Cluster-based computing.

Training on integration of OpenID Connect services to ELIXIR AAI

The target group of the training is developers and administrators of services that want to integrate to ELIXIR AAI for user authentication and authorisation. The training has hands-on sessions for the participants to integrate their own service (or, a test service provided by the trainers) to ELIXIR AAI.

Keywords: AAI, OpenID Connect, Authentication

Target audience: service administrators in organizations that want to make use of ELIXIR AAI

Difficulty level: Intermediate

Authors: Michal Prochazka, Dominik Frantisek Bucik

https://docs.google.com/document/d/1LGL1Ax_iRcw5A15kgr_epZobsDExDmCqu6keGBY22Dg/edit

 

An EOSC-hub proposal for the EOSC Technical Architecture

This webinar will describe the Reference Technical Architecture for EOSC proposed by EOSC-hub during the recent EOSC-hub Technical Workshop.

The proposed architecture is based on the concepts of service composability and interoperability. Service categories and relationships between them will be presented. The process to define interoperability guidelines for different technical areas will be also depicted.

Who should attend:

Service providers, Users, members of other EOSC implementation projects including EOSC cluster projects, members of EOSC working groups, European and national e-infrastructures, European and national research infrastructures

Key Takeaways for attendees

  • EOSC Technical Reference architecture proposed by EOSC-hub
  • Classification of services within EOSC
  • Status of the EOSC-hub work to define interoperability guidelines for EOSC macro-features (Federating core, AAI, Cloud and Container computing, FAIR data management, etc.)

Federated AAI for EIDA Services

EIDA is the European Integrated Data Archive infrastructure within ORFEUS to provide access to seismic waveform data and related metadata in European archives. EIDA has been stablised in 2013.  EPOS-ORFEUS Competence Center works on new federated seismological services for EIDA. The presentation slides introduced the new Authentication and Authorization for EIDA developed by the CC. The two presentations were given in EGU 2019 conference, April 10th 2019, Vienna, and in EPOS Seismology Meeting, May 7th 2019, Potsdam, respectively.

A user documentaion is also avaialbe at: https://geofon.gfz-potsdam.de/eas/EIDAAuthenticationService.pdf

Transparent data movement from EGI to EUDAT

The main goal of the EOSC-hub project is to synergize the services and infrastructures from major European providers including EGI and EUDAT, enabling researchers to freedom of choice of the services, data and infrastructure necessary for their work.  Users from many communities have reported interest in being able to use resources provisioned by these 2 infrastructures simultaneously in a transparent fashion, i.e.:

  • using single sign on mechanisms between infrastructures
  • being able to transparently transfer data between infrastructures

EOSC-hub WP6 has been endeavoring to enable transparent data access between the infrastructures. The main data management components in EGI and EUDAT are respectively, EGI-DataHub based on Onedata platform and B2SAFE/B2STAGE based on iRODS. Currently no transparent mechanisms allowing users to move data between these infrastructures exists, the only options are manual transfers using such tools as GridFTP.

These two demo videos present the managment of data transfer across EGI, EUDAT, INDIGO data and compute services. 

The first demo video shows the how data can be transparently moved from EGI to EUDAT. It divided into 4 sections:

  • Registration of B2STAGE storage in EGI-DataHub
  • Creation of dsata space in EGI-DataHub supported by the B2STAGE storage
  • Upload of some data to the data space
  • Data access from GUI and command line

The second demo video presents import of existing data from EUDAT to EGI. The demo is divided into the following 4 sections:

  • Registration of B2STAGE storage in EGI-DataHub
  • Creation of data space in EGI-DataHub supported by the B2STAGE storage from which existing data is imported to EGI-DataHub
  • Access of data from B2STAGE using EGI-DataHub user interface
  • Automatic discovery of new data added on the B2STAGE storage

ELIXIR AAI Training

This set of training materials introduce ELIXIR AAI service for user authentication and authorisation. The service is developed by the ELIXIR Compence Center. The training is delivered during the ECCB 2019 conference

Knowledge Hub: The PID basics

This category contains basic information for those new to Persistent Identifiers created by the FREYA Project. This section will continue to be updated.

Training on the EOSC-hub AAI--The service provider perspective

This training materilas is provided for the AAI training during EOSC-hub week 2019, 12 Apr 2019, Prague. This material provides an overview of the various integration workflows in support of resource providers’ needs for federated access through the EOSC-hub AAI. These workflows build on standards and open technologies, including SAML 2.0, OpenID Connect, and OAuth 2.0, in order to support the integration of web-based services. The training also covers more advanced workflows for addressing non-web-based access use cases (e.g. command line and API). In this context techniques for obtaining credentials on behalf of the end-user using OAuth tokens and X509 proxy certificates through online authorities will be presented. 

EGI Jupyter Notebooks examples

Some simple notebooks that showcase the EGI Notebooks features.

Operations Portal

The Operations Portal is one of EOSC-hub core services. It is the central portal for operations management of the EGI federated infrastructure. The linked training material gives an overview of the service, its architecture and tools. A data aggregation framework used by the Operation Portal is called Lavoisier. More information about Lavoisiter can be found at here

Pages