About
Objectives
Expected Results
Partners
Project Structure
SPECTRUMCoP
SPECTRUM Community of Practice

SPECTRUM Community of Practice (SPECTRUMCoP)

Creating a connected community of scientists and infrastructure managers to work towards a mutual understanding of future needs, associated challenges and their possible solutions

Joining domain and infrastructure efforts towards a future digital continuum for Radio-Astronomy and High-Energy Physics

 

You can express your interest to join the SPECTRUMCoP by sending an email to spectrumcop-expression-of-interest[at]mailman[dot]egi[dot]eu

What is the SPECTRUMCoP?

The amount of data gathered, shared and processed in frontier research is set to increase steeply in the coming decade, leading to unprecedented data processing, simulation and analysis needs. In particular, High Energy Physics and Radio Astronomy are gearing up for groundbreaking instruments, necessitating infrastructures many times larger than the current capabilities. In this context, the EU-funded SPECTRUM project brings together leading European science organisations and e-Infrastructure providers to formulate a Strategic Research, Innovation, and Deployment Agenda (SRIDA) along with a Technical Blueprint for a European computer and data continuum. This collaborative effort is set to create an Exabyte-scale research data federation and compute continuum, fostering data-intensive scientific collaborations across Europe.

The SPECTRUM Community of Practice (CoP) aims to create a connected community of scientists and infrastructure managers having a mutual understanding of future needs, associated challenges and their possible solutions.

The goal of the CoP is to serve as a discussion forum across the HEP and RA domains to identify common directions for the design and operations of future systems, agreed processing models and solutions, and to provide feedback on investment to funding agencies and policy makers.

In particular:

  • Select and Define Use Cases: Identify at least 10 representative HEP and RA science use cases, outlining current and future requirements for computing, storage/processing, and services
  • Collect Inventory Resources: Review existing services and resources relevant to the RI communities
  • Assess Policies: Examine existing and planned access policies and federation methods used by European e-Infrastructure service providers
  • Operate Community Survey: Develop and execute a survey to gather broader community insights.

 

You can express your interest to join the SPECTRUMCoP by sending an email to spectrumcop-expression-of-interest[at]mailman[dot]egi[dot]eu

SPECTRUMCoP Charter

SPECTRUMCoP Working Groups

1
WG1: Data Management and Access
  • Data Management – Including data location, movement, and registration.
  • Data Access Protocols
  • Data Archiving
  • Security
2
WG2: Workflow management and organization
  • Resource Discovery and Workflow Submission
  • Resource Allocation
  • Complex Workflows – including DAGs (Directed Acyclic Graphs), chain and more.
3
WG3: Compute Environment
  • Expected Tools and Services – Describes the tools and services expected at centers, including virtualization and CVMFS (CernVM File System).
  • Facility Expectations – Outlines expectations for facilities, including workflow execution times (“be able to execute workflows xx hours long”), memory requirements (“nodes with at least YY GB RAM”), networking capabilities (“networking in/out at least at YY Mbps per core”) and virtualization.
  • Edge Services – Discusses edge services needed to establish environment(s).
  • Library Provisioning – Discusses the minimal set of libraries and how to provide them, including virtualization, Spack, and module.
4
WG4: SW tools
  • Machine Learning Frameworks
  • Multithreading Frameworks
  • Multi-Node Tools – Including MPI (Message Passing Interface) and similar tools
  • Compilers, toolchains, …
  • Quantum computing tools and frameworks
  • Code Management Practices
5
WG5: Scientific Use cases
  • Typical Use Cases – Describes typical use cases with quantitative descriptions.
  • Requirements and Needs
  • Best Practices Collection – Gathers best practices and existing documents.
  • Data Fluxes and Paths 
6
WG6: Facilities
  • HPC Centers – Discusses drivers and future directions of HPC centers.
  • Access to Quantum Computing Hardware
  • Access to Commercial and Public Clouds
  • Sustainability – Examines economic and carbon footprint aspects.
  • Security – Including access and translation from global SSO to local credentials