Accelerating your computing with the LUMI European supercomputer

Monday 3 Jun 2024, 10:00 → 16:00 Europe/Warsaw

Centrum Szkoleniowe Wspólna

LUMI is one of the largest European supercomputers and flagship EuroHPC systems. It is unified, heterogeneous computing infrastructure aiming at large, accelerated workflows. One of the key elements of its computing architecture is accelerator type and its programming environment. This half-day workshop is presenting typical transition steps from common clusters and cloud resources together with use cases with both traditional HPC workloads and fundamental elements for running large models with machine learning frameworks.

 

10:00 → 13:00 Using machine learning frameworks on LUMI

This part shows how to setup environment for AI workflows on a real supercomputing system. It combines common HPC tools with popular machine learning frameworks relying on GPU offloading and multiprocessing across multiple computing nodes.

Speaker: Maciej Szpindler

13:00 → 14:00 Lunch Break (lunch provided)

14:00 → 16:00 Working with large language models using Megatron-DeepSpeed on LUMI

This builds up on details from the first part to setup specific environment for LLM processing. It uses Megatron-DeepSpeed framework to experiment with pretrained data for prompt engineering tasks.

Speaker: Maciej Szpindler