This training introduces PLGrid LLM Forge, an LLM inference service deployed on Cyfronet supercomputers. The platform allows users to access large language models (such as Bielik or Llama) via an OpenAI-compatible API. It simplifies the setup of an inference environment and provides monitoring of usage and accounting. During this session, you are going to learn how to apply for this resource, generate an API token, and use it in basic examples with Python. The training will also cover more complex hands-on exercises using the PLGrid LLM Forg service. The course is intended for PLGrid users who want to start using LLMs without the complicated setup.
Technical prerequisites:
- No recommended training before this one.
- No account required.
- Participants' computers should be equipped with software that allows SSH connections. On Windows, it is recommended to use Windows Terminal (not to be confused with PowerShell after checking if OpenSSH is installed (run `ssh -V` in the terminal). We advise against using Putty.
Date
Tuesday, April 14th, 15:00-17:00
Duration
2 hours
Trainers
Szymon Mazurek (ACC Cyfronet AGH): Deep Learning Engineer in HPC Software Department, specializing in model development, performance profiling, optimization, and benchmarking.
Oskar Klimas (ACC Cyfronet AGH): HPC trainer, computational chemistry specialist at Helpdesk, with experience in using a variety of applications, including Gaussian, AMS ADF, GROMACS, and LAMMPS.
Training language
English
