Examples

Deployment

SGLang

Deploy DeepSeek distilled models with SGLang

vLLM

Deploy Llama 3.1 with vLLM

TGI

Deploy Llama 4 with TGI

NIM

Deploy a DeepSeek distilled model with NIM

TensorRT-LLM

Deploy DeepSeek R1 and its distilled version with TensorRT-LLM

Fine-tuning

Axolotl

Fine-tune Llama 4 on a custom dataset using Axolotl.

TRL

Fine-tune Llama 3.1 8B on a custom dataset using TRL.

Accelerators

AMD

Deploy and fine-tune LLMs on AMD

Intel Gaudi

Deploy and fine-tune LLMs on Intel Gaudi

TPU

Deploy and fine-tune LLMs on TPU

LLMs

Deepseek

Deploy and train Deepseek models

Llama

Deploy Llama 4 models

Misc

Docker Compose

Use Docker and Docker Compose inside runs

NCCL tests

Run multi-node NCCL tests with MPI

A3 Mega

Set up GCP A3 Mega clusters with optimized networking

A3 High

Set up GCP A3 High clusters with optimized networking