Advanced Topics

Single GPU Billion-scale Model Training via Parameter-Efficient Finetuning

How to take advantage of large foundation models with the help of parameter-efficient finetuning. In the tutorial, we will use combine IA^3, BitFit, and gradient checkpointing to finetune FLAN-T5-XL.

efficient_finetuning_basic.html

Hyperparameter Optimization in AutoMM

How to do hyperparameter optimization in AutoMM.

hyperparameter_optimization.html

Knowledge Distillation in AutoMM

How to do knowledge distillation in AutoMM.

model_distillation.html

Customize AutoMM

How to customize AutoMM configurations.

customization.html

AutoMM Presets

How to use AutoMM presets.

presets.html

Few Shot Learning with AutoMM

How to use foundation models + SVM for few shot learning.

few_shot_learning.html

Handling Class Imbalance with AutoMM - Focal Loss

How to use AutoMM to handle class imbalance.

focal_loss.html

Faster Prediction with TensorRT

How to use TensorRT in accelerating AutoMM model inference.

tensorrt.html

Continuous Training with AutoMM

Different use cases for continuous training with AutoMM.

continuous_training.html