Skip to content
Ishaan Reddy
Cookbook
Blog
Projects
About
⌘K
FineTuning
Cookbook articles on FineTuning.
Cookbook · FineTuning
●
Supervised fine-tuning (SFT)
├─
Distillation
├─
LoRA (Low-Rank Adaptation)
├─
SFT dataset formats
├─
Project: distill a small model from an open Llama model
├─
QLoRA