Reports
Created by
Created On
Last edited
How to Fine-Tune an LLM Part 1: Preparing a Dataset for Instruction Tuning
Learn how to fine-tune an LLM on an instruction dataset! We'll cover how to format the data and train a model like Llama2, Mistral, etc. is this minimal example in (almost) pure PyTorch.
40
capecape2023-10-03
How to Fine-Tune an LLM Part 2: Instruction Tuning Llama 2
In part 1, we prepped our dataset. In part 2, we train our model
21
2023-10-13
How to Fine-tune an LLM Part 3: The HuggingFace Trainer
Exploring how to get the best out of the Hugging Face Trainer and subclasses
22
2023-11-08
Distributed Training and W&B: The definitive guide
How can you leverage W&B on your distributed training setup.
0
2024-01-23
Exploring Collation methods: Different ways to construct a batch
Maybe packing is not the best idea after all...
0
2023-11-04