llm_surgery
Members
This team has no public members. You must be a member to see who's a part of this team.
Runs
Name
Project
State
Created
User
No rows found
Loading...
Reports
Eval Harness Results
Dataset Viz [WIP]
Dataset: Alpaca, OpenHermes 2.5 sample 50k and Ultrachat/feedback
How to Fine-Tune an LLM Part 1: Preparing a Dataset for Instruction Tuning
Learn how to fine-tune an LLM on an instruction dataset! We'll cover how to format the data and train a model like Llama2, Mistral, etc. is this minimal example in (almost) pure PyTorch.
How to Fine-tune an LLM Part 3: The HuggingFace Trainer
Exploring how to get the best out of the Hugging Face Trainer and subclasses