Skip to main content

Llama-3.1-8b Fine-tuning

Fine-tuning a Llama 3.1 8b pre-trained model with the Alpaca dataset.
Created on August 28|Last edited on July 1

Test Metrics


100150200250300Step0.5120.5130.5140.5150.5160.5170.518
radiant-glitter-367 Run setsweet-deluge-366 Run setswift-wave-365 Run setearnest-galaxy-364 Run setbreezy-butterfly-363 Run setsparkling-oath-362 Run setsilver-pyramid-361 Run setfiery-wind-360 Run setethereal-terrain-359 Run setcopper-universe-358 Run setradiant-glitter-367 Run setsweet-deluge-366 Run setswift-wave-365 Run setearnest-galaxy-364 Run setbreezy-butterfly-363 Run setsparkling-oath-362 Run setsilver-pyramid-361 Run setfiery-wind-360 Run setethereal-terrain-359 Run setcopper-universe-358 Run set0.000.100.200.300.40
radiant-glitter-367 Run set 2sweet-deluge-366 Run set 2swift-wave-365 Run set 2earnest-galaxy-364 Run set 2breezy-butterfly-363 Run set 2sparkling-oath-362 Run set 2silver-pyramid-361 Run set 2fiery-wind-360 Run set 2ethereal-terrain-359 Run set 2copper-universe-358 Run set 2radiant-glitter-367 Run set 2sweet-deluge-366 Run set 2swift-wave-365 Run set 2earnest-galaxy-364 Run set 2breezy-butterfly-363 Run set 2sparkling-oath-362 Run set 2silver-pyramid-361 Run set 2fiery-wind-360 Run set 2ethereal-terrain-359 Run set 2copper-universe-358 Run set 20.000.050.100.15
Run set
177
Run set 2


Training Metrics


Run set
1
Run set 2



Run set
177



Run set
177