Skip to main content
morg
Projects
shakespeare-on-replit
Reports
Fine-tuning nanoGPT on Shakespeare

Fine-tuning nanoGPT on Shakespeare

Morgan McGuire
Created on January 18|Last edited on January 18
Created on Replit using this nanoGPT repl, based on on Andrej Karpathy's nanoGPT project,

Loss Metrics


Showing first 10 runs
02004006008001kStep3.43.63.84
ft-1674056421.9110324
ft-1674052489.2985106
ft-1674051320.9238033
ft-1674050949.2209725
ft-1674050637.2042222
ft-1674050276.3659801
ft-1674044707.3777597
ft-1674044340.014796
ft-1674043456.780434
ft-1674042742.9424796
Showing first 10 runs
02004006008001kStep33.544.5
ft-1674056421.9110324
ft-1674052489.2985106
ft-1674051320.9238033
ft-1674050949.2209725
ft-1674050637.2042222
ft-1674050276.3659801
ft-1674044707.3777597
ft-1674044340.014796
ft-1674043456.780434
ft-1674042742.9424796
Run set
24

n

Samples at 50 iterations


Run: ft-1674056421.9110324
1


Samples at 900 steps


Run set
1


Created with ❤️ on Weights & Biases.

https://wandb.ai/morg/shakespeare-on-replit/reports/Fine-tuning-nanoGPT-on-Shakespeare--VmlldzozMzY0MTEy
Made with Weights & Biases. Sign up or log in to create reports like this one.