Skip to main content
poludmik
Projects
learn-lightning
Reports
GPT-2 on 7B tokens training

GPT-2 on 7B tokens training

Mikhail Poludin
Created on October 2|Last edited on October 2

Training progress


50k100k150ktrainer/global_step0.0000050.000010.0000150.000020.000025
GPT-2 at 28.09._23:38
GPT-2 at 26.09._15:37
GPT-2 at 18.09._13:26
50k100k150ktrainer/global_step2345
GPT-2 at 28.09._23:38
GPT-2 at 26.09._15:37
GPT-2 at 18.09._13:26
There's no data for the selected runs.
Try a different X axis setting.
Current X axis: trainer/global_step
50k100k150ktrainer/global_step-2-1012
GPT-2 at 28.09._23:38
GPT-2 at 26.09._15:37
GPT-2 at 18.09._13:26
50k100k150ktrainer/global_step22.53
GPT-2 at 28.09._23:38
GPT-2 at 26.09._15:37
Run set
21


Created with ❤️ on Weights & Biases.

https://wandb.ai/poludmik/learn-lightning/reports/GPT-2-on-7B-tokens-training--Vmlldzo5NTc0NTU4
Made with Weights & Biases. Sign up or log in to create reports like this one.