Skip to main content

fix-ilql-sample-endings v. main

fix-ilql-sample-endings @20eec76/fix(ilql_randomwalks): bump `seq_length` to not trim any samples/2023-03-10 main @adbf8fc/Add intermediate checkpointing to `accelerate` trainers (#349)/2023-03-08
Created on March 10|Last edited on March 10

ilql_randomwalks/GPT2Config/1gpu


050100150Step00.20.40.60.8
050100150Step5060708090100
050100150Step20406080100
Run set
1



Run set
1


ppo_sentiments/gpt2-imdb/1gpu


Run set
1



Run set
1


ppo_sentiments_t5/t5-imdb/1gpu


Run set
0



Run set
0


sft_sentiments/gpt2/1gpu


Run set
1



Run set
1


ilql_sentiments/gpt2/1gpu


Run set
1



Run set
1


ppo_randomwalks/randomwalks/1gpu


Run set
1



Run set
1