Skip to main content

fix-total-steps-distributed v. main

fix-total-steps-distributed @c883b0f/fix(ilql_trainer): `total_steps` calculation if running distributed/2023-03-16 main @4623105/[fix] Drop `<eos>` from ILQL sample's phrases (#362)/2023-03-14
Created on March 16|Last edited on March 16

ppo_randomwalks/randomwalks/1gpu


050100150Step0.20.40.60.8
050100150Step10203040506070
050100150Step0.20.40.60.8
Run set
2



Run set
2


ppo_hh/pythia-6B-static-sft/7gpus


Run set
2



Run set
2


sft_sentiments/gpt2/1gpu


Run set
2



Run set
2


ilql_sentiments/gpt2/1gpu


Run set
2



Run set
2


ppo_sentiments/gpt2-imdb/1gpu


Run set
2



Run set
2


ilql_randomwalks/GPT2Config/1gpu


Run set
2



Run set
2