Skip to main content

infinite_prompt_pipeline v. main

infinite_prompt_pipeline @a50cc07/Adding `infinite_dataloader` since previous solution doesn't seem to work as expected/2023-03-07 main @ded2e5e/fix(ppo_trainer): update `AdaptiveKLController` with correct KL (#361)/2023-03-13
Created on March 13|Last edited on March 13

ilql_randomwalks/GPT2Config/1gpu


050100150Step20406080100
050100150Step00.10.20.30.4
050100150Step5060708090100
Run set
2



Run set
2


ppo_sentiments/gpt2-imdb/1gpu


Run set
2



Run set
2


ppo_randomwalks/randomwalks/1gpu


Run set
2



Run set
2


sft_sentiments/gpt2/1gpu


Run set
2



Run set
2


ilql_sentiments/gpt2/1gpu


Run set
2



Run set
2


ppo_hh/pythia-6B-static-sft/7gpus


Run set
2



Run set
2