Skip to main content

fix-preserve-eos-token v. main

fix-preserve-eos-token @de3b04f/fix(ppo_trainer): preserve `<eos>` and append it after trimming/2023-03-28 main @114998b/[feat] Add benchmark tools (#357)/2023-03-28
Created on March 28|Last edited on March 28

sft_sentiments/gpt2/1gpu


02004006008001kStep0.550.60.650.70.75
Run set
2



Run set
2


ilql_sentiments/gpt2/1gpu


Run set
2



Run set
2


ppo_hh/gpt-j-6B/7gpus


Run set
0



Run set
0


ppo_randomwalks/randomwalks/1gpu


Run set
2



Run set
2


ppo_sentiments_t5/t5-imdb/1gpu


Run set
2



Run set
2


ilql_randomwalks/GPT2Config/1gpu


Run set
2



Run set
2


ppo_hh/pythia-6B-static-sft/7gpus


Run set
2



Run set
2


ppo_sentiments/gpt2-imdb/1gpu


Run set
2



Run set
2