Skip to main content
sorry
Projects
trlx
Reports
Fix distributed dataloaders & deduplicate eval #276

Fix distributed dataloaders & deduplicate eval #276

https://github.com/CarperAI/trlx/pull/276
Sorry
Created on February 4|Last edited on February 4

Section 1


0100200300400Step0.60.650.70.75
ppo_sentiments/gpt2-imdb/4gpus:main@ddp
ppo_sentiments/gpt2-imdb/4gpus:main@zero2
ppo_sentiments/gpt2-imdb/4gpus:fix-ppo-dataloaders@zero2
ppo_sentiments/gpt2-imdb/4gpus:fix-ppo-dataloaders@ddp
Run set
4



Run set
4



Run set
4



Run set
4



Run set
4



Run set
4



Run set
4



Run set
4



Run set
4



Run set
4


Created with ❤️ on Weights & Biases.

https://wandb.ai/sorry/trlx/reports/Fix-distributed-dataloaders-deduplicate-eval-276---VmlldzozNDgzNDU3
Made with Weights & Biases. Sign up or log in to create reports like this one.