Skip to main content

trlx: fix(llama): add position_ids to LlamaModelBranch #418

https://github.com/CarperAI/trlx/pull/418
Created on April 4|Last edited on April 4

Results


01k2k3k4k5k6kStep0.550.60.650.70.750.80.85
Run: ppo_sentiments_llama/llama-7b-hf/8gpus:fix-llama-fwd
1



Run: ppo_sentiments_llama/llama-7b-hf/8gpus:fix-llama-fwd
1



Run: ppo_sentiments_llama/llama-7b-hf/8gpus:fix-llama-fwd
1



Run: ppo_sentiments_llama/llama-7b-hf/8gpus:fix-llama-fwd
1



Run: ppo_sentiments_llama/llama-7b-hf/8gpus:fix-llama-fwd
1



Run: ppo_sentiments_llama/llama-7b-hf/8gpus:fix-llama-fwd
1



Run: ppo_sentiments_llama/llama-7b-hf/8gpus:fix-llama-fwd
1



Run: ppo_sentiments_llama/llama-7b-hf/8gpus:fix-llama-fwd
1



Run: ppo_sentiments_llama/llama-7b-hf/8gpus:fix-llama-fwd
1



Run: ppo_sentiments_llama/llama-7b-hf/8gpus:fix-llama-fwd
1



Run: ppo_sentiments_llama/llama-7b-hf/8gpus:fix-llama-fwd
1