Skip to main content
jon-tow
Projects
trlx
Reports
hh-gpt-j

hh-gpt-j

Jonathan Tow
Created on March 17|Last edited on March 17
Reproduction of Max's (@reciprocate) HH example but saved with value heads.
https://github.com/CarperAI/trlx/blob/2f90ba0ecd640ae18cd62adb5e934a4b779f534b/examples/hh/ppo_hh.py


Results


02k4k6k8k10kStep-2.5-2-1.5-1
Run: ppo_hh/gpt-j-6B/7gpus:ppo-hh
1



Run: ppo_hh/gpt-j-6B/7gpus:ppo-hh
1



Run: ppo_hh/gpt-j-6B/7gpus:ppo-hh
1



Run: ppo_hh/gpt-j-6B/7gpus:ppo-hh
1



Run: ppo_hh/gpt-j-6B/7gpus:ppo-hh
1



Run: ppo_hh/gpt-j-6B/7gpus:ppo-hh
1



Run: ppo_hh/gpt-j-6B/7gpus:ppo-hh
1



Run: ppo_hh/gpt-j-6B/7gpus:ppo-hh
1



Run: ppo_hh/gpt-j-6B/7gpus:ppo-hh
1



Run: ppo_hh/gpt-j-6B/7gpus:ppo-hh
1



Run: ppo_hh/gpt-j-6B/7gpus:ppo-hh
1


Created with ❤️ on Weights & Biases.

https://wandb.ai/jon-tow/trlx/reports/hh-gpt-j--VmlldzozODE1NjAw
Made with Weights & Biases. Sign up or log in to create reports like this one.