Skip to main content
costa-huang
Projects
cleanRL
Reports
Cleanba impala threads ASAP grad norm

Cleanba impala threads ASAP grad norm

Costa
Created on April 9|Last edited on April 9

5M10M15M20M25Mglobal_step5000100001500020000
5M10M15M20M25Mglobal_step-3000-2500-2000-1500-1000-5000
5M10M15M20M25Mglobal_step32343638
5M10M15M20M25Mglobal_step00.020.040.060.080.10.120.14
5M10M15M20M25Mglobal_step2e+184e+186e+188e+181e+191.2e+191.4e+19
5M10M15M20M25Mglobal_step050001000015000200002500030000
5M10M15M20M25Mglobal_step0100200300
5101520Time (minutes)0100200300
baseline (RTX 3060 TI)
1
actor threads (A100)
1
actor threads asap (A100) prime candidate
1
A100
1
cleanba impala 8 A100 baseline (a0_l1_d4)
1
actor threads asap no update A100
1
actor threads asap (A100) prime candidate iteration
1
actor threads asap (A100) update policy mid rollout
1
cleanba baseline
1







Created with ❤️ on Weights & Biases.

https://wandb.ai/costa-huang/cleanRL/reports/Cleanba-impala-threads-ASAP-grad-norm--Vmlldzo0MDE1Njg5
Made with Weights & Biases. Sign up or log in to create reports like this one.