Skip to main content

Interleave ablation study

Created on February 25|Last edited on February 25
Larger models do benefit from interleaving.

200k400k600k800k1M1.2M1.4Mglobal_step600080001000012000140001600018000
200k400k600k800k1M1.2M1.4Mglobal_step6000800010000120001400016000
act thpt: ppo_atari_envpool_jax_3_buffer
1
act thpt: ppo_atari_envpool_jax_3_buffer_interleave
1
act thpt: ppo_atari_envpool_jax_3_buffer (large nn)
1
act thpt: ppo_atari_envpool_jax_3_buffer_interleave (large nn)
1

Training:

ppo_atari_envpool_jax_3_buffer (large nn)
1
ppo_atari_envpool_jax_3_buffer_interleave (large nn)
1