Skip to main content

How much time does env stepping take?

Created on August 8|Last edited on October 16

2M4M6M8Mglobal_step0.20.40.60.81
2M4M6M8Mglobal_step0.20.40.60.811.21.41.6
2M4M6M8Mglobal_step510152025
2M4M6M8Mglobal_step204060
For-loop (torch) stats/environment_step_timeFor-loop (torch) stats/inference_timeFor-loop (torch) stats/training_timeFor-loop (torch) stats/iteration_timeFor-loop (torch) stats/rollout_timeSubprocess (torch) stats/environment_step_timeSubprocess (torch) stats/inference_timeSubprocess (torch) stats/training_timeSubprocess (torch) stats/iteration_timeSubprocess (torch) stats/rollout_timeEnvPool (sync, torch) stats/environment_step_timeEnvPool (sync, torch) stats/inference_timeEnvPool (sync, torch) stats/training_timeEnvPool (sync, torch) stats/iteration_timeEnvPool (sync, torch) stats/rollout_timeEnvPool (sync, xla, jax) stats/environment_step_timeEnvPool (sync, xla, jax) stats/inference_timeEnvPool (sync, xla, jax) stats/training_timeEnvPool (sync, xla, jax) stats/iteration_timeEnvPool (sync, xla, jax) stats/rollout_timeEnvPool (sync, jax) stats/environment_step_timeEnvPool (sync, jax) stats/inference_timeEnvPool (sync, jax) stats/training_timeEnvPool (sync, jax) stats/iteration_timeEnvPool (sync, jax) stats/rollout_time0.00.51.0
For-loop (torch)
1
Subprocess (torch)
1
EnvPool (sync, torch)
1
EnvPool (sync, xla, jax)
1
EnvPool (sync, jax)
1




For-loop
1
Subprocess
1
EnvPool (sync)
1
For-loop (openai/baselines' style)
1