Async vs XLA

Created on September 8|Last edited on September 8
Comment
﻿
﻿
charts/avg_episodic_return
charts/avg_episodic_return
2M4M6M8M10Mglobal_step-20-10010
Pong-v5__ppo_atari_envpool_async_jax__1__1662603991
Pong-v5__ppo_atari_envpool_xla_jax__1__1662603177
charts/SPS_update
charts/SPS_update
2M4M6M8M10Mglobal_step200040006000800010000
Pong-v5__ppo_atari_envpool_async_jax__1__1662603991
Pong-v5__ppo_atari_envpool_xla_jax__1__1662603177
Run set2
Name2 visualized
fanciful-serenity-5197
fanciful-serenity-5197
stellar-haze-5196
stellar-haze-5196
worldly-dew-5195
worldly-dew-5195
sandy-field-5194
sandy-field-5194
sweet-dream-5193
sweet-dream-5193
swift-thunder-5192
swift-thunder-5192
CartPole-v1__main__42__1705883726
CartPole-v1__main__42__1705883726
train_policy_pipeline7__1__1703997365
train_policy_pipeline7__1__1703997365
train_policy_pipeline6__1__1703997345
train_policy_pipeline6__1__1703997345
train_policy1__1__1702072783
train_policy1__1__1702072783
State
Notes
User
Tags
Created
Runtime
Sweep
_name_or_path
a
accelerator_config.even_batches
accelerator_config.split_batches
accelerator_config.use_seedable_sampler
action_noise
action_shape
actor_buffer_size
actor_device_ids
actor_devices
adafactor
adam_beta1
adam_beta2
adam_epsilon
add_cross_attention
agent_model_path
alg
algorithm
algorithm_spec.GAE
algorithm_spec.K_epoch
algorithm_spec.dueling
algorithm_spec.entropy_coeff
algorithm_spec.episodic_update
algorithm_spec.eps_clip
algorithm_spec.eps_decay
algorithm_spec.eps_final
algorithm_spec.eps_start
algorithm_spec.gamma
algorithm_spec.lambda
algorithm_spec.max_grad_norm
algorithm_spec.multi_step
algorithm_spec.policy_loss_coeff
algorithm_spec.replay_buffer_size
algorithm_spec.target_update_interval
algorithm_spec.vf_coeff
alpha
anneal-lr
anneal_lr
architectures
async_batch_size
async_update
asyncvec
attention_bias
attention_dropout
Finished
-
costa-huang
1y ago
33s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Finished
-
costa-huang
1y ago
1m 5s
-
EleutherAI/pythia-160m
-
true
false
true
-
-
-
-
-
false
0.9
0.999
1.0000e-8
false
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
["GPTNeoXForCausalLM"]
-
-
-
true
0
Failed
-
costa-huang
1y ago
52s
-
EleutherAI/pythia-160m
-
true
false
true
-
-
-
-
-
false
0.9
0.999
1.0000e-8
false
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
["GPTNeoXForCausalLM"]
-
-
-
true
0
Killed
-
costa-huang
1y ago
1m 18s
-
EleutherAI/pythia-160m
-
true
false
true
-
-
-
-
-
false
0.9
0.999
1.0000e-8
false
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
["GPTNeoXForCausalLM"]
-
-
-
true
0
Failed
-
costa-huang
1y ago
24s
-
EleutherAI/pythia-160m
-
true
false
true
-
-
-
-
-
false
0.9
0.999
1.0000e-8
false
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
["GPTNeoXForCausalLM"]
-
-
-
true
0
Failed
-
costa-huang
1y ago
1m 34s
-
EleutherAI/pythia-160m
-
true
false
true
-
-
-
-
-
false
0.9
0.999
1.0000e-8
false
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
["GPTNeoXForCausalLM"]
-
-
-
true
0
Finished
-
costa-huang
2y ago
14m 27s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
-
costa-huang
2y ago
40m 34s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Crashed
-
costa-huang
2y ago
21m 9s
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Failed
-
costa-huang
2y ago
1h 36m
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
1-10
of 4,883
﻿
﻿
Add a comment