andrewzhang505

Andrewzhang505's group workspace

Group: mujoco_swimmer

1-1

of 1

Tags

async

mujoco

Author

andrewzhang505

State

Finished

Start time

July 13th, 2022 11:04:45 PM

Runtime

8m 44s

Tracked hours

8m 35s

Run path

andrewzhang505/sample_factory/87_mujoco_all_envs_see_4444_env_mujoco_swimmer_a.rl_True_20220713_160443_609920

Linux-5.13.0-35-generic-x86_64-with-glibc2.31

Python version

3.10.5

Command

-m sf_examples.mujoco_examples.train_mujoco --algo=APPO --with_wandb=True --wandb_tags mujoco async --seed=4444 --env=mujoco_swimmer --async_rl=True --experiment=87_mujoco_all_envs_see_4444_env_mujoco_swimmer_a.rl_True --train_dir=./train_dir/mujoco_all_envs/mujoco_all_envs_slurm

System Hardware

CPU count	72
GPU count	1
GPU type	NVIDIA GeForce RTX 2080 Ti

W&B CLI Version

0.12.21

Group

mujoco_swimmer

Job Type

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 110 keys
- actor_critic_share_weights:
  true
- actor_worker_gpus:[] 0 items
- adam_beta1:
  0.9
- adam_beta2:
  0.999
- adam_eps:
  0.000001
- adaptive_stddev:
  false
- algo:
  "APPO"
- async_rl:
  true
- batch_size:
  1,024
- batched_sampling:
  false
- benchmark:
  false
- ▶
  cli_args:{} 8 keys
- command_line:
  "--algo=APPO --with_wandb=True --wandb_tags mujoco async --seed=4444 --env=mujoco_swimmer --async_rl=True --experiment=87_mujoco_all_envs_see_4444_env_mujoco_swimmer_a.rl_True --train_dir=./train_dir/mujoco_all_envs/mujoco_all_envs_slurm"
- decorrelate_envs_on_one_worker:
  true
- decorrelate_experience_max_seconds:
  10
- default_niceness:
  0
- device:
  "gpu"
- encoder_custom:
  null
- encoder_extra_fc_layers:
  0
- encoder_subtype:
  "mlp_mujoco"
- encoder_type:
  "mlp"
- env:
  "mujoco_swimmer"
- env_frameskip:
  1
- env_framestack:
  4
- env_gpu_actions:
  false
- experiment:
  "87_mujoco_all_envs_see_4444_env_mujoco_swimmer_a.rl_True"
- experiment_summaries_interval:
  3
- exploration_loss:
  "entropy"
- exploration_loss_coeff:
  0
- force_envs_single_thread:
  true
- gae_lambda:
  0.95
- gamma:
  0.99
- git_hash:
  "unknown"
- git_repo_name:
  "not a git repository"
- help:
  false
- hidden_size:
  64
- initial_stddev:
  1
- keep_checkpoints:
  3
- kl_loss_coeff:
  0.1
- learning_rate:
  0.00295
- load_checkpoint_kind:
  "latest"
- lr_schedule:
  "linear_decay"
- lr_schedule_kl_threshold:
  0.008
- max_grad_norm:
  3.5
- max_policy_lag:
  10,000
- nonlinearity:
  "tanh"
- with_pbt:
  false
- with_vtrace:
  false
- with_wandb:
  true
- worker_num_splits:
  2

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 63 keys
- global_step:
  9,945,088
- len/len:
  1,000
- len/len_max:
  1,000
- len/len_min:
  1,000
- perf/_fps:
  19,251.298828125
- perf/_sample_throughput:
  39,566.19140625
- policy_stats/avg_true_objective:
  111.45321655273438
- policy_stats/avg_true_objective_max:
  116.6603012084961
- policy_stats/avg_true_objective_min:
  104.20648193359376
- reward/reward:
  111.45321655273438
- reward/reward_max:
  116.6603012084961
- reward/reward_min:
  104.20648193359376
- stats/avg_request_count:
  7.71999979019165
- stats/gpu_cache_learner:
  4.1943039894104
- stats/gpu_cache_policy_worker:
  2.0971519947052
- stats/gpu_mem_learner:
  1.2564480304718018
- stats/gpu_mem_policy_worker:
  0.02611199952661991
- stats/master_process_memory_mb:
  333.60546875
- stats/memory_learner:
  2,800.515625
- stats/memory_policy_worker:
  2,809.42578125
- stats/step_policy:
  0.0012823916040360928
- stats/wait_policy:
  0.00002940654667327181
- train/action_log_std_max:
  -1.5483306646347046
- train/action_log_std_mean:
  -1.8972663879394531
- train/action_log_std_min:
  -2.246201992034912
- train/action_mean:
  0.5009781718254089
- train/action_mean_max:
  2.225578546524048
- train/action_mean_min:
  -1.1786632537841797
- train/action_stddev_max:
  0.21260257065296173
- train/action_stddev_mean:
  0.15920142829418182
- train/action_stddev_min:
  0.10580029338598251
- train/adam_max_second_moment:
  0.1199343279004097
- train/adv_max:
  4.949295520782471
- train/adv_min:
  -4.4854960441589355
- train/adv_std:
  0.11896273493766785
- train/entropy:
  -0.956655740737915
- train/exploration_loss:
  0
- train/fraction_clipped:
  0.0205078125
- train/grad_norm:
  2.558384656906128
- train/kl_divergence:
  0.0018162161577492952
- train/kl_divergence_max:
  0.026402698829770088
- train/kl_loss:
  0.00018162162450607863
- train/loss:
  0.003691519144922495
- train/lr:
  0.00009697388304630294
- train/max_abs_logprob:
  2.245732307434082
- train/num_sgd_steps:
  8
- train/value_loss:
  0.001537013566121459
- train/version_diff_avg:
  9.90625
- train/version_diff_max:
  15
- train/version_diff_min:
  7

This run produced these artifacts as outputs. Total: 1. Learn more

wandb-history

run-87_mujoco_all_envs_see_4444_env_mujoco_swimmer_a.rl_True_20220713_160443_609920-history:v0