andrewzhang505

Andrewzhang505's group workspace

Group: mujoco_reacher

1-1

of 1

Tags

async

mujoco

Author

andrewzhang505

State

Finished

Start time

July 13th, 2022 11:01:30 PM

Runtime

8m 58s

Tracked hours

8m 49s

Run path

andrewzhang505/sample_factory/85_mujoco_all_envs_see_4444_env_mujoco_reacher_a.rl_True_20220713_160128_895698

Linux-5.13.0-35-generic-x86_64-with-glibc2.31

Python version

3.10.5

Command

-m sf_examples.mujoco_examples.train_mujoco --algo=APPO --with_wandb=True --wandb_tags mujoco async --seed=4444 --env=mujoco_reacher --async_rl=True --experiment=85_mujoco_all_envs_see_4444_env_mujoco_reacher_a.rl_True --train_dir=./train_dir/mujoco_all_envs/mujoco_all_envs_slurm

System Hardware

CPU count	72
GPU count	1
GPU type	NVIDIA GeForce RTX 2080 Ti

W&B CLI Version

0.12.21

Group

mujoco_reacher

Job Type

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 110 keys
- actor_critic_share_weights:
  true
- actor_worker_gpus:[] 0 items
- adam_beta1:
  0.9
- adam_beta2:
  0.999
- adam_eps:
  0.000001
- adaptive_stddev:
  false
- algo:
  "APPO"
- async_rl:
  true
- batch_size:
  1,024
- batched_sampling:
  false
- benchmark:
  false
- ▶
  cli_args:{} 8 keys
- command_line:
  "--algo=APPO --with_wandb=True --wandb_tags mujoco async --seed=4444 --env=mujoco_reacher --async_rl=True --experiment=85_mujoco_all_envs_see_4444_env_mujoco_reacher_a.rl_True --train_dir=./train_dir/mujoco_all_envs/mujoco_all_envs_slurm"
- decorrelate_envs_on_one_worker:
  true
- decorrelate_experience_max_seconds:
  10
- default_niceness:
  0
- device:
  "gpu"
- encoder_custom:
  null
- encoder_extra_fc_layers:
  0
- encoder_subtype:
  "mlp_mujoco"
- encoder_type:
  "mlp"
- env:
  "mujoco_reacher"
- env_frameskip:
  1
- env_framestack:
  4
- env_gpu_actions:
  false
- experiment:
  "85_mujoco_all_envs_see_4444_env_mujoco_reacher_a.rl_True"
- experiment_summaries_interval:
  3
- exploration_loss:
  "entropy"
- exploration_loss_coeff:
  0
- force_envs_single_thread:
  true
- gae_lambda:
  0.95
- gamma:
  0.99
- git_hash:
  "unknown"
- git_repo_name:
  "not a git repository"
- help:
  false
- hidden_size:
  64
- initial_stddev:
  1
- keep_checkpoints:
  3
- kl_loss_coeff:
  0.1
- learning_rate:
  0.00295
- load_checkpoint_kind:
  "latest"
- lr_schedule:
  "linear_decay"
- lr_schedule_kl_threshold:
  0.008
- max_grad_norm:
  3.5
- max_policy_lag:
  10,000
- nonlinearity:
  "tanh"
- with_pbt:
  false
- with_vtrace:
  false
- with_wandb:
  true
- worker_num_splits:
  2

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 63 keys
- global_step:
  9,957,376
- len/len:
  50
- len/len_max:
  50
- len/len_min:
  50
- perf/_fps:
  19,660.88671875
- perf/_sample_throughput:
  40,475.1640625
- policy_stats/avg_true_objective:
  -12.998997688293455
- policy_stats/avg_true_objective_max:
  -7.432575225830078
- policy_stats/avg_true_objective_min:
  -20.729650497436523
- reward/reward:
  -12.998997688293455
- reward/reward_max:
  -7.432575225830078
- reward/reward_min:
  -20.729650497436523
- stats/avg_request_count:
  7.159999847412109
- stats/gpu_cache_learner:
  4.1943039894104
- stats/gpu_cache_policy_worker:
  2.0971519947052
- stats/gpu_mem_learner:
  1.509376049041748
- stats/gpu_mem_policy_worker:
  0.027135999873280525
- stats/master_process_memory_mb:
  332.9765625
- stats/memory_learner:
  2,803.171875
- stats/memory_policy_worker:
  2,807.515625
- stats/step_policy:
  0.0013851546682417393
- stats/wait_policy:
  0.00003261566234868951
- train/action_log_std_max:
  -3.848093271255493
- train/action_log_std_mean:
  -3.9557271003723145
- train/action_log_std_min:
  -4.063360691070557
- train/action_mean:
  0.10746322572231291
- train/action_mean_max:
  0.5076733827590942
- train/action_mean_min:
  -0.3627979159355163
- train/action_stddev_max:
  0.02132035046815872
- train/action_stddev_mean:
  0.019255749881267548
- train/action_stddev_min:
  0.017191147431731224
- train/adam_max_second_moment:
  0.7662732005119324
- train/adv_max:
  6.304969310760498
- train/adv_min:
  -2.8065991401672363
- train/adv_std:
  0.30047592520713806
- train/entropy:
  -5.073576927185059
- train/exploration_loss:
  0
- train/fraction_clipped:
  0.1767578125
- train/grad_norm:
  3.4999992847442627
- train/kl_divergence:
  0.010504651814699171
- train/kl_divergence_max:
  0.062416765838861465
- train/kl_loss:
  0.0002464184653945267
- train/loss:
  0.00281147682107985
- train/lr:
  0.00004788274600286968
- train/max_abs_logprob:
  4.063408851623535
- train/num_sgd_steps:
  8
- train/value_loss:
  0.004246425349265337
- train/version_diff_avg:
  12.609375
- train/version_diff_max:
  20
- train/version_diff_min:
  8

This run produced these artifacts as outputs. Total: 1. Learn more

wandb-history

run-85_mujoco_all_envs_see_4444_env_mujoco_reacher_a.rl_True_20220713_160128_895698-history:v0