andrewzhang505

Andrewzhang505's group workspace

Group: mujoco_humanoid

1-1

of 1

Tags

envpool

Author

andrewzhang505

State

Finished

Start time

December 14th, 2022 3:11:46 AM

Runtime

24m 12s

Tracked hours

24m 3s

Run path

andrewzhang505/sample_factory/envpool_humanoid_envpool5_20221214_031145_609800

Linux-4.19.0-22-cloud-amd64-x86_64-with-glibc2.28

Python version

3.9.13

Git repository

git clone https://github.com/andrewzhang505/sample-factory.git

Git state

git checkout -b "envpool_humanoid_envpool5_20221214_031145_609800" 0319b736bfad9cf54f8f3ad6ab669193d3ca1d8b

Command

-m sf_examples.envpool.mujoco.train_envpool_mujoco --algo=APPO --env=mujoco_humanoid --experiment=envpool_humanoid_envpool5 --with_wandb=True --wandb_tags envpool --seed=5555

System Hardware

CPU count	8
GPU count	1
GPU type	Tesla T4

W&B CLI Version

0.12.20

Group

mujoco_humanoid

Job Type

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 123 keys
- actor_critic_share_weights:
  true
- actor_worker_gpus:[] 0 items
- adam_beta1:
  0.9
- adam_beta2:
  0.999
- adam_eps:
  0.000001
- adaptive_stddev:
  false
- algo:
  "APPO"
- async_rl:
  false
- batch_size:
  2,048
- batched_sampling:
  true
- benchmark:
  false
- ▶
  cli_args:{} 6 keys
- command_line:
  "--algo=APPO --env=mujoco_humanoid --experiment=envpool_humanoid_envpool5 --with_wandb=True --wandb_tags envpool --seed=5555"
- continuous_tanh_scale:
  0
- decoder_mlp_layers:[] 0 items
- decorrelate_envs_on_one_worker:
  true
- decorrelate_experience_max_seconds:
  0
- default_niceness:
  0
- device:
  "gpu"
- encoder_conv_architecture:
  "convnet_simple"
- ▶
  encoder_conv_mlp_layers:[] 1 item
  - 0:
    512
- ▶
  encoder_mlp_layers:[] 3 items
  - 0:
    512
  - 1:
    256
  - 2:
    128
- env:
  "mujoco_humanoid"
- env_agents:
  64
- env_frameskip:
  1
- env_framestack:
  1
- env_gpu_actions:
  false
- env_gpu_observations:
  true
- envpool_num_threads:
  8
- envpool_thread_affinity_offset:
  -1
- experiment:
  "envpool_humanoid_envpool5"
- experiment_summaries_interval:
  15
- exploration_loss:
  "entropy"
- exploration_loss_coeff:
  0
- flush_summaries_interval:
  30
- force_envs_single_thread:
  false
- gae_lambda:
  0.95
- gamma:
  0.99
- git_hash:
  "0319b736bfad9cf54f8f3ad6ab669193d3ca1d8b"
- git_repo_name:
  https://github.com/andrewzhang505/sample-factory.git
- heartbeat_interval:
  20
- heartbeat_reporting_interval:
  180
- help:
  false
- initial_stddev:
  1
- keep_checkpoints:
  2
- kl_loss_coeff:
  0.1
- with_pbt:
  false
- with_vtrace:
  false
- with_wandb:
  true
- worker_num_splits:
  1

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 63 keys
- global_step:
  9,986,048
- len/len:
  991.75
- len/len_max:
  1,000
- len/len_min:
  175
- perf/_fps:
  7,373.54052734375
- perf/_sample_throughput:
  7,099.9892578125
- policy_stats/avg_max_raw_reward:
  11.272625923156738
- policy_stats/avg_min_raw_reward:
  3.708798885345459
- reward/reward:
  9,703.1171875
- reward/reward_max:
  9,966.466796875
- reward/reward_min:
  1,134.29052734375
- stats/avg_request_count:
  1
- stats/gpu_cache_learner:
  163.57785034179688
- stats/gpu_cache_policy_worker:
  163.57785034179688
- stats/gpu_mem_learner:
  45.70470428466797
- stats/gpu_mem_policy_worker:
  33.24467086791992
- stats/master_process_memory_mb:
  3,215.234375
- stats/memory_learner:
  3,213.81640625
- stats/memory_policy_worker:
  3,215.234375
- stats/step_policy:
  0.001555275870487094
- stats/wait_policy:
  0
- train/action_log_std_max:
  -0.605689525604248
- train/action_log_std_mean:
  -0.8220688104629517
- train/action_log_std_min:
  -1.1537611484527588
- train/action_mean:
  0.06836871057748795
- train/action_mean_max:
  2.3610305786132812
- train/action_mean_min:
  -2.2658162117004395
- train/action_stddev_max:
  0.5456980466842651
- train/action_stddev_mean:
  0.4471835494041443
- train/action_stddev_min:
  0.3154481053352356
- train/actual_lr:
  0.00005925925870542415
- train/adam_max_second_moment:
  0.0019190930761396885
- train/adv_max:
  4.434013843536377
- train/adv_min:
  -5.703786849975586
- train/adv_std:
  0.7127072215080261
- train/entropy:
  10.146783828735352
- train/exploration_loss:
  0
- train/fraction_clipped:
  0.23876953125
- train/grad_norm:
  0.9999997615814208
- train/kl_divergence:
  0.012442078441381454
- train/kl_divergence_max:
  0.0829443484544754
- train/kl_loss:
  0.0012442078441381454
- train/loss:
  -0.02391044609248638
- train/lr:
  0.00005925925870542415
- train/max_abs_logprob:
  2.3846304416656494
- train/num_sgd_steps:
  20
- train/value_loss:
  0.0013332624221220613
- train/version_diff_avg:
  19
- train/version_diff_max:
  19
- train/version_diff_min:
  19

This run produced these artifacts as outputs. Total: 1. Learn more

wandb-history

run-envpool_humanoid_envpool5_20221214_031145_609800-history:v0