andrewzhang505

Andrewzhang505's group workspace

Group: mujoco_hopper

1-1

of 1

Tags

envpool

Author

andrewzhang505

State

Finished

Start time

December 14th, 2022 3:51:01 AM

Runtime

12m 45s

Tracked hours

12m 35s

Run path

andrewzhang505/sample_factory/envpool_hopper_20221214_035100_209866

Linux-4.19.0-22-cloud-amd64-x86_64-with-glibc2.28

Python version

3.9.13

Git repository

git clone https://github.com/andrewzhang505/sample-factory.git

Git state

git checkout -b "envpool_hopper_20221214_035100_209866" 0319b736bfad9cf54f8f3ad6ab669193d3ca1d8b

Command

-m sf_examples.envpool.mujoco.train_envpool_mujoco --algo=APPO --env=mujoco_hopper --experiment=envpool_hopper --with_wandb=True --wandb_tags envpool --seed=5555

System Hardware

CPU count	8
GPU count	1
GPU type	Tesla T4

W&B CLI Version

0.12.20

Group

mujoco_hopper

Job Type

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 123 keys
- actor_critic_share_weights:
  true
- actor_worker_gpus:[] 0 items
- adam_beta1:
  0.9
- adam_beta2:
  0.999
- adam_eps:
  0.000001
- adaptive_stddev:
  false
- algo:
  "APPO"
- async_rl:
  false
- batch_size:
  2,048
- batched_sampling:
  true
- benchmark:
  false
- ▶
  cli_args:{} 6 keys
- command_line:
  "--algo=APPO --env=mujoco_hopper --experiment=envpool_hopper --with_wandb=True --wandb_tags envpool --seed=5555"
- continuous_tanh_scale:
  0
- decoder_mlp_layers:[] 0 items
- decorrelate_envs_on_one_worker:
  true
- decorrelate_experience_max_seconds:
  0
- default_niceness:
  0
- device:
  "gpu"
- encoder_conv_architecture:
  "convnet_simple"
- ▶
  encoder_conv_mlp_layers:[] 1 item
  - 0:
    512
- ▶
  encoder_mlp_layers:[] 3 items
  - 0:
    256
  - 1:
    128
  - 2:
    64
- env:
  "mujoco_hopper"
- env_agents:
  64
- env_frameskip:
  1
- env_framestack:
  1
- env_gpu_actions:
  false
- env_gpu_observations:
  true
- envpool_num_threads:
  8
- envpool_thread_affinity_offset:
  -1
- experiment:
  "envpool_hopper"
- experiment_summaries_interval:
  15
- exploration_loss:
  "entropy"
- exploration_loss_coeff:
  0
- flush_summaries_interval:
  30
- force_envs_single_thread:
  false
- gae_lambda:
  0.95
- gamma:
  0.99
- git_hash:
  "0319b736bfad9cf54f8f3ad6ab669193d3ca1d8b"
- git_repo_name:
  https://github.com/andrewzhang505/sample-factory.git
- heartbeat_interval:
  20
- heartbeat_reporting_interval:
  180
- help:
  false
- initial_stddev:
  1
- keep_checkpoints:
  2
- kl_loss_coeff:
  0.1
- with_pbt:
  false
- with_vtrace:
  false
- with_wandb:
  true
- worker_num_splits:
  1

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 63 keys
- global_step:
  9,953,280
- len/len:
  490.3900146484375
- len/len_max:
  1,000
- len/len_min:
  275
- perf/_fps:
  14,316.650390625
- perf/_sample_throughput:
  13,464.361328125
- policy_stats/avg_max_raw_reward:
  6.391561985015869
- policy_stats/avg_min_raw_reward:
  0.743633508682251
- reward/reward:
  1,934.342041015625
- reward/reward_max:
  3,920.92236328125
- reward/reward_min:
  1,063.8463134765625
- stats/avg_request_count:
  1
- stats/gpu_cache_learner:
  29.36012840270996
- stats/gpu_cache_policy_worker:
  29.36012840270996
- stats/gpu_mem_learner:
  1.6732159852981567
- stats/gpu_mem_policy_worker:
  1.3521920442581177
- stats/master_process_memory_mb:
  3,192.6875
- stats/memory_learner:
  3,192.6875
- stats/memory_policy_worker:
  3,192.6875
- stats/step_policy:
  0.001483650179579854
- stats/wait_policy:
  0
- train/action_log_std_max:
  -1.7569400072097778
- train/action_log_std_mean:
  -1.834408164024353
- train/action_log_std_min:
  -1.905693292617798
- train/action_mean:
  0.020904742181301117
- train/action_mean_max:
  4.686295986175537
- train/action_mean_min:
  -5.013051509857178
- train/action_stddev_max:
  0.17257212102413175
- train/action_stddev_mean:
  0.16000506281852722
- train/action_stddev_min:
  0.14871950447559357
- train/actual_lr:
  0.00022222222469281405
- train/adam_max_second_moment:
  0.04992758482694626
- train/adv_max:
  3.7594192028045654
- train/adv_min:
  -5.813846588134766
- train/adv_std:
  0.3557382822036743
- train/entropy:
  -1.2464091777801514
- train/exploration_loss:
  0
- train/fraction_clipped:
  0.17626953125
- train/grad_norm:
  0.9999998211860656
- train/kl_divergence:
  0.01112246047705412
- train/kl_divergence_max:
  0.16711151599884033
- train/kl_loss:
  0.00000023023167727843
- train/loss:
  0.0039870645850896835
- train/lr:
  0.00022222222469281405
- train/max_abs_logprob:
  5.0130295753479
- train/num_sgd_steps:
  10
- train/value_loss:
  0.003982122987508774
- train/version_diff_avg:
  0
- train/version_diff_max:
  0
- train/version_diff_min:
  0

This run produced these artifacts as outputs. Total: 1. Learn more

wandb-history

run-envpool_hopper_20221214_035100_209866-history:v0