rickstaa

Rickstaa's group workspace

Group: han2020_reproduction_step_gpu

1-10

of 10

Tags

pilot

Author

rickstaa

State

Finished

Start time

February 9th, 2024 3:53:44 PM

Runtime

1h 41m 13s

Tracked hours

1h 41m 7s

Run path

rickstaa/stable-learning-control/ejduin9s

Linux-6.5.0-14-generic-x86_64-with-glibc2.35

Python version

3.10.13

Git repository

git clone git@github.com:rickstaa/stable-learning-control.git

Git state

git checkout -b "han2020_reproduction_lac_cartpole_cost_alpha3_tune_exp_alp0-1_s48104" 85654bce2c9a29d835ef479b3fcbf6c075978922

Command

/home/ricks/development/work/stable-learning-control/stable_learning_control/utils/run_entrypoint.py eJy1Vs9vG0UU3vXGiWOnSRoiVapaFIkDSaXYSVsQQm2p8CESJlabtkc0Gu+OPVPPzmxnZ5K6ohIStHGkgUuHA5yo4MKld1T4OyrEAcEJ1AN3TrxZOz8qaIWosGNn55uZ9+Z9731v/FH580+ng+JlT8RcmiRjcZ+T+pFnZ2dRivsEdY2INZPCPXDLNLDHUMcwrplAepARAG2lKRNy3Q/uuS233ArG74nWK83rSTiMtgN1OiklEQ/2SsPoqzAJH4Z7YfE0wYKHpb1gN9gNd0vdKCknk59UhlEydSHQpeHEx2EYDMtJhQXD6JvwMxgl0bXALduVa0SbbImIbaakSInQSyYnyRITS5qSJXI7I4p5uA7ng1VI4JS4VtC2VT/q72DVyx2deva0C8PSzWAYdkPwF3h/4Kt9z9kJTwREt2JRg8qUNBRQlDcSsk24zLybxo5U/UaucYeTVU6wEkz0VmMptJJ8jKN9HO3jRjOeN5QRqHiqZwM47QWO006CL7mWaZYWAkdrtGqj3iB1u25FA8P2jRhzjo7EeIFLgPJLdU2N6KOMm/wQO7BnJ33oXeGt2GkwKHDOTOpslMkMHKcZQ10Iw/uh87Z6aMy1eHO2ElVK1dJMuBhWooUIrI1JtFPCpCjOjLPlYgvsp4v+oHchUTWEMhz3cY8g5Ozp5zBRL+KHM6AiUX7p6y9cWj8grdjUZbzY9L+nx7TboIH5kTJImukBignnIIOVLUfr+1+7zscPKxcO5INyosGR9pKh5+96cugKfdXOIHTLYL4f9mv/IrfOziGEhZBgDiznsO+ulyuUdUK62HDtobY3/cy4ilAqE1NQRc/YKZiWsX+e9mkC7edGFXMBLC0iHMfmE3moIntyTBiU0NtNrPQVyUlT5np1ex0KC8f78vLbZihLEgLRsztkhJRxrKVyH7jlzSCEP2InY8U0iz3UugzveWJsFVax7SK+gqoWlJmob5H3bzi6Sa8ae1wanRmNnllHW/RqbmxFZnrUnqCqmWApOHe2muLbiGSQZ+Faf4IaMhnT3G3+Htq5XJMsR0A6KlC3GVRsDcJUGhVT0DrsjMkSyB+CslID10oOANzVRLnN3yI7f2hnNOdaV+xxrw9Ncg22WQ69EqxVgQaeUew2LgfjRjxZAOfcxjvffeFfX9oyxyBcAP54tHjnl41HdjKTfID7HnlSvZh9/cQu4gRnQAABBym4xRpS6IZ2givkd55889enp5qrxTiG8blvz6zdOItt1c+DbATmbuPiTx/+/OOTHx4XaPw39BigCYnxYEzpJGcCpOLszMGEIl3okj54oLmDdUyLhAONoa0pknFYUwDvXX53LrCzVCp2BzQBqehp6lplO51jCKKryC1PziRol8XgK+r5vnKMy14POD1SV9Vx+hMGB/n+P8ke8oMbFIuza2fXIIJMgTZGUuVQwzHkHugGDUBlo1FukDaCeHH68drq+svtRvn5t9bXzvsLCrCRtC6+lEUHBehpjCmJ+5lkQuduz87BzQjlIXKpOhKrBKBpD+1gkXSgVmaLB3RTdsYJLmuFmQDaRxNwkJskhjvjxHOYdLY2WtlT0kAFnP7HIHx1oCKdY4e+sRZRt21NdxDkeJR/G3G5A6e4ZRjRcNga6K0j4cDdFA4x4asPam8f3MYqd20D1UdIAiJ8bPyvENpshaP/dvV5FwnmPembOnSjmNaBY//x3uH7QfFbZhdiRkd+E6HcdEYdNIdm5Ztmj8sOdOeiA9NTdv3Fl5a/YQ+ftJRwfdFTD1xu7rv7W2v1vwDTaLLn

System Hardware

CPU count	6
Logical CPU count	12
GPU count	2
GPU type	NVIDIA GeForce GTX 1070 Ti

W&B CLI Version

0.16.3

Group

han2020_reproduction_step_gpu

Job Type

train

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 32 keys
- ▶
  ac_kwargs:{} 3 keys
  - ▶
    activation:{} 2 keys
    - actor:
      "nn.ReLU"
    - critic:
      "nn.ReLU"
  - ▶
    hidden_sizes:{} 2 keys
    - ▶
      actor:[] 2 items
      - 0:
        256
      - 1:
        256
    - ▶
      critic:[] 3 items
      - 0:
        64
      - 1:
        64
      - 2:
        16
  - ▶
    output_activation:{} 1 key
    - actor:
      "nn.ReLU"
- adaptive_temperature:
  true
- alpha:
  2
- alpha3:
  0.1
- batch_size:
  256
- device:
  "gpu"
- env:
  "CartPoleCost-v1"
- env_class:
  "stable_gym.envs.classic_control.cartpole_cost.cartpole_cost.CartPoleCost"
- epochs:
  489
- exp_name:
  "han2020_reproduction_lac_cartpole_cost_alpha3_tune_exp_alp0-1"
- export:
  false
- gamma:
  0.99
- horizon_length:
  5
- labda:
  0.99
- lr_a:
  0.0001
- lr_a_final:
  0.0000000001
- lr_c:
  0.0003
- lr_c_final:
  0.0000000001
- lr_decay_ref:
  "step"
- lr_decay_type:
  "linear"
- max_ep_len:
  250
- num_test_episodes:
  10
- opt_type:
  "minimize"
- polyak:
  0.995
- replay_size:
  1,000,000
- save_freq:
  10
- seed:
  48,104
- start_steps:
  0
- steps_per_epoch:
  2,048
- steps_per_update:
  80
- update_after:
  1,000
- update_every:
  100

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 32 keys
- AverageAlpha:
  0.00000000063177191256
- AverageEntropy:
  0.506755530834198
- AverageEpLen:
  250
- AverageEpRet:
  85.89768981933594
- AverageErrorL:
  1.595165729522705
- AverageLambda:
  0.00000000059137000852
- AverageLogPi:
  -0.5067555904388428
- AverageLossAlpha:
  0.00000000095192587146
- AverageLossLambda:
  -0.3879285156726837
- AverageLossPi:
  -0.00000000033095035046
- AverageLVals:
  1.5589698553085327
- AverageTestEpLen:
  250
- AverageTestEpRet:
  27.54207420349121
- Epoch:
  489
- Lr_a:
  0.0000000001
- Lr_alpha:
  0.0000000001
- Lr_c:
  0.0000000001
- Lr_labda:
  0.0000000001
- MaxEpRet:
  122.06397247314452
- MaxLogPi:
  14.794792175292969
- MaxLVals:
  544.8507080078125
- MaxTestEpRet:
  72.62808990478516
- MinEpRet:
  56.462589263916016
- MinLogPi:
  -8.956995964050293
- MinLVals:
  0
- MinTestEpRet:
  7.408057689666748
- StdEpRet:
  23.959247589111328
- StdLogPi:
  0.6440959572792053
- StdLVals:
  8.461675643920898
- StdTestEpRet:
  23.081377029418945
- Time:
  6,063.918214559555
- TotalEnvInteracts:
  1,001,471

This run consumed these artifacts as inputs. Learn more

job

job-git_github.com_rickstaa_stable-learning-control.git_stable_learning_control_utils_run_entrypoint.py:v13

This run produced these artifacts as outputs. Total: 5. Learn more

run-ejduin9s-history:v0