rickstaa

Rickstaa's group workspace

Group: han2020_reproduction_small_critic_short

1-15

of 15

Tags

extra

incorrect

Notes

Author

rickstaa

State

Finished

Start time

March 7th, 2024 3:49:55 PM

Runtime

24m 35s

Tracked hours

24m 25s

Run path

rickstaa/stable-learning-control/pxieut7b

Linux-6.5.0-17-generic-x86_64-with-glibc2.35

Python version

3.10.13

Git repository

git clone git@github.com:rickstaa/stable-learning-control.git

Git state

git checkout -b "han2020_reproduction_lac_oscillator_complicated_alpha3_tune_exp_small_critic_alp1-0_s234" f1c32c843f802fb3a732625d2f9a558b94deb115

Command

/home/ricks/development/work/stable-learning-control/stable_learning_control/utils/run_entrypoint.py eJy1Vs1rG0cU35UsW5Ycf8UQKElxCbR2wJI/0h5CmqbVwVDVauMkxzKMdkeaiWZnNrszdhQIFNrEMgylkMm9ob30kv+i/0JzKZT2UEJ7aP6EvtmVZIfEoRRi2fLMe2/e9+/NfFV6ZCte9mPOBFzqMGZBj5PasbU1syjCPYI6WgSKSWEf2hXqmVOorRlXTCDVjwkQTbkhQ3LDbe7bXbvS9Iafiebpxo3QHxT3vORcWAiL3DssDIrf+6H/2D/0s9UE8x4XDr0D78A/KHSKYSmc/KY8KIZTlz1VGEx87fveoBSWmTco/uh/C7uweN2zK2b1OlE6XiZijyVSRESoZZ2ScJmJZUXJMrkTk4Q5cg38AykkcERs02uZitv19nHSTS2detHbxUHhljfwOz7Y85w9sNW6b82ESwREt2pQncqI1BNIUVoPyR7hMnZm6vsy6dVThducrHGCE8FEdy2QQiWSD+loREcjulaMp/VEC5StanEfvL3McdQO8RXbVI3ComdplVZMsduP7IFdVZBh836AOUfHYrzMJZDSKzVFteihmOv0iDbWZyZd6B3htJhpUChwynRkTTGWMRiOYoY6EIazQ+dN5UiZbfYas+ViuVApzPhLfrm4WARtwySaKaEjFMTamlJ2BM7TJefoPShUFaEYBz3cJQhZc+6ETNSy+MEHlBXKib73WtHaOGnZoQ7j2aE3Xh7dagEG5nNkkChWfRQQzgEGq7uW1kZfB9bFD5KLY/iglCgwpBxk6MV7Ljl0lb5tZhC6rTEfhX3+P9TWmjmEsBAS1IHmFM7dc3CFtg5JB2uuHKnlVL+wryAUyVBnqaIXzBSwZeDW065MgP1UJxnPA9EswmFsrpBHKDLnhwmDFrr0eRowzrGSSUNGMWcBRBiu7W1Ah+FghDN3foayMCSQBnaX5JQSDuCY/dKu7Hg+/BIzGSRMscCRmlfhM0+0qYAU28sCzXLWhH4TtV3y2U1Ld+g1bRakVrFW6AU52qTXUm3KMlb5nIL2ZoJFYNyaSoTvIBJDwYXd+c4HXMQyoNDlG2YuVSROEWQfZUS745VNFeJNFMpYMEPMjI5DCBNBfyV92wzHBNxRJLE7z4pm/khPzrPNL8yCA4oiqQLdLIWhCdoqkAYeU2y3r3rDiTyZEbbs9kfPh5QSx4BgIPzzZOnu79tPzGQseR/3HOVp5cP4h6dmCYc4hgQQMBCBWayglnZgJniC3Mm3Pvjj77ONtWwfwH7rpwvrNzexKTt+7sBYxtFGFkdyFScHOBOY2+0rC7Xqs3d/eZRRgzF19eeFXy99/JuZHel8SX52pPmlM3OZ/pAEuD8s2CRnAhBpM1bwatbpsaUT2bm54+wy4BsqKmAKzoBAzkpIB+a8qxr0RxurgGadCvX3TTUhMQeZjPDp1U/mPDNLZcLuAqqhh7qK2mbJTKcYst9JyG1X1UmYPiwAa6VurC8BHE5x2e1COxyDRGXYuSEDX//8X6MLWgvXKRab65vrEEOcAL7zccMBfnIMTphpY3TmGdtCSgviJg1KIzdzcuw55sba+pvQidLNrYvuOgZ2PkiuvwErFrDnChFQEvRiyYRK7aGZg9cBIEOkMmlLnIRAmnakfSzCNsBkNlugW7I9bJKSSjATULacAe7dIgF0zJkTKmFNNZfsJlJDD73zytCO+2tHRt0Fk+WjZaqqjaBP8i4yRS73wZPbmhEFDldh3LQlON2JwJEJ1+TQwSPiHk5S29LQw4SEtvmXdo8x2mj6+X+zdtJ9inlXursNch3QGiTf/Tnj8P0we9IdQNjo2NMQpbqdXyQpjGp3d3S5bMMllV1E9KzZeP3d7R4aRyslJdzi9OxDm+oH9sHueu1fZ8gSwQ==

System Hardware

CPU count	6
Logical CPU count	12
GPU count	2
GPU type	NVIDIA GeForce GTX 1070 Ti

W&B CLI Version

0.16.3

Group

han2020_reproduction_small_critic_short

Job Type

train

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 40 keys
- ▶
  ac_kwargs:{} 3 keys
  - ▶
    activation:{} 2 keys
    - actor:
      "nn.ReLU"
    - critic:
      "nn.ReLU"
  - ▶
    hidden_sizes:{} 2 keys
    - ▶
      actor:[] 2 items
      - 0:
        256
      - 1:
        256
    - ▶
      critic:[] 3 items
      - 0:
        64
      - 1:
        64
      - 2:
        16
  - ▶
    output_activation:{} 1 key
    - actor:
      "nn.ReLU"
- adaptive_temperature:
  true
- alpha:
  2
- alpha3:
  1
- batch_size:
  256
- device:
  "gpu:1"
- env:
  "OscillatorComplicated-v1"
- env_class:
  "stable_gym.envs.biological.oscillator_complicated.oscillator_complicated.OscillatorComplicated"
- epochs:
  49
- exp_name:
  "han2020_reproduction_lac_oscillator_complicated_alpha3_tune_exp_small_critic_alp1-0"
- export:
  false
- gamma:
  0.99
- horizon_length:
  5
- labda:
  0.99
- lr_a:
  0.0001
- lr_a_decay_type:
  "linear"
- lr_a_final:
  0.000000001
- lr_alpha:
  0.0001
- lr_alpha_decay_type:
  "linear"
- lr_alpha_final:
  0.000000001
- lr_c:
  0.0003
- lr_c_decay_type:
  "linear"
- lr_c_final:
  0.000000003
- lr_decay_ref:
  "step"
- lr_decay_type:
  "linear"
- lr_labda:
  0.0003
- lr_labda_decay_type:
  "constant"
- lr_labda_final:
  0.000000003
- max_ep_len:
  400
- num_test_episodes:
  10
- opt_type:
  "minimize"
- polyak:
  0.995
- replay_size:
  1,000,000
- save_freq:
  10
- seed:
  234
- start_steps:
  0
- steps_per_epoch:
  2,048
- steps_per_update:
  80
- update_after:
  1,000
- update_every:
  100

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 32 keys
- AverageAlpha:
  0.048625048249959946
- AverageEntropy:
  -1.594435691833496
- AverageEpLen:
  400
- AverageEpRet:
  178.0680694580078
- AverageErrorL:
  66.97834014892578
- AverageLambda:
  1
- AverageLogPi:
  1.594435453414917
- AverageLossAlpha:
  0.11697044223546982
- AverageLossLambda:
  -214.59722900390625
- AverageLossPi:
  10.711333274841309
- AverageLVals:
  68.37958526611328
- AverageTestEpLen:
  400
- AverageTestEpRet:
  189.58200073242188
- Epoch:
  49
- Lr_a:
  0.000000001
- Lr_alpha:
  0.000000001
- Lr_c:
  0.000000003
- Lr_labda:
  0.0003
- MaxEpRet:
  270.7032775878906
- MaxLogPi:
  58.18398666381836
- MaxLVals:
  14,394.400390625
- MaxTestEpRet:
  278.6903991699219
- MinEpRet:
  128.29061889648438
- MinLogPi:
  -11.21916961669922
- MinLVals:
  0
- MinTestEpRet:
  106.24009704589844
- StdEpRet:
  58.64699935913086
- StdLogPi:
  4.0256733894348145
- StdLVals:
  679.5557250976562
- StdTestEpRet:
  52.87702941894531
- Time:
  1,461.5486466884613
- TotalEnvInteracts:
  100,352

This run consumed these artifacts as inputs. Learn more

job

job-git_github.com_rickstaa_stable-learning-control.git_stable_learning_control_utils_run_entrypoint.py:v76

This run produced these artifacts as outputs. Total: 5. Learn more

run-pxieut7b-history:v0