rickstaa

Rickstaa's group workspace

Group: han2020_reproduction_sac_different_steps_per_update

1-20

of 20

Tags

Notes

Author

rickstaa

State

Finished

Start time

March 15th, 2024 11:46:45 AM

Runtime

47m 45s

Tracked hours

47m 38s

Run path

rickstaa/stable-learning-control/vrx4y0qj

Linux-6.5.0-17-generic-x86_64-with-glibc2.35

Python version

3.10.13

Git repository

git clone git@github.com:rickstaa/stable-learning-control.git

Git state

git checkout -b "han2020_reproduction_sac_oscillator_complicated_alpha3_tune_exp_lac_critic_different_steps_per_update_s78456" 9cdd1cf6ba35cc182a73d8500ae680ce81d17f3e

Command

/home/ricks/development/work/stable-learning-control/stable_learning_control/utils/run_entrypoint.py eJy9VltrHDcUntnx2utdx46dQKAkxRBo7YB3HefSEtL0sg+BbO02TgJ9KUI7o10pq5GUGcnOFgKFNvEaRClEeW9oX/pD+heal0KhT4E+tD+hR7MXO20cSqHZq3TO0bl/OvNl+YmqBsXLnoq5NIlicY+T+qG1s/MoxT2COkbEmknhHrsVGthjqG0Y10wg3VcEiLbSlAm57TcP3bZbaQWj91TrRPN2Eg6inSA7k5SSiAf7pUH0XZiET8P9sFhNseBpaT/YC/bCvVInSsrJ9NeVQZTMXA10aTD1VRgGg3JSYcEg+iH8BnZJdCtwK3b1FtFGLROxwzIpUiL0sslJsszEsqZkmdxXJGOeXAf/QAoJnBLXCrZs1e96uzjr5o7OvOjt0qB0NxiEnRDsBd4e2Np66OyUTwREt2pRg8qUNDJIUd5IyA7hUnkzjV2Z9Rq5xm1O1jjBmWCiuxZLoTPJR3Q0pqMx3WjG80ZmBCpWddUHb69ynLYTfM21dLO0FDhao1Ubdfup23OrGjJsL8WYc3QoxqtcAim/VtfUiB5S3OQHtIk+O+1D7wivxc6CQoFzZlJnIyUVGE4VQx0Iw9uhx231QJlr9ZrzlahSqpbmwpNhJVqKQNsoiXZGmBTFyjhbLo7AeXrSO/oAClVDSOG4h7sEIWfPHJGJehE/+ICKQnnRt18pWp8krTjUYbw49L+Xx2xtAQaOD5FBUqX7KCacAwxWtx2tj3/2nI8fJJcm8EE50WBIe8jQiw98cugqfdPOIXTPYD4O++y/qK2zCwhhISSoA805nHvg4QptnZAONlx70pZX/cK+ilAqE1Okip6zM8CWsV/P+jIB9nOTFbwARIsIR7H5Qh6gyJ4dJQxa6Monecw4x1pmTZkqzmKIMFnbOQ8dhuMxzvz5OcqShEAa2BdkSCnjGI65z93KZhDCh9jpOGOaxYdIxlZBiu0UgRY5a0G/ifo2+fiOo5v0prGL0mhlNHpBjrbozdzYilR6eE9BezPBUjDubDXF9xFRUHDhNr8NARdKxhS6vG0Xck1UjiD7qCC6zaBiaxBvplHBgjvEzhmVQJgI+ivru1YyIeCOJpnbfB7Z4wd6hjzX+tQueqBokmvQzXK4NEFbFdLAFcXu+vt/jm7kchenqSf88az6nvr+mZ1Wkvdx7xDlJE6wgnAJqEvBCNZQOTewUzxD/uQbl3/7/XRzrdjHsL/w47n1OxvYVjx/ZG4sU/U0QJDA3F2/tlivPX/r5ycFNZ5QV39a/OXKh7/a+fH5f8gvFFoSEuP+KOHTnAlAlCtY8ctZJyb6XsqeA/aQkZEOXMM+qVC+NtYxLRoJyhPaWkYUB5mCcOODjxYCO5tjyE0nI/d8hqfhJmAxKC53lbkCrXmMy24XSnOoPaujLkpY5j6bC4PgP90kUGncoFhsrG+sg88qA7iN0A9okBOswBUzAcswAReQNoJ44CMOokMggDedDsnALPp7P70eKyh/592Lly77GQpHhugnr8WyAwj5GsaUxD0lmdC527cLMOSh5UUus7bEWQKkWU/axSJpQ//PFwt0V7ZHrVTWGWYCKj5kgMN3SQzj79QRFXS2NpTsZtJAr104MthXuT5yw0+OImdbtqbbCJpu2JI24nIXfLtnGNEQQg3ukbaEMDopuDblux96f0zcwVnutgx0PyGJu3F/IwyMf9CizVY4/LdrR81KzLvSzy0oSUzr4Lb/gn3/+7h4XNuDXKBDj30oN+3hkMjhGvZzoctlGwZQMWToaXv+1XPZP0QcrLSUMKHp6ccuN4/co+31+l+2SQbj

System Hardware

CPU count	6
Logical CPU count	12
GPU count	2
GPU type	NVIDIA GeForce GTX 1070 Ti

W&B CLI Version

0.16.3

Group

han2020_reproduction_sac_different_steps_per_update

Job Type

train

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 34 keys
- ▶
  ac_kwargs:{} 3 keys
  - ▶
    activation:{} 2 keys
    - actor:
      "nn.ReLU"
    - critic:
      "nn.ReLU"
  - ▶
    hidden_sizes:{} 2 keys
    - ▶
      actor:[] 2 items
      - 0:
        256
      - 1:
        256
    - ▶
      critic:[] 2 items
      - 0:
        256
      - 1:
        256
  - ▶
    output_activation:{} 1 key
    - actor:
      "nn.ReLU"
- adaptive_temperature:
  true
- alpha:
  1
- batch_size:
  256
- device:
  "gpu:1"
- env:
  "OscillatorComplicated-v1"
- env_class:
  "stable_gym.envs.biological.oscillator_complicated.oscillator_complicated.OscillatorComplicated"
- epochs:
  98
- exp_name:
  "han2020_reproduction_sac_oscillator_complicated_alpha3_tune_exp_lac_critic_different_steps_per_update"
- export:
  false
- gamma:
  0.995
- lr_a:
  0.0001
- lr_a_decay_type:
  "linear"
- lr_a_final:
  0.000000001
- lr_alpha:
  0.0001
- lr_alpha_decay_type:
  "linear"
- lr_alpha_final:
  0.000000001
- lr_c:
  0.0003
- lr_c_decay_type:
  "linear"
- lr_c_final:
  0.000000003
- lr_decay_ref:
  "step"
- lr_decay_type:
  "linear"
- max_ep_len:
  400
- num_test_episodes:
  10
- opt_type:
  "minimize"
- polyak:
  0.995
- replay_size:
  1,000,000
- save_freq:
  10
- seed:
  78,456
- start_steps:
  0
- steps_per_epoch:
  2,048
- steps_per_update:
  80
- update_after:
  1,000
- update_every:
  100

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 33 keys
- AverageAlpha:
  0.3152644634246826
- AverageEntropy:
  -4.035008430480957
- AverageEpLen:
  400
- AverageEpRet:
  277.4869689941406
- AverageLogPi:
  4.035008430480957
- AverageLossAlpha:
  -0.01103695947676897
- AverageLossPi:
  71.12554168701172
- AverageLossQ:
  529.5055541992188
- AverageQ1Vals:
  94.46084594726562
- AverageQ2Vals:
  94.4747085571289
- AverageTestEpLen:
  400
- AverageTestEpRet:
  278.30389404296875
- Epoch:
  98
- Lr_a:
  0.000000001
- Lr_alpha:
  0.000000001
- Lr_c:
  0.000000003
- MaxEpRet:
  319.1129150390625
- MaxLogPi:
  36.68864059448242
- MaxQ1Vals:
  77,656.328125
- MaxQ2Vals:
  77,628.3515625
- MaxTestEpRet:
  342.11578369140625
- MinEpRet:
  228.89059448242188
- MinLogPi:
  -12.156331062316896
- MinQ1Vals:
  -647.9972534179688
- MinQ2Vals:
  -633.0460815429688
- MinTestEpRet:
  223.7678070068359
- StdEpRet:
  33.55588912963867
- StdLogPi:
  3.547321081161499
- StdQ1Vals:
  3,783.83154296875
- StdQ2Vals:
  3,783.819580078125
- StdTestEpRet:
  30.861438751220703
- Time:
  2,854.923807859421
- TotalEnvInteracts:
  200,704

This run consumed these artifacts as inputs. Learn more

job

job-git_github.com_rickstaa_stable-learning-control.git_stable_learning_control_utils_run_entrypoint.py:v114

This run produced these artifacts as outputs. Total: 5. Learn more

run-vrx4y0qj-history:v0