rickstaa

Rickstaa's group workspace

Group: han2020_reproduction_small_actor

1-20

of 75

Tags

extra

Notes

Author

rickstaa

State

Finished

Start time

March 9th, 2024 11:37:02 AM

Runtime

21m 19s

Tracked hours

21m 5s

Run path

rickstaa/stable-learning-control/w7bb31xg

Linux-6.5.0-21-generic-x86_64-with-glibc2.35

Python version

3.10.13

Git repository

git clone git@github.com:rickstaa/stable-learning-control.git

Git state

git checkout -b "han2020_reproduction_lac_oscillator_alpha3_tune_exp_small_actor_alp0-1_s234" 5ee15b46f2a20017ece36ac93a6cf806c24afba5

Command

/home/ricks/development/work/stable-learning-control/stable_learning_control/utils/run_entrypoint.py eJy1Vs1vG0UU37XjxLHTfDVSEWpRJCRIKsXOR+FQlRKIRCRMDE3bIxqNd8eeqWdntrszSV2pEhK0caQRQur0ACcquHDpnT+AG2d6QUJwquDAv8CbXdtJ1aZCqDiJs/Pem/f9e28/Kz3AFS/7mDMBlzqMWdDlpHbs2ZppFOEuQW0tAsWksPftEvXMKdTSjCsmkOrFBIimvCVDcs0d7tpdu9TwBj9jjdNb10K/X9zzknNhISxy77DQL37rh/5D/9DPnsaY97Bw6B14B/5BoV0MS+H4F+V+MZy45KlCf+xz3/f6pbDMvH7xe/9LOIXFq55dMstXidLxIhF7LJEiIkIt6pSEi0wsKkoWya2YJMyRa+AfSCGBI2IbXtNU3Km7j5NOaunE097O9ws3vL7f9sGe5+yBreZda8ZcIiC6ZYPqVEaknkCK0npI9giXsTNT35dJt54q3OJkhROcCCY6K4EUKpF8QEdDOhrStWI8rSdaoOypFvfA20scR60QX7YNtVWY9yyt0oopdnqRPbDLCjJs3gow5+hYjJe4BFJ6uaaoFl0Uc50e0Ub6zLgLvS2cFjMJCgVOmY6sKcYyBsNRzFAbwnB26KypHCmzje7WdLlYLlQKU/6CXy7OF0HbIIlmQugIBbG2ppRdgft0wTl6BwpVRSjGQRd3CELWnDshE7UsfvABZYVyom++ULQ2Slp2qc14dul/L49uNgEDszkySBSrHgoI5wCD5V1La8OvA+viB8n5EXxQShQYUg4y9MIdlxy6TF8zUwjd1JgPw379X9TWmhmEsBAS1IHmFO7dcXCFtg5JG2uuHKnpVD91riAUyVBnqaLnzQSwZeCeJ12ZAPupTjKeB6JZhIPYXCGPUGReGSQMWujix2nAOMdKJit7a9BWOBiCy12aoiwMCcTObpOcUsIByNpPYU5sNjaJGQ8SpljgCDueD7+NWaJNBaTYXhZdlqgGNJmo7ZKPrlu6Q69oMye1irVCT8nRBr2SalOWscqHE/Q0EywC49ZUInwLkRiqLOzOVz6AIZYBhdZeMzOpInGKIOUoI9odr2yqEGSiUMaCwWGmdBxC9RA0VdKzjXBEwG1FErvzpGhmj/TkPNv4xMw5dCiSKtDNUpiUoK0CaeAxxXZ70xuM4fGMsGG33/3xa/f5xpQ4BtgC4e9HC7d/335kxmPJe7jrKI8r78TfPTYLOMQxJICAgQjMYgUFtH0zxhPkbr769h9/nd1ayc4BnDd+OL96fR2bsuPnDoxkHG1ocShXcXIALoG53b48V6s+eeOXBxk1GFGXf5r79eJ7v5npoc5n5KeHmp+5M5PpD0mAe4OCjXMmAIY2YwXPZ50eWTqRnZs7zi4DqKGiAkbfFAjkrIS0Ybi7qkF/tLAKaNapUH/fVBMSc5DJCB9uvj/jmWkqE3YboAw91FHUNkpmMsWQ/XZCbrqqjsPIYQFYK3VifRHgcIrLTgfa4RgkKoPODRn4+vN/mlfQWrhOsVhfXV+FGOIEQJ3PGA7wkyNE5lnaQEoL4kYKSiM3XDIEOt7qytpLUoPS9Y0LbtMCN58RH7wcxRZA5TIcUBJ0Y8mESu2hmYFdDy0vUpm0JE5CIE060j4WYQv6fzp7QDdka1D9kkowE1CPnAEe3SABtMKZE1JsTTWX7CRSQ3MsPjeaY+7aoU23LbIMNE1VtRDUP+8OU+RyHxy5qRlR4G8VxkhLgs/tCPwYc80LnTkk7uEktU0NvUlIaBt/avdmRbcafv7frJy0HDHvSLeowKWA1iDd7s8Zh+/72fvZAUSNjr3noVS38q2QwhB2i6DDZQs2TrZV6Fmz9uJF7N4ajp6UlLCS6dn7NtX37L3d1do/rUEBFg==

System Hardware

CPU count	16
Logical CPU count	32
GPU count	1
GPU type	NVIDIA GeForce GTX 1070 Ti

W&B CLI Version

0.16.3

Group

han2020_reproduction_small_actor

Job Type

train

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 40 keys
- ▶
  ac_kwargs:{} 3 keys
  - ▶
    activation:{} 2 keys
    - actor:
      "nn.ReLU"
    - critic:
      "nn.ReLU"
  - ▶
    hidden_sizes:{} 2 keys
    - ▶
      actor:[] 2 items
      - 0:
        64
      - 1:
        64
    - ▶
      critic:[] 3 items
      - 0:
        256
      - 1:
        256
      - 2:
        16
  - ▶
    output_activation:{} 1 key
    - actor:
      "nn.ReLU"
- adaptive_temperature:
  true
- alpha:
  2
- alpha3:
  0.1
- batch_size:
  256
- device:
  "gpu:1"
- env:
  "Oscillator-v1"
- env_class:
  "stable_gym.envs.biological.oscillator.oscillator.Oscillator"
- epochs:
  49
- exp_name:
  "han2020_reproduction_lac_oscillator_alpha3_tune_exp_small_actor_alp0-1"
- export:
  false
- gamma:
  0.99
- horizon_length:
  5
- labda:
  0.99
- lr_a:
  0.0001
- lr_a_decay_type:
  "linear"
- lr_a_final:
  0.000000001
- lr_alpha:
  0.0001
- lr_alpha_decay_type:
  "linear"
- lr_alpha_final:
  0.000000001
- lr_c:
  0.0003
- lr_c_decay_type:
  "linear"
- lr_c_final:
  0.000000003
- lr_decay_ref:
  "step"
- lr_decay_type:
  "linear"
- lr_labda:
  0.0003
- lr_labda_decay_type:
  "constant"
- lr_labda_final:
  0.000000003
- max_ep_len:
  400
- num_test_episodes:
  10
- opt_type:
  "minimize"
- polyak:
  0.995
- replay_size:
  1,000,000
- save_freq:
  10
- seed:
  234
- start_steps:
  0
- steps_per_epoch:
  2,048
- steps_per_update:
  80
- update_after:
  1,000
- update_every:
  100

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 32 keys
- AverageAlpha:
  0.04884791374206543
- AverageEntropy:
  0.603373646736145
- AverageEpLen:
  400
- AverageEpRet:
  2,488.935546875
- AverageErrorL:
  16.591232299804688
- AverageLambda:
  0.02329295128583908
- AverageLogPi:
  -0.6033737063407898
- AverageLossAlpha:
  0.17601749300956726
- AverageLossLambda:
  -0.008352721109986305
- AverageLossPi:
  -0.029527176171541217
- AverageLVals:
  39.41169357299805
- AverageTestEpLen:
  400
- AverageTestEpRet:
  1,309.2901611328125
- Epoch:
  49
- Lr_a:
  0.000000001
- Lr_alpha:
  0.000000001
- Lr_c:
  0.000000003
- Lr_labda:
  0.0003
- MaxEpRet:
  2,737.483642578125
- MaxLogPi:
  7.215539932250977
- MaxLVals:
  633.7622680664062
- MaxTestEpRet:
  1,422.7835693359375
- MinEpRet:
  2,223.63330078125
- MinLogPi:
  -12.832170486450195
- MinLVals:
  0.016239924356341362
- MinTestEpRet:
  1,243.681396484375
- StdEpRet:
  188.20399475097656
- StdLogPi:
  1.257422924041748
- StdLVals:
  47.4729118347168
- StdTestEpRet:
  53.94862365722656
- Time:
  1,258.5315573215485
- TotalEnvInteracts:
  100,352

This run consumed these artifacts as inputs. Learn more

job

job-git_github.com_rickstaa_stable-learning-control.git_stable_learning_control_utils_run_entrypoint.py:v87

This run produced these artifacts as outputs. Total: 5. Learn more

run-w7bb31xg-history:v0