rickstaa

Rickstaa's group workspace

Group: han2020_reproduction_small_critic

1-18

of 18

Tags

extra

Notes

Author

rickstaa

State

Finished

Start time

March 8th, 2024 9:42:34 AM

Runtime

23m 2s

Tracked hours

22m 57s

Run path

rickstaa/stable-learning-control/gunuil4m

Linux-6.5.0-17-generic-x86_64-with-glibc2.35

Python version

3.10.13

Git repository

git clone git@github.com:rickstaa/stable-learning-control.git

Git state

git checkout -b "han2020_reproduction_lac_oscillator_complicated_alpha3_tune_exp_small_critic_alp0-1_s78456" b40c02adc21eb9f93782a168b4fac779b88e8e9d

Command

/home/ricks/development/work/stable-learning-control/stable_learning_control/utils/run_entrypoint.py eJy1Vs1rG0cU35UsWZYcf8UQKElxCbR2wJLjfLSENE2rgyGq3cZJjmUY7Y40E83ObHZn7CgQKLSJZRhKIZNDempoL73k3j+g/0J7KZT2FOih/0Lf7EqyQ+JQCtHnzHtv3vfvzX5Zevyk6mUvcyLgUocxC3qc1A+trZlBEe4R1NEiUEwK+8guU88cQ23NuGICqX5MgGgqTRmSm27zwG7b5ZY3fE+0jjdvhv6guOMlp8JCWOTefmFQ/N4P/af+vp+tJpj3tLDv7Xl7/l6hUwxLYfnryqAYTl72VGEw8ZXve4NSWGHeoPij/w3swuINzy6blRtE6XiJiB2WSBERoZZ0SsIlJpYUJUvkbkwS5sh18A+kkMARsS1vy1TdrreLk25q6eSL3i4MCre9gd/xwZ7n7IGtrQfWTLhEQHQrBjWojEgjgRSljZDsEC5jZ6axK5NeI1W4zckqJzgRTHRXAylUIvmQjkZ0NKJrxXjaSLRA2aoe98HbyxxH7RBfsS3VLCx4ltZo1RS7/cju2RUFGTYXAsw5OhTjZS6BlF6pK6pFD8Vcpwe0sT5TdqF3hNNipkChwCnTkTXFWMZgOIoZ6kAYzg6dM9UDZbbVa85UipVCtTDtL/qV4kIRtA2TaCaFjlAQa2tK2RE4Txedo/ehUDWEYhz0cJcgZM2pIzJRz+IHH1BWKCf63mtF6+OkZYc6jGeH3nh59NYWYGAuRwaJYtVHAeEcYLCybWl99LNnXfwguTCGD0qJAkPKQYaev++SQ1fo22YaoTsa81HYp/9Dba2ZRQgLIUEdaE7h3H0HV2jrkHSw5sqRtpzqF/ZVhCIZ6ixV9IyZBLYM3HrKlQmwn+ok43kgmkU4jM0V8gBF5vQwYdBClz5LA8Y5VjJpyijmLIAIw9Wds9BhOBjhzJ2fpiwMCaSB3SM5pYQDOGa/sMubng8fYspBwhQLHKl1Fd5zRJsqSLGdLNAsZy3oN1HfJp/esnSTXtdmXmoVa4VekKMtej3VpiJjlc8paG8mWATGralG+C4iMRRc2M1vfcBFLAMKXd42s6kicYog+ygj2k2vYmoQb6JQxoIZYqZ1HEKYCPor6dtWOCbgjiKJ3XxeNHMHenKebX1u5h1QFEkV6GYpDE3QVoU08Jhiu3HVG07kckY4Zzc++vmJe31nShwDgoHwz7PFe39uPDPlWPI+7jnKb9UP4x9+M4s4xDEkgICBCMxiBbW0AzPBE+ROvnXxr79PNlezfQD7cz+dWbu1jk3F8XMHxjKONrI4kqs6OcCZwNxuXJmv156/++vjjBqMqSu/zP9+6eM/zMxI50vyMyPNL52ZzfSHJMD9YcHKnAlApM1YwatZx8eWjmTn5g6zK4BvqKiAKTgNAjkrIR2Y865q0B9trAKadSrU3ze1hMQcZDLCtaufzHpmhsqE3QNUQw91FbWtkplKMWS/k5A7rqplmD4sAGulbqwvARyOcdntQjscgkR12LkhA1+f/6/RBa2FGxSL9bX1NYghTgDf+bjhAD85BifMtDE684ydQ0oL4iYNSiM3c3LsOeba6tk3oROl739w/sJFdyGDQD5KbrwBOxbQ50oRUBL0YsmESu2+mYXnA8CGSGXSljgJgTTlSLtYhG0Ayky2QLdle9gmJZVgJqBwOQPcu00C6JkTR9TCmlou2U2khi5655WhHfbXjoy6KybLx5apqTaCTsn7yBS53AVP7mhGFDhcg4HTluB0JwJHJlybQw+PiDs4Se2Whi4mJLTX7q77nnZPZLTZ8vN/s3rUpYp5V7oLDtId0Drk332dffh9lD3X7UHk6NDzIUp1O79NUpjX7gLpctmGmyq7jehJc/b1F7h72jhYKSnhKqcnH9lUP7QPt9fq/wL/yBaO

System Hardware

CPU count	6
Logical CPU count	12
GPU count	2
GPU type	NVIDIA GeForce GTX 1070 Ti

W&B CLI Version

0.16.3

Group

han2020_reproduction_small_critic

Job Type

train

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 40 keys
- ▶
  ac_kwargs:{} 3 keys
  - ▶
    activation:{} 2 keys
    - actor:
      "nn.ReLU"
    - critic:
      "nn.ReLU"
  - ▶
    hidden_sizes:{} 2 keys
    - ▶
      actor:[] 2 items
      - 0:
        256
      - 1:
        256
    - ▶
      critic:[] 3 items
      - 0:
        64
      - 1:
        64
      - 2:
        16
  - ▶
    output_activation:{} 1 key
    - actor:
      "nn.ReLU"
- adaptive_temperature:
  true
- alpha:
  2
- alpha3:
  0.1
- batch_size:
  256
- device:
  "gpu:1"
- env:
  "OscillatorComplicated-v1"
- env_class:
  "stable_gym.envs.biological.oscillator_complicated.oscillator_complicated.OscillatorComplicated"
- epochs:
  98
- exp_name:
  "han2020_reproduction_lac_oscillator_complicated_alpha3_tune_exp_small_critic_alp0-1"
- export:
  false
- gamma:
  0.99
- horizon_length:
  5
- labda:
  0.99
- lr_a:
  0.0001
- lr_a_decay_type:
  "linear"
- lr_a_final:
  0.000000001
- lr_alpha:
  0.0001
- lr_alpha_decay_type:
  "linear"
- lr_alpha_final:
  0.000000001
- lr_c:
  0.0003
- lr_c_decay_type:
  "linear"
- lr_c_final:
  0.000000003
- lr_decay_ref:
  "step"
- lr_decay_type:
  "linear"
- lr_labda:
  0.0003
- lr_labda_decay_type:
  "constant"
- lr_labda_final:
  0.000000003
- max_ep_len:
  400
- num_test_episodes:
  10
- opt_type:
  "minimize"
- polyak:
  0.995
- replay_size:
  1,000,000
- save_freq:
  10
- seed:
  78,456
- start_steps:
  0
- steps_per_epoch:
  2,048
- steps_per_update:
  80
- update_after:
  1,000
- update_every:
  100

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 32 keys
- AverageAlpha:
  0.0018834668444469571
- AverageEntropy:
  1.818642020225525
- AverageEpLen:
  400
- AverageEpRet:
  20,557.515625
- AverageErrorL:
  785.5087890625
- AverageLambda:
  0.00015096249990165234
- AverageLogPi:
  -1.8186419010162351
- AverageLossAlpha:
  0.010959225706756117
- AverageLossLambda:
  0.5549890995025635
- AverageLossPi:
  -0.003415881423279643
- AverageLVals:
  619.8463745117188
- AverageTestEpLen:
  400
- AverageTestEpRet:
  12,112.21484375
- Epoch:
  98
- Lr_a:
  0.000000001
- Lr_alpha:
  0.000000001
- Lr_c:
  0.000000003
- Lr_labda:
  0.0003
- MaxEpRet:
  21,894.4296875
- MaxLogPi:
  7.420685291290283
- MaxLVals:
  33,401.51953125
- MaxTestEpRet:
  12,215.9150390625
- MinEpRet:
  19,224.361328125
- MinLogPi:
  -10.937051773071287
- MinLVals:
  0
- MinTestEpRet:
  11,985.8203125
- StdEpRet:
  844.6542358398438
- StdLogPi:
  1.1954171657562256
- StdLVals:
  2,675.307861328125
- StdTestEpRet:
  60.26020812988281
- Time:
  1,374.2954659461975
- TotalEnvInteracts:
  200,704

This run consumed these artifacts as inputs. Learn more

job

job-git_github.com_rickstaa_stable-learning-control.git_stable_learning_control_utils_run_entrypoint.py:v81

162

This run produced these artifacts as outputs. Total: 5. Learn more

run-gunuil4m-history:v0