rickstaa

Rickstaa's group workspace

Group: han2020_reproduction_sac_bigger_initial_alpha

1-20

of 20

Tags

Notes

Author

rickstaa

State

Finished

Job

job-git_github.com_rickstaa_stable-learning-control.git_stable_learning_control_utils_run_entrypoint.py:v111

Start time

March 14th, 2024 1:25:10 PM

Runtime

13m 46s

Tracked hours

13m 40s

Run path

rickstaa/stable-learning-control/m13oqx0z

Linux-6.5.0-17-generic-x86_64-with-glibc2.35

Python version

3.10.13

Git repository

git clone git@github.com:rickstaa/stable-learning-control.git

Git state

git checkout -b "han2020_reproduction_sac_oscillator_alpha3_tune_exp_bigger_initial_alpha_s234" 31109f0ae4867f0f525d95d6f7ed5b49edac7a49

Command

/home/ricks/development/work/stable-learning-control/stable_learning_control/utils/run_entrypoint.py eJy1Vs1vHDUUn9nJJpvdNGnSSkWoRZGQIKmU3TQtHKpSCjkUsWRR0/ZYWd4Z79pdj+3O2EkXqRIStNlIFkKqe6eCC38Id070goTEqYID/wLPM5tNKpoKobKf9nvP7+P3PjxfVp8E9aB42TMxlyZRLB5w0jyydnYepXhAUM+IWDMp3GO3QgN7AnUN45oJpIeKANHWNmVCbvnNQ7ftVtrB+D3VPrV5KwlH0U6QnUsqScSD/coo+i5MwqfhflispljwtLIf7AV74V6lFyXVZPrr2ihKZq4EujKa+ioMg1E1qbFgFP0QfgO7JLoZuBW7epNoo5aJ2GGZFCkRetnkJFlmYllTskzuK5IxT26CfyCFBE6JawcdW/e7wS7O+rmjMy96uzSq3A1GYS8Ee4G3B7Y6D52d8kBAdKsWtahMSSsDiPJWQnYIl8qbae3KbNDKNe5yssYJzgQT/bVYCp1JPqajAzo6oBvNeN7KjEDFqqmG4O0VjtNugq+6tt6sLAWONmjdRv1h6vbcqgaE7Xsx5hwdifEKl0DKrzY1NWKAFDf5IW2iz0770HvCa7GzoFDgnJnU2UhJBYZTxVAPwvB26ElbP1Tm2oPN+VpUq9Qrc+HpsBYtRaBtDKKdESZFsTLOVosjcJ6e9o4+gEQ1EFI4HuA+QcjZc8cg0SziBx9QkSgv+u4rRZsT0IpDPcaLQ/97ekynAz1wsuwMkio9RDHhHNpgddvR5sHPnvPxg+TSpH1QTjQY0r5l6KUHHhy6St+ycwjdM5gfhP32v8itswsIYSEkqAPNOZx74NsVyjohPWy49qSOV/3Cvo5QKhNTQEXP2xlgy9ivZ32aoPdzkxW8AESLCMex+UQedpF9YwwYlNDlz/OYcY61zNZ2LkBZ4figufyhOcqShEDs7AtSUqo4Bll3x61sBSF8iJ2OM6ZZfIRkbB2k2E4RXQFUG4pMNLfJZ7cd3aI3jF2URiuj0QtytE1v5MbWpNLlcIKaZoKlYNzZeorvI6Igy8JtfRtCMygZUyjtC3Yh10TlCCBHBdFtBTXbgCAzjQoWDA47Z1QC2UNQVNnQtZMJAfc0ydzW88iePNRT8lx7wy767tAk16Cb5TApQVsdYOCKYnf9WjAew9U+TlMgfPjXs/oH6vtndlpJPsSDI5TTOMEKwiWgLgUjWEO63MhO8Qz5k2++//ufZzfXin0M+4s/nl+/vYFtzfNLcxOZuqdB2wjM3fWri83G83d+eVJQ4wl19afFXy9/9JudPzj/D/mFQktCYjwcAz7NmYA2cgUrfjnr1ETfS9lzwC4ZGenB7PWgQvq6WMe0KCRIT2gbGVEcZArCp9c+XgjsbI4Bm15G7nmEp6H9WQyKq31lLkNpnuCy34fUHCnP+riKEgZ2f/5PswPSjFsUi431jXVwWGXQYON+h1aQk+4oI76ItBHEtzfqssIbqE/NMC/Zr00RyjcuXvI3H/DLnv3kdal2UOYe55iSeKAkEzp3+3YBbl8oS5HLrCtxlgBp1pN2sUi6UKPzxQLdld1xuqs6w0xAVkoG+HSXxHAvnTkGaGcbpWQ/kwbqYe3YeF7u9NgBP8wLQDq2obsISqIsGBtxuQte3TOMaHC+AV3elRBALwWnpnxtQmUeEHdwlruOgdokJHHtP4x/8KGb7bD8t2vH3V2Y96W/RwDsmDbBW/8F4/73cfH4tAcQoCOPYSg33XJo5zAh/Zzuc9mFC6EY+vSsvfDqe9Jf6ocrLSXcmPTsY5ebR+7R9nrzbw/N2qk=

System Hardware

CPU count	6
Logical CPU count	12
GPU count	2
GPU type	NVIDIA GeForce GTX 1070 Ti

W&B CLI Version

0.16.3

Group

han2020_reproduction_sac_bigger_initial_alpha

Job Type

train

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 34 keys
- ▶
  ac_kwargs:{} 3 keys
  - ▶
    activation:{} 2 keys
    - actor:
      "nn.ReLU"
    - critic:
      "nn.ReLU"
  - ▶
    hidden_sizes:{} 2 keys
    - ▶
      actor:[] 2 items
      - 0:
        256
      - 1:
        256
    - ▶
      critic:[] 2 items
      - 0:
        256
      - 1:
        256
  - ▶
    output_activation:{} 1 key
    - actor:
      "nn.ReLU"
- adaptive_temperature:
  true
- alpha:
  2
- batch_size:
  256
- device:
  "gpu:1"
- env:
  "Oscillator-v1"
- env_class:
  "stable_gym.envs.biological.oscillator.oscillator.Oscillator"
- epochs:
  49
- exp_name:
  "han2020_reproduction_sac_oscillator_alpha3_tune_exp_bigger_initial_alpha"
- export:
  false
- gamma:
  0.995
- lr_a:
  0.0001
- lr_a_decay_type:
  "linear"
- lr_a_final:
  0.000000001
- lr_alpha:
  0.0001
- lr_alpha_decay_type:
  "linear"
- lr_alpha_final:
  0.000000001
- lr_c:
  0.0003
- lr_c_decay_type:
  "linear"
- lr_c_final:
  0.000000003
- lr_decay_ref:
  "step"
- lr_decay_type:
  "linear"
- max_ep_len:
  400
- num_test_episodes:
  10
- opt_type:
  "minimize"
- polyak:
  0.995
- replay_size:
  1,000,000
- save_freq:
  10
- seed:
  234
- start_steps:
  0
- steps_per_epoch:
  2,048
- steps_per_update:
  50
- update_after:
  1,000
- update_every:
  100

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 33 keys
- AverageAlpha:
  0.22563506662845612
- AverageEntropy:
  -2.3362162113189697
- AverageEpLen:
  137.86666870117188
- AverageEpRet:
  499.2735900878906
- AverageLogPi:
  2.3362162113189697
- AverageLossAlpha:
  0.14977319538593292
- AverageLossPi:
  162.12950134277344
- AverageLossQ:
  255.20989990234375
- AverageQ1Vals:
  164.973388671875
- AverageQ2Vals:
  164.95774841308594
- AverageTestEpLen:
  139
- AverageTestEpRet:
  512.4005737304688
- Epoch:
  49
- Lr_a:
  0.000000001
- Lr_alpha:
  0.000000001
- Lr_c:
  0.000000003
- MaxEpRet:
  608.586669921875
- MaxLogPi:
  21.614442825317383
- MaxQ1Vals:
  717.3741455078125
- MaxQ2Vals:
  703.5576171875
- MaxTestEpRet:
  599.5789184570312
- MinEpRet:
  389.1680603027344
- MinLogPi:
  -10.486027717590332
- MinQ1Vals:
  82.63333129882812
- MinQ2Vals:
  75.4577407836914
- MinTestEpRet:
  455.1324768066406
- StdEpRet:
  64.09320068359375
- StdLogPi:
  2.9160547256469727
- StdQ1Vals:
  64.5444564819336
- StdQ2Vals:
  64.74299621582031
- StdTestEpRet:
  45.275047302246094
- Time:
  816.5572814941406
- TotalEnvInteracts:
  100,352

This run consumed these artifacts as inputs. Learn more

job

job-git_github.com_rickstaa_stable-learning-control.git_stable_learning_control_utils_run_entrypoint.py:v111

This run produced these artifacts as outputs. Total: 5. Learn more

run-m13oqx0z-history:v0