rickstaa

Rickstaa's group workspace

Group: han2020_reproduction_lambda_lr_check

1-20

of 75

Tags

extra

Notes

Author

rickstaa

State

Finished

Job

job-git_github.com_rickstaa_stable-learning-control.git_stable_learning_control_utils_run_entrypoint.py:v90

Start time

March 10th, 2024 7:57:03 AM

Runtime

3h 43m 11s

Tracked hours

3h 43m

Run path

rickstaa/stable-learning-control/5dwtal66

Linux-6.5.0-17-generic-x86_64-with-glibc2.35

Python version

3.10.13

Git repository

git clone git@github.com:rickstaa/stable-learning-control.git

Git state

git checkout -b "han2020_reproduction_lac_cartpole_cost_alpha3_tune_exp_lambda_lr_check_alp1-0_s48104" 8c7803cc893c8ef9741ac2e01cdaae6366adb949

Command

/home/ricks/development/work/stable-learning-control/stable_learning_control/utils/run_entrypoint.py eJy1Vt9rHEUc373NJZdLmqRpoFBaCSiYFHKXtFWktLV4DwGvCW3aPsowtzt3M73Zme3uTNIUi4K2ucDgS8dHwaIgvvQfKP4LvhZREPWl4oM++OST39m9uyTUFJGaSy47n+93vt/5/vh8Zz8sf/pB1ct/zPGQSx0lLOxyUtv3bM0UinGXoLYWoWJS2Id2gXrmCGppxhUTSG0nBEBTaciI3HCL+3bDLjS9/mekeaxxI/J7waaXnopKUcC93VIv+NyP/Ef+rp8/jTDvUWnX2/F2/J1SO4jK0ejHlV4QjV3wVKk38pHve71yVGFeL/jS/wRWUXDdswtm8TpROpknYpOlUsREqHmdkWieiXlFyTy5k5CUObgG5wMtJHBMbNNbN1W36m7htJNZOnbwtLO90i2v57d98Oc5f+Br/b41Iy4REN2iQXUqY1JPIUVZPSKbhMvEualvybRbzxRucbLECU4FE52lUAqVSt7H0QBHA1wrxrN6qgXKn2rJNpz2AsdxK8KXbFM1SrOepRO0aoLOdmx37KKCDJs3Qsw52hfjBS4Byi7VFNWiixKusz1saM+MutDbwlkx42BQ4Izp2JogkQk4jhOG2hCG80NnTHXPmG12G1OVoFKqlib9Ob8SzAZgrZ9EMyZ0jMJEW1POt8B+OucOeg8KNYFQgsMu7hCErDl1SCZqefxwBpQXyqm+/kLV2jBp+aY24/mm/708en0dODBTMIPEidpGIeEcaLC4YWlt8LVjXfygOTukD8qIAkfKUYaeu+eSQxfpK2YSodsa80HYr/6L2lozjRAWQoI5sJzBvnuOrtDWEWljzZWD1p3pA+sqQrGMdJ4qetqMgViG7nnclQm4n+k0l3mgmkfYj80Vco9F5kQ/YdBC5xs4VVclJw2ZqaXNFWgsHA7o5bZNUhZFBKJnd0mBlHGoZGrfswtrng+/xIyGKVMsdFDzMnxmiDZV0GKbeXx5qprQZqK2Qa7ctHSNXtPmqNQq0Qod0KNNei3TpiITVYwn6GomWAzOranG+A4iCdRZ2OZfwIZEhjSza7/6ZjpTJMkQJB3lqF3zKmYCwkwVykUwOsykTiKoH4K2SrdtMxoCuK1IateeBWZmz04hs82r5qjjhyKZAtssg1kJ1qqQBp5QbFcve/1BPJoDZ+3q23/0kTLHQFwAfn88d/en1cdmNJF8G3cd8rR6MfniqZnDEU4gAQQcxOAWKyih7ZkRniK388SbP/92srGUr0NYn/369PLNM9hUnLw4wFDHYQOPA6zq9IBeAnO7evH793/87uk3T3I0HKJ/fvbVL/jbK2ZqYPM5/amB5eck07n9iIR4u1+wUc4EENHmovCfRceGng4VF+72iytAa6iogOE3CQqFKCVtGO+uatAfLaxCmncq1N83EylJOOjkwLuX35n2zBSVKbsLZIYe6ihqm2UznmHIfjslt11VR2HosBC8lTuJPg90OMJlpwPtsI8S1X7nRgzO+sN/mljQWrhOsTizfGYZYkhSoHUxZTjQL4S2hU4B+gIpi0SdRUoL4uYKKq4D5LJLSdh18pWl5ZdrDWXn3lpZPufuXtAppsbaS/VggWsu8TmWSCZUZnfNNLwEABNEJtOWxGkE0LiDtrCIWkCLqfwB3ZKtflOUVYqZgDIVAjjYLRJChxw/JPPWTBSanVRq6JnXDgnqwJHtwK+7SvJkrJsJ1ULQGkXjmIDLLTjMbc2IgjNPwIRpSTh3O4azjLi+hqYdgJs4zey6hrYlJIKx80S79y7aaPrFf7N02NWJeUe6awzmb0hrkHr357zD98P87W0HQkf73gJRplvFnZHBeHbXRIfLFtxH+Z1DT5qVF1/T7p1i70lJCRc2PfnQZvqBfbCxXPsbAGsTXg==

System Hardware

CPU count	6
Logical CPU count	12
GPU count	2
GPU type	NVIDIA GeForce GTX 1070 Ti

W&B CLI Version

0.16.3

Group

han2020_reproduction_lambda_lr_check

Job Type

train

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 40 keys
- ▶
  ac_kwargs:{} 3 keys
  - ▶
    activation:{} 2 keys
    - actor:
      "nn.ReLU"
    - critic:
      "nn.ReLU"
  - ▶
    hidden_sizes:{} 2 keys
    - ▶
      actor:[] 2 items
      - 0:
        256
      - 1:
        256
    - ▶
      critic:[] 3 items
      - 0:
        64
      - 1:
        64
      - 2:
        16
  - ▶
    output_activation:{} 1 key
    - actor:
      "nn.ReLU"
- adaptive_temperature:
  true
- alpha:
  2
- alpha3:
  1
- batch_size:
  256
- device:
  "gpu:1"
- env:
  "CartPoleCost-v1"
- env_class:
  "stable_gym.envs.classic_control.cartpole_cost.cartpole_cost.CartPoleCost"
- epochs:
  489
- exp_name:
  "han2020_reproduction_lac_cartpole_cost_alpha3_tune_exp_lambda_lr_check_alp1-0"
- export:
  false
- gamma:
  0.99
- horizon_length:
  5
- labda:
  0.99
- lr_a:
  0.0001
- lr_a_decay_type:
  "linear"
- lr_a_final:
  0.0000000001
- lr_alpha:
  0.0001
- lr_alpha_decay_type:
  "linear"
- lr_alpha_final:
  0.0000000001
- lr_c:
  0.0003
- lr_c_decay_type:
  "linear"
- lr_c_final:
  0.0000000003
- lr_decay_ref:
  "step"
- lr_decay_type:
  "linear"
- lr_labda:
  0.0001
- lr_labda_decay_type:
  "constant"
- lr_labda_final:
  0.0000000001
- max_ep_len:
  250
- num_test_episodes:
  10
- opt_type:
  "minimize"
- polyak:
  0.995
- replay_size:
  1,000,000
- save_freq:
  10
- seed:
  48,104
- start_steps:
  0
- steps_per_epoch:
  2,048
- steps_per_update:
  80
- update_after:
  1,000
- update_every:
  100

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 32 keys
- AverageAlpha:
  0.02530682645738125
- AverageEntropy:
  -0.9995659589767456
- AverageEpLen:
  250
- AverageEpRet:
  32.90620803833008
- AverageErrorL:
  2.2130331993103027
- AverageLambda:
  1
- AverageLogPi:
  0.9995659589767456
- AverageLossAlpha:
  0.00001098423490475398
- AverageLossLambda:
  -0.6599587798118591
- AverageLossPi:
  0.07268703728914261
- AverageLVals:
  1.725545048713684
- AverageTestEpLen:
  250
- AverageTestEpRet:
  27.75028419494629
- Epoch:
  489
- Lr_a:
  0.0000000001
- Lr_alpha:
  0.0000000001
- Lr_c:
  0.0000000003
- Lr_labda:
  0.0001
- MaxEpRet:
  69.23688507080078
- MaxLogPi:
  30.65059471130371
- MaxLVals:
  567.692138671875
- MaxTestEpRet:
  88.86639404296875
- MinEpRet:
  4.357083320617676
- MinLogPi:
  -12.26197910308838
- MinLVals:
  0
- MinTestEpRet:
  1.673601150512695
- StdEpRet:
  19.912240982055664
- StdLogPi:
  1.726423263549805
- StdLVals:
  11.79593563079834
- StdTestEpRet:
  31.696218490600582
- Time:
  13,377.254215478895
- TotalEnvInteracts:
  1,001,472

This run consumed these artifacts as inputs. Learn more

job

job-git_github.com_rickstaa_stable-learning-control.git_stable_learning_control_utils_run_entrypoint.py:v90

This run produced these artifacts as outputs. Total: 5. Learn more

run-5dwtal66-history:v0