Skip to main content

sweep working

Created on July 24|Last edited on July 24
lr at 1e-10

lr at 1e-8

Run set
42

sweep_working_long - similar parameters, just a longer runtime
learning rate of 1e-8, but that's balanced by plasticity caps of as high as 1e8, as well. It's usually immediately unstable at that, though. Plasticity learning rates were tested at 1e-2, 1e-3, and 1e-4.

Run set
24