Skip to main content
jadens_team
Projects
hebby
Reports
handing two

handing two

Jaden
Created on March 31|Last edited on April 30

last two instead of last one

current

big_long_sweep, long_range_memory dataset

050100150200250Step11e+20
learning_rate: 0.001, plast_clip: 100000
learning_rate: 0.001, plast_clip: 10000
learning_rate: 0.001, plast_clip: 1000
learning_rate: 0.001, plast_clip: 100
learning_rate: 0.0001, plast_clip: 100000
learning_rate: 0.0001, plast_clip: 10000
learning_rate: 0.0001, plast_clip: 1000
learning_rate: 0.0001, plast_clip: 100
learning_rate: 0.00001, plast_clip: 100000
learning_rate: 0.00001, plast_clip: 10000
learning_rate: 0.00001, plast_clip: 1000
learning_rate: 0.00001, plast_clip: 100
050100150200250Step0.60.70.80.912345678910
0.001 100000
0.001 10000
0.001 1000
0.001 100
0.0001 100000
0.0001 10000
0.0001 1000
0.0001 100
0.00001 100000
0.00001 10000
0.00001 1000
0.00001 100
last-two
48

sweep forget rates, too

last-two
83

additionally, sweep grad_clip

last-two
504



Created with ❤️ on Weights & Biases.

https://wandb.ai/jadens_team/hebby/reports/handing-two--VmlldzoxMjA3MDM0MA
Made with Weights & Biases. Sign up or log in to create reports like this one.