Skip to main content
jadens_team
Projects
hebby
Reports
batches
Log in
Sign up
Share
Comment
Star
batches
Jaden
Created on February 4
|
Last edited on February 5
Comment
batches, forget when plastic
positional encoding
sweep on lr and plasticity values
avg_loss
avg_loss
0
1k
2k
3k
4k
Step
2
3
4
5
6
7
8
9
10
20
30
learning_rate: 0.001, plast_clip: 100
learning_rate: 0.0001, plast_clip: 10000
learning_rate: 0.0001, plast_clip: 1000
learning_rate: 0.0001, plast_clip: 100
learning_rate: 0.001, plast_clip: 10
Run set
11
Add a comment