Select runs that logged avg_loss
to visualize data in this line chart.
to visualize data in this line chart.
Static Plasticity
Should the plasticity values for each parameter change? Or can they stay the same and still let the model work fine? What should their value be? Randomly initialized, or all zero, or something else?
Created on July 25|Last edited on July 25
Comment
A comparison between a plasticity learning rate of zero or something else. PLR of zero means no change in the initialized plasticity values at all.
Add a comment