Select runs that logged avg_loss
to visualize data in this line chart.
to visualize data in this line chart.
riff on normal distributions
Created on September 11|Last edited on September 11
Comment
positive plasticity only.
gelu
use mse loss instead of crossentropy.
slower last layer, remove relu derivative calculation, since I'm using sigmoid rn.
even slower last layer
actually make the last layer faster
maybe fixed pos_only
go mini
Add a comment