Skip to main content

bench sweep

I've long suspected that there was smth wrong w backprop
Created on August 12|Last edited on August 15

does any backprop work?


Computing group metrics from first 36 groups
500k1M1.5M2Miter00.20.40.60.81
updater: dfa
updater: backprop
Run set
845

plast_clip, updater

Run set
845

plast_clip set to 1e4, updater vs. recurrence. We hope to see solid performance on both dfa and backprop even without recurrence.

Run set
202

is clip_weights useful at all, and if so, what value of it?

Run set
112

is residual_connections a useful parameter?

Run set
244