Skip to main content

RNN

new experiments
Created on November 20|Last edited on November 20

RNN Notes

Explore correlation between hidden size and accuracy for a bidirectional RNN: larger hidden size leads to higher acc.

accuracy ∝\propto hidden size




50100150200250300350400450500550batch_size00learning_rate0.400.350.300.250.200.150.100.050.00loss020406080100120140160180200hidden_size97.998.098.198.298.398.498.598.698.798.898.999.099.1acc
Showing first 10 runs
2k4k6k8kStep93949596979899
Run set 1
17



Run set 1
17
Hidden size
286
Batch size
286


TODO: try varying batch size