Bidirectional RNNs

Created on November 20|Last edited on November 20

Comment

﻿
RNN NotesExplore correlation between hidden size and accuracy for a bidirectional RNN: larger hidden size leads to higher acc.
accuracy ∝\propto∝ hidden size
﻿
﻿
﻿
50100150200250300350400450500550batch_size00learning_rate0.400.350.300.250.200.150.100.050.00loss020406080100120140160180200hidden_size97.297.497.697.898.098.298.498.698.899.099.2acc
acc
acc
Showing first 10 runs
2k4k6k8kStep93949596979899
fiery-snow-1
vibrant-sun-2
comic-fire-3
eager-oath-4
copper-pyramid-5
noble-bird-6
breezy-energy-7
rich-grass-8
polished-donkey-9
logical-monkey-10
Run set 119
﻿
Next experiment: Hidden size correlation?
﻿
﻿

Add a comment