Skip to main content
sparsify
Projects
tinystories-1m-ratio
Reports
Scaling dict size tinystories blocks.4 runtype=local
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
Scaling dict size tinystories blocks.4 runtype=local
Dan Braun
Created on March 28
|
Last edited on April 28
Comment
performance/eval/difference_ce_loss and saes.dict_size_to_input_ratio v. sparsity/eval/L_0/blocks.4.hook_resid_pre
performance/eval/difference_ce_loss and saes.dict_size_to_input_ratio v. sparsity/eval/L_0/blocks.4.hook_resid_pre
10
20
30
40
50
60
70
80
90
100
saes.dict_size_to_input_ratio
10
20
30
40
50
60
70
80
90
100
110
sparsity/eval/L_0/blocks.4.hook_resid_pre
-0.6
-0.55
-0.5
-0.45
-0.4
-0.35
-0.3
-0.25
-0.2
-0.15
-0.1
-0.05
performance/eval/difference_ce_loss
Run set
24
Add a comment