Skip to main content
sparsify
Projects
gpt2-e2e
Reports
Increasing n_samples for e2e
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
Increasing n_samples for e2e
Samples 100k (blue), 200k (purple), 400k (yellow)
Dan Braun
Created on April 3
|
Last edited on April 3
Comment
Section 1
performance/eval/difference_ce_loss and n_samples v. sparsity/alive_dict_elements/blocks.10.hook_resid_pre
performance/eval/difference_ce_loss and n_samples v. sparsity/alive_dict_elements/blocks.10.hook_resid_pre
100,000
120,000
140,000
160,000
180,000
200,000
220,000
240,000
260,000
280,000
300,000
320,000
340,000
360,000
380,000
400,000
n_samples
26,000
28,000
30,000
32,000
34,000
36,000
38,000
40,000
42,000
44,000
sparsity/alive_dict_elements/blocks.10.hook_resid_pre
-0.14
-0.13
-0.12
-0.11
-0.1
-0.09
-0.08
-0.07
-0.06
performance/eval/difference_ce_loss
Run set
6
Run set 2
3
Add a comment