pile-code-attn Table – Weights & Biases

Skip to main content

Nickypro's workspace

Runs

264

accuracy/code/base

accuracy/code/skip

accuracy/code/topk

accuracy/code/topk_skip

accuracy/pile/base

accuracy/pile/skip

accuracy/pile/topk

accuracy/pile/topk_skip

areas/base

areas/skip

areas/topk

areas/topk_skip

deletions/attn_del

deletions/attn_threshold

Finished

-

nickypro

2y ago

2h 4m 15s

-

0.05

pile

0.001

0

code

facebook/opt-6.7b

true

1000

pre_out

false

false

abs

false

false

true

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

38.73463

15.32636

62.67816

40.42252

25.73228

13.2137

52.77788

34.92149

0.93023

1.02926

0.94691

0.96972

6553

1.01367

Finished

-

nickypro

2y ago

2h 3m 53s

-

0.05

code

0.001

0

pile

facebook/opt-6.7b

true

1000

pre_out

false

false

abs

false

false

true

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

27.22284

10.16642

51.22391

29.74489

19.56006

7.84607

45.29744

24.61792

1.00422

1.07105

0.97987

0.98034

6553

1.01563

Finished

-

nickypro

2y ago

2h 3m 14s

-

0.05

pile

0.001

0

code

facebook/opt-6.7b

true

1000

pre_out

false

false

abs

false

false

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

33.17793

9.22172

57.06284

31.63926

16.72921

6.10538

40.04544

21.5074

0.82504

0.91796

0.82517

0.8336

6553

0.9126

Finished

-

nickypro

2y ago

2h 3m 11s

-

0.05

code

0.001

0

pile

facebook/opt-6.7b

true

1000

pre_out

false

false

abs

false

false

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

9.04823

3.9143

23.56632

12.47035

15.39036

6.05354

38.39772

19.81357

1.30266

1.40512

1.28716

1.3894

6553

1.40332

Finished

-

nickypro

3y ago

2h 44m 59s

-

0

code

0.001

0.04

pile

facebook/opt-6.7b

true

1000

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

0.0016283

0.00099651

0.091725

0.00099651

0.01021

0.00099696

0.022974

0.0039878

1.60888

1.57442

1.62458

1.61926

0

0

Finished

-

nickypro

3y ago

2h 44m 25s

-

0.007

code

0.001

0.04

pile

facebook/opt-6.7b

true

1000

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

0

0

0

0

0

0

0

0

1.4562

1.39985

1.48139

1.45471

7

1.39941

Finished

-

nickypro

3y ago

2h 45m 58s

-

0.05

code

0.001

0

pile

facebook/opt-6.7b

true

1000

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

6.08426

0.25311

31.06499

2.33782

8.35982

1.44061

24.39343

6.37456

0.9962

1.04511

1.05528

0.97091

51

0.69824

1-7

of 7