psy-llama-pretraining Workspace

Kirp's workspace

Runs

4

Name

3 visualized

Train with default qkvogdu+lm+emb on 4*A6000 lr=1e-4 pretraining

Train with t10000 map qkvogdu+lm+emb on 8*A6000 lr=1e-4 pretraining

Train with t10000 random qkvogdu+lm+emb on 4*A6000 lr=1e-4 pretraining

Train with default qkvogdu

1-4

of 4

eval

5

eval/accuracy

eval/runtime

eval/steps_per_second

eval/samples_per_second

eval/loss

To pick up a draggable item, press the space bar. While dragging, use the arrow keys to move the item. Press space again to drop the item in its new position, or press escape to cancel.