Skip to main content
eleutherai
Projects
neox
Reports
Rotary Pos Emb tests 1

Rotary Pos Emb tests 1

s black
Created on April 10|Last edited on April 10

Section 1


1k2k3k4k5kStep3
group: POS_EMB_TESTS_F75rxFNEsFqyvt7ABDZ2Wq
group: POS_EMB_TESTS_UNTgrCaGcXDis9kxanz2Cg
group: POS_EMB_TESTS_FryhmDuJR2FRUdspz8H32E
group: POS_EMB_TESTS_WeVtvSb8WjExHJRSG2j9i3
1k2k3k4k5kStep0.912345678910
group: POS_EMB_TESTS_F75rxFNEsFqyvt7ABDZ2Wq
group: POS_EMB_TESTS_UNTgrCaGcXDis9kxanz2Cg
group: POS_EMB_TESTS_FryhmDuJR2FRUdspz8H32E
group: POS_EMB_TESTS_WeVtvSb8WjExHJRSG2j9i3
Run set
10



Run set
10


Created with ❤️ on Weights & Biases.

https://wandb.ai/eleutherai/neox/reports/Rotary-Pos-Emb-tests-1--Vmlldzo1OTgzOTI
Made with Weights & Biases. Sign up or log in to create reports like this one.