Skip to main content
imdatta0
Projects
lora_inits
Reports
LoRA initialisations
Log in
Sign up
Share
Comment
Star
LoRA initialisations
Testing various LoRA initialisations
Venkata Datta Sai Nimmaturi
Created on June 7
|
Last edited on June 7
Comment
eval/loss
eval/loss
0.2
0.4
0.6
0.8
train/epoch
0.45
0.5
0.55
0.6
0.65
mistral_7b_v_MetaMathQA_40K_ortho_eye
mistral_7b_v_MetaMathQA_40K_orthogonal
mistral_7b_v_MetaMathQA_40K_reverse_
mistral_7b_v_MetaMathQA_40K_
eval/loss
eval/loss
0.2
0.4
0.6
0.8
train/epoch
1.2
1.25
1.3
1.35
llama_2_7b_Magiccoder_evol_10k_orthogonal
llama_2_7b_Magiccoder_evol_10k_reverse
llama_2_7b_Magiccoder_evol_10k
Add a comment