Skip to main content
corianas
Projects
llamac
Reports
Microllama 300k step
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
Microllama 300k step
29,491,200,000 Tokens trained. Character level model with English ascii characters
Corianas
Created on April 7
|
Last edited on April 7
Comment
Section 1
step_time
step_time
0
50k
100k
150k
200k
250k
300k
Step
20000
40000
60000
tokens
tokens
0
50k
100k
150k
200k
250k
300k
Step
0
5e+9
1e+10
1.5e+10
2e+10
2.5e+10
lr
lr
0
50k
100k
150k
200k
250k
300k
Step
0
0.00002
0.00004
0.00006
0.00008
0.0001
Run set
2
Add a comment