Skip to main content

Sequence Parallel GPT-NeoX

Created on September 25|Last edited on September 25

Section 1


2004006008001kStep12345
2004006008001kStep0.0050.010.0150.020.025
2004006008001kStep0.010.020.030.040.050.060.07
2004006008001kStep12345
2004006008001kStep0.20.40.60.81
2004006008001kStep-2-1012
Run set
2



Run set
2



Run set
2



Run set
2



Run set
2