Skip to main content
marin-community
Projects
marin
Reports
FineMath Annealing Runs

FineMath Annealing Runs

Herumb Shandilya
Created on April 1|Last edited on August 24

670k670.5k671k671.5kStep0.3250.330.3350.34
8b-quality-eval-finemath-crawl-control-token-proportional-e8bde7
8b-quality-eval-finemath-crawl-control-mix-048ab1
8b-quality-eval-tokenized-finemath-crawled-c6c5c7
8b-quality-eval-tokenized-finemath-control-dcbd48
670k670.5k671k671.5kStep0.270.280.290.30.310.320.33
8b-quality-eval-finemath-crawl-control-token-proportional-e8bde7
8b-quality-eval-finemath-crawl-control-mix-048ab1
8b-quality-eval-tokenized-finemath-crawled-c6c5c7
8b-quality-eval-tokenized-finemath-control-dcbd48
670k670.5k671k671.5kStep0.420.430.440.450.46
8b-quality-eval-finemath-crawl-control-token-proportional-e8bde7
8b-quality-eval-finemath-crawl-control-mix-048ab1
8b-quality-eval-tokenized-finemath-crawled-c6c5c7
8b-quality-eval-tokenized-finemath-control-dcbd48
670k670.5k671k671.5kStep0.40.410.420.43
8b-quality-eval-finemath-crawl-control-token-proportional-e8bde7
8b-quality-eval-finemath-crawl-control-mix-048ab1
8b-quality-eval-tokenized-finemath-crawled-c6c5c7
8b-quality-eval-tokenized-finemath-control-dcbd48
670k670.5k671k671.5kStep0.30.320.340.360.38
8b-quality-eval-finemath-crawl-control-token-proportional-e8bde7
8b-quality-eval-finemath-crawl-control-mix-048ab1
8b-quality-eval-tokenized-finemath-crawled-c6c5c7
8b-quality-eval-tokenized-finemath-control-dcbd48
670k670.5k671k671.5kStep0.320.330.340.350.360.370.38
8b-quality-eval-finemath-crawl-control-token-proportional-e8bde7
8b-quality-eval-finemath-crawl-control-mix-048ab1
8b-quality-eval-tokenized-finemath-crawled-c6c5c7
8b-quality-eval-tokenized-finemath-control-dcbd48
Run set
4


Created with ❤️ on Weights & Biases.

https://wandb.ai/marin-community/marin/reports/FineMath-Annealing-Runs--VmlldzoxMjA4NjI4Nw
Made with Weights & Biases. Sign up or log in to create reports like this one.