Comparison of small language models performance on common downstream tasks

Comparison of effectiveness of LR-finder suggestions for NLP tasks on GLUE benchmark

Comparison of performance on RTE and STSB tasks when starting from MNLI checkpoint vs vanilla DistilRoBERTa