Here we will train transformers for classification from scratch , and how self attention plays crucial role in working of transformers for sequential tasks.

Summarization is basically of two types i.e. Abstractive and Extractive Summarization. Here we will cover both types and will see how we can finetune pretrained T5 transformers on particular dataset.