Train Large, Then Compress

This video explains a new study on the best way to use a limited compute budget when training Natural Language Processing tasks. They show that Lar...