Movement Pruning: Adaptive Sparsity by Fine-Tuning

Magnitude pruning has become common. But it is not the most efficient way when it comes to transfer learning. Movement pruning offers a better way...