Does the Lottery Ticket Hypothesis hold for BERT? Experiments with structured and magnitude pruning reveal some good and some bad news.
When BERT Plays The Lottery, All Tickets Are Winning
When BERT Plays The Lottery, All Tickets Are…
When BERT Plays The Lottery, All Tickets Are Winning
Does the Lottery Ticket Hypothesis hold for BERT? Experiments with structured and magnitude pruning reveal some good and some bad news.