Pruning can be a clever way to reduce a model's resource greediness. But what gets forgotten when you do?