Latest release of timm (pytorch image models) has a new convnext variant that it's even better for fine-tuning.