panfrost: Fine-grained init tracking

This optimization was previously part of !8125 (merged) and has been moved to a separate MR as per @alyssa recommendation.