panvk: only validate the push-sets that we update
We are conditionally updating the push-sets, so we need to also conditionally clear the dirty-flags here instead of clearing them wholesale. Otherwise, we end up not updating the descriptors that are used in subsequent draws, but not in the first one.
Fixes: 79e51463 ("panvk: Sanitize the driver-internal dirty state tracking")