Similar to 5e8386c6 ("panfrost: Compact the bo_access readers array"), rebuild the array to remove the holes before appending to it.
Fixes: a6af15aa ("panfrost: Simplify the dependency tracking logic")