We have to keep sampler uniforms around for later YUV lowering, and we
only need to remove uniforms that take up storage space.  Code comes from
radeonsi.

Closes: #4644.
Fixes: de17b4aa ("freedreno: Remove uniform variables after finalizing NIR.")
Part-of: <mesa/mesa!10246>