panfrost,agx: Remove load_kernel_input path
For after !18581 (merged) lands and load_kernel_input becomes clover only. (if we care about clover on these drivers, we should make clover do the equivalent lowering, having this in the backend doesn't make sense IMHO)