util/set: stop leaking u32 key sets which pass a mem ctx
Fixes: 10a76824 ("util: add _mesa_set_create_u32_keys where keys are not pointers") Reviewed-by:Jason Ekstrand <jason@jlekstrand.net> Part-of: <mesa/mesa!9810> (cherry picked from commit 5ecad3cb)