If we set a port configuration upon enslaving, delete it when the port is released.
https://bugzilla.redhat.com/show_bug.cgi?id=1753975