nleghostpad: Deactivate pad before removing it from the element

Otherwise we might have a pad floating around that is still activated,
or even finalize a pad that is still activated.
22 jobs for deactivate-before-remove in 42 minutes and 58 seconds (queued for 1 second)
latest