Backport of "splitmuxsrc: don't consider unlinked pads when deactivating part" into 1.20
Backport of !3099 (merged) "splitmuxsrc: don't consider unlinked pads when deactivating part".
Commits:
- f8d8d67b splitmuxsrc: don't consider unlinked pads when deactivating part