audio/video aggregator: make use of new aggregator inactive pad API

See gstreamer/gstreamer!867
37 jobs for !1255 with aggregator-inactive-pads in 1 minute and 3 seconds (queued for 4 seconds)
latest merge request