aggregator: Only wake up source pad task on chain if all pads are ready
Otherwise it would just wake up to check all pads and then wait again, which causes unnecessary context switches.
Otherwise it would just wake up to check all pads and then wait again, which causes unnecessary context switches.