Fix critical jitterbuffer stall
We have been experiencing more jitterbuffer-stalls lately.
This patch-set fixes the problem and tries to clean up the code a bit around it.
Fixes #609 (closed), #610 (closed) and #611 (closed)
Edited by Nicolas Dufresne