Otherwise we will just deadlock the thread if e.g. scheduling a video frame fails for whatever reason.