And unref additional buffers we never use for rendering directly instead of going via the output queue.