This enables a kill of an Xorg process to propagate further.
Without this, the read masks would be set, and we could end up
blocking in an accept() call and not exiting from the signal.