Revert !236 which may cause key event being filtered unconditionally when using input method

The intention might be ok, but not all people are using libX11 xim client in a expected way.

At least Steam/Gtk2 may send synthetic XEvent instead of event coming from wire.

Fix #205