appveyor: Drop building Xorg server

(Temporarily) drop building Xorg server (since this doesn't work after
a530b6e8) until we come up with a better solution. (See #692)
4 jobs for xwin-misc-fixes in 8 minutes and 32 seconds (queued for 1 second)