Technically, the xorg/ prefix should not be specified.  It generally works,
because xorg/ is usually hung off /usr/include.  This enables
compliation that correctly respects a pkg-config --cflags xorg-server.