Fix crash on XkbSetMap

Some devices may not have keyboard information.

Fixes #574

(cherry picked from commit 8469bfea)
3 jobs for server-1.20-branch in 5 minutes and 33 seconds