ci: Make Bookworm CI use GCC 11

Fixes the longstanding "allow failure" in arm64 caused by bad codegen of accsadubl.

See #41 (closed), #45 (closed)