backend/drm: fix primary FB check

When turning off a CRTC, we don't need a buffer.

It doesn't matter whether this is a modeset or not: we always need a buffer even for regular page-flips as long as a connector is active.

Fixes: 374daeb2 ("backend/drm: Ensure a primary fb is available when configuring an output")