gstreamer alsasink starts with a delay

❯ gst-launch-1.0 audiotestsrc ! alsasink device=pipewire
Setting pipeline to PAUSED ...
Pipeline is PREROLLING ...

(gst-launch-1.0:652357): GLib-CRITICAL **: 15:32:34.193: Failed to set scheduler settings: Operation not permitted
Redistribute latency...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...

This takes exactly 2 seconds to start up and falls into:

I 15:32:12.009563 script/policy-node policy-node.lua:326:handleLinkable: <WpSiAudioAdapter:0x5646db6d10e0> handling item: PipeWire ALSA [gst-launch-1.0] (35)
I 15:32:12.009651 script/policy-node policy-node.lua:364:handleLinkable: <WpSiAudioAdapter:0x5646db6d10e0> ... waiting for target

while it shouldn't