Pipewire loopback sink stream cuts for ~1s when pulseaudio client connects/disconnects

I'm not sure if this is a wireplumber issue, but I noticed it right after I switched away from pipewire-media-session.

Basically, I have a few libpipewire-module-loopback sinks set up to separate audio streams and whenever I open/close pavucontrol, whatever is playing on them cuts for like a second or so.

Here's what I have in my context.modules @ pipewire.conf:

    { name = libpipewire-module-loopback
        args = {
            audio.position = [ FL FR ]
            capture.props = {
                media.class = Audio/Sink
                node.name = null-sink-1
                node.description = null-sink-1
            }
            playback.props = {
                media.name = null-sink-loopback-1
            }
        }
    }
    { name = libpipewire-module-loopback
        args = {
            audio.position = [ FL FR ]
            capture.props = {
                media.class = Audio/Sink
                node.name = null-sink-2
                node.description = null-sink-2
            }
            playback.props = {
                media.name = null-sink-loopback-2
            }
        }
    }
    { name = libpipewire-module-loopback
        args = {
            audio.position = [ FL FR ]
            capture.props = {
                media.class = Audio/Sink
                node.name = null-sink-3
                node.description = null-sink-3
            }
            playback.props = {
                media.name = null-sink-loopback-3
            }
        }
    }
    { name = libpipewire-module-loopback
        args = {
            audio.position = [ FL FR ]
            capture.props = {
                media.class = Audio/Sink
                node.name = sunshine-sink
                node.description = sunshine-sink
            }
            playback.props = {
                media.name = sunshine-sink-loopback
            }
        }
    }