queue2: Stream keeps buffering even with stable network connection

(Coming from https://gitlab.gnome.org/World/Shortwave/-/issues/528)

I was able to reproduce the issue in a isolated toolbox fedora-toolbox-34 image.

⬢[haecker-felix@toolbox ~]$ gst-play-1.0 http://s2-webradio.antenne.de/antenne
Press 'k' to see a list of keyboard shortcuts.
Now playing http://s2-webradio.antenne.de/antenne
Prerolling...
Redistribute latency...
Prerolled... 100%  
Buffering... 100%  
Buffering... 100%  
Buffering... 100%  
Buffering... 100%  
Buffering... 100%  
Buffering... 100%  
Buffering... 100%  
Buffering... 100%  
Buffering... 100%  
Buffering... 100%  

Same stream, but GST_DEBUG=4 enabled: log.txt