Gstreamer Application Pauses or Starts Skipping While Seeking

Version, Distribution, Desktop Environment:

0.3.20+nightly-210130.fc33, Fedora 33, Gnome 3.38.

Description of Problem:

Problem started with 0.3.20+nightly-210129.fc33, I will seek the track in Rhythmbox and it would pause the track until you seek again then the track would continue. With the current version 0.3.20+nightly-210130.fc33 when you seek the track the time will continue counting and silence will play until you seek again.

Or you will seek and the track will start skipping every couple of seconds until you seek again.

How Reproducible:

If you start seeking through a track eventually you should run into either of these two issues.

Steps to Reproduce:

Open a gstreamer program
Start seeking through a track
It will either pause and play silence or start skipping

Actual Results:

GST_DEBUG=4 rhythmbox shows:

0:06:01.954367606 28934 0x55cb7c6a9330 WARN                   pulse pulsesink.c:702:gst_pulsering_stream_underflow_cb:<autoaudiosink0-actual-sink-pulse> Got underflow
0:06:05.112067363 28934 0x55cb7c6a9330 WARN                   pulse pulsesink.c:702:gst_pulsering_stream_underflow_cb:<autoaudiosink0-actual-sink-pulse> Got underflow

This is the warning that pops up at the exact second the music stops playing so I don't know if it's responsible or just the byproduct.

Expected Results:

No pausing, no skipping when seeking through a track.

Additional Info Eg. pw-dump > file (As Attachment Please):

Output of GST_DEBUG=4 rhythmbox where I loaded the program, played a track, started seeking through the track, got it to pause with the timer continuing to count and let that go for 20 seconds. Started seeking through the track again and got it to start skipping, seek again until it went back to normal and exited the program. rythmbox.log