check.gst-plugins-good.elements_rtpjitterbuffer.test_fill_queue: Sometimes fails with "test_fill_queue:0: '1000 + i' (1324) is not equal to 'get_rtp_seq_num (buf)' (33843)"

https://gitlab.freedesktop.org/slomo/gst-plugins-bad/-/jobs/421669

GST_PLUGIN_LOADING_WHITELIST='gstreamer:gst-plugins-base:gst-plugins-good@/builds/slomo/gst-plugins-bad/gst-build/build' CK_DEFAULT_TIMEOUT='20' GST_PLUGIN_PATH_1_0='/builds/slomo/gst-plugins-bad/gst-build/build' GST_CHECKS='test_fill_queue' GST_REGISTRY='/builds/slomo/gst-plugins-bad/gst-build/build/subprojects/gst-plugins-good/tests/check/elements_rtpjitterbuffer.registry' GST_PLUGIN_SYSTEM_PATH_1_0='' GST_STATE_IGNORE_ELEMENTS='aasink autoaudiosrc autoaudiosink autovideosrc
 autovideosink cacasink cairotextoverlay gtkglsink gtksink jackaudiosrc
 jackaudiosink osssrc osssink osxaudiosink osxaudiosrc osxvideosrc osxvideosink
 pulsesink pulsesrc pulsemixer v4l2src' /builds/slomo/gst-plugins-bad/gst-build/build/subprojects/gst-plugins-good/tests/check/elements_rtpjitterbuffer

elements_rtpjitterbuffer output

Running suite(s): rtpjitterbuffer
0%: Checks: 1, Failures: 1, Errors: 0
../subprojects/gst-plugins-good/tests/check/elements/rtpjitterbuffer.c:2681:F:general:test_fill_queue:0: '1000 + i' (1324) is not equal to 'get_rtp_seq_num (buf)' (33843)
Check suite rtpjitterbuffer ran in 0.188s (tests failed: 1)

CC @ndufresne