baseparse tests occasionally fail
The baseparse test suites are occasionally failing in our CI in gstreamer 1.22.11. Actual failed tests and their counts are:
3 tests/check/libs/baseparse.c:116:E:general:parser_convert_duration:0: (after this point) Test timeout expired
5 tests/check/libs/baseparse.c:116:E:general:parser_pull_frame_growth:0: (after this point) Test timeout expired
5 tests/check/libs/baseparse.c:116:E:general:parser_pull_short_read:0: (after this point) Test timeout expired
1 tests/check/libs/baseparse.c:116:E:general:parser_reverse_playback:0: (after this point) Test timeout expired
The runs are happening on a fairly loaded machine in CI, so we've set CK_TIMEOUT_MULTIPLIER=5
to increase the default 20s timeout to 100s. However, in the same run the other test suites ran in less than a second, so it's not as if this is entirely down to an incredibly loaded build host.
I see that gst-devtools has a list of known bad test cases which includes one of the tests in baseparse.c
(parser_pull_short_read
):
Are these other tests known to be flakey and should be added to that list, or is there another exclusion list of known bad tests that I can use? Should I file bugs for each of these other issues?