Skip to content

turnip/ci: Bump the number of tests per group

Valentine Burley requested to merge Valentine/mesa:tu-tpg into main

Due to the slow startup time of deqp-vk, the previous default of 500 tests per group caused the jobs to run up to twice as slowly compared to using a higher number of tests per group.

I've attached a graph illustrating the relationship between tests_per_group and runtime. The graph is specifically for radv-raven-vkcts, but the trend is similar across all VKCTS runs.Screenshot_from_2024-12-03_16-59-35

While the long-term solution is to increase the default in deqp-runner for deqp-vk, this MR takes a more immediate approach by increasing the number of tests per group for all subsets of the deqp-runner suites for turnip, allowing for a reduction in the fractions. It’s worth noting that increasing tests_per_group only benefits VKCTS, GLCTS remains unaffected.

These changes enable us to either run more tests or decrease runtime, and in some cases, achieve both simultaneously. I've reduced the fractions for the merge jobs, while maintaining a runtime of around 10 minutes. The a660-vk job has been consistently taking too long, so I increased the fraction of the gmem run. However, if preferred, this can be adjusted by maintaining the fraction on the basic test set instead. We can now also complete a non-fractional run for the a618-vk-full job.

A notable highlight is the a630-vk-full job, which used to take ~130 minutes but now completes in about 60 minutes.

Merge request reports

Loading