Skip to content

CI/Windows: Use deqp-runner for D3D12 piglit

Jesse Natalie requested to merge jenatali/mesa:d3d12-piglit-deqp-runner into main

This is something I've been wanting to do for a while, ever since we started using it for Dozen, but hadn't found the time until now. Some nice benefits of using deqp-runner:

  • Timeouts that actually work on Windows (though I think upgrading piglit would've fixed this too - that's also on my list but I wanted to do this first).
  • Better parallelism.
  • Better filtering using a skips file that can be annotated.
  • Better baselining, using a file that only logs fails/crashes and doesn't include total test counts, so keeping it up-to-date is easier.
  • Better output for unexpected passes/fails which matches what all of the other drivers are used to seeing, to avoid confusion from common changes that introduces fails/fixes.
  • Automatic flake re-running or manual flake annotations.

Interestingly it seems that deqp-runner only works for piglit when doing an in-tree build, but we can do that. Unfortunately, that means that this needs a container rebuild instead of just reworking the test scripts.

I suspect @daniels would want to at least ack this 😄

Merge request reports