Skip to content

WIP: Make the CI system run regression tests

Albert's special regression test suite finds a lot of bugs in (my) merge requests. For that, he has to run it by hand on the merge requests he cares about (at least that's how I understand it). I consider this a waste of his time and attention.

At the same time, pretty much everything needed to have automatic regressions tests is available:

This patch adds a CI pipeline that runs the poppler/regtest code on the test files in the above repository. The patch is in a very early state: I am neither a python nor a CI expert, the regtest code is slightly underdocumented, and it is difficult to test CI pipelines locally. I will need a fair bit of mentoring here. For a start I would be happy if the pipeline would simply render all the files in the test repo. That would only catch programs crashes, but that's at least a step in the right direction.

You may object that this new pipeline isn't worth much because there are so few files in the test repository. However, I keep seeing simple test files attached to issues that could be added easily to the test repo. That repo may not reach the completeness of Albert's test suite in a while, but (I hope that) the CI system running regression tests will motivate people to submit more test files.

Merge request reports