record1414x-paint-alpha-clip-mask tests broken
I tried regenerating the reference images for the record1414x-paint-alpha-clip-mask tests. I worked in the docker image used for CI, registry.freedesktop.org/cairo/cairo/fedora/34:2021-05-04.2.
On 5ae89cf3, although the tests passed when run normally (i.e. using CAIRO_TESTS="record1414x-paint-alpha-clip-mask" xfvb-run make test
), when I set #define GENERATE_REF 1
in record1414x.c to generate the reference images, all of the tests failed. A sample of the breakage looks like this:
(generated by convert ... -compose difference -composite -separate -evaluate-sequence add -evaluate Multiply 50
)
On 03df52a8, 8488ae02, 113ba5f3 where the reference images were created, when I ran the tests, neither sets of images matched the reference images, nor did they agree.
These issues are currently stopping #480 from being fixed. It seems like there are three options for how to proceed:
- Add these tests to the ignore list.
- Change the reference images just to allow the fix for #480 to pass.
- Figure out why the testing environment cannot produce the right reference images on 03df52a8.
The second is preferable to the first, and the last is ideal but hard. The second would also be preferable to doing nothing, because if nothing else, the difference between reference and non-reference is at least reduced: