expectation update patch for any pipeline
There is a subcommand in ci-uprev
called "collate" that is part of the split to have ci-collate
.
Both provide a way to see which tests failed and they are at one simple step to provide a expectation changes
patch.
When ci-uprev
, requiring too much in environment variables, can return:
export TARGET_PROJECT_PATH="mesa/mesa"; \
export export FORK_PROJECT_PATH="gfx-ci-bot/mesa"; \
export DEP_PROJECT_PATH="mesa/piglit"; \
python ci-uprev.py collate 819067
Only collate results from pipeline 819067 in gfx-ci-bot/mesa.
Looking for failed jobs in pipeline https://gitlab.freedesktop.org/gfx-ci-bot/mesa/-/pipelines/819067
Downloaded artifacts for 'zink-lvp' from 'results/failures.csv' at https://gitlab.freedesktop.org/gfx-ci-bot/mesa/-/jobs/37244543
Failures:
{"('zink-lvp', 'layered-backends')": {'glx@extension string sanity': ['UnexpectedPass']}}
ci-collate
provides almost the same information but knowing the jon ids:
ci-collate --namespace gfx-ci-bot \
--project mesa \
pipeline --status failed \
--artifact 'results/failures.csv' \
819067
{'zink-lvp': {37243489: 'glx@extension string sanity,UnexpectedPass\n',
37244543: 'glx@extension string sanity,UnexpectedPass\n'}}
Users would use ci-collate
, but right now it is ci-uprev
who knows about expectations, so it this tool the first that can include this information.
Edited by Sergi Blanch Torné