Skip to content

New deqp-runner test status results

Sergi Blanch Torné requested to merge sergi/ci-collate:new_deqp-runner_test_status into main

There was an ambiguous test result in deqp-runner, UnexpectedPass, that includes more than one result. The transition from Crash to Fail was an  improvement reported as UnexpectedPass. So, deqp-runner replaced it by a "UnexpectedImprovement(...)" test result with, in parentheses, the reported end status of the test. With this, we can handle the different improvements in the test results.

Only two cases of "UnexpectedImprovement(...)" are used: Pass and Fail. They are considered like if the test result was the value in the parentheses. The other possible "UnexpectedImprovement(...)" will be logged for manual management.

Depends on: !24 (closed)

This will solve #7

Edited by Sergi Blanch Torné

Merge request reports