integration test sometimes fails to train
Nov 01 15:17:19 vivian executor[27009]: <local> - - [01/Nov/2023 15:17:19] "GET /api/v1/state HTTP/1.1" 200 -
Nov 01 15:17:24 vivian executor[27009]: <local> - - [01/Nov/2023 15:17:24] "GET /api/v1/state HTTP/1.1" 200 -
Nov 01 15:17:29 vivian executor[27009]: <local> - - [01/Nov/2023 15:17:29] "GET /api/v1/state HTTP/1.1" 200 -
Nov 01 15:17:34 vivian executor[27009]: <local> - - [01/Nov/2023 15:17:34] "GET /api/v1/state HTTP/1.1" 200 -
[812689.55]: ERROR: did not train.
Eg. https://gitlab.freedesktop.org/gfx-ci/ci-tron/-/jobs/51040990#L1487
Something happens that prevents the DUT from getting trained. It happens randomly, retrying usually works, but this should be investigated at some point.