mesa-ci-status: add ERRORS PER TESTS table
Add table that counts the number of occurrences of individual tests.
Example:
SUMMARY:
PERIOD: 2022-05-11 - 2022-05-17
FAILED MERGE PIPELINES: 44/159 - 27.67%
FAILED JOBS: 282/14936 - 1.89%
PIPELINES TAKING MORE THAN 1H: 22/159 - 13.84%
PIPELINES TAKING MORE THAN 30MIN: 82/159 - 51.57%
STAGES TAKING MORE THAN 30MIN: 62/1178 - 5.26%
DETAILED:
TOP 10 FAILING JOBS:
| job name | number of failures |
|---|---|
| lima-mali450-piglit-gpu:arm64 1/2 | 7 |
| debian-testing-msan | 6 |
| radeonsi-stoney-gl:amd64 5/5 | 6 |
| radeonsi-stoney-gl:amd64 4/5 | 6 |
| radeonsi-stoney-gl:amd64 3/5 | 6 |
| radeonsi-stoney-gl:amd64 2/5 | 6 |
| radeonsi-stoney-gl:amd64 1/5 | 6 |
| debian-clang | 5 |
| radeonsi-stoney-va:amd64 | 5 |
| debian-release | 5 |
ERRORS PER CATEGORY (TOP 10):
| error category | number of occurrences |
|---|---|
| Job finished | 215 |
| Job didn't finished - Docker | 26 |
| Job didn't finished - Other | 24 |
| Job didn't finished - LAVA machine got hung | 9 |
| Job didn't finished - Job's log exceeded limit | 8 |
FAILED JOBS (limited to 100 entries):
ERRORS PER TESTS (TOP 10):
| job | test | number of errors |
|---|---|---|
| radeonsi-stoney-va:amd64 | CreateSurfaces/VAAPICreateSurfaces.CreateSurfacesWithConfigAttribs/1120 | 3 |
| radeonsi-stoney-va:amd64 | CreateSurfaces/VAAPICreateSurfaces.CreateSurfacesWithConfigAttribs/1630 | 3 |
| radeonsi-stoney-va:amd64 | CreateSurfaces/VAAPICreateSurfaces.CreateSurfacesWithConfigAttribs/1800 | 3 |
| radeonsi-stoney-va:amd64 | CreateSurfaces/VAAPICreateSurfaces.CreateSurfacesWithConfigAttribs/2990 | 3 |
| radeonsi-stoney-va:amd64 | CreateSurfaces/VAAPICreateSurfaces.CreateSurfacesWithConfigAttribs/3160 | 3 |
| virpipe-on-gl | KHR-GL43.blend_equation_advanced.blend_all.GL_COLORBURN_KHR_all_qualifier | 2 |
| virpipe-on-gl | KHR-GL43.blend_equation_advanced.blend_all.GL_COLORDODGE_KHR_all_qualifier | 2 |
| virpipe-on-gl | KHR-GL43.blend_equation_advanced.blend_all.GL_DARKEN_KHR_all_qualifier | 2 |
| virpipe-on-gl | KHR-GL43.blend_equation_advanced.blend_all.GL_DIFFERENCE_KHR_all_qualifier | 2 |
| virpipe-on-gl | KHR-GL43.blend_equation_advanced.blend_all.GL_EXCLUSION_KHR_all_qualifier | 2 |
PIPELINES TAKING MORE THAN 30MIN (TOP 10):
| pipeline | queued duration | exec duration | total duration |
|---|---|---|---|
| zink: link to vulkan-loader at run-time | 0:00 | 1:49 | 1:49 |
| st: Improve mesa_error about GL_OUT_OF... | 0:00 | 1:47 | 1:47 |
| Reviewed patches from !14774 !16196 !161... | 0:00 | 1:39 | 1:39 |
| ci: uprev piglit 2022-05-10 | 0:00 | 1:25 | 1:26 |
| glxconfig: set max values for pbuffer wi... | 0:00 | 1:25 | 1:25 |
| glsl: Fix ir_quadop_vector validation | 0:03 | 1:22 | 1:25 |
| D3D12: Implement H264 video encode and d... | 0:00 | 1:12 | 1:13 |
| ci/lava: Make job submitter parse the jo... | 0:00 | 1:10 | 1:10 |
| zink: link to vulkan-loader at run-time | 0:00 | 1:09 | 1:09 |
| radv/ci: reboot the DUTs when hitting a ... | 0:00 | 1:09 | 1:09 |
STAGES TAKING MORE THAN 30min (TOP 10):
| stage | longest job | pipeline | queued duration | exec duration | total duration |
|---|---|---|---|---|---|
| freedreno | a630_vk | zink: Implemented EXT_external_objects_w... | 2 days, 19:45 | 0:00 | 2 days, 19:45 |
| broadcom | v3d-rpi4-piglit:armhf 3/4 | zink: Implemented EXT_external_objects_w... | 2 days, 19:44 | 0:00 | 2 days, 19:44 |
| intel | iris-glk-traces-performance | Reviewed patches from !14774 !16196 !161... | 0:03 | 1:00 | 1:03 |
| layered-backends | virgl-on-gles 3/3 | radeonsi,util,st: clear color buffers us... | 0:00 | 1:00 | 1:00 |
| layered-backends | virgl-on-gles 2/3 | radeonsi,util,st: clear color buffers us... | 0:00 | 1:00 | 1:00 |
| amd | radeonsi-stoney-gl:amd64 2/5 | ac,radeonsi: first fixes for gfx11 | 0:00 | 1:00 | 1:00 |
| amd | radeonsi-stoney-gl:amd64 4/5 | ac,radeonsi: first fixes for gfx11 | 0:00 | 1:00 | 1:00 |
| amd | radeonsi-stoney-gl:amd64 5/5 | ac,radeonsi: first fixes for gfx11 | 0:00 | 1:00 | 1:00 |
| intel | iris-glk-traces-performance | st: Improve mesa_error about GL_OUT_OF... | 0:00 | 1:00 | 1:00 |
| amd | radeonsi-stoney-va:amd64 | glsl: Fix ir_quadop_vector validation | 0:35 | 0:15 | 0:51 |
INFORMATION:
details
- All numbers only considers mesa/mesa.
- Pipelines with updated_at < 2022-05-11 and jobs with finished_at < 2022-05-11 were ignored.
- FAILED MERGE PIPELINES:
- Calculated from finished pipelines triggered by Marge in a merge requests.
- Counted when a pipeline contains a failed job, even if it got retried and the pipeline passed (status success).
- FAILED JOBS: Consider jobs from the same pipelines from FAILED MERGE PIPELINES.
- PIPELINES TAKING MORE THAN 30MIN also counts PIPELINES TAKING MORE THAN 1H.
- STAGES TAKING MORE THAN 30MIN: same stages from different pipelines are counted as different stages.
Edited by Helen Mae Koike Fornazier