Driver Performance Alerts
Motivation
It is hard to track driver performances in Mesa CI since we have been monitoring dozens of them in freedesktop Grafana instance.
This issue will create alerts daily to keep developers aware of performance changes in drivers being monitored.
Methodology
A daily script runs
ministat binary against
two groups of data from a data range from 30 days before to the
execution date, looking for 60 commit measurements for the
past group, called Before
, and [15, 20]
for the current group, labeled After
. The latter is calculated dynamically
depending on the variance using the coefficient of variation formula from
Lehr's rule of
thumb.
For the curious, the underlying statistical method that ministat
uses is the
hypothesis test. This
article
explains it briefly.
Notes
- Confidence Level: 95%
- Absolute relative changes lesser than 1% are ignored.
- Average values are omitted.
- Jobs and traces without relevant changes are ommitted, if all data fall in this category the daily report will be skipped, to avoid bothering users.
See also
List of currently monitored drivers and traces
Traces
- 0ad/0ad-v2.trace
- behdad-glyphy/glyphy-v2.trace
- blender/blender-demo-ellie_pose.trace
- freedoom/freedoom-phase2-gl-high.trace
- glxgears/glxgears-2-v2.trace
- gputest/furmark-v2.trace
- gputest/gimark-v2.trace
- gputest/pixmark-julia-fp32-v2.trace
- gputest/pixmark-julia-fp64-v2.trace
- gputest/pixmark-piano-v2.trace
- gputest/pixmark-volplosion-v2.trace
- gputest/plot3d-v2.trace
- gputest/tessmark-v2.trace
- gputest/triangle-v2.trace
- humus/AmbientAperture-v2.trace
- humus/CelShading-v2.trace
- humus/DynamicBranching3-v2.trace
- humus/HDR-v2.trace
- humus/Portals-v2.trace
- humus/RaytracedShadows-v2.trace
- humus/VolumetricFogging2-v2.trace
- neverball/neverball-v2.trace
- paraview/pv-manyspheres-v2.trace
- paraview/pv-waveletcontour-v2.trace
- paraview/pv-waveletvolume-v2.trace
- pathfinder/canvas_moire-v2.trace
- pathfinder/canvas_text_v2-v2.trace
- pathfinder/demo-v2.trace
- ror/ror-default.trace
- unvanquished/unvanquished-lowest.trace
- unvanquished/unvanquished-ultra.trace
- valve/counterstrike-source-v2.trace
- valve/counterstrike-v2.trace
- valve/half-life-2-v2.trace
- valve/portal-2-v2.trace
- warzone2100/warzone2100-default.trace
- xonotic/xonotic-keybench-high-v2.trace
Driver Jobs
- a630-traces-performance
- iris-amly-traces-performance
- iris-apl-traces-performance
- iris-glk-traces-performance
- iris-kbl-traces-performance
- iris-whl-traces-performance
- virgl-iris-traces-performance