Skip to content
  • Marek Olšák's avatar
    si-report.py: add completely new shader statistics reporting · c584a2fc
    Marek Olšák authored
    
    
    We can remove the old reporting if people are OK with that.
    The old reporting has a bug that it reports 0->N changes as 0 % in several
    places. (should be inf %)
    
    The new reporting shows:
    - VGPR spilling shaders and apps (from the second file only)
    - the same for SGPRs
    - worst regressions (from the comparison of both files)
    - percentage deltas at the end
    .. and colors!!!
    
    Example:
    
     WORST VGPR SPILLS (not deltas)                                        VGPRs SpillVGPR ScratchVGPR
     shaders/private/f1-2015/18.shader_test [0]                               32         0       516
     shaders/private/bioshock-infinite/256.shader_test [0]                    64       176       180
     shaders/private/ue4_lightroom_interior_day/42.shader_test [0]            28         0        76
     shaders/private/dirt-showdown/676.shader_test [0]                        68        49        72
     shaders/private/f1-2015/1102.shader_test [0]                             52         0        72
     shaders/private/bioshock-infinite/814.shader_test [0]                    64        57        60
     shaders/private/ue4_lightroom_interior_day/33.shader_test [0]            24         0        52
     shaders/private/ue4_lightroom_interior_day/37.shader_test [0]            24         0        52
     shaders/private/bioshock-infinite/698.shader_test [0]                    16         0        36
     shaders/private/dirt-showdown/406.shader_test [0]                        64        33        36
    
     VGPR SPILLING APPS   Shaders SpillVGPR ScratchVGPR
     alien_isolation         2938        12        16
     bioshock-infinite       1769       233       720
     dirt-showdown            541        82       108
     f1-2015                  774         0       624
     tesseract                430         2         4
     ue4_lightroom_inter..     74         0       180
    
     WORST SGPR SPILLS (not deltas)                                        SGPRs SpillSGPR
     shaders/private/talos_principle/1942.shader_test [1]                     80       168
     shaders/private/ue4_effects_cave/289.shader_test [0]                     80       168
     shaders/private/talos_principle/2052.shader_test [1]                     80       161
     shaders/private/serious_sam_3_bfe/1081.shader_test [1]                   80       148
     shaders/private/borderlands2/5330.shader_test [0]                        80       137
     shaders/private/talos_principle/2040.shader_test [1]                     80       133
     shaders/private/talos_principle/2041.shader_test [1]                     80       133
     shaders/private/talos_principle/2036.shader_test [1]                     80       133
     shaders/private/talos_principle/2035.shader_test [1]                     80       133
     shaders/private/borderlands2/5548.shader_test [0]                        80       131
    
     SGPR SPILLING APPS   Shaders SpillSGPR AvgPerSh
     alien_isolation         2938     23198      7.9
     batman_arkham_origins    589        30      0.1
     bioshock-infinite       1769        84      0.0
     borderlands2            3968      6449      1.6
     brutal-legend            338       647      1.9
     civilization_beyond..    116       213      1.8
     counter_strike_glob..   1142      4338      3.8
     dirt-showdown            541      1071      2.0
     dolphin                   22        62      2.8
     dota2                   1747       338      0.2
     europa_universalis_4      76        44      0.6
     f1-2015                  774      6245      8.1
     left_4_dead_2           1762     13778      7.8
     metro_2033_redux        2670       547      0.2
     nexuiz                    80       111      1.4
     portal                   474      2211      4.7
     serious_sam_3_bfe        392      6626     16.9
     talos_principle          324      4539     14.0
     team_fortress_2          808      4823      6.0
     thea                     172        41      0.2
     ue4_effects_cave         299       494      1.7
     ue4_elemental            586       355      0.6
     ue4_lightroom_inter..     74        29      0.4
     ue4_realistic_rende..     92        60      0.7
     unigine_heaven           322       174      0.5
     unigine_sanctuary        264       400      1.5
     unigine_tropics          210       328      1.6
     unigine_valley           278       427      1.5
     unity                     72        45      0.6
     warsow                   176        13      0.1
     witcher2                1040         2      0.0
    
     WORST REGRESSIONS - VGPRS                                            Before     After     Delta Percentage
     shaders/private/metro_2033_redux/1082.shader_test [0]                   136       180        44   32.35 %
     shaders/private/witcher2/20.shader_test [0]                              48        64        16   33.33 %
     shaders/private/witcher2/1097.shader_test [0]                            60        76        16   26.67 %
     shaders/private/unigine_valley/298.shader_test [0]                       44        56        12   27.27 %
     shaders/private/witcher2/158.shader_test [0]                             52        64        12   23.08 %
     shaders/private/witcher2/138.shader_test [0]                             60        72        12   20.00 %
     shaders/private/witcher2/136.shader_test [0]                             60        72        12   20.00 %
     shaders/private/witcher2/187.shader_test [0]                             56        68        12   21.43 %
     shaders/private/left_4_dead_2/1567.shader_test [0]                       32        40         8   25.00 %
     shaders/private/team_fortress_2/4662.shader_test [0]                     20        28         8   40.00 %
    
     WORST REGRESSIONS - Spilled SGPRs                                    Before     After     Delta Percentage
     shaders/private/serious_sam_3_bfe/883.shader_test [0]                    14        49        35  250.00 %
     shaders/private/talos_principle/1942.shader_test [0]                     14        49        35  250.00 %
     shaders/private/serious_sam_3_bfe/1081.shader_test [0]                   14        49        35  250.00 %
     shaders/private/talos_principle/1941.shader_test [0]                     14        49        35  250.00 %
     shaders/private/talos_principle/2052.shader_test [0]                      9        42        33  366.67 %
     shaders/private/serious_sam_3_bfe/869.shader_test [0]                    35        67        32   91.43 %
     shaders/private/talos_principle/1986.shader_test [0]                     45        76        31   68.89 %
     shaders/private/left_4_dead_2/3764.shader_test [0]                       15        46        31  206.67 %
     shaders/private/talos_principle/2008.shader_test [0]                     45        76        31   68.89 %
     shaders/private/talos_principle/2035.shader_test [0]                     45        76        31   68.89 %
    
     WORST REGRESSIONS - Spilled VGPRs                                    Before     After     Delta Percentage
     shaders/tesseract/506.shader_test [0]                                     0         2         2     inf %
    
     WORST REGRESSIONS - Scratch VGPRs                                    Before     After     Delta Percentage
     shaders/tesseract/506.shader_test [0]                                     0         4         4     inf %
    
     WORST REGRESSIONS - Code Size                                        Before     After     Delta Percentage
     shaders/private/talos_principle/1942.shader_test [0]                   3116      3808       692   22.21 %
     shaders/private/talos_principle/1941.shader_test [0]                   3116      3808       692   22.21 %
     shaders/private/serious_sam_3_bfe/883.shader_test [0]                  3108      3792       684   22.01 %
     shaders/private/serious_sam_3_bfe/1081.shader_test [0]                 3108      3792       684   22.01 %
     shaders/private/serious_sam_3_bfe/869.shader_test [0]                  4124      4744       620   15.03 %
     shaders/private/talos_principle/2052.shader_test [0]                   2904      3512       608   20.94 %
     shaders/private/left_4_dead_2/3764.shader_test [0]                     3344      3928       584   17.46 %
     shaders/private/left_4_dead_2/1260.shader_test [0]                     3344      3928       584   17.46 %
     shaders/private/talos_principle/2061.shader_test [0]                   5312      5892       580   10.92 %
     shaders/private/talos_principle/1994.shader_test [0]                   5312      5892       580   10.92 %
    
     PERCENTAGE DELTAS    Shaders     SGPRs     VGPRs SpillSGPR SpillVGPR   Scratch  CodeSize  MaxWaves     Waits
     (unknown)                  4     .         .         .         .         .       -0.02 %     .         .
     0ad                        6     .         .         .         .         .         .         .         .
     alien_isolation         2938     .       -5.35 %   -0.77 %     .         .        0.21 %    3.79 %     .
     anholt                    10     .         .         .         .         .         .         .         .
     batman_arkham_origins    589     .       -4.77 %  -96.56 %     .         .       -1.59 %    4.48 %     .
     bioshock-infinite       1769     .       -1.41 %  -86.60 %     .         .       -0.59 %    0.94 %     .
     borderlands2            3968     .       -2.20 %  -36.23 %     .         .       -1.07 %    1.15 %     .
     brutal-legend            338     .       -0.90 %   -6.50 %     .         .       -0.10 %    0.43 %     .
     civilization_beyond..    116     .       -0.97 %    0.47 %     .         .        0.04 %    0.46 %     .
     counter_strike_glob..   1142     .       -2.00 %   -7.58 %     .         .       -0.43 %    0.06 %     .
     dirt-showdown            541     .       -1.37 %  -22.95 %     .       -3.57 %   -0.79 %    1.03 %     .
     dolphin                   22     .         .         .         .         .        0.23 %     .         .
     dota2                   1747     .       -0.07 %     .         .         .        0.03 %    0.04 %     .
     europa_universalis_4      76     .       -0.46 %     .         .         .        0.09 %     .         .
     f1-2015                  774     .       -2.11 %   -1.51 %     .         .       -0.02 %    1.05 %     .
     furmark-0.7.0              4     .         .         .         .         .        0.16 %     .         .
     gimark-0.7.0              10     .         .         .         .         .        0.18 %     .         .
     glamor                    16     .         .         .         .         .       -0.91 %     .         .
     humus-celshading           4     .         .         .         .         .        0.42 %     .         .
     humus-domino               6     .         .         .         .         .         .         .         .
     humus-dynamicbranching    24     .       -0.70 %     .         .         .        0.42 %    0.45 %     .
     humus-hdr                 10     .         .         .         .         .         .         .         .
     humus-portals              2     .         .         .         .         .         .         .         .
     humus-volumetricfog..      6     .         .         .         .         .         .         .         .
     left_4_dead_2           1762     .       -0.62 %   10.13 %     .         .        0.72 %   -0.14 %     .
     metro_2033_redux        2670     .       -4.73 %  -12.20 %     .         .        0.20 %    1.52 %     .
     nexuiz                    80     .         .         .         .         .         .         .         .
     pixmark-julia-fp32         2     .         .         .         .         .         .         .         .
     pixmark-julia-fp64         2     .         .         .         .         .         .         .         .
     pixmark-piano-0.7.0        2     .         .         .         .         .       -0.85 %     .         .
     pixmark-volplosion-..      2     .         .         .         .         .         .         .         .
     plot3d-0.7.0               8     .         .         .         .         .         .         .         .
     portal                   474     .       -2.05 %  206.23 %     .         .        1.69 %    0.58 %     .
     sauerbraten                7     .         .         .         .         .        0.62 %     .         .
     serious_sam_3_bfe        392     .       -8.64 %    0.93 %     .         .       -1.79 %    4.05 %     .
     supertuxkart               4     .         .         .         .         .         .         .         .
     talos_principle          324     .       -7.67 %  -10.07 %     .         .       -1.39 %    2.92 %     .
     team_fortress_2          808     .       -2.62 %  276.21 %     .         .        2.26 %    1.24 %     .
     tesseract                430     .       -1.31 % -100.00 %     inf %     inf %   -0.12 %    0.75 %     .
     tessmark-0.7.0             6     .         .         .         .         .        0.09 %     .         .
     thea                     172     .       -1.98 %     .         .         .        0.34 %    0.91 %     .
     ue4_effects_cave         299     .       -1.87 %   -8.52 %     .         .       -0.18 %    1.87 %     .
     ue4_elemental            586     .       -4.67 %  -42.56 %     .         .       -1.17 %    4.57 %     .
     ue4_lightroom_inter..     74     .       -1.57 %  -12.12 %     .         .        0.12 %    1.00 %     .
     ue4_realistic_rende..     92     .       -0.27 %     .         .         .        0.11 %     .         .
     unigine_heaven           322     .       -0.87 %  -36.73 %     .         .       -0.46 %    0.69 %     .
     unigine_sanctuary        264     .       -1.57 %   -7.41 %     .         .        0.01 %    0.96 %     .
     unigine_tropics          210     .       -1.22 %  -10.87 %     .         .       -0.18 %    0.88 %     .
     unigine_valley           278     .       -2.11 %  -27.87 %     .         .       -0.46 %    1.39 %     .
     unity                     72     .       -1.74 %  -15.09 %     .         .       -0.54 %    0.93 %     .
     warsow                   176     .       -0.10 %     .         .         .         .        0.06 %     .
     warzone2100                4     .       -4.35 %     .         .         .        0.67 %    2.63 %     .
     witcher2                1040     .       -5.93 %  -93.55 %     .         .       -0.59 %    2.54 %     .
     xcom_enemy_within       1236     .       -4.81 % -100.00 %     .         .       -0.03 %    3.22 %     .
     yofrankie                 82     .       -0.41 %     .         .         .        0.80 %    0.14 %     .
     ------------------------------------------------------------------------------------------------------------
     All affected            7287     .       -8.94 %   -5.18 %    0.61 %     .       -0.36 %    6.21 %     .
     ------------------------------------------------------------------------------------------------------------
     Total                  26002     .       -3.09 %   -1.82 %    0.61 %     .       -0.16 %    1.55 %     .
    
    Acked-by: default avatarNicolai Hähnle <nicolai.haehnle@amd.com>
    c584a2fc