1. 08 Nov, 2018 1 commit
  2. 24 Jul, 2018 1 commit
    • Dylan Baker's avatar
      JSON: move info utilities out of root · 840e6e98
      Dylan Baker authored
      And into a generic sub element in the output. This makes information
      like glxinfo and clinfo not a hard requirement and will allow any sort
      of system information to be encoded.
      840e6e98
  3. 18 Oct, 2017 3 commits
  4. 21 Jul, 2017 2 commits
  5. 10 Feb, 2017 1 commit
  6. 30 Jan, 2017 1 commit
  7. 15 Nov, 2016 1 commit
    • Mark Janes's avatar
      framework/backends/json: support non-piglit junit files · 1e5dd0ea
      Mark Janes authored
      The junit loader is unnecessarily strict with the input that it
      accepts.  It expects input generated by piglit, but can be made to
      handle junit from other test suites like crucible.
      
      v2: Remove unnecessary initializers
          Conditionally parse command for piglit tests
      1e5dd0ea
  8. 04 Nov, 2016 1 commit
  9. 26 Oct, 2016 1 commit
  10. 24 Oct, 2016 3 commits
    • Dylan Baker's avatar
      framework/backends/json: Don't convert to TestrunResult while updating · 12012814
      Dylan Baker authored
      This changes the way updates are done in the backend, instead of
      converting to a TestrunResult immediately, all of the transformations
      are done to the JSON data in it's rawest form, ie, as dicts and lists,
      and then transform to a TestrunResult (and children) after that.
      
      This makes the loading code more robust and simpler, since it's
      decoupled from the representation, making the transformations easier to
      test and manage.
      
      Part of this change is fixing the .to_json and .from_dict methods, many
      of which "worked" because their shortcomings were papered over by using
      json.load with a custom decoder. This patch fixes them to actually work
      correctly. Despite my best attempts I couldn't decouple this work for
      this patch because of the close coupling of the JSON loading code and
      the class representations.
      
      There are a number of fixups to the tests in this patch, since a number
      of issues were being covered by the TestrunResult.to_json() method
      filling it missing values.
      Signed-off-by: default avatarDylan Baker <dylanx.c.baker@intel.com>
      12012814
    • Dylan Baker's avatar
      framework: Drop support for JSON formats < 7 · ef57fdd7
      Dylan Baker authored
      Most of these are pretty old at this point (over a year), and it seems
      unlikely anyone still has results in those formats. The biggest problem
      with them is that some of them (especially the early ones) are complex
      transformations with a lot of validation needed, and some of the middle
      ones rely on the class representations to do the transformations, which
      is what this series is trying to change, since the tight coupling makes
      changes to the schema difficult, or nearly impossible in other cases.
      
      If there is compelling reason I could push support back a bit more, but
      I really want to drop some of the versions we support since it
      simplifies the code considerably.
      
      This also drops support for the older "main" file, and only supports
      results.json and results.json.<compression>
      Signed-off-by: default avatarDylan Baker <dylanx.c.baker@intel.com>
      ef57fdd7
    • Dylan Baker's avatar
      framework/backends/json: replace str() with six.text_type() · 6c8ddc3b
      Dylan Baker authored
      since str() is incorrect in python2.x. This also fixes an indentation
      error.
      Signed-off-by: default avatarDylan Baker <dylanx.c.baker@intel.com>
      6c8ddc3b
  11. 07 Oct, 2016 1 commit
  12. 09 Sep, 2016 1 commit
    • Dylan Baker's avatar
      framework: Add support for jsonstreams · d0f6d81a
      Dylan Baker authored
      This commit adds support in the json backend for using an external
      library that I wrote called jsonstreams. It's a pretty self-explanatory
      library, and for piglit has several advantages. First, I've measured
      a consistent 10-15 second speed up for running the quick profile.
      Second, it *vastly* reduces the amount of memory piglit needs to write
      the final JSON document out.
      
      This is not implemented as a separate backend because the way that
      piglit's backend are implemented only one backend can handle a specific
      file extension. While this can be worked around by setting the
      extension to something like '.junit.xml' that doesn't really make sense
      here, since they are writing the same format, just using different
      means.
      Signed-off-by: default avatarDylan Baker <dylanx.c.baker@intel.com>
      d0f6d81a
  13. 31 Aug, 2016 3 commits
  14. 06 May, 2016 1 commit
    • Dylan Baker's avatar
      framework/backends/junit: Fix invalid JUnit output · 6406b9fc
      Dylan Baker authored
      In commit b0d05323 code was added to produce clearer error messages for
      tests who's status changed from crash to fail and vice versa. There is a
      not so subtle bug in that patch, it adds a "crash" element, but that
      element should be an "error" element.
      
      This patch fixes that bug.
      
      cc: Kenneth Graunke <kenneth@whitecape.org>
      Reviewed-by: Mark Janes's avatarMark Janes <mark.a.janes@intel.com>
      Signed-off-by: Dylan Baker <dylanx.c.baker@intel.com
      6406b9fc
  15. 03 May, 2016 1 commit
  16. 17 Apr, 2016 1 commit
  17. 16 Mar, 2016 1 commit
  18. 11 Feb, 2016 1 commit
    • Dylan Baker's avatar
      python: function with six version 1.5.2 · c4a5618a
      Dylan Baker authored
      CMake actually marks that we require six 1.4.0, however, I can't find
      any packages anywhere for 1.4.0, and the lowest version I've seen
      requested is 1.5.2.
      
      This fixes requirements for working with six 1.5.2, and sets tox to use
      1.5.2 (and a suitable version of mock). Primarily there are a few things
      we're using that are not available: six.moves.getcwd, six.viewvalues,
      six.python_2_unicode_compatible.
      Signed-off-by: default avatarDylan Baker <dylanx.c.baker@intel.com>
      Tested-by: Brian Paul's avatarBrian Paul <brianp@vmware.com>
      c4a5618a
  19. 08 Feb, 2016 9 commits
  20. 21 Jan, 2016 1 commit
  21. 07 Jan, 2016 1 commit
    • Dylan Baker's avatar
      framework: record pid of test process in results · d1bdd2bc
      Dylan Baker authored
      This information can be used on linux in conjunction with scripts to
      associate information in dmesg with information in piglit results.
      
      Adds the pid information to both the json and junit backends, and adds
      tests for both.
      
      This information is not published into any of the summary modes on
      purpose. It's usefulness is limited to the system on which the test was
      ran, and only while a log of dmesg exists.
      
      v2: - remove extra newline in junit stderr (Mark)
      Signed-off-by: default avatarDylan Baker <dylanx.c.baker@intel.com>
      Reviewed-by: Mark Janes's avatarMark Janes <mark.a.janes@intel.com>
      d1bdd2bc
  22. 11 Nov, 2015 1 commit
  23. 19 Oct, 2015 2 commits
  24. 08 Oct, 2015 1 commit