1. 15 Dec, 2018 1 commit
    • Kenneth Graunke's avatar
      Fix 'piglit resume' · b227bb35
      Kenneth Graunke authored
      metadata.json contains 'force_glsl' but not 'glsl'.  I guess it must
      have gotten renamed at some point.  Fixes the following traceback when
      attempting to call 'piglit resume':
      
      Traceback (most recent call last):
        File "/home/kayden/Projects/piglit/piglit", line 178, in <module>
          main()
        File "/home/kayden/Projects/piglit/piglit", line 174, in main
          sys.exit(runner(args))
        File "/home/kayden/Projects/piglit/framework/exceptions.py", line 52, in _inner
          func(*args, **kwargs)
        File "/home/kayden/Projects/piglit/framework/programs/run.py", line 439, in resume
          options.OPTIONS.force_glsl = results.options['glsl']
      Reviewed-by: Dylan Baker's avatarDylan Baker <dylan@pnwbakers.com>
      b227bb35
  2. 09 Nov, 2018 3 commits
  3. 08 Nov, 2018 2 commits
  4. 07 Nov, 2018 1 commit
    • Neil Roberts's avatar
      framework: Add a vulkan tests profile · 221d9246
      Neil Roberts authored
      This searches for files named *.vk_shader_test in the tests/vulkan
      directory and runs them with VkRunner. VkRunner is executed as an
      external dependency. It is found either with the vkrunner:bin config
      option, by setting the PIGLIT_VKRUNNER_BINARY environment variable, or
      just in the search path.
      
      v2: Move VkShaderTest to piglit_test.py and rename to VkRunnerTest.
          Add future imports. Remove unused import.
      v3: Support the PIGLIT_VKRUNNER_BINARY variable to specify the
          location of VkRunner.
      v4: Add documentation to the README. Add an option in piglit.conf to
          set the binary location. (Suggested by Samuel Iglesias)
      Reviewed-by: Samuel Iglesias Gonsálvez's avatarSamuel Iglesias Gonsálvez <siglesias@igalia.com>
      Reviewed-by: Dylan Baker's avatarDylan Baker <dylan@pnwbakers.com>
      221d9246
  5. 20 Sep, 2018 5 commits
    • Dylan Baker's avatar
      framework/wflinfo: delete deprecated interface · 05b9c02a
      Dylan Baker authored
      This is the old interface which is now not depended on by any tests.
      
      v2: - remove shader_test interfaces as well
      05b9c02a
    • Dylan Baker's avatar
      framework/test: Convert tests to new fast-skip interface · 1f9234b5
      Dylan Baker authored
      This converts the two test types that use the fast-skipping mechanism
      (glsl parser and shader) to use the new interfaces. This has been
      verified by running with PIGLIT_NO_FAST_SKIP=1 and without, and sans 1
      test (that is fixed later in the series) the results are the same.
      1f9234b5
    • Dylan Baker's avatar
      wflinfo: Reimplement wflinfo separating the various API's · c53f6ba3
      Dylan Baker authored
      Currently fast skipping is implemented such that it assumes there's a
      single version of ES, a single version of desktop, and all extensions
      are shared between them. This has basically worked because 1) there are
      basically no gles1 tests, and 2) piglit didn't have compat profile. But
      worked and correct are two different things.
      
      With the addition of compat profiles it's time to re-evaluate how fast
      skipping works. Namely we need to have different attributes for ES1,
      ES1+, core, compat, and I've added on for "legacy" (pre-profile), since
      waffle supports that.
      
      This maintains legacy interfaces so that existing code continues to
      work.
      
      v2: - Fix versions < 3.1 on implementations without core profile
      c53f6ba3
    • Dylan Baker's avatar
      framework/shader_test: GL_NUM_PROGRAM_BINARY_FORMATS >= 1 is not an extension · 45f2526a
      Dylan Baker authored
      So don't treat it like one. Stops one test from being fast-skipped that
      shouldn't be.
      45f2526a
    • Dylan Baker's avatar
      framework/test: Fix whitespace · d8558200
      Dylan Baker authored
      d8558200
  6. 21 Aug, 2018 1 commit
    • Alejandro Piñeiro's avatar
      framework: add --glsl option · 804e96c6
      Alejandro Piñeiro authored
      So when executing shader tests, they will be executed with -glsl. This
      is the force GLSL mode, that is only relevant if the shader test
      includes SPIR-V shaders.
      
      So for example:
      ./piglit run tests/shader.py -t ARB_gl_spirv --glsl results/results
      
      Will try to run all the shader tests for ARB_gl_spirv using GLSL
      instead of the default (for that extension) SPIR-V.
      Acked-by: Timothy Arceri's avatarTimothy Arceri <tarceri@itsqueeze.com>
      804e96c6
  7. 08 Aug, 2018 1 commit
  8. 24 Jul, 2018 2 commits
  9. 20 Jul, 2018 1 commit
  10. 18 Jul, 2018 1 commit
  11. 29 Jun, 2018 1 commit
    • Dylan Baker's avatar
      framework: add a --timeout parameter · 56db16e4
      Dylan Baker authored
      This allows an timeout (in integers) to be set for each test. If the
      tests run over this alotted time they'll be killed and the status will
      be set to timeout. This only work on Unix-like machines running with
      python 3.x or with 2.7 and subprocess32 installed.
      
      It can be made to work for windows, either by bumping the python version
      or by writing some windows specific code for killing processes.
      
      v2: - Add the word "Default" to help message.
      Reviewed-by: Jordan Justen's avatarJordan Justen <jordan.l.justen@intel.com>
      56db16e4
  12. 22 Jun, 2018 1 commit
  13. 30 May, 2018 3 commits
  14. 24 May, 2018 1 commit
  15. 16 May, 2018 1 commit
  16. 09 May, 2018 4 commits
    • Dylan Baker's avatar
    • Dylan Baker's avatar
      framework: Add filters class · 1f0f2ad2
      Dylan Baker authored
      This class works like a list, but with an extra method that allows it to
      "reset" a filter. This will allow class based filters that need to be
      reset to have deterministic behavior to do so.
      Tested-by: Michel Dänzer's avatarMichel Dänzer <michel.daenzer@amd.com>
      1f0f2ad2
    • Dylan Baker's avatar
      framework: ensure that all tests are run before exiting · bde5cb43
      Dylan Baker authored
      This is a bug that has existed for a long time, and I'm not really sure
      how we haven't hit this before honestly, I think that the reason this
      has worked is that we've always provided a concrete type to to
      pool.imap.
      
      The problem is that pool.imap is an iterator. If you don't walk the
      results then the program might exit before finishing. This seems to be
      especially true when running without -c or -1. Instead we'll write the
      loop, using pool.apply_async does basically the same thing (without the
      ability to use chunks), but with out exiting early.
      Tested-by: Michel Dänzer's avatarMichel Dänzer <michel.daenzer@amd.com>
      bde5cb43
    • Dylan Baker's avatar
      framework: fix running with mixed concurrency (neither -c or -1) · 597e4844
      Dylan Baker authored
      test_list is an iterator, you can't walk an iterator more than once. To
      solve this we use itertools.tee, which creates a shared buffer for the
      iterators to draw from. This fixes errors like:
      
      [000/480]
      Traceback (most recent call last):
        File "./piglit", line 178, in <module>
          main()
        File "./piglit", line 174, in main
          sys.exit(runner(args))
        File "/home/user/piglit/framework/exceptions.py", line 51, in _inner
          func(*args, **kwargs)
        File "/home/user/piglit/framework/programs/run.py", line 370, in run
          backend.finalize({'time_elapsed': time_elapsed.to_json()})
        File "/home/user/piglit/framework/backends/json.py", line 163, in finalize
          assert data['tests']
        AssertionError
      
      Thanks Tomi for figuring out what was wrong with the original patch!
      
      CC: Tomi Sarvela <tomi.p.sarvela@intel.com>
      Tested-by: Michel Dänzer's avatarMichel Dänzer <michel.daenzer@amd.com>
      Reviewed-by: Juan Suárez Romero's avatarJuan A. Suarez <jasuarez@igalia.com>
      597e4844
  17. 02 May, 2018 2 commits
  18. 01 May, 2018 9 commits