GitLab

Signed-off-by: Andres Gomez <agomez@igalia.com>
Reviewed-by: Dylan Baker <dylan@pnwbakers.com>
Part-of: <!353>

This removes all of the python code for handling python 2.x vs 3.x, now
only 3.6+ is supported. This also drops all uses of the six module, as
its no longer needed.

Python 2.x and <= 3.5 are all EOL, it doesn't make sense to continue to
support version of python that are at the end of their lives and are
being removed from operating systems.
Acked-by: Eric Engestrom <eric@engestrom.ch>
Part-of: <!223>

Python 3.4 reached end-of-life in March 2019 [0].

Clean up remaining configuration, corner-case and documentation references
to this prior Python version.

[0] https://www.python.org/dev/peps/pep-0429/#release-schedule

Fixes: 155b93e1

 ("travis: Drop python3.4")
Signed-off-by: Rhys Kidd <rhyskidd@gmail.com>
Reviewed-by: Eric Engestrom <eric@engestrom.ch>

This reverts commit c878a27d.

pushed by accident

To support the gbm platform on a default build
Signed-off-by: Kenny Ho <Kenny.Ho@amd.com>
Signed-off-by: Marek Olšák <marek.olsak@amd.com>

This makes the text a little less pretty when viewed directly on text
editors (although vim puts some nice colors to it), but makes
navigation on the Gitlab page much nicer.
Signed-off-by: Paulo Zanoni <paulo.r.zanoni@intel.com>
Reviewed-by: Kenneth Graunke <kenneth@whitecape.org>

Section 6 is Integration, not Todo.
Signed-off-by: Paulo Zanoni <paulo.r.zanoni@intel.com>
Reviewed-by: Kenneth Graunke <kenneth@whitecape.org>

When reading README.md on the gitlab web page, the main sections are
shown as small unlinkable text, while subsections work fine. On Vim,
they are not bold and colored as the subsections. Use Markdown for the
main sections too so we get pretty linkable html output and also bold
red on Vim.
Signed-off-by: Paulo Zanoni <paulo.r.zanoni@intel.com>
Reviewed-by: Kenneth Graunke <kenneth@whitecape.org>

This searches for files named *.vk_shader_test in the tests/vulkan
directory and runs them with VkRunner. VkRunner is executed as an
external dependency. It is found either with the vkrunner:bin config
option, by setting the PIGLIT_VKRUNNER_BINARY environment variable, or
just in the search path.

v2: Move VkShaderTest to piglit_test.py and rename to VkRunnerTest.
    Add future imports. Remove unused import.
v3: Support the PIGLIT_VKRUNNER_BINARY variable to specify the
    location of VkRunner.
v4: Add documentation to the README. Add an option in piglit.conf to
    set the binary location. (Suggested by Samuel Iglesias)
Reviewed-by: Samuel Iglesias Gonsálvez <siglesias@igalia.com>
Reviewed-by: Dylan Baker <dylan@pnwbakers.com>

Reviewed-by: Rhys Kidd <rhyskidd@gmail.com>
Reviewed-by: Dylan Baker <dylan@pnwbakers.com>

Acked-by: Lionel Landwerlin <lionel.g.landwerlin@intel.com>
Acked-by: Dylan Baker <dylan@pnwbakers.com>
Reviewed-by: Juan A. Suarez <jasuarez@igalia.com>

The extra indentation does not make markdown happy.  Instead, use a
proper list and make the test script names bold.
Acked-by: Lionel Landwerlin <lionel.g.landwerlin@intel.com>
Acked-by: Dylan Baker <dylan@pnwbakers.com>
Reviewed-by: Juan A. Suarez <jasuarez@igalia.com>

Acked-by: Lionel Landwerlin <lionel.g.landwerlin@intel.com>
Acked-by: Dylan Baker <dylan@pnwbakers.com>
Reviewed-by: Juan A. Suarez <jasuarez@igalia.com>

Acked-by: Lionel Landwerlin <lionel.g.landwerlin@intel.com>
Acked-by: Dylan Baker <dylan@pnwbakers.com>
Reviewed-by: Juan A. Suarez <jasuarez@igalia.com>

Extra indentation results in code blocks
Acked-by: Lionel Landwerlin <lionel.g.landwerlin@intel.com>
Acked-by: Dylan Baker <dylan@pnwbakers.com>
Reviewed-by: Juan A. Suarez <jasuarez@igalia.com>

Acked-by: Lionel Landwerlin <lionel.g.landwerlin@intel.com>
Acked-by: Dylan Baker <dylan@pnwbakers.com>
Reviewed-by: Juan A. Suarez <jasuarez@igalia.com>

Acked-by: Lionel Landwerlin <lionel.g.landwerlin@intel.com>
Acked-by: Dylan Baker <dylan@pnwbakers.com>
Reviewed-by: Juan A. Suarez <jasuarez@igalia.com>

Acked-by: Lionel Landwerlin <lionel.g.landwerlin@intel.com>
Acked-by: Dylan Baker <dylan@pnwbakers.com>
Reviewed-by: Juan A. Suarez <jasuarez@igalia.com>

deqp_gles3.py accepted a now deprecated 'exe' configuration option.
Bring README into consistency with the current approach suggested in the
deprecation warning, as well as piglit.conf.example

Fixes: 51528bcd

 ("framework: Deprecated abnormalities in deqp_gles3.py")
Signed-off-by: Rhys Kidd <rhyskidd@gmail.com>
Reviewed-by: Brian Paul <brianp@vmware.com>

Signed-off-by: Rhys Kidd <rhyskidd@gmail.com>
Reviewed-by: Brian Paul <brianp@vmware.com>

No other stage of the suggested initial sanity.py test or other
tests uses a folder structure with *.results.

Use a consistent naming approach throughout the initial README to
make initial setup clearer.
Signed-off-by: Rhys Kidd <rhyskidd@gmail.com>
Reviewed-by: Dylan Baker <dylan@pnwbakers.com>

Signed-off-by: Rhys Kidd <rhyskidd@gmail.com>
Reviewed-by: Dylan Baker <dylan@pnwbakers.com>

v3 (Rhys Kidd): Fix typo with cts_gles.py

v2 (Dylan Baker): Do not document es3conform.py, as it is for a very
  old version of the Khronos CTS and should be deleted.
Signed-off-by: Rhys Kidd <rhyskidd@gmail.com>
Reviewed-by: Tobias Klausmann <tobias.johannes.klausmann@mni.thm.de>

MSVC build of Piglit was broken for over a month.  No point in
sustaining it.

Building with MinGW is the way forward.
Reviewed-by: Brian Paul <brianp@vmware.com>

So far this is the only options I found to build 32-on-64. It supersedes
the prev. patch to README — turns out, replacing i386→x86 isn't enough.
The inconsistent results were because cmake retains options used for old
runs. This patch was tested by completely removing piglit, and git
cloning it again.

v2: (per Brian Paul comment) fix typos, and mention that it's enough
to remove CMakeCache.txt from the previous build.
Signed-off-by: Constantine Charlamov <Hi-Angel@yandex.ru>
Supersedes: https://patchwork.freedesktop.org/patch/141700/

Reviewed-by: Brian Paul <brianp@vmware.com>

This commit adds support in the json backend for using an external
library that I wrote called jsonstreams. It's a pretty self-explanatory
library, and for piglit has several advantages. First, I've measured
a consistent 10-15 second speed up for running the quick profile.
Second, it *vastly* reduces the amount of memory piglit needs to write
the final JSON document out.

This is not implemented as a separate backend because the way that
piglit's backend are implemented only one backend can handle a specific
file extension. While this can be worked around by setting the
extension to something like '.junit.xml' that doesn't really make sense
here, since they are writing the same format, just using different
means.
Signed-off-by: Dylan Baker <dylanx.c.baker@intel.com>

Reviewed-by: Dylan Baker <dylan@pnwbakers.com>

Signed-off-by: Dylan Baker <dylanx.c.baker@intel.com>

Signed-off-by: Eric Engestrom <eric@engestrom.ch>
Reviewed-by: Dylan Baker <baker.dylan.c@gmail.com>
Signed-off-by: Vinson Lee <vlee@freedesktop.org>

Signed-off-by: Dylan Baker <dylanx.c.baker@intel.com>

This variable allows timeouts to be disabled, which can be useful for
debugging tests.
Signed-off-by: Dylan Baker <dylanx.c.baker@intel.com>

Setting PIGLIT_NO_FAST_SKIP will disable the fast skipping mechanism
altogether.

It does this by shadowing FastSkipMixin at import time. This method is
robust and cheap, but makes testing difficult.
Signed-off-by: Dylan Baker <dylanx.c.baker@intel.com>

Document the environment variables the framework and tests accept.

Trivial.
Signed-off-by: Dylan Baker <dylanx.c.baker@intel.com>

A basic setup for running dEQP through piglit.

This adds a pretty extensive set of tests for oglconform.py, with the
goal of making further cleanups and refactors easier and not introducing
regressions.

This adds a dependency of mock for the unittests. No production code
needs this dependency, so this wont affect most (any?) piglit users.
Mock allows for better testing, in fact, it allows oglconform to be
tested even when it's not installed.
Signed-off-by: Dylan Baker <dylanx.c.baker@intel.com>

tox is a python test manager that runs the tests in isolated
environments with their own copies of dependent libraries, and can be
used to test against multiple versions of python. This allows us to
easily test the framework with and without the acceleration modules it
can optionally use (simplejson and lxml), it will also allow us to test
against multiple versions of python 3.x (which we support for the
generators, and presumably will support in the future)

This uses the coverage module, and uses nose's cover-tests option.
Unfortunately nose assumes that anything /[Tt]est/ is a test, and hides
the tests for the test package. This might be resolvable by modifying
the regex, but it isn't something straightforward to fix. Using
--cover-tests will get us the test package, but it also gets us the
tests package.
Signed-off-by: Dylan Baker <dylanx.c.baker@intel.com>

Signed-off-by: Ian Romanick <ian.d.romanick@intel.com>
Reviewed-by: Matt Turner <mattst88@gmail.com>
Thanked-by: Kristian Høgsberg <krh@bitplanet.net>

It's worth noting that piglit run and piglit summary count tests
differently.
Signed-off-by: Dylan Baker <dylanx.c.baker@intel.com>