A bug in vkrunner causes intermittent test failures due to parallel
execution.

When a test fails, we want to report it, but we do not want the
component to fail.