Currently the max_fails option will not count expected failures or
unexpected improvements, but it is counting known flakes and will stop
execution incorrectly if the number of known flakes exceeds the max_fails
specified.

Add logic to stop including known flakes in the max_fails count and add
an integration test to check for this behaviour.