Revert "Revert "ci: set venus on lavapipe to manual due to flakes""

This reverts commit 55e99a22.

Things are still very flaky for me. Here's a pipeline where the Venus job failed twice in a row.