[Feature] : Halt testing upon the first failure

[shubham-cmyk]

What this PR does / why we need it:

This PR would skip all the Further Testing if any of the test failed if user passed the field stopOnFirstFailure to be true

It is much needed as it prevents waste of time and processing in order for a user/contributor to know what may be broken and requires remediation.

Fixes #26

[shubham-cmyk]

@chipzoller @eddycharly Check out

simply taking a field stopOnFirstFailure from the user's skip all the further testing if found any error in the test.

[shubham-cmyk]

@chipzoller I think this is what was probably required.
Any feedback would help a lot

[eddycharly]

So basically it skips tests when a failure happens ?

[shubham-cmyk]

Yes. The requirements was discussed in the issue #26

[eddycharly]

LGTM, thanks !

[chipzoller]

@shubham-cmyk @eddycharly, as these issues are closed and features are added, we must ensure we document them in Kyverno's fork of kuttl. I'm glad to do some refactoring of the README, but for now let's start a separate Markdown file in the root with the changes we're adding so we don't forget. You should make this a requirement for this mentorship, Charles.

[shubham-cmyk]

@chipzoller @eddycharly What columns would you consider in a readme.md
Would you consider something like below where we can maybe mark the issue, PR with the description

Issues & PRs Tracker

Issue #	PR #	Description
#26	#31	Halt testing upon the first failure
2	6	Fix ..........
3	7	Add ...........
...	...	...

[chipzoller]

Anything works right now.