Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gojson processing passes failing tests #1937

Open
Smeb opened this issue Oct 17, 2023 · 0 comments
Open

gojson processing passes failing tests #1937

Smeb opened this issue Oct 17, 2023 · 0 comments

Comments

@Smeb
Copy link

Smeb commented Oct 17, 2023

What steps did you take and what happened:
We had a test fail in the Setup phase, meaning that the logs show a failure, but the plugin detects a passed test.

What did you expect to happen:
We expect that the test is reported as failing

Anything else you would like to add:
Here are (sanitised) test logs. The only change made was renaming the package.

{"Time":"2023-10-17T11:38:30.536126509Z","Action":"start","Package":"/test-suite/k8s-cluster-tests/clustertests/preflight/kube-system"}
{"Time":"2023-10-17T11:38:30.556740676Z","Action":"output","Package":"/test-suite/k8s-cluster-tests/clustertests/preflight/kube-system","Output":"F1017 11:38:30.556634      77 env.go:375] Setup failure: loading aws config\n"}
{"Time":"2023-10-17T11:38:30.558280565Z","Action":"output","Package":"/test-suite/k8s-cluster-tests/clustertests/preflight/kube-system","Output":"FAIL\t/test-suite/k8s-cluster-tests/clustertests/preflight/kube-system\t0.022s\n"}
{"Time":"2023-10-17T11:38:30.558315464Z","Action":"fail","Package":"/test-suite/k8s-cluster-tests/clustertests/preflight/kube-system","Elapsed":0.022}

This happens on the current main version.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant