Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ACTION NEEDED] Fix flaky integration tests at distribution level #6337

Open
gaiksaya opened this issue Apr 3, 2024 · 5 comments
Open

[ACTION NEEDED] Fix flaky integration tests at distribution level #6337

gaiksaya opened this issue Apr 3, 2024 · 5 comments
Assignees
Labels
bug Something isn't working v2.14.0

Comments

@gaiksaya
Copy link
Member

gaiksaya commented Apr 3, 2024

What is the bug?
It was observed in 2.13.0 and previous other releases that this component manually signed off on the release for failing integration tests. See opensearch-project/opensearch-build#4433 (comment)
The flakiness of the test runs take a lot of time from the release team to collect go/no-go decision and significantly lower the confidence in the release bundles.

How can one reproduce the bug?
Steps to reproduce the behavior:

  1. Run integration testing for altering and see the failures.
  2. Issues can be reproduced using the steps declared in AUTOCUT issues for failed integration testing

What is the expected behavior?
Tests should be consistently passing.

Do you have any additional context?
Please note that this is a hard blocker for 2.14.0 release as per the discussion here

@gaiksaya gaiksaya added bug Something isn't working untriaged v2.14.0 labels Apr 3, 2024
@ashwin-pc
Copy link
Member

ashwin-pc commented Apr 9, 2024

@bbarani
Copy link
Member

bbarani commented Apr 23, 2024

@ashwin-pc @AMoo-Miki Can you please provide your inputs?

@ashwin-pc
Copy link
Member

Both the tests should already be resolved. Will let @kavilla reply once he verifies it

@gaiksaya
Copy link
Member Author

Adding 2.14.0 release manager @rishabh6788

@kavilla
Copy link
Member

kavilla commented May 2, 2024

Checked previously and passing will make check when RC is ran.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working v2.14.0
Projects
Status: No status
Development

No branches or pull requests

4 participants