Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[test visibility] Update "new test" logic for early flake detection #25769

Merged
merged 3 commits into from
Oct 18, 2024
Merged

[test visibility] Update "new test" logic for early flake detection #25769

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
afeedc3
new logic
juan-fernandez Oct 17, 2024
9e2f23b
Apply suggestions from code review
juan-fernandez Oct 18, 2024
a4b5147
add back image
juan-fernandez Oct 18, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 2 additions & 6 deletions content/en/tests/early_flake_detection/_index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -94,11 +94,7 @@

## Manage Excluded Branches

Excluded Branches will not have any tests retried by Early Flake Detection. Tests run in these branches are not considered new for the purposes of Early Flake Detection.

{{< img src="continuous_integration/early_flake_detection_commit_new_test_explanation.png" alt="How Early Flake Detection works in your commits" style="width:100%">}}

You can manage the list of excluded branches on the [Test Service Settings page][7], ensuring that the feature is tailored to your specific workflow and branch structure.
Excluded Branches do not have any tests retried by Early Flake Detection. Tests run in these branches are not considered new for the purposes of Early Flake Detection. You can manage the list of excluded branches on the [Test Service Settings page][7], ensuring that the feature is tailored to your specific workflow and branch structure.

Check notice on line 97 in content/en/tests/early_flake_detection/_index.md

View workflow job for this annotation

GitHub Actions / vale

Datadog.sentencelength 

Suggestion: Try to keep your sentence length to 25 words or fewer.

## Explore results in the Test Visibility Explorer

Expand All @@ -115,7 +111,7 @@

This could be caused by a couple of reasons:

* This test has already run in an excluded branch, such as `staging`, `main`, or `preprod`.
* This test has ran previously.
* This test is slower than five minutes. There is a mechanism not to run Early Flake Detection on tests that are too slow, since retrying these tests could cause significant delays in CI pipelines.

### A test was retried that is not new
Expand Down
Loading