Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Milestone1 jan 2025 #257

Open
wants to merge 16 commits into
base: ibm
Choose a base branch
from
Open

Milestone1 jan 2025 #257

wants to merge 16 commits into from

Conversation

mahdipub
Copy link

@mahdipub mahdipub commented Dec 6, 2024

No description provided.

sophia-guo and others added 16 commits November 6, 2024 09:33
* Limit docker label to linux special.system

* limit to temurin
…pport Windows/docker builds (adoptium#1117)

* First pass of batOrSh and fixes for windows containers

Signed-off-by: Stewart X Addison <[email protected]>

* Refactoring signing code to allow operation in Windows containers

Signed-off-by: Stewart X Addison <[email protected]>
* Reduce stashing and avoid pre-unstash chmod in non-docker case

Signed-off-by: Stewart X Addison <[email protected]>

* Move workspace scope and use it for cleaning cyclone-dx and security directories

Signed-off-by: Stewart X Addison <[email protected]>

---------

Signed-off-by: Stewart X Addison <[email protected]>
Signed-off-by: Andrew Leonard <[email protected]>
Co-authored-by: Andrew Leonard <[email protected]>
Co-authored-by: sophia-guo <[email protected]>
Co-authored-by: George Adams <[email protected]>
* Add release Tap collection and upload url

* Limit to adoptium jenkins

* Replace HUDSON_URL to JENKINS_URL as HUDSON_URL deprecates

* typo
Signed-off-by: Stewart X Addison <[email protected]>
* Switch to ubi8 base cuda image

The ubuntu image does not support ppc64le arch. We are now building (Semeru)
on ppc64le in the cent7 container and require the cuda libs.

Related #228

Signed-off-by: Adam Brousseau <[email protected]>

* Pull cuda image from nvcr Nvidia

Sometimes pulls fail because DockerHub is rate limited. We are
also facing pull restrictions from DockerHub for Semeru.

Related eclipse-openj9/openj9#20622

Signed-off-by: Adam Brousseau <[email protected]>

---------

Signed-off-by: Adam Brousseau <[email protected]>
* Adding platforms to reproducibility healthcheck

We now have automated reproducibility testing on 3 more platforms,
so we're checking their results as part of the daily healthcheck.

Signed-off-by: Adam Farley <[email protected]>

* Adding tolerance for decimal point

Signed-off-by: Adam Farley <[email protected]>

* Typo fix

* Syntax fix

Signed-off-by: Adam Farley <[email protected]>

* Fixing the regex

Signed-off-by: Adam Farley <[email protected]>

* Fixing variable content loss

Signed-off-by: Adam Farley <[email protected]>

* Fixing another regex

Signed-off-by: Adam Farley <[email protected]>

* Typo fix

Signed-off-by: Adam Farley <[email protected]>

* Fixing Linter concerns

Signed-off-by: Adam Farley <[email protected]>

* Alternative rounding method to solve Jenkins' MathContext aversion

Signed-off-by: Adam Farley <[email protected]>

* Changing method of rounding down

Signed-off-by: Adam Farley <[email protected]>

* Removing banned method

Signed-off-by: Adam Farley <[email protected]>

* Making sure we use the latest build repro info during healthcheck

Currently, we use the earliest pipeline with a given tag as our
best guess at the root source of a published build.

However, if the build link is rerun by a user for specific
platforms, the original link becomes outdated, and we should
use the new link for healthchecks (but only on the affected
platform).

This change adds the per-platform logic required to do that. We may
expand the scope for this in the long run, but for now this logic
will only be used by the section of the code which identifies the
reproducibility percentages for published builds.

Signed-off-by: Adam Farley <[email protected]>

* Swapping paranthesis with curley braces

Signed-off-by: Adam Farley <[email protected]>

* Continues should be changed to returns if used inside lambdas

Signed-off-by: Adam Farley <[email protected]>

* Adding useful debug messages

Signed-off-by: Adam Farley <[email protected]>

* More debug output

Signed-off-by: Adam Farley <[email protected]>

* Point repro healthcheck at the correct build.

Signed-off-by: Adam Farley <[email protected]>

* Resolving conflict and fixing typo

Signed-off-by: Adam Farley <[email protected]>

* Renaming variable

Signed-off-by: Adam Farley <[email protected]>

* Adapting contains call to map API

Signed-off-by: Adam Farley <[email protected]>

* Adding white space tolerance to 100 percent check

Signed-off-by: Adam Farley <[email protected]>

* Adding debug output

Signed-off-by: Adam Farley <[email protected]>

* Debug messages

* Switching nodes to try and get faster performance

Will revert before merge.

Signed-off-by: Adam Farley <[email protected]>

* Fixing typos

Signed-off-by: Adam Farley <[email protected]>

* Changing node

* Debug output

Signed-off-by: Adam Farley <[email protected]>

* Trimming string

Signed-off-by: Adam Farley <[email protected]>

* Expanding range of nodes to be used for execution

Signed-off-by: Adam Farley <[email protected]>

* Resetting label

Signed-off-by: Adam Farley <[email protected]>

* Fixing method signature

Signed-off-by: Adam Farley <[email protected]>

* Debug output

Signed-off-by: Adam Farley <[email protected]>

* Adjusting debug messages

Signed-off-by: Adam Farley <[email protected]>

* Removing lambdas

Signed-off-by: Adam Farley <[email protected]>

* Removing another lambda

Signed-off-by: Adam Farley <[email protected]>

* Restructuring error checking

Signed-off-by: Adam Farley <[email protected]>

* Debug message

Signed-off-by: Adam Farley <[email protected]>

* debug

Signed-off-by: Adam Farley <[email protected]>

* Changing structure to prevent syntax problem

Signed-off-by: Adam Farley <[email protected]>

* debug

Signed-off-by: Adam Farley <[email protected]>

* To ensure accuracy when some platforms are subsets of other platforms

Like how alpine-linux contains the string linux.

Signed-off-by: Adam Farley <[email protected]>

* debug

Signed-off-by: Adam Farley <[email protected]>

* Bracket mislaid - fixing

Signed-off-by: Adam Farley <[email protected]>

* Switching for loop styles

Because the previous kind doesn't appear to work, unsure why.

Signed-off-by: Adam Farley <[email protected]>

* Removing reference to restricted job

Signed-off-by: Adam Farley <[email protected]>

* Removing legacy code

Signed-off-by: Adam Farley <[email protected]>

* Moving platformKeys scope to allow wider usage

Signed-off-by: Adam Farley <[email protected]>

* Adding tests check

Signed-off-by: Adam Farley <[email protected]>

* Typo

Signed-off-by: Adam Farley <[email protected]>

* Regex fix

Signed-off-by: Adam Farley <[email protected]>

* Adjusting regex and adding debug

Signed-off-by: Adam Farley <[email protected]>

* Swapping out regex

Signed-off-by: Adam Farley <[email protected]>

* Removing superfluous check

Signed-off-by: Adam Farley <[email protected]>

* Better debug messages and a test tag

Signed-off-by: Adam Farley <[email protected]>

* Changing tag for testing

Signed-off-by: Adam Farley <[email protected]>

* Removing lambdas and getting test output data from trss

Signed-off-by: Adam Farley <[email protected]>

* Removing another lambda

Signed-off-by: Adam Farley <[email protected]>

* Correcting variable name

Signed-off-by: Adam Farley <[email protected]>

* Making sure that a missing buildOutputId can be worked around

Signed-off-by: Adam Farley <[email protected]>

* Removing static method use

Signed-off-by: Adam Farley <[email protected]>

* Removing legacy code.

* Removing redundant command

Signed-off-by: Adam Farley <[email protected]>

* Adding check for blank test output

Signed-off-by: Adam Farley <[email protected]>

* Fixing typo

Signed-off-by: Adam Farley <[email protected]>

* Tidying output and adding debug

Signed-off-by: Adam Farley <[email protected]>

* Reducing quanity of output

Signed-off-by: Adam Farley <[email protected]>

* Debug

Signed-off-by: Adam Farley <[email protected]>

* Reducing output

Signed-off-by: Adam Farley <[email protected]>

* More useful output

Signed-off-by: Adam Farley <[email protected]>

* More debug

Signed-off-by: Adam Farley <[email protected]>

* Syntax fix

Signed-off-by: Adam Farley <[email protected]>

* Changing expected repro test bucket for windows and mac

Signed-off-by: Adam Farley <[email protected]>

* Removing debug messages, making all wgets more robust, plus code tidy

wgets to trss can hang if you're passing an invalid value, as per
aqa-test-tools issue 935. This code change allows us to treat
hangs (no response) as if the wget had returned an empty string.

Signed-off-by: Adam Farley <[email protected]>

* Making wget spider call silent

Signed-off-by: Adam Farley <[email protected]>

* Fixing output typo

Signed-off-by: Adam Farley <[email protected]>

* Removing excess white spaces

Signed-off-by: Adam Farley <[email protected]>

* Adding variable use to make linter happy

Signed-off-by: Adam Farley <[email protected]>

* Removing build-passed check in favor of an upload-success check

So that if one of the tests fails and the upload is still successful,
we can still try to provide information on the reproducibility
test (assuming it ran at all).

Signed-off-by: Adam Farley <[email protected]>

---------

Signed-off-by: Adam Farley <[email protected]>
…arning (adoptium#1150)

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

* Add pipeline publish link warning if job fails

Signed-off-by: Andrew Leonard <[email protected]>

---------

Signed-off-by: Andrew Leonard <[email protected]>
…fic asset (adoptium#1153)

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <[email protected]>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <[email protected]>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <[email protected]>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <[email protected]>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <[email protected]>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <[email protected]>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <[email protected]>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <[email protected]>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <[email protected]>

* Make trigger_beta job check specific jdk8u aarch32 and alpine assests exist

Signed-off-by: Andrew Leonard <[email protected]>

---------

Signed-off-by: Andrew Leonard <[email protected]>
Copy link

github-actions bot commented Dec 6, 2024

Thank you for creating a pull request!

Please check out the information below if you have not made a pull request here before (or if you need a reminder how things work).

Code Quality and Contributing Guidelines

If you have not done so already, please familiarise yourself with our Contributing Guidelines and Code Of Conduct, even if you have contributed before.

Tests

Github actions will run a set of jobs against your PR that will lint and unit test your changes. Keep an eye out for the results from these on the latest commit you submitted. For more information, please see our testing documentation.

In order to run the advanced pipeline tests (executing a set of mock pipelines), it requires an admin to post run tests on this PR.
If you are not an admin, please ask for one's attention in #infrastructure on Slack or ping one here.
To run full set of tests, use "run tests"; a subset of tests on specific jdk version, use "run tests quick 11,21"

@github-actions github-actions bot added documentation Improvements or additions to documentation jenkins-pipeline code-tools docker labels Dec 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
code-tools docker documentation Improvements or additions to documentation jenkins-pipeline
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants