Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RPU] builds stuck in trusted.ci.jenkins.io #4122

Closed
dduportal opened this issue Jun 5, 2024 · 6 comments
Closed

[RPU] builds stuck in trusted.ci.jenkins.io #4122

dduportal opened this issue Jun 5, 2024 · 6 comments

Comments

@dduportal
Copy link
Contributor

Service(s)

trusted.ci.jenkins.io

Summary

Since jenkins-infra/repository-permissions-updater#3953, builds of RPU are stuck on trusted.ci.jenkins.io (past 14 hours).

As a consequence, the CD tokens are expired, preventing plugins to be released.

Reproduction steps

No response

@dduportal dduportal added the triage Incoming issues that need review label Jun 5, 2024
@dduportal dduportal added repository-permissions-updater and removed triage Incoming issues that need review labels Jun 5, 2024
@dduportal
Copy link
Contributor Author

Initial analysis on trusted.ci.jenkins.io: builds are stuck waiting for a maven-21 node but this is not configured on trusted.ci.jenkins.io.

Applied the label to the ubuntu-22 Azure VM template as a hotfix : VM was scheduled and build is running using JDK11 as it was before the jenkins-infra/repository-permissions-updater#3953 change => it is only a label and we know RPU works fine with JDK11.

@MarkEWaite
Copy link

MarkEWaite commented Jun 5, 2024

Thanks! Sorry that I broke the RPU with that pull request. Is there a way the pull request that introduced the damage could have been safely executed on trusted.ci.jenkins.io without actually performing any operations?

I assume probably not, so the next best thing would have been for me to ask someone with access to trusted.ci.jenkins.io to confirm that the jobs are still running successfully. I'll do that in the future.

@dduportal
Copy link
Contributor Author

Thanks! Sorry that I broke the RPU with that pull request. Is there a way the pull request that introduced the damage could have been safely executed on trusted.ci.jenkins.io without actually performing any operations?

I assume probably not, so the next best thing would have been for me to ask someone with access to trusted.ci.jenkins.io to confirm that the jobs are still running successfully. I'll do that in the future.

Good point: we can check the status of the trusted.ci build after such a change in the future. But as the jenkins-infra team does not have a monitoring of private builds, it's not easy for you as a "consumer" though.

Another point: the jenkins-infra team should provide the same "feature set" for agent and their labels between ci.jio, trusted.ci.jio and infra.ci.jio. WiP on this!

@dduportal dduportal mentioned this issue Jun 5, 2024
11 tasks
@MarkEWaite
Copy link

We can also revert the change to repository permissions updater in order to remove any pressure for this change. My change broke RPU and reverting the change is perfectly reasonable.

@dduportal
Copy link
Contributor Author

We can also revert the change to repository permissions updater in order to remove any pressure for this change. My change broke RPU and reverting the change is perfectly reasonable.

I would propose an intermediate:

  • Set the label to 'maven-21' || 'java' (so it always spawn an agent)
  • Add a withEnv(JAVA_HOME=/opt/jdk-21) and/or using JDK tool

=> we have promising results and should be able to implement the maven-XX labels on trusted.ci soon!

@dduportal
Copy link
Contributor Author

@dduportal dduportal added this to the infra-team-sync-2024-06-11 milestone Jun 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants