Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spack module rebuild pipelines for Incline and Deception #40

Merged
merged 9 commits into from
Oct 31, 2023

Conversation

jaelynlitz
Copy link
Collaborator

closes #36

@jaelynlitz
Copy link
Collaborator Author

@cameronrutherford you are the owner of /qfs/projects/exasgd/resolve/ and /qfs/projects/exasgd/resolve/spack-ci can you please give the exasgd group write permissions there?

https://gitlab.pnnl.gov/exasgd/resolve-mirror/-/jobs/131654#L93

@cameronrutherford
Copy link
Collaborator

https://github.com/ORNL/ReSolve/blob/develop/buildsystem/spack/deception/spack.yaml#L19 - deception

https://github.com/ORNL/ReSolve/blob/develop/buildsystem/spack/incline/spack.yaml#L22 - incline

https://github.com/ORNL/ReSolve/blob/develop/buildsystem/configure-modules.sh#L36 - module configuration step with permissions updates

@jaelynlitz not going to fix this as a once off and have the issue persist.

I was under the impression that the spack configuration in the respective spack.yaml was sufficient to set permissions, but apparently that is not working correctly.. Is it just the root directories that are the issue? Are the module and binary packages ok?

If so, we can change our chmod commands here and in exago to fix the parent dir, and let spack take care of the rest

@jaelynlitz
Copy link
Collaborator Author

https://github.com/ORNL/ReSolve/blob/develop/buildsystem/spack/deception/spack.yaml#L19 - deception

https://github.com/ORNL/ReSolve/blob/develop/buildsystem/spack/incline/spack.yaml#L22 - incline

https://github.com/ORNL/ReSolve/blob/develop/buildsystem/configure-modules.sh#L36 - module configuration step with permissions updates

@jaelynlitz not going to fix this as a once off and have the issue persist.

I was under the impression that the spack configuration in the respective spack.yaml was sufficient to set permissions, but apparently that is not working correctly.. Is it just the root directories that are the issue? Are the module and binary packages ok?

If so, we can change our chmod commands here and in exago to fix the parent dir, and let spack take care of the rest

It isn't erroring in the configure-modules script - it isn't getting that far since it can't create the SPACK_INSTALL and SPACK_CACHE dirs here https://github.com/ORNL/ReSolve/blob/develop/buildsystem/load-spack.sh#L62C1-L62C1

So it's the parent directory that has the wrong permissions, not something that spack is touching

@jaelynlitz jaelynlitz force-pushed the module-rebuild-pipelines branch from 0e5116a to 3dc5685 Compare October 31, 2023 17:48
@ryandanehy ryandanehy merged commit fa76fba into develop Oct 31, 2023
2 checks passed
@pelesh pelesh added this to the First Release milestone Nov 2, 2023
ryandanehy pushed a commit that referenced this pull request Nov 2, 2023
Add final incline touches.

adding incline rocm build instead of cpu only

[skip ci] add structure for crusher ci

Trigger crusher mirror

fix export command

Spack module rebuild pipelines for Incline and Deception  (#40)

* enable module rebuild for incline and deception [incline-rebuild] [deception-rebuild]

* update perms for SPACK_INSTALL dir [deception-rebuild] [incline-rebuild]

* remove chmod command [deception-rebuild]

* send correct exit code [deception-rebuild]

* try with SPACK_GIT_TOKEN added [deception-rebuild]

* Update deception spack built tcl modules - [deception-test]

* do not run ascent tests on PNNL rebuild pipelines [deception-rebuild] [incline-rebuild]

* Update deception spack built tcl modules - [deception-test]

* Update incline spack built tcl modules - [incline-test]

---------

Co-authored-by: spack-auto-module <[email protected]>

Update base.gitlab-ci.yml (#51)

* add library file

* Update base.gitlab-ci.yml

[ascent test] testing ci

* [ascent-test] testing ci

* rm extar file

---------

Co-authored-by: Ryan Danehy <[email protected]>

fix lack of generator

Allowing Klu

Adding Crusher amd support
@pelesh pelesh deleted the module-rebuild-pipelines branch December 1, 2023 18:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Spack Module Rebuild Pipelines
4 participants