Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dev 0.22 #1011

Open
wants to merge 111 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 91 commits
Commits
Show all changes
111 commits
Select commit Hold shift + click to select a range
58dd558
Set submodule spack to v0.22.2
dominichofer Oct 31, 2024
e95aaae
fdb: Remove package
dominichofer Oct 31, 2024
8592711
metkit: Remove package
dominichofer Oct 31, 2024
4f1ce65
py-frozendict: Remove package
dominichofer Oct 31, 2024
0116e61
xpmem: Remove package
dominichofer Oct 31, 2024
40eb0a7
py-hatchling: Update from upstream
dominichofer Oct 31, 2024
698bd7f
py-tabulate: Update from upstream
dominichofer Oct 31, 2024
561c571
icon-ham: Use spack/icon
dominichofer Oct 31, 2024
2c6231e
icon: Split package
dominichofer Oct 31, 2024
6cf047a
py-lark: Remove package
dominichofer Oct 31, 2024
118109d
Remove unnecessary tests
dominichofer Oct 31, 2024
695ac57
Migrate unit tests to pytest
dominichofer Nov 5, 2024
491591d
Rename icon to icon-c2sm
dominichofer Nov 5, 2024
2a7a337
cosmo: Remove package
dominichofer Nov 5, 2024
a1e05dd
Jenkins: Use mch/prgenv-icon:rc1
dominichofer Nov 5, 2024
9b5c5be
GitHub Action: Apply Pep8-formatting
invalid-email-address Nov 5, 2024
a2acb40
Merge branch 'main' into dev_0.22
dominichofer Nov 5, 2024
6ff2517
Add tests for 'spack find' and 'spack compilers'.
dominichofer Nov 5, 2024
de903c8
Start uenv in test stages
dominichofer Nov 5, 2024
1059f74
deactivate
dominichofer Nov 5, 2024
4a3cf6d
Simplify run_with_spack
dominichofer Nov 5, 2024
8b5222c
Keep venv
dominichofer Nov 6, 2024
77df0b9
Bring back devirtualization
dominichofer Nov 6, 2024
e073f3c
Update uenv
dominichofer Nov 6, 2024
c827041
Use .venv
dominichofer Nov 6, 2024
bce9413
GitHub Action: Apply Pep8-formatting
invalid-email-address Nov 6, 2024
5c42d6e
Shuffle Jenkinsfile
dominichofer Nov 7, 2024
e352780
revert
dominichofer Nov 7, 2024
20fe9af
uenv
dominichofer Nov 7, 2024
6fb5890
revert clean env
dominichofer Nov 7, 2024
3bd74dd
Remove fdb-fortran
dominichofer Nov 7, 2024
31fe66b
flexpart-cosmo: Add workaround
dominichofer Nov 7, 2024
1b66901
Update icon-mch tests
dominichofer Nov 7, 2024
d219b6e
Typo
dominichofer Nov 7, 2024
9353b9b
icontools: Workaround
dominichofer Nov 7, 2024
c94ed34
Fix some icon tests
dominichofer Nov 7, 2024
7362726
Fix type
dominichofer Nov 11, 2024
ea79b33
Remove icon-mch gcc test
dominichofer Nov 11, 2024
32677b1
GitHub Action: Apply Pep8-formatting
invalid-email-address Nov 11, 2024
afc297b
Merge commit 'ba82f8f97283312d769e3ca4a79a01ba2a1af5d1' into dev_0.22
dominichofer Nov 11, 2024
fe73488
Revert "cosmo: Remove package"
dominichofer Nov 11, 2024
6a6e53c
cosmo: remove package
dominichofer Nov 12, 2024
7c06aaf
cosmo: remove tests
dominichofer Nov 12, 2024
d99581c
Fix icon-mch test
dominichofer Nov 12, 2024
5a1ebe8
fix icon test
dominichofer Nov 12, 2024
94826e1
eccodes: remove version 2.19.0
dominichofer Nov 12, 2024
0ce3053
Clean up system tests
dominichofer Nov 12, 2024
c570630
GitHub Action: Apply Pep8-formatting
invalid-email-address Nov 12, 2024
59f1b02
Update uenv
dominichofer Nov 12, 2024
1ca68b1
cosmo-eccodes-definitions: Remove versions 2.19.0.x
dominichofer Nov 12, 2024
9627760
icon-mch: Add workarounds
dominichofer Nov 12, 2024
3c01785
icon-c2sm: Inherit from icon
dominichofer Nov 12, 2024
76bfb04
Improve tests
dominichofer Nov 12, 2024
e4d3aac
Disable failing package tests.
dominichofer Nov 13, 2024
7b68f2e
Move mpi workaround
dominichofer Nov 13, 2024
ca88007
GitHub Action: Apply Pep8-formatting
invalid-email-address Nov 13, 2024
1d30755
Merge remote-tracking branch 'origin/main' into dev_0.22
dominichofer Nov 25, 2024
7376c3c
icon-mch: Remove gcc test and add version tests
dominichofer Nov 25, 2024
cdc5b67
icon-c2sm: Remove copy_runscript_related_input_files because there's …
dominichofer Nov 25, 2024
c0f83dc
icon-mch: fix tags
dominichofer Nov 25, 2024
7898444
icon: Set new maintainer
dominichofer Nov 26, 2024
83da947
Rename icon-c2sm to icon
dominichofer Nov 27, 2024
c58351d
Use require
dominichofer Nov 27, 2024
65b37b9
GitHub Action: Apply Pep8-formatting
invalid-email-address Nov 27, 2024
5ff1b40
Merge branch 'main' into dev_0.22
dominichofer Nov 27, 2024
201a1c0
pytorch-fortran-proxy: requires gcc
dominichofer Dec 4, 2024
31383eb
Merge branch 'main' into dev_0.22
jonasjucker Dec 5, 2024
adf2ad9
GitHub Action: Apply Pep8-formatting
invalid-email-address Dec 5, 2024
e804ce0
dirty gt4py fix
huppd Dec 5, 2024
e103c77
Merge branch 'dev_0.22' of github.com:C2SM/spack-c2sm into dev_0.22
huppd Dec 5, 2024
90cbaf5
GitHub Action: Apply Pep8-formatting
invalid-email-address Dec 5, 2024
8ac1984
rm exclaim
huppd Dec 5, 2024
e9f2c44
GitHub Action: Apply Pep8-formatting
invalid-email-address Dec 5, 2024
639d2b8
fix test and add icon-exlcaim
huppd Dec 5, 2024
c4eab38
GitHub Action: Apply Pep8-formatting
invalid-email-address Dec 5, 2024
941db8b
make out-of-source work
jonasjucker Dec 5, 2024
e0dd2af
Merge branch 'dev_0.22' of github.com:C2SM/spack-c2sm into dev_0.22
jonasjucker Dec 5, 2024
82ce7e2
GitHub Action: Apply Pep8-formatting
invalid-email-address Dec 5, 2024
8557771
fix url
huppd Dec 5, 2024
c30fb38
rm file
huppd Dec 5, 2024
b46ca72
update test
huppd Dec 5, 2024
b94b537
cleanup
huppd Dec 5, 2024
7ea4ac7
GitHub Action: Apply Pep8-formatting
invalid-email-address Dec 5, 2024
ca49b5a
fix
huppd Dec 5, 2024
ef02763
Merge branch 'dev_0.22' of github.com:C2SM/spack-c2sm into dev_0.22
huppd Dec 5, 2024
59ecadc
fix version
jonasjucker Dec 5, 2024
fb7ce7c
Merge branch 'dev_0.22' of github.com:C2SM/spack-c2sm into dev_0.22
jonasjucker Dec 5, 2024
4ed055d
rm include
huppd Dec 5, 2024
5ad9805
GitHub Action: Apply Pep8-formatting
invalid-email-address Dec 5, 2024
1598542
Merge branch 'dev_0.22' of github.com:C2SM/spack-c2sm into dev_0.22
huppd Dec 5, 2024
aefb2a9
fix icon-ham
jonasjucker Dec 5, 2024
81ad942
add maintainer
huppd Dec 5, 2024
a0bd445
Merge branch 'dev_0.22' of github.com:C2SM/spack-c2sm into dev_0.22
huppd Dec 5, 2024
13d4c08
Update repos/c2sm/packages/icon-exclaim/package.py
jonasjucker Dec 5, 2024
57010f3
GitHub Action: Apply Pep8-formatting
invalid-email-address Dec 5, 2024
cb59d55
change
jonasjucker Dec 5, 2024
2aef510
GitHub Action: Apply Pep8-formatting
invalid-email-address Dec 5, 2024
2dabff6
disable version
huppd Dec 5, 2024
f66f2b6
GitHub Action: Apply Pep8-formatting
invalid-email-address Dec 5, 2024
ae454ec
remove loop-exchange
jonasjucker Dec 5, 2024
e4386b6
Merge branch 'dev_0.22' of github.com:C2SM/spack-c2sm into dev_0.22
jonasjucker Dec 5, 2024
42a5efe
fix icon
jonasjucker Dec 5, 2024
c40e511
dirty fix icon4py
huppd Dec 5, 2024
b139e23
readd loop-exchange
huppd Dec 6, 2024
eb6d5b3
Update package.py
jonasjucker Dec 9, 2024
8693130
fix bug again of serialbox dep, cleanup
jonasjucker Dec 9, 2024
fe686ce
reintroduce skip configure
jonasjucker Dec 9, 2024
d9e66b7
remove libtorch
jonasjucker Dec 9, 2024
52db158
upgrade docs (#1038)
jonasjucker Dec 9, 2024
ca2ba85
update docs
jonasjucker Dec 9, 2024
8150572
Update cosmo-eccodes-definitions versions to 2.36.0.3
lxavier Jan 15, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 23 additions & 11 deletions Jenkinsfile
Original file line number Diff line number Diff line change
Expand Up @@ -20,20 +20,30 @@ pipeline {
}
}
stages {
stage('Create environment') {
stage('Create python environment') {
steps {
sh """
python3 -m venv env
source env/bin/activate
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
"""
}
}
stage('Create uenv') {
steps {
sh """
git clone -b fix/jenkins https://github.com/eth-cscs/uenv.git
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Warning: This is a branch!

./uenv/install --yes --destdir=$WORKSPACE
source $WORKSPACE/etc/profile.d/uenv.sh
uenv repo create
uenv image pull mch/v8:rc2
"""
}
}
stage('Bootstrap spack') {
// Bootstrapping spack is a separate stage to avoid problems with concurrently bootstrapping spack in the tests.
steps {
sh """
source env/bin/activate
source ./setup-env.sh
spack spec gnuconfig
"""
Expand All @@ -42,26 +52,28 @@ pipeline {
stage('Unit Tests') {
steps {
sh """
source env/bin/activate
source .venv/bin/activate
python3 test/unit_test.py
"""
}
}
stage('Integration Tests') {
steps {
sh """
source env/bin/activate
source ./setup-env.sh /mch-environment/v7
pytest -v -n auto test/integration_test.py
source $WORKSPACE/etc/profile.d/uenv.sh
source ./setup-env.sh /user-environment
source .venv/bin/activate
uenv run mch/v8:rc2 -- pytest -v -n auto test/integration_test.py
"""
}
}
stage('System Tests') {
steps {
sh """
source env/bin/activate
source ./setup-env.sh /mch-environment/v7
pytest -v -n auto test/system_test.py
source $WORKSPACE/etc/profile.d/uenv.sh
source ./setup-env.sh /user-environment
source .venv/bin/activate
uenv run mch/v8:rc2 -- pytest -v -n auto test/system_test.py
"""
}
}
Expand Down
32 changes: 0 additions & 32 deletions repos/c2sm/packages/cosmo-eccodes-definitions/package.py
Original file line number Diff line number Diff line change
@@ -1,25 +1,3 @@
# Copyright 2013-2020 Lawrence Livermore National Security, LLC and other
# Spack Project Developers. See the top-level COPYRIGHT file for details.
#
# SPDX-License-Identifier: (Apache-2.0 OR MIT)

# ----------------------------------------------------------------------------
# If you submit this package back to Spack as a pull request,
# please first remove this boilerplate and all FIXME comments.
#
# This is a template package file for Spack. We've put "FIXME"
# next to all the things you'll want to change. Once you've handled
# them, you can save this file and test your package like this:
#
# spack install cosmo-eccodes-definitions
#
# You can edit this file again by typing:
#
# spack edit cosmo-eccodes-definitions
#
# See the Spack documentation for more information on packaging.
# ----------------------------------------------------------------------------

from spack import *


Expand All @@ -35,22 +13,12 @@ class CosmoEccodesDefinitions(Package):
version('2.25.0.3', tag='v2.25.0.3')
version('2.25.0.2', tag='v2.25.0.2')
version('2.25.0.1', tag='v2.25.0.1')
version('2.19.0.7', tag='v2.19.0.7')
version('2.19.0.6', tag='v2.19.0.6')
version('2.19.0.5', tag='v2.19.0.5')
version('2.19.0.4', tag='v2.19.0.4')
version('2.19.0.3', tag='v2.19.0.3')
version('2.19.0.2', tag='v2.19.0.2')
version('2.19.0.1', tag='v2.19.0.1')
version('2.18.0.1', tag='v2.18.0.1')

depends_on('eccodes')
depends_on('[email protected]',
type=('build', 'link', 'run'),
when='@2.25.0.1:')
depends_on('[email protected]',
type=('build', 'link', 'run'),
when='@2.19.0.1:2.19.0.7')
depends_on('[email protected]',
type=('build', 'link', 'run'),
when='@2.18.0.1')
Expand Down
Loading
Loading