Skip to content

Commit

Permalink
Updates Spark version for cache
Browse files Browse the repository at this point in the history
  • Loading branch information
edgararuiz committed Sep 17, 2024
1 parent 6ea4aab commit aa1b3be
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 4 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/spark-tests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ jobs:
fail-fast: false
matrix:
config:
- {spark: '3.5.1', pyspark: '3.5', hadoop: '3', name: 'PySpark 3.5'}
- {spark: '3.5.2', pyspark: '3.5', hadoop: '3', name: 'PySpark 3.5'}

env:
GITHUB_PAT: ${{ secrets.GITHUB_TOKEN }}
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/test-coverage.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -40,14 +40,14 @@ jobs:
id: cache-spark-2
uses: actions/cache@v2
with:
path: /home/runner/spark/spark-3.5.0-bin-hadoop3
key: sparklyr-spark-3.5.0-bin-hadoop3-2
path: /home/runner/spark/spark-3.5.2-bin-hadoop3
key: sparklyr-spark-3.5.2-bin-hadoop3-2

- name: Install Spark (via sparklyr)
if: steps.cache-spark.outputs.cache-2-hit != 'true'
run: |
devtools::install_github("sparklyr/sparklyr")
sparklyr::spark_install(version = "3.5.0")
sparklyr::spark_install(version = "3.5")
shell: Rscript {0}

- name: Cache Scala
Expand Down

0 comments on commit aa1b3be

Please sign in to comment.