Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[infra] Update pyspark java iceberg library to 1.6.0 #1462

Merged

Conversation

kevinjqliu
Copy link
Contributor

@kevinjqliu kevinjqliu commented Dec 21, 2024

Integration test dockerfile is using version 1.6.0

ENV SPARK_VERSION=3.5.3
ENV ICEBERG_SPARK_RUNTIME_VERSION=3.5_2.12
ENV ICEBERG_VERSION=1.6.0

Also fixed tests since apache/iceberg#10122 is fixed in new versions

We should figure out a way to keep this in sync.

@kevinjqliu kevinjqliu changed the title [infra] Update pyspark java iceberb library to 1.6.0 [infra] Update pyspark java iceberg library to 1.6.0 Dec 21, 2024
@kevinjqliu kevinjqliu requested a review from Fokko December 21, 2024 21:13
Copy link
Contributor

@Fokko Fokko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! Thanks for fixing this.

There seems to be an issue with whitespace

@kevinjqliu kevinjqliu merged commit b450c1c into apache:main Dec 22, 2024
7 checks passed
@kevinjqliu kevinjqliu deleted the kevinjqliu/pyspark-java-iceberg-version branch December 22, 2024 20:55
sungwy pushed a commit to sungwy/iceberg-python that referenced this pull request Dec 24, 2024
* update pyspark java iceberb library to 1.6.0

* fix test

* add reminder

* make link
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants