Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade Hadoop 3.4.0 #111

Open
pan3793 opened this issue Oct 18, 2024 · 0 comments
Open

Upgrade Hadoop 3.4.0 #111

pan3793 opened this issue Oct 18, 2024 · 0 comments

Comments

@pan3793
Copy link
Member

pan3793 commented Oct 18, 2024

  • Hadoop 3.4.1 seems does not have aarch64 binary tarball, while 3.4.0 does
  • HADOOP-18073 - Hadoop 3.4 switched to AWS SDK v2
  • SPARK-45393 - Spark 4.0 switched to Hadoop 3.4, also AWS SDK v2

For components that ship Hadoop client jars, e.g. Kyuubi, Spark, we should keep the AWS SDK jar version aligned with them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant