Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not able to query iceberg using duckdb extension for hdfs warehouse #56

Open
UtkarshSharma2612 opened this issue Jun 18, 2024 · 0 comments

Comments

@UtkarshSharma2612
Copy link

We have tables with hadoop and jdbc-catalog saved in hdfs file systems. When query the data by directly giving metadata.json file it throws no such file directory exist IO Error: Cannot open file "hdfs:///warehouse/user_journey_analytics/engagement_analytics/metadata/00065-83cdaa3e-0d01-40e2-acd4-431f560f0aab.metadata.json": No such file or directory. This is my query for the table with jdbc-catalog SELECT count(*) FROM iceberg_scan('hdfs:///warehouse/user_journey_analytics/engagement_analytics/metadata/00065-83cdaa3e-0d01-40e2-acd4-431f560f0aab.metadata.json'); and hadoop catalog with SELECT count(*) FROM iceberg_scan('hdfs:///warehouse/broadcast/aggregated_analytics/metadata/v20.metadata.json'); I installed duckdb on hadoop box to avoid network call and directly query the table that is why /// are present in the query

@UtkarshSharma2612 UtkarshSharma2612 changed the title Not able to iceberg using duckdb extension for hdfs warehouse Not able to query iceberg using duckdb extension for hdfs warehouse Jun 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant