Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error querying delta tables from azure storage. #458

Open
Happycipher opened this issue Oct 7, 2024 · 1 comment
Open

Error querying delta tables from azure storage. #458

Happycipher opened this issue Oct 7, 2024 · 1 comment

Comments

@Happycipher
Copy link
Contributor

  1. Since the support for delta tables is added in duckdb_azure, the implementation now requires the storage account name to be mentioned explicitly while creating the azure secret using service principal. ( Line no.162 of - https://github.com/datacontract/datacontract-cli/blob/main/datacontract/engines/soda/connections/duckdb.py)

  2. Otherwise, it returns [Error: IO Error: Hit DeltaKernel FFI error (from: While trying to read from delta table: 'abfss://.dfs.core.windows.net//<delta_table>/'): Hit error: 8 (ObjectStoreError) with message (Error interacting with object store: Generic MicrosoftAzure error: URL did not match any known pattern for scheme: abfss://.dfs.core.windows.net//<delta_table>/)]

  3. The location present in one's datacontract.yaml should also be changed to just - abfss://container/path/to/table
    image

  4. As resolved in Add support to Delta files stored in ADLS Gen2 duckdb/duckdb-delta#21

@jochenchrist
Copy link
Contributor

We would appreciate a pull request here, should be quite straight-forwared.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants