You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Support a table transaction where the user can directly supply the file metadata, similar to the Java Interface.
This is a lower-level operation than what is covered add_files operation and it covers several additional use-cases. For example:
Implicit Partitioning: Iceberg does not require that partition values actually be stored in the actual parquet files. And in some cases, it may be useful to define a partiion value of a parquet file after it has been written (or to intentionally exclude to e.g. minimize storage). However, add_files does not currently support an option.
Pre-calculated statistics: Calculating parquet statistics (e.g. column bounds) can be a somewhat resource intensive operations. If this has been pre-calculated by the user, it would be faster to update the manifest file directly.
The text was updated successfully, but these errors were encountered:
Feature Request / Improvement
Support a table transaction where the user can directly supply the file metadata, similar to the Java Interface.
This is a lower-level operation than what is covered
add_files
operation and it covers several additional use-cases. For example:add_files
does not currently support an option.The text was updated successfully, but these errors were encountered: