CHANGELOG.md

Change Log

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog and this project adheres to Semantic Versioning.

[v0.4.0] - 2024-12-16

• io: add support for role arn and external id s3 props by @mattheusv in apache#553
• fix: ensure S3 and GCS integ tests are conditionally compiled only when the storage-s3 and storage-gcs features are enabled by @sdd in apache#552
• docs: fix main iceberg example by @jdockerty in apache#554
• io: add support to set assume role session name by @mattheusv in apache#555
• test: refactor datafusion test with memory catalog by @FANNG1 in apache#557
• chore: add clean job in Makefile by @ChinoUkaegbu in apache#561
• docs: Fix build website permission changed by @Xuanwo in apache#564
• Object Cache: caches parsed Manifests and ManifestLists for performance by @sdd in apache#512
• Update the paths by @Fokko in apache#569
• docs: Add links for released crates by @Xuanwo in apache#570
• Python: Use hatch for dependency management by @sungwy in apache#572
• Ensure that RestCatalog passes user config to FileIO by @sdd in apache#476
• Move zlib and unicode licenses to allow by @Fokko in apache#566
• website: Update links for 0.3.0 by @Xuanwo in apache#573
• feat(timestamp_ns): Implement timestamps with nanosecond precision by @Sl1mb0 in apache#542
• fix: correct partition-id to field-id in UnboundPartitionField by @FANNG1 in apache#576
• fix: Update sqlx from 0.8.0 to 0.8.1 by @FANNG1 in apache#584
• chore(deps): Update typed-builder requirement from 0.19 to 0.20 by @dependabot in apache#582
• Expose Transforms to Python Binding by @sungwy in apache#556
• chore(deps): Bump crate-ci/typos from 1.23.6 to 1.24.1 by @dependabot in apache#583
• Table Scan: Add Row Group Skipping by @sdd in apache#558
• chore: bump crate-ci/typos to 1.24.3 by @sdlarsen in apache#598
• feat: SQL Catalog - namespaces by @callum-ryan in apache#534
• feat: Add more fields in FileScanTask by @Xuanwo in apache#609
• chore(deps): Bump crate-ci/typos from 1.24.3 to 1.24.5 by @dependabot in apache#616
• fix: Less Panics for Snapshot timestamps by @c-thiel in apache#614
• feat: partition compatibility by @c-thiel in apache#612
• feat: SortOrder methods should take schema ref if possible by @c-thiel in apache#613
• feat: add client.region by @jdockerty in apache#623
• fix: Correctly calculate highest_field_id in schema by @liurenjie1024 in apache#590
• Feat: Normalize TableMetadata by @c-thiel in apache#611
• refactor(python): Expose transform as a submodule for pyiceberg_core by @Xuanwo in apache#628
• feat: support projection pushdown for datafusion iceberg by @FANNG1 in apache#594
• chore: Bump opendal to 0.50 by @Xuanwo in apache#634
• feat: add Sync to TransformFunction by @xxchan in apache#638
• feat: expose arrow type <-> iceberg type by @xxchan in apache#637
• doc: improve FileIO doc by @xxchan in apache#642
• chore(deps): Bump crate-ci/typos from 1.24.5 to 1.24.6 by @dependabot in apache#640
• Migrate to arrow-* v53 by @sdd in apache#626
• feat: expose remove_all in FileIO by @xxchan in apache#643
• feat (datafusion integration): convert datafusion expr filters to Iceberg Predicate by @a-agmon in apache#588
• feat: Add NamespaceIdent.parent() by @c-thiel in apache#641
• Table Scan: Add Row Selection Filtering by @sdd in apache#565
• fix: compile error due to merge stale PR by @xxchan in apache#646
• scan: change ErrorKind when table dont have spanshots by @mattheusv in apache#608
• fix: avoid to create operator of memory storage every time by @ZENOTME in apache#635
• feat (datafusion): making IcebergTableProvider public to be used without a catalog by @a-agmon in apache#650
• test (datafusion): add test for table provider creation by @a-agmon in apache#651
• fix: page index evaluator min/max args inverted by @sdd in apache#648
• chore: fix typo in FileIO Schemes by @wcy-fdu in apache#653
• fix: TableUpdate Snapshot deserialization for v1 by @c-thiel in apache#656
• feat: Reassign field ids for schema by @c-thiel in apache#615
• feat: add gcp oauth support by @twuebi in apache#654
• fix(arrow): Use new ParquetMetaDataReader instead by @Xuanwo in apache#661
• chore(deps): bump typos crate to 1.25.0 by @matthewwillian in apache#662
• RecordBatchTransformer: Handle schema migration and column re-ordering in table scans by @sdd in apache#602
• docs: installation of the new iceberg_catalog_rest added to the docs by @nishant-sachdeva in apache#355
• feat(datafusion): Support pushdown more datafusion exprs to Iceberg by @FANNG1 in apache#649
• feat: Derive PartialEq for FileScanTask by @Xuanwo in apache#660
• feat: SQL Catalog - Tables by @callum-ryan in apache#610
• ci: Allow install a non-debian-packaged Python package by @Xuanwo in apache#666
• docs: README uses iceberg-rust instead of we by @caicancai in apache#667
• chore(deps): Bump crate-ci/typos from 1.25.0 to 1.26.0 by @dependabot in apache#668
• feat: Add equality delete writer by @Dysprosium0626 in apache#372
• Revert "feat: Add equality delete writer (#372)" by @Xuanwo in apache#672
• ci: Fix CI for bindings python by @Xuanwo in apache#678
• fix: OpenDAL is_exist => exists by @sdd in apache#680
• feat: Expose ManifestEntry status by @zheilbron in apache#681
• feat: allow empty projection in table scan by @sundy-li in apache#677
• chore(deps): Bump crate-ci/typos from 1.26.0 to 1.26.8 by @dependabot in apache#683
• fix: bump parquet minor version by @xxchan in apache#684
• fix(type): fix type promote to ignore field name. by @chenzl25 in apache#685
• feat: implement IcebergTableProviderFactory for datafusion by @yukkit in apache#600
• feat: Safer PartitionSpec & SchemalessPartitionSpec by @c-thiel in apache#645
• chore(deps): Bump crate-ci/typos from 1.26.8 to 1.27.0 by @dependabot in apache#687
• feat: TableMetadata accessors for current ids of Schema, Snapshot and SortOrder by @c-thiel in apache#688
• chore: upgrade to DataFusion 43 by @gruuya in apache#691
• chore(deps): Bump crate-ci/typos from 1.27.0 to 1.27.3 by @dependabot in apache#693
• feat: Expose length of Iterators by @c-thiel in apache#692
• feat: Implement TableRequirement checks by @c-thiel in apache#689
• feat: Add ViewUpdate to catalog by @c-thiel in apache#690
• chore: update .asf.yaml by @c-thiel in apache#701
• datafusion: Create table provider for a snapshot. by @ryzhyk in apache#707
• Add Python Release Action to publish pyiceberg_core dist to Pypi by @sungwy in apache#705
• chore: Mark last-field-id as deprecated by @Fokko in apache#715
• TableMetadataBuilder by @c-thiel in apache#587
• Add fallback attribute to all strip_options. by @ryzhyk in apache#708
• fix: Remove check of last_column_id by @liurenjie1024 in apache#717
• Fix error running data fusion queries - Physical input schema should be the same as the one converted from logical input schema by @FANNG1 in apache#664
• chore: Typo in test :) by @Fokko in apache#727
• Derive Clone for IcebergTableProvider by @SergeiPatiakin in apache#722
• fix: expand arrow to iceberg schema to handle nanosecond timestamp by @jdockerty in apache#710
• feat: Add equality delete writer by @ZENOTME in apache#703
• chore: Bump upload-artifact@v3 to v4 by @sungwy in apache#725
• feat: support append data file and add e2e test by @ZENOTME in apache#349
• chore(deps): Bump actions/setup-python from 4 to 5 by @dependabot in apache#746
• chore: Align argument name with doc comment by @SergeiPatiakin in apache#750
• fix: equality delete writer field id project by @ZENOTME in apache#751
• feat: expose opendal S3 options for anonymous access by @gruuya in apache#757
• fix: current-snapshot-id serialized to -1 in TableMetadata.json by @c-thiel in apache#755
• feat(puffin): Add Puffin crate and CompressionCodec by @fqaiser94 in apache#745
• Build: Delete branch automatically on PR merge by @manuzhang in apache#764
• chore(deps): bump crate-ci/typos from 1.27.3 to 1.28.1 by @jonathanc-n in apache#769
• chore(deps): Bump crate-ci/typos from 1.27.3 to 1.28.2 by @dependabot in apache#767
• Add Spark for integration tests by @Fokko in apache#766
• refine: refine writer interface by @ZENOTME in apache#741
• Clean up docker Docker by @Fokko in apache#770
• name mapping serde by @barronw in apache#740
• docker: The archive seems unstable by @Fokko in apache#773
• doc: add RisingWave to users by @xxchan in apache#775
• feat: Expose disable_config_load opendal S3 option by @gruuya in apache#782
• Support conversion of Arrow Int8 and Int16 to Iceberg Int by @gruuya in apache#787
• infra: Dismiss stale reviews by @liurenjie1024 in apache#779
• fix: return type for year and month transform should be int by @xxchan in apache#776
• feat: Allow for schema evolution by @Fokko in apache#786
• Retry object store reads on temporary errors. by @ryzhyk in apache#788
• refactor(puffin): Move puffin crate contents inside iceberg crate by @fqaiser94 in apache#789
• feat: Implement Decimal from/to bytes represents by @Xuanwo in apache#665
• feat: eagerly project the arrow schema to scope out non-selected fields by @gruuya in apache#785
• fix: wrong compute of partitions in manifest by @ZENOTME in apache#794
• fix: set key_metadata to Null by default by @feniljain in apache#800
• test: append partition data file by @feniljain in apache#742
• chore: Add more debug message inside error by @Xuanwo in apache#793
• fix: Error source from cache has been shadowed by @Xuanwo in apache#792
• fix(catalog/rest): Ensure token been reused correctly by @Xuanwo in apache#801
• feat!: Remove BoundPartitionSpec by @c-thiel in apache#771
• chore(deps): Bump crate-ci/typos from 1.28.2 to 1.28.3 by @dependabot in apache#805
• feat: add DataFileWriter tests for schema and partition by @jonathanc-n in apache#768
• fix: day transform compute by @ZENOTME in apache#796
• feat: TableMetadata Statistic Files by @c-thiel in apache#799
• Bump pyiceberg_core to 0.4.0 by @sungwy in apache#808
• chore(docs): Update Readme - Lakekeeper repository moved by @c-thiel in apache#810
• Prep 0.4.0 release by @sungwy in apache#809
• feat: Add RemovePartitionSpecs table update by @c-thiel in apache#804
• feat: Store file io props to allow re-build it by @Xuanwo in apache#802
• chore: chmod +x on verify.py script by @sungwy in apache#817
• fix: Reading a table with positional deletes should fail by @Fokko in apache#826

v0.3.0 - 2024-08-14

• Smooth out release steps by @Fokko in apache#197
• refactor: remove support of manifest list format as a list of file path by @Dysprosium0626 in apache#201
• refactor: remove unwraps by @odysa in apache#196
• Fix: add required rust version in cargo.toml by @dp-0 in apache#193
• Fix the REST spec version by @Fokko in apache#198
• feat: Add Sync + Send to Catalog trait by @ZhengLin-Li in apache#202
• feat: Make thrift transport configurable by @DeaconDesperado in apache#194
• Add UnboundSortOrder by @fqaiser94 in apache#115
• ci: Add workflow for publish by @Xuanwo in apache#218
• Add workflow for cargo audit by @sdd in apache#217
• docs: Add basic README for all crates by @Xuanwo in apache#215
• Follow naming convention from Iceberg's Java and Python implementations by @s-akhtar-baig in apache#204
• doc: Add download page by @liurenjie1024 in apache#219
• chore(deps): Update derive_builder requirement from 0.13.0 to 0.20.0 by @dependabot in apache#203
• test: add FileIO s3 test by @odysa in apache#220
• ci: Ignore RUSTSEC-2023-0071 for no actions to take by @Xuanwo in apache#222
• feat: Add expression builder and display. by @liurenjie1024 in apache#169
• chord: Add IssueNavigationLink for RustRover by @stream2000 in apache#230
• minor: Fix double API doc by @viirya in apache#226
• feat: add UnboundPredicate::negate() by @sdd in apache#228
• fix: Remove deprecated methods to pass ci by @liurenjie1024 in apache#234
• Implement basic Parquet data file reading capability by @sdd in apache#207
• chore: doc-test as a target by @liurenjie1024 in apache#235
• feat: add parquet writer by @ZENOTME in apache#176
• Add hive metastore catalog support (part 1/2) by @marvinlanhenke in apache#237
• chore: Enable projects. by @liurenjie1024 in apache#247
• refactor: Make plan_files as asynchronous stream by @viirya in apache#243
• feat: Implement binding expression by @liurenjie1024 in apache#231
• Implement Display instead of ToString by @lewiszlw in apache#256
• add rewrite_not by @marvinlanhenke in apache#263
• feat: init TableMetadataBuilder by @ZENOTME in apache#262
• Rename stat_table to table_exists in Catalog trait by @lewiszlw in apache#257
• feat (static table): implement a read-only table struct loaded from metadata by @a-agmon in apache#259
• feat: implement OAuth for catalog rest client by @TennyZhuang in apache#254
• docs: annotate precision and length to primitive types by @waynexia in apache#270
• build: Restore CI by making parquet and arrow version consistent by @viirya in apache#280
• Metadata Serde + default partition_specs and sort_orders by @marvinlanhenke in apache#272
• feat: make optional oauth param configurable by @himadripal in apache#278
• fix: enable public access to ManifestEntry properties by @a-agmon in apache#284
• feat: Implement the conversion from Arrow Schema to Iceberg Schema by @viirya in apache#258
• Rename function name to add_manifests by @viirya in apache#293
• Modify Bind calls so that they don't consume self and instead return a new struct, leaving the original unmoved by @sdd in apache#290
• Add hive metastore catalog support (part 2/2) by @marvinlanhenke in apache#285
• feat: implement prune column for schema by @Dysprosium0626 in apache#261
• chore(deps): Update reqwest requirement from ^0.11 to ^0.12 by @dependabot in apache#296
• Glue Catalog: Basic Setup + Test Infra (1/3) by @marvinlanhenke in apache#294
• feat: rest client respect prefix prop by @TennyZhuang in apache#297
• fix: HMS Catalog missing properties fn create_namespace by @marvinlanhenke in apache#303
• fix: renaming FileScanTask.data_file to data_manifest_entry by @a-agmon in apache#300
• feat: Make OAuth token server configurable by @whynick1 in apache#305
• feat: Glue Catalog - namespace operations (2/3) by @marvinlanhenke in apache#304
• feat: add transform_literal by @ZENOTME in apache#287
• feat: Complete predicate builders for all operators. by @QuakeWang in apache#276
• feat: Support customized header in Rest catalog client by @whynick1 in apache#306
• fix: chrono dep by @odysa in apache#274
• feat: Read Parquet data file with projection by @viirya in apache#245
• Fix day timestamp micro by @marvinlanhenke in apache#312
• feat: support uri redirect in rest client by @TennyZhuang in apache#310
• refine: separate parquet reader and arrow convert by @ZENOTME in apache#313
• chore: upgrade to rust-version 1.77.1 by @marvinlanhenke in apache#316
• Support identifier warehouses by @Fokko in apache#308
• feat: Project transform by @marvinlanhenke in apache#309
• Add Struct Accessors to BoundReferences by @sdd in apache#317
• Use str args rather than String in transform to avoid needing to clone strings by @sdd in apache#325
• chore(deps): Update pilota requirement from 0.10.0 to 0.11.0 by @dependabot in apache#327
• chore(deps): Bump peaceiris/actions-mdbook from 1 to 2 by @dependabot in apache#332
• chore(deps): Bump peaceiris/actions-gh-pages from 3.9.3 to 4.0.0 by @dependabot in apache#333
• chore(deps): Bump apache/skywalking-eyes from 0.5.0 to 0.6.0 by @dependabot in apache#328
• Add BoundPredicateVisitor (alternate version) by @sdd in apache#334
• add InclusiveProjection Visitor by @sdd in apache#335
• feat: Implement the conversion from Iceberg Schema to Arrow Schema by @ZENOTME in apache#277
• Simplify expression when doing {and,or} operations by @Fokko in apache#339
• feat: Glue Catalog - table operations (3/3) by @marvinlanhenke in apache#314
• chore: update roadmap by @marvinlanhenke in apache#336
• Add ManifestEvaluator, used to filter manifests in table scans by @sdd in apache#322
• feat: init iceberg writer by @ZENOTME in apache#275
• Implement manifest filtering in TableScan by @sdd in apache#323
• Refactor: Extract partition_filters from ManifestEvaluator by @marvinlanhenke in apache#360
• Basic Integration with Datafusion by @marvinlanhenke in apache#324
• refactor: cache partition_schema in fn plan_files() by @marvinlanhenke in apache#362
• fix (manifest-list): added serde aliases to support both forms conventions by @a-agmon in apache#365
• feat: Extract FileRead and FileWrite trait by @Xuanwo in apache#364
• feat: Convert predicate to arrow filter and push down to parquet reader by @viirya in apache#295
• chore(deps): Update datafusion requirement from 37.0.0 to 38.0.0 by @dependabot in apache#369
• chore(deps): Update itertools requirement from 0.12 to 0.13 by @dependabot in apache#376
• Add InclusiveMetricsEvaluator by @sdd in apache#347
• Rename V2 spec names by @gupteaj in apache#380
• feat: make file scan task serializable by @ZENOTME in apache#377
• Feature: Schema into_builder method by @c-thiel in apache#381
• replaced i32 in TableUpdate::SetDefaultSortOrder to i64 by @rwwwx in apache#387
• fix: make PrimitiveLiteral and Literal not be Ord by @ZENOTME in apache#386
• docs(writer/docker): fix small typos and wording by @jdockerty in apache#389
• feat: StructAccessor.get returns Result<Option<Datum>> instead of Result<Datum> by @sdd in apache#390
• feat: add ExpressionEvaluator by @marvinlanhenke in apache#363
• Derive Clone for TableUpdate by @c-thiel in apache#402
• Add accessor for Schema identifier_field_ids by @c-thiel in apache#388
• deps: Bump arrow related crates to 52 by @Dysprosium0626 in apache#403
• SnapshotRetention::Tag max_ref_age_ms should be optional by @c-thiel in apache#391
• feat: Add storage features for iceberg by @Xuanwo in apache#400
• Implement BoundPredicateVisitor trait for ManifestFilterVisitor by @s-akhtar-baig in apache#367
• Add missing arrow predicate pushdown implementations for StartsWith, NotStartsWith, In, and NotIn by @sdd in apache#404
• feat: make BoundPredicate,Datum serializable by @ZENOTME in apache#406
• refactor: Upgrade hive_metastore to 0.1 by @Xuanwo in apache#409
• fix: Remove duplicate filter by @liurenjie1024 in apache#414
• Enhancement: refine the reader interface by @ZENOTME in apache#401
• refactor(catalog/rest): Split http client logic to separate mod by @Xuanwo in apache#423
• Remove #[allow(dead_code)] from the codebase by @vivek378521 in apache#421
• ci: use official typos github action by @shoothzj in apache#426
• feat: support lower_bound&&upper_bound for parquet writer by @ZENOTME in apache#383
• refactor: Implement ArrowAsyncFileWriter directly to remove tokio by @Xuanwo in apache#427
• chore: Don't enable reqwest default features by @Xuanwo in apache#432
• refactor(catalogs/rest): Split user config and runtime config by @Xuanwo in apache#431
• feat: runtime module by @odysa in apache#233
• fix: Fix namespace identifier in url by @liurenjie1024 in apache#435
• refactor(io): Split io into smaller mods by @Xuanwo in apache#438
• chore: Use once_cell to replace lazy_static by @Xuanwo in apache#443
• fix: Fix build while no-default-features enabled by @Xuanwo in apache#442
• chore(deps): Bump crate-ci/typos from 1.22.9 to 1.23.1 by @dependabot in apache#447
• docs: Refactor the README to be more user-oriented by @Xuanwo in apache#444
• feat: Add cargo machete by @vaibhawvipul in apache#448
• chore: Use nightly toolchain for check by @liurenjie1024 in apache#445
• reuse docker container to save compute resources by @thexiay in apache#428
• feat: Add macos runner for ci by @QuakeWang in apache#441
• chore: remove compose obsolete version (#452) by @yinheli in apache#454
• Refactor file_io_s3_test.rs by @fqaiser94 in apache#455
• chore(deps): Bump crate-ci/typos from 1.23.1 to 1.23.2 by @dependabot in apache#457
• refine: move binary serialize in literal to datum by @ZENOTME in apache#456
• fix: Hms test on macos should use correct arch by @liurenjie1024 in apache#461
• Fix ManifestFile length calculation by @nooberfsh in apache#466
• chore(deps): Update typed-builder requirement from ^0.18 to ^0.19 by @dependabot in apache#473
• fix: use avro fixed to represent decimal by @xxchan in apache#472
• feat(catalog!): Deprecate rest.authorization-url in favor of oauth2-server-uri by @ndrluis in apache#480
• Alter Transform::Day to map partition types to Date rather than Int for consistency with reference implementation by @sdd in apache#479
• feat(iceberg): Add memory file IO support by @Xuanwo in apache#481
• Add memory catalog implementation by @fqaiser94 in apache#475
• chore: Enable new rust code format settings by @Xuanwo in apache#483
• docs: Generate rust API docs by @Xuanwo in apache#486
• chore: Fix format of recent PRs by @Xuanwo in apache#487
• Rename folder to memory by @fqaiser94 in apache#490
• chore(deps): Bump crate-ci/typos from 1.23.2 to 1.23.5 by @dependabot in apache#493
• View Spec implementation by @c-thiel in apache#331
• fix: Return error on reader task by @ndrluis in apache#498
• chore: Bump OpenDAL to 0.48 by @Xuanwo in apache#500
• feat: add check compatible func for primitive type by @ZENOTME in apache#492
• refactor(iceberg): Remove an extra config parse logic by @Xuanwo in apache#499
• feat: permit Datum Date<->Int type conversion by @sdd in apache#496
• Add additional S3 FileIO Attributes by @c-thiel in apache#505
• docs: Add links to dev docs by @Xuanwo in apache#508
• chore: Remove typo in README by @Xuanwo in apache#509
• feat: podman support by @alexyin1 in apache#489
• feat(table): Add debug and clone trait to static table struct by @ndrluis in apache#510
• Use namespace location or warehouse location if table location is missing by @fqaiser94 in apache#511
• chore(deps): Bump crate-ci/typos from 1.23.5 to 1.23.6 by @dependabot in apache#521
• Concurrent table scans by @sdd in apache#373
• refactor: replace num_cpus with thread::available_parallelism by @SteveLauC in apache#526
• Fix: MappedLocalTime should not be exposed by @c-thiel in apache#529
• feat: Establish subproject pyiceberg_core by @Xuanwo in apache#518
• fix: complete miss attribute for map && list in avro schema by @ZENOTME in apache#411
• arrow/schema.rs: refactor tests by @AndreMouche in apache#531
• feat: initialise SQL Catalog by @callum-ryan in apache#524
• chore(deps): Bump actions/setup-python from 4 to 5 by @dependabot in apache#536
• feat(storage): support aws session token by @twuebi in apache#530
• Simplify PrimitiveLiteral by @ZENOTME in apache#502
• chore: bump opendal to 0.49 by @jdockerty in apache#540
• feat: support timestamp columns in row filters by @sdd in apache#533
• fix: don't silently drop errors encountered in table scan file planning by @sdd in apache#535
• chore(deps): Update sqlx requirement from 0.7.4 to 0.8.0 by @dependabot in apache#537
• Fix main branch building break by @liurenjie1024 in apache#541
• feat: support for gcs storage by @jdockerty in apache#520
• feat: Allow FileIO to reuse http client by @Xuanwo in apache#544
• docs: Add an example to scan an iceberg table by @Xuanwo in apache#545
• Concurrent data file fetching and parallel RecordBatch processing by @sdd in apache#515
• doc: Add statement for contributors to avoid force push as much as possible by @liurenjie1024 in apache#546
• feat: Partition Binding and safe PartitionSpecBuilder by @c-thiel in apache#491

v0.2.0 - 2024-02-20

• chore: Setup project layout by @Xuanwo in apache#1
• ci: Fix version for apache/skywalking-eyes/header by @Xuanwo in apache#4
• feat: Implement serialize/deserialize for datatypes by @JanKaul in apache#6
• docs: Add CONTRIBUTING and finish project setup by @Xuanwo in apache#7
• feat: Add lookup tables to StructType by @JanKaul in apache#12
• feat: Implement error handling by @Xuanwo in apache#13
• chore: Use HashMap instead of BTreeMap for storing fields by id in StructType by @amogh-jahagirdar in apache#14
• chore: Change iceberg into workspace by @Xuanwo in apache#15
• feat: Use macro to define from error. by @liurenjie1024 in apache#17
• feat: Introduce schema definition. by @liurenjie1024 in apache#19
• refactor: Align data type with other implementation. by @liurenjie1024 in apache#21
• chore: Ignore .idea by @liurenjie1024 in apache#27
• feat: Implement Iceberg values by @JanKaul in apache#20
• feat: Define schema post order visitor. by @liurenjie1024 in apache#25
• feat: Add transform by @liurenjie1024 in apache#26
• fix: Fix build break in main branch by @liurenjie1024 in apache#30
• fix: Update github configuration to avoid conflicting merge by @liurenjie1024 in apache#31
• chore(deps): Bump apache/skywalking-eyes from 0.4.0 to 0.5.0 by @dependabot in apache#35
• feat: Table metadata by @JanKaul in apache#29
• feat: Add utility methods to help conversion between literals. by @liurenjie1024 in apache#38
• [comment] should be IEEE 754 rather than 753 by @zhjwpku in apache#39
• fix: Add doc test action by @liurenjie1024 in apache#44
• chore: Ping toolchain version by @liurenjie1024 in apache#48
• feat: Introduce conversion between iceberg schema and avro schema by @liurenjie1024 in apache#40
• feat: Allow Schema Serialization/deserialization by @y0psolo in apache#46
• chore: Add cargo sort check by @liurenjie1024 in apache#51
• chore(deps): Bump actions/checkout from 3 to 4 by @dependabot in apache#58
• Metadata integration tests by @JanKaul in apache#57
• feat: Introduce FileIO by @liurenjie1024 in apache#53
• feat: Add Catalog API by @Xuanwo in apache#54
• feat: support transform function by @ZENOTME in apache#42
• chore(deps): Update ordered-float requirement from 3.7.0 to 4.0.0 by @dependabot in apache#64
• feat: Add public methods for catalog related structs by @Xuanwo in apache#63
• minor: Upgrade to latest toolchain by @liurenjie1024 in apache#68
• chore(deps): Update opendal requirement from 0.39 to 0.40 by @dependabot in apache#65
• refactor: Make directory for catalog by @liurenjie1024 in apache#69
• feat: support read Manifest List by @ZENOTME in apache#56
• chore(deps): Update apache-avro requirement from 0.15 to 0.16 by @dependabot in apache#71
• fix: avro bytes test for Literal by @JanKaul in apache#80
• chore(deps): Update opendal requirement from 0.40 to 0.41 by @dependabot in apache#84
• feat: manifest list writer by @barronw in apache#76
• feat: First version of rest catalog. by @liurenjie1024 in apache#78
• chore(deps): Update typed-builder requirement from ^0.17 to ^0.18 by @dependabot in apache#87
• feat: Implement load table api. by @liurenjie1024 in apache#89
• chroes:Manage dependencies using workspace. by @my-vegetable-has-exploded in apache#93
• minor: Provide Debug impl for pub structs #73 by @DeaconDesperado in apache#92
• feat: support ser/deser of value by @ZENOTME in apache#82
• fix: Migrate from tempdir to tempfile crate by @cdaudt in apache#91
• chore(deps): Update opendal requirement from 0.41 to 0.42 by @dependabot in apache#101
• chore(deps): Update itertools requirement from 0.11 to 0.12 by @dependabot in apache#102
• Replace i64 with DateTime by @fqaiser94 in apache#94
• feat: Implement create table and update table api for rest catalog. by @liurenjie1024 in apache#97
• Fix compile failures by @fqaiser94 in apache#105
• feat: replace 'Builder' with 'TypedBuilder' for 'Snapshot' by @xiaoyang-sde in apache#110
• chore: Upgrade uuid manually and remove pinned version by @liurenjie1024 in apache#108
• chore: Add cargo build and build guide by @manuzhang in apache#111
• feat: Add hms catalog layout by @Xuanwo in apache#112
• feat: support UnboundPartitionSpec by @my-vegetable-has-exploded in apache#106
• test: Add integration tests for rest catalog. by @liurenjie1024 in apache#109
• chore(deps): Update opendal requirement from 0.42 to 0.43 by @dependabot in apache#116
• feat: support read/write Manifest by @ZENOTME in apache#79
• test: Remove binary manifest list avro file by @liurenjie1024 in apache#118
• refactor: Conversion between literal and json should depends on type. by @liurenjie1024 in apache#120
• fix: fix parse partitions in manifest_list by @ZENOTME in apache#122
• feat: Add website layout by @Xuanwo in apache#130
• feat: Expression system. by @liurenjie1024 in apache#132
• website: Fix typo in book.toml by @Xuanwo in apache#136
• Set ghp_{pages,path} properties by @Fokko in apache#138
• chore: Upgrade toolchain to 1.75.0 by @liurenjie1024 in apache#140
• feat: Add roadmap and features status in README.md by @liurenjie1024 in apache#134
• Remove publish: section from .asf.yaml by @Fokko in apache#141
• chore(deps): Bump peaceiris/actions-gh-pages from 3.9.2 to 3.9.3 by @dependabot in apache#143
• chore(deps): Update opendal requirement from 0.43 to 0.44 by @dependabot in apache#142
• docs: Change homepage to rust.i.a.o by @Xuanwo in apache#146
• feat: Introduce basic file scan planning. by @liurenjie1024 in apache#129
• chore: Update contributing guide. by @liurenjie1024 in apache#163
• chore: Update reader api status by @liurenjie1024 in apache#162
• #154 : Add homepage to Cargo.toml by @hiirrxnn in apache#160
• Add formatting for toml files by @Tyler-Sch in apache#167
• chore(deps): Update env_logger requirement from 0.10.0 to 0.11.0 by @dependabot in apache#170
• feat: init file writer interface by @ZENOTME in apache#168
• fix: Manifest parsing should consider schema evolution. by @liurenjie1024 in apache#171
• docs: Add release guide for iceberg-rust by @Xuanwo in apache#147
• fix: Ignore negative statistics value by @liurenjie1024 in apache#173
• feat: Add user guide for website. by @liurenjie1024 in apache#178
• chore(deps): Update derive_builder requirement from 0.12.0 to 0.13.0 by @dependabot in apache#175
• refactor: Replace unwrap by @odysa in apache#183
• feat: add handwritten serialize by @odysa in apache#185
• Fix: avro schema names for manifest and manifest_list by @JanKaul in apache#182
• feat: Bump hive_metastore to use pure rust thrift impl volo by @Xuanwo in apache#174
• feat: Bump version 0.2.0 to prepare for release. by @liurenjie1024 in apache#181
• fix: default_partition_spec using the partition_spec_id set by @odysa in apache#190
• Docs: Add required Cargo version to install guide by @manuzhang in apache#191
• chore(deps): Update opendal requirement from 0.44 to 0.45 by @dependabot in apache#195