Skip to content

Commit

Permalink
fix: include parquet hex_id in verify columns, STAC hex_id need to be…
Browse files Browse the repository at this point in the history
… standarized
  • Loading branch information
Gabe-Levin committed Nov 26, 2024
1 parent 2321bf2 commit bcf7098
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion space2stats_api/src/space2stats_ingest/main.py
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,9 @@ def verify_columns(
raise ValueError("The 'hex_id' column is missing from the Parquet file.")

# Verify Parquet columns match the STAC fields
if parquet_columns - {"hex_id"} != stac_fields:
# TODO: Standarize the hex_id in the parquet files/STAC items.
# if parquet_columns - {"hex_id"} != stac_fields:
if parquet_columns != stac_fields:
extra_in_parquet = parquet_columns - stac_fields
extra_in_stac = stac_fields - parquet_columns
raise ValueError(
Expand Down

0 comments on commit bcf7098

Please sign in to comment.