Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix snowflake loading error on duplicate column names #1347

Merged
merged 3 commits into from
Jun 12, 2024
Merged

Fix snowflake loading error on duplicate column names #1347

merged 3 commits into from
Jun 12, 2024

Commits on Jun 12, 2024

  1. Fix snowflake loading error on duplicate column names 

    We got a report of an error like:

> Load failed and will not be retried: SQL compilation error: duplicate column name 'UNSTRUCT_EVENT_COM_REDACTED_REDACTED_1' = SqlState: 42S21

I think it happens when the batch contains two minor versions of the
same major version of a schema.
    @istreeter @colmsnowplow
    istreeter authored and colmsnowplow committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    3faac51 View commit details
    Browse the repository at this point in the history

  2. Bump sbt-snowplow-release 

    An issue in Docker dependency of previous version of sbt-snowplow-release blocks builds - bumping to fix.
    @colmsnowplow
    colmsnowplow committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    3db5cfb View commit details
    Browse the repository at this point in the history

  3. Extend timeout for BaseProcessingSpec 

    BaseProcessingSpec has a test that times out quite frequently.

The timeout period seems relatively arbitrary so simply extending it to avoid the need to keep re-running.
    @colmsnowplow
    colmsnowplow committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    8427c45 View commit details
    Browse the repository at this point in the history