Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[sc-28750] Set ignore_command_statement default to False #984

Conversation

usefulalgorithm
Copy link
Contributor

@usefulalgorithm usefulalgorithm commented Sep 18, 2024

🤔 Why?

ignore_command_statement was defaulted to True, which made all crawlers that parses SQL queries in all environments started processing queries.

Instead of doing it by default, our users should explicitly opt-in to query processing.

The actual SQL query that could not be parsed by sqlglot is tracked in a separate ticket

🤓 What?

  • Set ignore_command_statement default to False
  • Modified unit test
  • Updated readme

🧪 Tested?

Modified unit test.

☑️ Checks

  • My PR contains actual code changes, and I have updated the version number in pyproject.toml.

Copy link

☂️ Python Coverage

current status: ✅

Overall Coverage

Lines Covered Coverage Threshold Status
11961 10652 89% 85% 🟢

New Files

No new covered files...

Modified Files

File Coverage Status
metaphor/common/sql/process_query/config.py 100% 🟢
metaphor/postgresql/config.py 100% 🟢
TOTAL 100% 🟢

updated for commit: 052d15a by action🐍

Copy link
Contributor

@elic-eon elic-eon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So, only Postgres and Redshift will set this config true by default?

metaphor/postgresql/config.py Show resolved Hide resolved
Copy link
Contributor

@elic-eon elic-eon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Gogogo

@usefulalgorithm usefulalgorithm merged commit a036ba5 into main Sep 18, 2024
4 checks passed
@usefulalgorithm usefulalgorithm deleted the tsung-julii/sc-28750/metaphor-crawler-big-query-integrations-error branch September 18, 2024 18:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants