[sc-2887] GX Crawler

[usefulalgorithm]

🤔 Why?

Great Expectations is a well known data quality assurance tool, we want to get data monitor information from it.

🤓 What?

Implemented basic GX crawler. Currently only Snowflake and Postgres connections have been tested. Pandas datasources and simple csv files are not supported, as we can't link them to actual datasets in an existing data platform.

An ExpectationSuite is mapped to a DataMonitor, so if there's a single failed Expectation in the suite, the monitor will be marked as failed.

🧪 Tested?

Added unit tests.

☑️ Checks

• My PR contains actual code changes, and I have updated the version number in pyproject.toml.

[github-actions]

☂️ Python Coverage

current status: ✅

Overall Coverage

Lines	Covered	Coverage	Threshold	Status
13382	11953	89%	85%	🟢

New Files

File	Coverage	Status
metaphor/great_expectations/config.py	100%	🟢
metaphor/great_expectations/extractor.py	89%	🟢
TOTAL	94%	🟢

Modified Files

File	Coverage	Status
metaphor/glue/extractor.py	96%	🟢
TOTAL	96%	🟢

updated for commit: 76f4a61 by action🐍

[codecov]

Codecov Report

Attention: Patch coverage is 90.09901% with 10 lines in your changes missing coverage. Please review.

Please upload report for BASE (main@955ff89). Learn more about missing BASE report.
Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
metaphor/great_expectations/extractor.py	88.88%	10 Missing ⚠️

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #1025   +/-   ##
=======================================
  Coverage        ?   89.32%           
=======================================
  Files           ?      205           
  Lines           ?    13382           
  Branches        ?        0           
=======================================
  Hits            ?    11953           
  Misses          ?     1429           
  Partials        ?        0           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[elic-eon]

gogo