[sc-29547] Deprecate BQ lineage crawler and a lot of refactor

[usefulalgorithm]

🤔 Why?

We want to deprecate BQ lineage crawler.

🤓 What?

• Removed implementation in BQ lineage crawler, and move the logic into main BQ crawler.
• Moved a bunch of code in main BQ crawler into separate files.

🧪 Tested?

• Run crawler against our stage configuration.
• Updated unit tests.

☑️ Checks

• My PR contains actual code changes, and I have updated the version number in pyproject.toml.

[github-actions]

☂️ Python Coverage

current status: ✅

Overall Coverage

Lines	Covered	Coverage	Threshold	Status
13422	12013	90%	85%	🟢

New Files

File	Coverage	Status
metaphor/bigquery/log_filter.py	100%	🟢
metaphor/bigquery/log_type.py	86%	🟢
metaphor/bigquery/queries.py	100%	🟢
metaphor/bigquery/schema_field.py	96%	🟢
metaphor/bigquery/table.py	96%	🟢
TOTAL	96%	🟢

Modified Files

File	Coverage	Status
metaphor/bigquery/config.py	100%	🟢
metaphor/bigquery/extractor.py	82%	🟢
metaphor/bigquery/lineage/extractor.py	79%	🟢
metaphor/bigquery/profile/extractor.py	61%	🟢
TOTAL	80%	🟢

updated for commit: 30d753f by action🐍

[codecov]

Codecov Report

Attention: Patch coverage is 90.08621% with 23 lines in your changes missing coverage. Please review.

Project coverage is 89.50%. Comparing base (02f7f98) to head (30d753f).
Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
metaphor/bigquery/extractor.py	86.81%	12 Missing ⚠️
metaphor/bigquery/job_change_event.py	90.56%	5 Missing ⚠️
metaphor/bigquery/lineage/extractor.py	60.00%	2 Missing ⚠️
metaphor/bigquery/log_type.py	85.71%	1 Missing ⚠️
metaphor/bigquery/profile/extractor.py	50.00%	1 Missing ⚠️
metaphor/bigquery/schema_field.py	96.15%	1 Missing ⚠️
metaphor/bigquery/table.py	95.65%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1038      +/-   ##
==========================================
+ Coverage   89.29%   89.50%   +0.20%     
==========================================
  Files         206      211       +5     
  Lines       13440    13422      -18     
==========================================
+ Hits        12001    12013      +12     
+ Misses       1439     1409      -30     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[mars-lan]

Does this include the rate limit change (#1032)?

[usefulalgorithm]

It does

[mars-lan]

Thanks for refactoring!