fix(tableau): retry on InternalServerError 504

[sgomezvillamor]

Retries on the following case

Internal error 504 at https://prod-useast-a.online.tableau.com/api/metadata/graphql
b''
Traceback (most recent call last):
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/run/pipeline.py", line 465, in run
    for wu in itertools.islice(
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/source/state/stale_entity_removal_handler.py", line 72, in auto_stale_entity_removal
    for wu in stream:
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/api/auto_work_units/auto_dataset_properties_aspect.py", line 62, in auto_patch_last_modified
    for wu in stream:
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/api/source_helpers.py", line 149, in auto_workunit_reporter
    for wu in stream:
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/api/source_helpers.py", line 253, in auto_browse_path_v2
    for urn, batch in _batch_workunits_by_urn(stream):
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/api/source_helpers.py", line 512, in _batch_workunits_by_urn
    for wu in stream:
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/api/source_helpers.py", line 416, in auto_fix_empty_field_paths
    for wu in stream:
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/api/source_helpers.py", line 368, in auto_fix_duplicate_schema_field_paths
    for wu in stream:
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/api/source_helpers.py", line 172, in auto_materialize_referenced_tags_terms
    for wu in stream:
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/api/source_helpers.py", line 104, in auto_status_aspect
    for wu in stream:
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/source/tableau/tableau.py", line 798, in get_workunits_internal
    yield from site_source.ingest_tableau_site()
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/source/tableau/tableau.py", line 3437, in ingest_tableau_site
    yield from self.emit_embedded_datasources()
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/source/tableau/tableau.py", line 3250, in emit_embedded_datasources
    datasource = self.update_datasource_for_field_upstream(
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/source/tableau/tableau.py", line 2538, in update_datasource_for_field_upstream
    for field_upstream in self.get_connection_objects(
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/source/tableau/tableau.py", line 1342, in get_connection_objects
    ) = self.get_connection_object_page(
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/source/tableau/tableau.py", line 1173, in get_connection_object_page
    query_data = query_metadata_cursor_based_pagination(
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/datahub/ingestion/source/tableau/tableau_common.py", line 959, in query_metadata_cursor_based_pagination
    result = server.metadata.query(
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/tableauserverclient/server/endpoint/endpoint.py", line 274, in wrapper
    return func(self, *args, **kwargs)
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/tableauserverclient/server/endpoint/metadata_endpoint.py", line 71, in query
    server_response = self.post_request(url, graphql_query, content_type="application/json", parameters=parameters)
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/tableauserverclient/server/endpoint/endpoint.py", line 226, in post_request
    return self._make_request(
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/tableauserverclient/server/endpoint/endpoint.py", line 141, in _make_request
    self._check_status(server_response, url)
  File "/tmp/datahub/ingest/venv-tableau-ab9d9cb03b44c5de/lib/python3.10/site-packages/tableauserverclient/server/endpoint/endpoint.py", line 159, in _check_status
    raise InternalServerError(server_response, url)
tableauserverclient.server.endpoint.exceptions.InternalServerError: 

Internal error 504 at https://prod-useast-a.online.tableau.com/api/metadata/graphql
b''

Checklist

• The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
• Links to related issues (if applicable)
• Tests for the changes have been added/updated (if applicable)
• Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
• For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

[hsheth2]

Approving to unblock

[hsheth2]

do we need an else: raise

[sgomezvillamor]

indeed

[hsheth2]

not a huge fan of this entire method - it feels way more complicated than it needs to be and has a ton of mostly duplicated code

[sgomezvillamor]

I agree
If this works, we should invest some time on a refactor.