TEST: adopt new rest catalog image and enable tableExists tests

[sungwy]

NOTE: the test is failing because tableExists endpoint isn't exposed on the adapter. Related fix: apache/iceberg#11678

[Fokko]

The image is published, including the fix around the tableExists, so 🤞

[Fokko]

Hmm, still an issue with the tableExists:

    @pytest.mark.integration
    def test_table_v1_with_null_nested_namespace(session_catalog: Catalog, arrow_table_with_null: pa.Table) -> None:
        identifier = "default.lower.table_v1_with_null_nested_namespace"
        tbl = _create_table(session_catalog, identifier, {"format-version": "1"}, [arrow_table_with_null])
        assert tbl.format_version == 1, f"Expected v1, got: v{tbl.format_version}"
    
        assert session_catalog.load_table(identifier) is not None
>       assert session_catalog.table_exists(identifier)
E       AssertionError: assert False
E        +  where False = <bound method RestCatalog.table_exists of local (<class 'pyiceberg.catalog.rest.RestCatalog'>)>('default.lower.table_v1_with_null_nested_namespace')
E        +    where <bound method RestCatalog.table_exists of local (<class 'pyiceberg.catalog.rest.RestCatalog'>)> = local (<class 'pyiceberg.catalog.rest.RestCatalog'>).table_exists

tests/integration/test_writes/test_writes.py:1373: AssertionError
=============================== warnings summary ========================

[sungwy]

:) @Fokko I'm on my way to the office, but will take a look at this in a few minutes

[sungwy]

@Fokko - it looks like the issue is because the rest-fixture is returning a 200 response. I've put in edits to allow PyIceberg to infer a 200 response as being successful.

The proposed solution deviates from the REST Catalog Spec, but this is already the behavior of PyIceberg when handles the success codes of the other endpoints that are also meant to return 204 response:

iceberg-python/pyiceberg/catalog/rest.py

Lines 422 to 448 in df804c4

	def _handle_non_200_response(self, exc: HTTPError, error_handler: Dict[int, Type[Exception]]) -> None:
	exception: Type[Exception]
	if exc.response is None:
	raise ValueError("Did not receive a response")
	code = exc.response.status_code
	if code in error_handler:
	exception = error_handler[code]
	elif code == 400:
	exception = BadRequestError
	elif code == 401:
	exception = UnauthorizedError
	elif code == 403:
	exception = ForbiddenError
	elif code == 422:
	exception = RESTError
	elif code == 419:
	exception = AuthorizationExpiredError
	elif code == 501:
	exception = NotImplementedError
	elif code == 503:
	exception = ServiceUnavailableError
	elif 500 <= code < 600:
	exception = ServerError
	else:
	exception = RESTError

[Fokko]

Thanks for following this up @sungwy. I think it is okay to mark all 2xx responses as table exists. Polaris had a similar issue: #1363

[kevinjqliu]

woot! LGTM

[kevinjqliu]

should we upstream this to the spec?

[kevinjqliu]

#1363 (comment)

[sungwy]

Thanks for the reviews @Fokko and @kevinjqliu !