Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MAINTENANCE] Add context to BatchConfig, and fetch assets by name #8982

Merged
merged 3 commits into from
Nov 20, 2023

Merge branch 'develop' into f/batch_config_context

9b2395f
Select commit
Loading
Failed to load commit list.
Merged

[MAINTENANCE] Add context to BatchConfig, and fetch assets by name #8982

Merge branch 'develop' into f/batch_config_context
9b2395f
Select commit
Loading
Failed to load commit list.
Azure Pipelines / sqlalchemy_compatibility succeeded Nov 20, 2023 in 12m 26s

Build #20231120.18 had test failures

4 errors / 20 warnings

Details

Tests

  • Failed: 4 (0.32%)
  • Passed: 1,264 (99.68%)
  • Other: 0 (0.00%)
  • Total: 1,268

Annotations

Check failure on line 34 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sqlalchemy_compatibility

Build log #L34 

1 test(s) failed, 317 test(s) collected.

Check failure on line 34 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sqlalchemy_compatibility

Build log #L34 

1 test(s) failed, 317 test(s) collected.

Check failure on line 34 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sqlalchemy_compatibility

Build log #L34 

1 test(s) failed, 317 test(s) collected.

Check failure on line 34 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sqlalchemy_compatibility

Build log #L34 

1 test(s) failed, 317 test(s) collected.

Check failure on line 1 in tests/execution_engine/test_sqlalchemy_execution_engine.py::test_instantiation_via_fluent_data_source__trino_add_sql[test_backends0]

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sqlalchemy_compatibility

tests/execution_engine/test_sqlalchemy_execution_engine.py::test_instantiation_via_fluent_data_source__trino_add_sql[test_backends0] 

sa = <module 'sqlalchemy' from '/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/__init__.py'>
empty_data_context = {
  "anonymous_usage_statistics": {
    "usage_statistics_url": "https://qa.stats.greatexpectations.io/great_expectati..._id": true,
        "base_directory": "profilers/"
      }
    }
  },
  "validations_store_name": "validations_store"
}

    @pytest.mark.trino
    def test_instantiation_via_fluent_data_source__trino_add_sql(sa, empty_data_context):
        context = empty_data_context
    
        CONNECTION_STRING = "trino://test@localhost:8088/memory/schema"
    
        # This utility is not for general use. It is only to support testing.
>       load_data_into_test_database(
            table_name="taxi_data",
            csv_path=file_relative_path(
                __file__,
                "../test_sets/taxi_yellow_tripdata_samples/yellow_tripdata_sample_2019-01.csv",
            ),
            connection_string=CONNECTION_STRING,
            convert_colnames_to_datetime=["pickup_datetime"],
        )

tests/execution_engine/test_sqlalchemy_execution_engine.py:185: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/test_utils.py:646: in load_data_into_test_database
    engine = sa.create_engine(connection_string)
<string>:2: in create_engine
    ???
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/util/deprecations.py:281: in warned
    return fn(*args, **kwargs)  # type: ignore[no-any-return]
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/engine/create.py:552: in create_engine
    entrypoint = u._get_entrypoint()
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/engine/url.py:754: in _get_entrypoint
    cls = registry.load(name)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <sqlalchemy.util.langhelpers.PluginLoader object at 0x7fc058f04850>
name = 'trino'

    def load(self, name: str) -> Any:
        if name in self.impls:
            return self.impls[name]()
    
        if self.auto_fn:
            loader = self.auto_fn(name)
            if loader:
                self.impls[name] = loader
                return loader()
    
        for impl in compat.importlib_metadata_get(self.group):
            if impl.name == name:
                self.impls[name] = impl.load
                return impl.load()
    
>       raise exc.NoSuchModuleError(
            "Can't load plugin: %s:%s" % (self.group, name)
        )
E       sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:trino

/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/util/langhelpers.py:374: NoSuchModuleError
Raw output 
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/util/langhelpers.py:374: sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:trino

Check failure on line 1 in tests/execution_engine/test_sqlalchemy_execution_engine.py::test_instantiation_via_fluent_data_source__trino_add_sql[test_backends0]

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sqlalchemy_compatibility

tests/execution_engine/test_sqlalchemy_execution_engine.py::test_instantiation_via_fluent_data_source__trino_add_sql[test_backends0] 

sa = <module 'sqlalchemy' from '/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/__init__.py'>
empty_data_context = {
  "anonymous_usage_statistics": {
    "usage_statistics_url": "https://qa.stats.greatexpectations.io/great_expectati..._id": true,
        "base_directory": "profilers/"
      }
    }
  },
  "validations_store_name": "validations_store"
}

    @pytest.mark.trino
    def test_instantiation_via_fluent_data_source__trino_add_sql(sa, empty_data_context):
        context = empty_data_context
    
        CONNECTION_STRING = "trino://test@localhost:8088/memory/schema"
    
        # This utility is not for general use. It is only to support testing.
>       load_data_into_test_database(
            table_name="taxi_data",
            csv_path=file_relative_path(
                __file__,
                "../test_sets/taxi_yellow_tripdata_samples/yellow_tripdata_sample_2019-01.csv",
            ),
            connection_string=CONNECTION_STRING,
            convert_colnames_to_datetime=["pickup_datetime"],
        )

tests/execution_engine/test_sqlalchemy_execution_engine.py:185: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/test_utils.py:646: in load_data_into_test_database
    engine = sa.create_engine(connection_string)
<string>:2: in create_engine
    ???
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/util/deprecations.py:281: in warned
    return fn(*args, **kwargs)  # type: ignore[no-any-return]
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/engine/create.py:552: in create_engine
    entrypoint = u._get_entrypoint()
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/engine/url.py:754: in _get_entrypoint
    cls = registry.load(name)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <sqlalchemy.util.langhelpers.PluginLoader object at 0x7fbe71f5b880>
name = 'trino'

    def load(self, name: str) -> Any:
        if name in self.impls:
            return self.impls[name]()
    
        if self.auto_fn:
            loader = self.auto_fn(name)
            if loader:
                self.impls[name] = loader
                return loader()
    
        for impl in compat.importlib_metadata_get(self.group):
            if impl.name == name:
                self.impls[name] = impl.load
                return impl.load()
    
>       raise exc.NoSuchModuleError(
            "Can't load plugin: %s:%s" % (self.group, name)
        )
E       sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:trino

/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/util/langhelpers.py:374: NoSuchModuleError
Raw output 
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/util/langhelpers.py:374: sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:trino

Check failure on line 1 in tests/execution_engine/test_sqlalchemy_execution_engine.py::test_instantiation_via_fluent_data_source__trino_add_sql[test_backends0]

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sqlalchemy_compatibility

tests/execution_engine/test_sqlalchemy_execution_engine.py::test_instantiation_via_fluent_data_source__trino_add_sql[test_backends0] 

sa = <module 'sqlalchemy' from '/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/__init__.py'>
empty_data_context = {
  "anonymous_usage_statistics": {
    "data_context_id": "0ceaaf5c-d12e-426e-8ac5-d565689a6aa9",
    "usage_statisti..._id": true,
        "base_directory": "profilers/"
      }
    }
  },
  "validations_store_name": "validations_store"
}

    @pytest.mark.trino
    def test_instantiation_via_fluent_data_source__trino_add_sql(sa, empty_data_context):
        context = empty_data_context
    
        CONNECTION_STRING = "trino://test@localhost:8088/memory/schema"
    
        # This utility is not for general use. It is only to support testing.
>       load_data_into_test_database(
            table_name="taxi_data",
            csv_path=file_relative_path(
                __file__,
                "../test_sets/taxi_yellow_tripdata_samples/yellow_tripdata_sample_2019-01.csv",
            ),
            connection_string=CONNECTION_STRING,
            convert_colnames_to_datetime=["pickup_datetime"],
        )

tests/execution_engine/test_sqlalchemy_execution_engine.py:185: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/test_utils.py:646: in load_data_into_test_database
    engine = sa.create_engine(connection_string)
<string>:2: in create_engine
    ???
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/util/deprecations.py:375: in warned
    return fn(*args, **kwargs)
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/engine/create.py:518: in create_engine
    entrypoint = u._get_entrypoint()
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/engine/url.py:662: in _get_entrypoint
    cls = registry.load(name)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <sqlalchemy.util.langhelpers.PluginLoader object at 0x7f91665f6370>
name = 'trino'

    def load(self, name):
        if name in self.impls:
            return self.impls[name]()
    
        if self.auto_fn:
            loader = self.auto_fn(name)
            if loader:
                self.impls[name] = loader
                return loader()
    
        for impl in compat.importlib_metadata_get(self.group):
            if impl.name == name:
                self.impls[name] = impl.load
                return impl.load()
    
>       raise exc.NoSuchModuleError(
            "Can't load plugin: %s:%s" % (self.group, name)
        )
E       sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:trino

/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/util/langhelpers.py:343: NoSuchModuleError
Raw output 
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/util/langhelpers.py:343: sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:trino

Check failure on line 1 in tests/execution_engine/test_sqlalchemy_execution_engine.py::test_instantiation_via_fluent_data_source__trino_add_sql[test_backends0]

See this annotation in the file changed.

@azure-pipelines azure-pipelines / sqlalchemy_compatibility

tests/execution_engine/test_sqlalchemy_execution_engine.py::test_instantiation_via_fluent_data_source__trino_add_sql[test_backends0] 

sa = <module 'sqlalchemy' from '/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/__init__.py'>
empty_data_context = {
  "anonymous_usage_statistics": {
    "enabled": false,
    "data_context_id": "5c04a728-7596-4284-b998-4030e1ffaae4..._id": true,
        "base_directory": "profilers/"
      }
    }
  },
  "validations_store_name": "validations_store"
}

    @pytest.mark.trino
    def test_instantiation_via_fluent_data_source__trino_add_sql(sa, empty_data_context):
        context = empty_data_context
    
        CONNECTION_STRING = "trino://test@localhost:8088/memory/schema"
    
        # This utility is not for general use. It is only to support testing.
>       load_data_into_test_database(
            table_name="taxi_data",
            csv_path=file_relative_path(
                __file__,
                "../test_sets/taxi_yellow_tripdata_samples/yellow_tripdata_sample_2019-01.csv",
            ),
            connection_string=CONNECTION_STRING,
            convert_colnames_to_datetime=["pickup_datetime"],
        )

tests/execution_engine/test_sqlalchemy_execution_engine.py:185: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/test_utils.py:646: in load_data_into_test_database
    engine = sa.create_engine(connection_string)
<string>:2: in create_engine
    ???
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/util/deprecations.py:375: in warned
    return fn(*args, **kwargs)
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/engine/create.py:518: in create_engine
    entrypoint = u._get_entrypoint()
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/engine/url.py:662: in _get_entrypoint
    cls = registry.load(name)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <sqlalchemy.util.langhelpers.PluginLoader object at 0x7fbca62f9400>
name = 'trino'

    def load(self, name):
        if name in self.impls:
            return self.impls[name]()
    
        if self.auto_fn:
            loader = self.auto_fn(name)
            if loader:
                self.impls[name] = loader
                return loader()
    
        for impl in compat.importlib_metadata_get(self.group):
            if impl.name == name:
                self.impls[name] = impl.load
                return impl.load()
    
>       raise exc.NoSuchModuleError(
            "Can't load plugin: %s:%s" % (self.group, name)
        )
E       sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:trino

/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/util/langhelpers.py:343: NoSuchModuleError
Raw output 
/opt/hostedtoolcache/Python/3.8.18/x64/lib/python3.8/site-packages/sqlalchemy/util/langhelpers.py:343: sqlalchemy.exc.NoSuchModuleError: Can't load plugin: sqlalchemy.dialects:trino
View more details on Azure Pipelines