Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dialect impala:impala will not make use of SQL compilation caching as it does not set the 'supports_statement_cache' attribute to True. #503

Open
ckapolonaris opened this issue Oct 10, 2022 · 2 comments

Comments

@ckapolonaris
Copy link

Hello to everyone! When I'm attempting to write a dataframe to an impala database, with the Pandas function "to_sql" and a SQLAlchemy engine I get the message:

"/usr/local/lib/python3.8/dist-packages/pandas/io/sql.py:857: SAWarning: Dialect impala:impala will not make use of SQL compilation caching as it does not set the 'supports_statement_cache' attribute to True. This can have significant performance implications including some performance degradations in comparison to prior SQLAlchemy versions. Dialect maintainers should seek to set this attribute to True after appropriate development and testing for SQLAlchemy 1.4 caching support. Alternatively, this attribute may be set to False which will disable this warning. (Background on this error at: https://sqlalche.me/e/14/cprf)
result = conn.execute(self.table.insert(), data)"

Impyla Version: 0.18.0

@proyectopetunia
Copy link

seems that cloudera team is not interested in solving the issue.
Probably it is time to change database technology :-(

@contang0
Copy link

contang0 commented Sep 8, 2023

bump

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants