Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DATE is not supported in CDH 5.16 Impala #37

Open
jpoblete opened this issue Apr 6, 2020 · 3 comments
Open

DATE is not supported in CDH 5.16 Impala #37

jpoblete opened this issue Apr 6, 2020 · 3 comments

Comments

@jpoblete
Copy link

jpoblete commented Apr 6, 2020

Running impala-external.sql & impala-parquet.sql scripts on CDH 5.16.2 (impalad version 2.12.0-cdh5.16.2 RELEASE) fails with:

ERROR: AnalysisException: Unsupported data type: DATE
@jpoblete
Copy link
Author

jpoblete commented Apr 6, 2020

Had to change the scripts to execute...

sed -e 's/ date,/ varchar(10),/g' impala-external.sql  > impala-external_varchar.sql 
sed -e 's/ date,/ varchar(10),/g' impala-parquet.sql   > impala-parquet_varchar.sql

Also, the compute-stats.sql is missing:

use use tpcds_10000_parquet;

@drorke
Copy link
Collaborator

drorke commented Apr 6, 2020

The DDL scripts were changed recently to use the DATE type which is only supported in Impala version 3.3 and later (https://issues.apache.org/jira/browse/IMPALA-7368). If you're looking for a Cloudera release with the required DATE support I believe it's supported in all of the CDP releases (both CDP cloud and CDP Data Center 7.0 for on-prem). The DATE support isn't available on CDH 5 or CDH 6. If you need to run on earlier CDH releases you could consider using a version of the TPC-DS kit prior to the recent commit that made the DATE related changes.

@gregrahn
Copy link
Contributor

gregrahn commented Apr 6, 2020

@jpoblete - stats are collected in impala-insert.sql -- compute-stats.sql is just a stand alone helper file if needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants