You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Dharmik Thakkar (Jira)" <ji...@apache.org> on 2023/06/14 19:22:00 UTC
[jira] [Created] (IMPALA-12215) Iceberg table creation as CTAS of Hive table containing char/varchar fails in Impala
Dharmik Thakkar created IMPALA-12215:
----------------------------------------
Summary: Iceberg table creation as CTAS of Hive table containing char/varchar fails in Impala
Key: IMPALA-12215
URL: https://issues.apache.org/jira/browse/IMPALA-12215
Project: IMPALA
Issue Type: Bug
Reporter: Dharmik Thakkar
Iceberg table creation as CTAS of Hive table containing char/varchar fails in Impala
Hive Table
{code:java}
CREATE TABLE tpch.customer ( c_custkey INT, c_name STRING, c_address STRING, c_nationkey INT, c_phone CHAR(15), c_acctbal DECIMAL(15,2), c_mktsegment CHAR(10), c_comment STRING ) STORED AS ORC LOCATION 's3a://qe-s3-bucket-weekly/cc-dwx-97hupz/warehouse/tablespace/managed/hive/tpch.db/customer' TBLPROPERTIES ('COLUMN_STATS_ACCURATE'='{\"BASIC_STATS\":\"true\",\"COLUMN_STATS\":{\"c_acctbal\":\"true\",\"c_address\":\"true\",\"c_comment\":\"true\",\"c_custkey\":\"true\",\"c_mktsegment\":\"true\",\"c_name\":\"true\",\"c_nationkey\":\"true\",\"c_phone\":\"true\"}}', 'bucketing_version'='2', 'numFiles'='2', 'numFilesErasureCoded'='0', 'numRows'='150000', 'rawDataSize'='0', 'totalSize'='8023612', 'transactional'='true', 'transactional_properties'='default') {code}
Create iceberg table in Impala with CTAS
{code:java}
CREATE TABLE customer
STORED AS ICEBERG
TBLPROPERTIES (
'write.format.parquet'='parquet',
'format-version'='1',
'write.${file_format}.compression-codec'='gzip'
)
AS SELECT * FROM tpch.customer; {code}
Error
{code:java}
java.sql.SQLException: [Cloudera][ImpalaJDBCDriver](500051) ERROR processing query/statement. Error Code: 0, SQL state: TStatus(statusCode:ERROR_STATUS, sqlState:HY000, errorMessage:AnalysisException: Exception caught during generating Iceberg schema:
CAUSED BY: CatalogException: Exception caught during generating Iceberg schema:
CAUSED BY: ImpalaRuntimeException: Type CHAR(15) is not supported in Iceberg {code}
The same CTAS query works for non iceberg tables.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org