You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2024/02/02 02:51:00 UTC

[jira] [Updated] (IMPALA-2005) CTAS should not create table until insert succeeds

     [ https://issues.apache.org/jira/browse/IMPALA-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Quanlong Huang updated IMPALA-2005:
-----------------------------------
    Epic Link: IMPALA-12674

> CTAS should not create table until insert succeeds
> --------------------------------------------------
>
>                 Key: IMPALA-2005
>                 URL: https://issues.apache.org/jira/browse/IMPALA-2005
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Catalog
>    Affects Versions: Impala 1.4, Impala 1.4.1, Impala 2.0, Impala 2.0.1, Impala 2.1, Impala 2.1.1, Impala 2.2
>            Reporter: Tomoaki Yano
>            Priority: Major
>              Labels: correctness, downgraded, ramp-up
>
> I checked create table like the following fails.
> (parquet_file_size is sample to make create table fail)
> sudo -u impala impala-shell -q "set parquet_file_size=10g; create table 59915_test stored as parquet as select * from sample_08;"
> But table/folder is created as followings.
> I think failed DDL should clean up table and its directory.
> Terminal Log
> --
> [root@nightly-2 ~]# sudo -u impala impala-shell -q "set parquet_file_size=10g; create table 59915_test stored as parquet as select * from sample_08;"
> Starting Impala Shell without Kerberos authentication
> Connected to nightly-2.ent.cloudera.com:21000
> Server version: impalad version 2.3.0-cdh5-INTERNAL RELEASE (build 03b1ea79d41c49617be46313ffe0f5f05b1b54f5)
> PARQUET_FILE_SIZE set to 10g
> Query: create table 59915_test stored as parquet as select * from sample_08
> WARNINGS: Failed to open HDFS file for writing: hdfs://nightly-1.ent.cloudera.com:8020/user/hive/warehouse/59915_test/_impala_insert_staging/d945ce65feede9a4_355731418cd694b9//.d945ce65feede9a4-355731418cd694ba_1653921013_dir/d945ce65feede9a4-355731418cd694ba_1805782816_data.0.parq
> Error(255): Unknown error 255
> :
> [nightly-2.ent.cloudera.com:21000] > select * from 59915_test;
> Query: select * from 59915_test
> Fetched 0 row(s) in 2.04s
> --
> *Workaround*
> The workaround is to manually delete the extraneous table and the corresponding HDFS directory.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org