You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Qing Cai (Jira)" <ji...@apache.org> on 2021/08/18 03:04:00 UTC
[jira] [Updated] (IMPALA-10867) insert overwrite failed when table
location schema is different partition location schema
[ https://issues.apache.org/jira/browse/IMPALA-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Qing Cai updated IMPALA-10867:
------------------------------
Description:
reproduce sql:
create table census (name string, census_year int) partitioned by (year int) location "hdfs://nameservice/table_dir";
insert into census partition (year=2011) values ('Smith',2010),('Jones',2010);
alter table census PARTITION(year=2011) set location "oss://bucket/table_dir";
insert overwrite census partition (year=2011) values ('Smith',2010);
result: total row count is 3, not 1
insert overwrite became to insert into
root cause:
DmlExecState::FinalizeHdfsInsert
!image-2021-08-18-10-52-58-750.png!
check partition dir exist use an error fs_connect it creates from table location and it always return false
was:
reproduce sql:
create table census (name string, census_year int) partitioned by (year int) location "hdfs://nameservice/table_dir";
insert into census partition (year=2011) values ('Smith',2010),('Jones',2010);
alter table census PARTITION(year=2011) set location "oss://bucket/table_dir";
insert overwrite census partition (year=2011) values ('Smith',2010);
result: total row count is 3, not 1
insert overwrite became to insert into
root cause:
DmlExecState::FinalizeHdfsInsert
!image-2021-08-18-10-52-58-750.png!
check partition location use an error fs_connect it creates from table location
> insert overwrite failed when table location schema is different partition location schema
> -----------------------------------------------------------------------------------------
>
> Key: IMPALA-10867
> URL: https://issues.apache.org/jira/browse/IMPALA-10867
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 3.4.0
> Reporter: Qing Cai
> Priority: Major
> Attachments: image-2021-08-18-10-52-58-750.png
>
>
> reproduce sql:
> create table census (name string, census_year int) partitioned by (year int) location "hdfs://nameservice/table_dir";
> insert into census partition (year=2011) values ('Smith',2010),('Jones',2010);
> alter table census PARTITION(year=2011) set location "oss://bucket/table_dir";
> insert overwrite census partition (year=2011) values ('Smith',2010);
>
> result: total row count is 3, not 1
> insert overwrite became to insert into
>
> root cause:
> DmlExecState::FinalizeHdfsInsert
> !image-2021-08-18-10-52-58-750.png!
>
> check partition dir exist use an error fs_connect it creates from table location and it always return false
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org