You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "WangHualei (Jira)" <ji...@apache.org> on 2021/04/19 07:18:00 UTC
[jira] [Updated] (HIVE-25025) Distcp In MoveTask may cause stats
info lost
[ https://issues.apache.org/jira/browse/HIVE-25025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
WangHualei updated HIVE-25025:
------------------------------
Environment: (was: example:
set hive.exec.copyfile.maxsize=0;
set hive.exec.copyfile.maxnumfiles=0;
insert overwrite table abd_new select * from abc;
select count(*) from abd_new ;
select * from abd_new ;
then the count(*) result will be 0, but select * will display real data, because stats info lost.)
> Distcp In MoveTask may cause stats info lost
> --------------------------------------------
>
> Key: HIVE-25025
> URL: https://issues.apache.org/jira/browse/HIVE-25025
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Reporter: WangHualei
> Assignee: WangHualei
> Priority: Major
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> after set _Run_ _as_ _end_ _user_ _instead_ _of_ _Hive_ _user_ , when execute insert overwrite , In MoveTask ,if source byte > HIVE_EXEC_COPYFILE_MAXSIZE and source file count> HIVE_EXEC_COPYFILE_MAXNUMFILES , HIve will use distcp method, it may cause tmp stats file lost.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)