You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "WangHualei (Jira)" <ji...@apache.org> on 2021/04/19 07:18:00 UTC
[jira] [Created] (HIVE-25025) Distcp In MoveTask may cause stats
info lost
WangHualei created HIVE-25025:
---------------------------------
Summary: Distcp In MoveTask may cause stats info lost
Key: HIVE-25025
URL: https://issues.apache.org/jira/browse/HIVE-25025
Project: Hive
Issue Type: Bug
Components: Hive
Environment: example:
set hive.exec.copyfile.maxsize=0;
set hive.exec.copyfile.maxnumfiles=0;
insert overwrite table abd_new select * from abc;
select count(*) from abd_new ;
select * from abd_new ;
then the count(*) result will be 0, but select * will display real data, because stats info lost.
Reporter: WangHualei
Assignee: WangHualei
after set _Run_ _as_ _end_ _user_ _instead_ _of_ _Hive_ _user_ , when execute insert overwrite , In MoveTask ,if source byte > HIVE_EXEC_COPYFILE_MAXSIZE and source file count> HIVE_EXEC_COPYFILE_MAXNUMFILES , HIve will use distcp method, it may cause tmp stats file lost.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)