You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Eugene Koifman (JIRA)" <ji...@apache.org> on 2017/07/11 17:37:00 UTC
[jira] [Created] (HIVE-17075) unstable stats in q files
Eugene Koifman created HIVE-17075:
-------------------------------------
Summary: unstable stats in q files
Key: HIVE-17075
URL: https://issues.apache.org/jira/browse/HIVE-17075
Project: Hive
Issue Type: Bug
Reporter: Eugene Koifman
Assignee: Pengcheng Xiong
stats recorded in explain plan in .out files are sometimes unstable
here is 1 concrete example (HIVE-15898 1st run is patch 6, 2nd run is patch 7)
{noformat}
[10:23 AM] Eugene Koifman: 1st run
[10:23 AM] Eugene Koifman: https://builds.apache.org/job/PreCommit-HIVE-Build/5951/testReport/org.apache.hadoop.hive.cli/TestMi...
[10:23 AM] Eugene Koifman: 316c316
< Statistics: Num rows: 45 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 45 Data size: 4571 Basic stats: COMPLETE Column stats: NONE
[10:23 AM] Eugene Koifman: this is the 1st diff - it says that actual result was 4560 and expected was 4571
[10:24 AM] Eugene Koifman: here is a 2nd run (the only difference is that I update the .out file)
[10:24 AM] Eugene Koifman: https://builds.apache.org/job/PreCommit-HIVE-Build/5956/testReport/org.apache.hadoop.hive.cli/TestMi...
[10:24 AM] Eugene Koifman: 316c316
< Statistics: Num rows: 45 Data size: 4573 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 45 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
[10:25 AM] Eugene Koifman: is the 1st diff in the 2nd run
{noformat}
The actual value from each run is different.
Complete output from patch 6 run
{noformat}
Client Execution succeeded but contained differences (error code = 1) after executing sqlmerge_type2_scd.q
316c316
< Statistics: Num rows: 45 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 45 Data size: 4571 Basic stats: COMPLETE Column stats: NONE
319c319
< Statistics: Num rows: 45 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 45 Data size: 4571 Basic stats: COMPLETE Column stats: NONE
324c324
< Statistics: Num rows: 45 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 45 Data size: 4571 Basic stats: COMPLETE Column stats: NONE
347c347
< Statistics: Num rows: 22 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 22 Data size: 4571 Basic stats: COMPLETE Column stats: NONE
350c350
< Statistics: Num rows: 22 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 22 Data size: 4571 Basic stats: COMPLETE Column stats: NONE
355c355
< Statistics: Num rows: 22 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 22 Data size: 4571 Basic stats: COMPLETE Column stats: NONE
369c369
< Statistics: Num rows: 49 Data size: 5016 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 49 Data size: 5028 Basic stats: COMPLETE Column stats: NONE
373c373
< Statistics: Num rows: 49 Data size: 5016 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 49 Data size: 5028 Basic stats: COMPLETE Column stats: NONE
378c378
< Statistics: Num rows: 49 Data size: 5016 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 49 Data size: 5028 Basic stats: COMPLETE Column stats: NONE
390c390
< Statis
{noformat}
From patch 7 run
{noformat}
316c316
< Statistics: Num rows: 45 Data size: 4573 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 45 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
319c319
< Statistics: Num rows: 45 Data size: 4573 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 45 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
324c324
< Statistics: Num rows: 45 Data size: 4573 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 45 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
347c347
< Statistics: Num rows: 22 Data size: 4573 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 22 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
350c350
< Statistics: Num rows: 22 Data size: 4573 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 22 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
355c355
< Statistics: Num rows: 22 Data size: 4573 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 22 Data size: 4560 Basic stats: COMPLETE Column stats: NONE
369c369
< Statistics: Num rows: 49 Data size: 5030 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 49 Data size: 5016 Basic stats: COMPLETE Column stats: NONE
373c373
< Statistics: Num rows: 49 Data size: 5030 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 49 Data size: 5016 Basic stats: COMPLETE Column stats: NONE
378c378
< Statistics: Num rows: 49 Data size: 5030 Basic stats: COMPLETE Column stats: NONE
---
> Statistics: Num rows: 49 Data size: 5016 Basic stats: COMPLETE Column stats: NONE
390c390
< Statis
{noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)