You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2017/02/01 15:23:52 UTC

[jira] [Commented] (HIVE-15723) Hive should report a warning about missing table/column statistics to user.

    [ https://issues.apache.org/jira/browse/HIVE-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848502#comment-15848502 ] 

Hive QA commented on HIVE-15723:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12850426/HIVE-15723.05.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 10997 tests executed
*Failed tests:*
{noformat}
TestDerbyConnector - did not produce a TEST-*.xml file (likely timed out) (batchId=235)
TestMiniSparkOnYarnCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=160)
	[infer_bucket_sort_reducers_power_two.q,list_bucket_dml_10.q,orc_merge9.q,orc_merge6.q,leftsemijoin_mr.q,bucket6.q,bucketmapjoin7.q,uber_reduce.q,empty_dir_in_table.q,vector_outer_join3.q,index_bitmap_auto.q,vector_outer_join2.q,vector_outer_join1.q,orc_merge1.q,orc_merge_diff_fs.q,load_hdfs_file_with_space_in_the_name.q,scriptfile1_win.q,quotedid_smb.q,truncate_column_buckets.q,orc_merge3.q]
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver[encryption_join_with_different_encryption_keys] (batchId=159)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_varchar_simple] (batchId=153)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] (batchId=223)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query23] (batchId=223)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3305/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3305/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3305/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 6 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12850426 - PreCommit-HIVE-Build

> Hive should report a warning about missing table/column statistics to user.
> ---------------------------------------------------------------------------
>
>                 Key: HIVE-15723
>                 URL: https://issues.apache.org/jira/browse/HIVE-15723
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Remus Rusanu
>            Assignee: Remus Rusanu
>            Priority: Minor
>             Fix For: 2.2.0
>
>         Attachments: HIVE-15723.01.patch, HIVE-15723.02.patch, HIVE-15723.03.patch, HIVE-15723.04.patch, HIVE-15723.05.patch
>
>
> Many Hive performance issues are due to missing statistics. Either all, table or column statistics are missing. Potentially a new partition has been added and customer forgot to gather stats for that partition.
> A simple warning about a table or column missing statistics can be very helpful and makes hive more user friendly. Hive already has this information, its a matter of printing it out.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)