You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Navis (JIRA)" <ji...@apache.org> on 2014/05/21 03:45:39 UTC

[jira] [Commented] (HIVE-7095) Fix test fails for both hadoop-1 and hadoop-2

    [ https://issues.apache.org/jira/browse/HIVE-7095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14004204#comment-14004204 ] 

Navis commented on HIVE-7095:
-----------------------------

Problem 3 is not valid. I've seen wrong result from older revision.

For problem 2, the test uses forced bucketing but local exec in hadoop-1 supports only one reducer. Might be fixed by making separate test for each version.
Problem 1 seemed caused by different environment(file system?). I've rewritten the test to show test purpose more effectively.
Problem 4,5 might be caused by different iteration order from different java versions. Sorting map before print out the properties might help.

> Fix test fails for both hadoop-1 and hadoop-2
> ---------------------------------------------
>
>                 Key: HIVE-7095
>                 URL: https://issues.apache.org/jira/browse/HIVE-7095
>             Project: Hive
>          Issue Type: Task
>          Components: Tests
>            Reporter: Navis
>
> There are some try to fix test results for hadoop-2(HIVE-6838, HIVE-6979, etc.). But these remained problems for hadoop-1. Let's finish this here, not prolonging output ping-pongs between two versions.
> 1. Data size in explain result is different
> bucketizedhiveinputformat.q
> 2. forced bucketing(=2) does not make two files in hadoop-1. 
> groupby_sort_1.q
> groupby_sort_skew_1.q
> 3. Column stats of srcpart, which has loaded a file rather than inserted, has COLUMN_STATS_ACCURATE=true, numRows=0, rawDataSize=0 for hadoop-2, which seemed wrong.
> sample8.q
> transform_ppr1.q
> transform_ppr2.q
> union_ppr.q
> 4. Iteration order of table properties for show create table is different.
> nullformatCTAS.q
> show_create_table_alter.q
> 5. Iteration order of show table properties is different
> unset_table_view_property.q



--
This message was sent by Atlassian JIRA
(v6.2#6252)