You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Jason Dere (JIRA)" <ji...@apache.org> on 2014/04/21 22:24:14 UTC

[jira] [Commented] (HIVE-6939) TestExecDriver.testMapRedPlan3 fails on hadoop-2

    [ https://issues.apache.org/jira/browse/HIVE-6939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13975990#comment-13975990 ] 

Jason Dere commented on HIVE-6939:
----------------------------------

It appears that on hadoop-2 there are multiple output files for this test, whereas on hadoop-1 there is just a single file.  Also the test looks like it assumes there is just a single file to compare to.
This test for some reason is specifying 5 reducers.  I've been told that hadoop-1 Hive did not obey the number of reducers, while hadoop-2 does.  This could explain why this test works for hadoop-1 since if it only ever used 1 reducer and generated a single output file.

Changing this test to use just a single reducer allows the test to pass with hadoop-2.  Does anyone know the history of this test and why it was set to use 5 reducers?

> TestExecDriver.testMapRedPlan3 fails on hadoop-2
> ------------------------------------------------
>
>                 Key: HIVE-6939
>                 URL: https://issues.apache.org/jira/browse/HIVE-6939
>             Project: Hive
>          Issue Type: Bug
>          Components: Tests
>            Reporter: Jason Dere
>            Assignee: Jason Dere
>
> Passes on hadoop-1, but fails on hadoop-2.



--
This message was sent by Atlassian JIRA
(v6.2#6252)