You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Jason Dere (JIRA)" <ji...@apache.org> on 2014/04/21 22:24:14 UTC
[jira] [Commented] (HIVE-6939) TestExecDriver.testMapRedPlan3 fails
on hadoop-2
[ https://issues.apache.org/jira/browse/HIVE-6939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13975990#comment-13975990 ]
Jason Dere commented on HIVE-6939:
----------------------------------
It appears that on hadoop-2 there are multiple output files for this test, whereas on hadoop-1 there is just a single file. Also the test looks like it assumes there is just a single file to compare to.
This test for some reason is specifying 5 reducers. I've been told that hadoop-1 Hive did not obey the number of reducers, while hadoop-2 does. This could explain why this test works for hadoop-1 since if it only ever used 1 reducer and generated a single output file.
Changing this test to use just a single reducer allows the test to pass with hadoop-2. Does anyone know the history of this test and why it was set to use 5 reducers?
> TestExecDriver.testMapRedPlan3 fails on hadoop-2
> ------------------------------------------------
>
> Key: HIVE-6939
> URL: https://issues.apache.org/jira/browse/HIVE-6939
> Project: Hive
> Issue Type: Bug
> Components: Tests
> Reporter: Jason Dere
> Assignee: Jason Dere
>
> Passes on hadoop-1, but fails on hadoop-2.
--
This message was sent by Atlassian JIRA
(v6.2#6252)