You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Alejandro Abdelnur (JIRA)" <ji...@apache.org> on 2012/05/11 01:24:01 UTC
[jira] [Created] (OOZIE-834) Testcases for MapReduceMain,
StreamingMain, PigMain, HiveMain fail with Hadoop 2
Alejandro Abdelnur created OOZIE-834:
----------------------------------------
Summary: Testcases for MapReduceMain, StreamingMain, PigMain, HiveMain fail with Hadoop 2
Key: OOZIE-834
URL: https://issues.apache.org/jira/browse/OOZIE-834
Project: Oozie
Issue Type: Bug
Components: tests
Affects Versions: trunk
Reporter: Alejandro Abdelnur
Assignee: Alejandro Abdelnur
Fix For: trunk
Hadoop 2 changed it's minicluster to use random ports recently.
The testcases for the MR/Streaming/Pig/Hive Main classes are not being configured correctly with the minicluster configuration thus are taking incorrect ports and fail.
This is seen on top of OOZIE-831.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-834) Testcases for MapReduceMain,
StreamingMain, PigMain, HiveMain fail with Hadoop 2
Posted by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13272921#comment-13272921 ]
jiraposter@reviews.apache.org commented on OOZIE-834:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/5090/
-----------------------------------------------------------
Review request for oozie.
Summary
-------
Hadoop 2 changed it's minicluster to use random ports recently.
The testcases for the MR/Streaming/Pig/Hive Main classes are not being configured correctly with the minicluster configuration thus are taking incorrect ports and fail.
This addresses bug OOZIE-834.
https://issues.apache.org/jira/browse/OOZIE-834
Diffs
-----
trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestHiveMain.java 1336960
trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestMapReduceMain.java 1336960
trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestPigMain.java 1336960
trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestStreamingMain.java 1336960
trunk/core/src/test/java/org/apache/oozie/test/XTestCase.java 1336960
Diff: https://reviews.apache.org/r/5090/diff
Testing
-------
run successfully the affected tests with Hadoop 1 and Hadoop 2 (except for the TestPigMain & TestHiveMain because there are not JARs for hadoop 2 avail in maven repo)
Thanks,
Alejandro
> Testcases for MapReduceMain, StreamingMain, PigMain, HiveMain fail with Hadoop 2
> --------------------------------------------------------------------------------
>
> Key: OOZIE-834
> URL: https://issues.apache.org/jira/browse/OOZIE-834
> Project: Oozie
> Issue Type: Bug
> Components: tests
> Affects Versions: trunk
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Fix For: trunk
>
>
> Hadoop 2 changed it's minicluster to use random ports recently.
> The testcases for the MR/Streaming/Pig/Hive Main classes are not being configured correctly with the minicluster configuration thus are taking incorrect ports and fail.
> This is seen on top of OOZIE-831.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-834) Testcases for MapReduceMain,
StreamingMain, PigMain, HiveMain fail with Hadoop 2
Posted by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13273552#comment-13273552 ]
jiraposter@reviews.apache.org commented on OOZIE-834:
-----------------------------------------------------
bq. On 2012-05-11 19:38:05, Mohammad Islam wrote:
bq. > +1
bq. > how the unavailable maven repo will be resolved in the long run.
it is up to pig and hive teams to take care o that, for pig i opened a jira
- Alejandro
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/5090/#review7812
-----------------------------------------------------------
On 2012-05-11 16:07:07, Alejandro Abdelnur wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/5090/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2012-05-11 16:07:07)
bq.
bq.
bq. Review request for oozie.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. Hadoop 2 changed it's minicluster to use random ports recently.
bq.
bq. The testcases for the MR/Streaming/Pig/Hive Main classes are not being configured correctly with the minicluster configuration thus are taking incorrect ports and fail.
bq.
bq.
bq. This addresses bug OOZIE-834.
bq. https://issues.apache.org/jira/browse/OOZIE-834
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestHiveMain.java 1336960
bq. trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestMapReduceMain.java 1336960
bq. trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestPigMain.java 1336960
bq. trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestPipesMain.java 1336960
bq. trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestStreamingMain.java 1336960
bq. trunk/core/src/test/java/org/apache/oozie/test/XTestCase.java 1336960
bq.
bq. Diff: https://reviews.apache.org/r/5090/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. run successfully the affected tests with Hadoop 1 and Hadoop 2 (except for the TestPigMain & TestHiveMain because there are not JARs for hadoop 2 avail in maven repo)
bq.
bq.
bq. Thanks,
bq.
bq. Alejandro
bq.
bq.
> Testcases for MapReduceMain, StreamingMain, PigMain, HiveMain fail with Hadoop 2
> --------------------------------------------------------------------------------
>
> Key: OOZIE-834
> URL: https://issues.apache.org/jira/browse/OOZIE-834
> Project: Oozie
> Issue Type: Bug
> Components: tests
> Affects Versions: trunk
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Fix For: trunk
>
>
> Hadoop 2 changed it's minicluster to use random ports recently.
> The testcases for the MR/Streaming/Pig/Hive Main classes are not being configured correctly with the minicluster configuration thus are taking incorrect ports and fail.
> This is seen on top of OOZIE-831.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-834) Testcases for MapReduceMain,
StreamingMain, PigMain, HiveMain fail with Hadoop 2
Posted by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13273386#comment-13273386 ]
jiraposter@reviews.apache.org commented on OOZIE-834:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/5090/
-----------------------------------------------------------
(Updated 2012-05-11 16:07:07.900173)
Review request for oozie.
Changes
-------
adding fix for TestPipesMain which I've missed before
Summary
-------
Hadoop 2 changed it's minicluster to use random ports recently.
The testcases for the MR/Streaming/Pig/Hive Main classes are not being configured correctly with the minicluster configuration thus are taking incorrect ports and fail.
This addresses bug OOZIE-834.
https://issues.apache.org/jira/browse/OOZIE-834
Diffs (updated)
-----
trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestHiveMain.java 1336960
trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestMapReduceMain.java 1336960
trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestPigMain.java 1336960
trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestPipesMain.java 1336960
trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestStreamingMain.java 1336960
trunk/core/src/test/java/org/apache/oozie/test/XTestCase.java 1336960
Diff: https://reviews.apache.org/r/5090/diff
Testing
-------
run successfully the affected tests with Hadoop 1 and Hadoop 2 (except for the TestPigMain & TestHiveMain because there are not JARs for hadoop 2 avail in maven repo)
Thanks,
Alejandro
> Testcases for MapReduceMain, StreamingMain, PigMain, HiveMain fail with Hadoop 2
> --------------------------------------------------------------------------------
>
> Key: OOZIE-834
> URL: https://issues.apache.org/jira/browse/OOZIE-834
> Project: Oozie
> Issue Type: Bug
> Components: tests
> Affects Versions: trunk
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Fix For: trunk
>
>
> Hadoop 2 changed it's minicluster to use random ports recently.
> The testcases for the MR/Streaming/Pig/Hive Main classes are not being configured correctly with the minicluster configuration thus are taking incorrect ports and fail.
> This is seen on top of OOZIE-831.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-834) Testcases for MapReduceMain,
StreamingMain, PigMain, HiveMain fail with Hadoop 2
Posted by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13273544#comment-13273544 ]
jiraposter@reviews.apache.org commented on OOZIE-834:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/5090/#review7812
-----------------------------------------------------------
Ship it!
+1
how the unavailable maven repo will be resolved in the long run.
- Mohammad
On 2012-05-11 16:07:07, Alejandro Abdelnur wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/5090/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2012-05-11 16:07:07)
bq.
bq.
bq. Review request for oozie.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. Hadoop 2 changed it's minicluster to use random ports recently.
bq.
bq. The testcases for the MR/Streaming/Pig/Hive Main classes are not being configured correctly with the minicluster configuration thus are taking incorrect ports and fail.
bq.
bq.
bq. This addresses bug OOZIE-834.
bq. https://issues.apache.org/jira/browse/OOZIE-834
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestHiveMain.java 1336960
bq. trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestMapReduceMain.java 1336960
bq. trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestPigMain.java 1336960
bq. trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestPipesMain.java 1336960
bq. trunk/core/src/test/java/org/apache/oozie/action/hadoop/TestStreamingMain.java 1336960
bq. trunk/core/src/test/java/org/apache/oozie/test/XTestCase.java 1336960
bq.
bq. Diff: https://reviews.apache.org/r/5090/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. run successfully the affected tests with Hadoop 1 and Hadoop 2 (except for the TestPigMain & TestHiveMain because there are not JARs for hadoop 2 avail in maven repo)
bq.
bq.
bq. Thanks,
bq.
bq. Alejandro
bq.
bq.
> Testcases for MapReduceMain, StreamingMain, PigMain, HiveMain fail with Hadoop 2
> --------------------------------------------------------------------------------
>
> Key: OOZIE-834
> URL: https://issues.apache.org/jira/browse/OOZIE-834
> Project: Oozie
> Issue Type: Bug
> Components: tests
> Affects Versions: trunk
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Fix For: trunk
>
>
> Hadoop 2 changed it's minicluster to use random ports recently.
> The testcases for the MR/Streaming/Pig/Hive Main classes are not being configured correctly with the minicluster configuration thus are taking incorrect ports and fail.
> This is seen on top of OOZIE-831.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (OOZIE-834) Testcases for MapReduceMain,
StreamingMain, PigMain, HiveMain fail with Hadoop 2
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur resolved OOZIE-834.
--------------------------------------
Resolution: Fixed
committed to trunk
> Testcases for MapReduceMain, StreamingMain, PigMain, HiveMain fail with Hadoop 2
> --------------------------------------------------------------------------------
>
> Key: OOZIE-834
> URL: https://issues.apache.org/jira/browse/OOZIE-834
> Project: Oozie
> Issue Type: Bug
> Components: tests
> Affects Versions: trunk
> Reporter: Alejandro Abdelnur
> Assignee: Alejandro Abdelnur
> Fix For: trunk
>
>
> Hadoop 2 changed it's minicluster to use random ports recently.
> The testcases for the MR/Streaming/Pig/Hive Main classes are not being configured correctly with the minicluster configuration thus are taking incorrect ports and fail.
> This is seen on top of OOZIE-831.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira