[jira] [Commented] (HIVE-3156) Support MiniMR tests for Hadoop-0.23

["Hudson (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-3156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434738#comment-13434738 ] 

Hudson commented on HIVE-3156:
------------------------------

Integrated in Hive-trunk-h0.21 #1605 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1605/])
    HIVE-3341 [jira] Making hive tests run against different MR versions
(Sushanth Sowmyan via Ashutosh Chauhan)

Summary:
HIVE-3341 Making hive tests run against different MR versions

After we build hive, we want to have the ability to run unit tests against specific hadoop versions. Currently, the classpath constructed has multiple hadoop jars, which makes compiling okay, but running non-deterministic.

An example is HIVE-3156, where running against 0.23 shows issues with a couple of tests (which should either be shimmed out, or separated into directories the way it's done in the shims/ directory) - It would also be nice to find these issues out at test-compile time itself, rather than having them fail at test runtime.

With this patch, we can set ant variable hadoop.mr.rev to 20, 20S or 23 to test against a particular version.

Test Plan: current tests continue to work - this is a build system change

Reviewers: JIRA, ashutoshc, cwsteinbach

Reviewed By: ashutoshc

Differential Revision: https://reviews.facebook.net/D4557 (Revision 1372745)

     Result = SUCCESS
hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1372745
Files : 
* /hive/trunk/build-common.xml
* /hive/trunk/build.properties
* /hive/trunk/ivy/common-configurations.xml
* /hive/trunk/shims/build.xml
* /hive/trunk/shims/src/common-secure/test
* /hive/trunk/shims/src/common-secure/test/org
* /hive/trunk/shims/src/common-secure/test/org/apache
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java
* /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift/TestZooKeeperTokenStore.java
* /hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java
* /hive/trunk/shims/src/test/org/apache/hadoop/hive/thrift/TestZooKeeperTokenStore.java

                
> Support MiniMR tests for Hadoop-0.23
> ------------------------------------
>
>                 Key: HIVE-3156
>                 URL: https://issues.apache.org/jira/browse/HIVE-3156
>             Project: Hive
>          Issue Type: Bug
>          Components: Tests
>    Affects Versions: 0.9.1
>         Environment: Hive-0.9.1 + Hadoop-0.23.0
>            Reporter: rohithsharma
>
> When MiniMR tests are ran with hadoop-0.23.0, tests fails throwing following exception.
> java.lang.UnsupportedOperationException
> 	at org.apache.hadoop.mapred.MiniMRCluster.getJobTrackerPort(MiniMRCluster.java:88)
> 	at org.apache.hadoop.hive.ql.QTestUtil.initConf(QTestUtil.java:215)
> In hadoop-0.23 ,few mapreduce API's are not supported like getJobTrackerPort(). 
> Here, we need to use API's based on hadoop versions.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira