You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Zhenxiao Luo (JIRA)" <ji...@apache.org> on 2012/09/05 23:51:07 UTC
[jira] [Commented] (HIVE-3435) Get pdk pluginTest passed when
triggered from both builtin tests and pdk tests on hadoop23
[ https://issues.apache.org/jira/browse/HIVE-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13449174#comment-13449174 ]
Zhenxiao Luo commented on HIVE-3435:
------------------------------------
The problems are similar to HIVE-3413:
1. missing dependency
hadoop-minicluster needs to be added to pdk/ivy.xml as well.
In pdk/build.xml, the test target needs to depend on "init, setup, ivy-retrieve, ivy-retrieve-test", so that when running pdk tests directly, the pdk/ivy.xml dependency will be resolved firstly.
2. configuration files need to be added
log4j.properties and hive-site.xml need to be added to get rid of the following warning nessage:
[junit] 2012-08-28 18:13:01,668 WARN [main] conf.HiveConf (HiveConf.java:<clinit>(73)) - hive-site.xml not found on CLASSPATH
[junit] 2012-08-28 19:05:20,679 WARN [main] conf.Configuration (Configuration.java:loadProperty(1621)) - file:/tmp/cloudera/hive_2012-08-28_19-05-17_531_4347419252405007581/-local-10002/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
[junit] 2012-08-28 19:05:20,680 WARN [main] conf.Configuration (Configuration.java:loadProperty(1621)) - file:/tmp/cloudera/hive_2012-08-28_19-05-17_531_4347419252405007581/-local-10002/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
These configuration files also needs to be put in a place where both builtin tests and pdk tests could load(due to property overload, pdk/test-plugin/test/conf could not be loaded by pdk, my plan is to update the place to pdk/scripts/conf).
3. HADOOP_ROOT_LOGGER needs to be set in pdk/scripts/build-plugin.xml
If not set, testutils/hadoop would initialize it to be "INFO,console", which would print log4j warning message on the console, and is not expected.
> Get pdk pluginTest passed when triggered from both builtin tests and pdk tests on hadoop23
> -------------------------------------------------------------------------------------------
>
> Key: HIVE-3435
> URL: https://issues.apache.org/jira/browse/HIVE-3435
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Zhenxiao Luo
> Assignee: Zhenxiao Luo
> Fix For: 0.10.0
>
>
> Hive pdk pluginTest is running twice in unit testing, one is triggered from running builtin tests, another is triggered from running pdk tests.
> HIVE-3413 fixed pdk pluginTest on hadoop23 when triggered from running builtin tests. While, when triggered from running pdk tests directly on hadoop23, it is failing:
> Testcase: SELECT tp_rot13('Mixed Up!') FROM onerow; took 6.426 sec
> FAILED
> expected:<[]Zvkrq Hc!> but was:<[2012-09-04 18:13:01,668 WARN [main] conf.HiveConf (HiveConf.java:<clinit>(73)) - hive-site.xml not found on CLASSPATH
> ]Zvkrq Hc!>
> junit.framework.ComparisonFailure: expected:<[]Zvkrq Hc!> but was:<[2012-09-04 18:13:01,668 WARN [main] conf.HiveConf (HiveConf.java:<clinit>(73)) - hive-site.xml not found on CLASSPATH
> ]Zvkrq Hc!>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira