You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Sushanth Sowmyan (JIRA)" <ji...@apache.org> on 2012/08/14 21:35:38 UTC
[jira] [Created] (HIVE-3385) fixing 0.23 test build
Sushanth Sowmyan created HIVE-3385:
--------------------------------------
Summary: fixing 0.23 test build
Key: HIVE-3385
URL: https://issues.apache.org/jira/browse/HIVE-3385
Project: Hive
Issue Type: Bug
Reporter: Sushanth Sowmyan
Assignee: Sushanth Sowmyan
Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-3385) fixing 0.23 test build
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan resolved HIVE-3385.
------------------------------------
Resolution: Fixed
Fix Version/s: 0.10.0
Committed to trunk. Thanks, Sushanth!
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Fix For: 0.10.0
>
> Attachments: HIVE-3385.patch, HIVE-3385.patch.2
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3385) fixing 0.23 test build
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435300#comment-13435300 ]
Namit Jain commented on HIVE-3385:
----------------------------------
I meant, I verified that the tests run on 23.
+1 from my side.
@Ashutosh, do you want me to commit it, or you can commit this ?
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Attachments: HIVE-3385.patch, HIVE-3385.patch.2
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3385) fixing 0.23 test build
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434577#comment-13434577 ]
Ashutosh Chauhan commented on HIVE-3385:
----------------------------------------
Looks good to me. @Namit would you like to try out the patch to check if it fixes build issues in your environment as well.
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Attachments: HIVE-3385.patch, HIVE-3385.patch.2
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3385) fixing 0.23 test build
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434535#comment-13434535 ]
Ashutosh Chauhan commented on HIVE-3385:
----------------------------------------
I believe this brings in both jobclient jar as well as jobclient-tests jar. We also need client-common jar for some tests to pass. See my comment at https://issues.apache.org/jira/browse/HIVE-3143?focusedCommentId=13419630&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13419630
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Attachments: HIVE-3385.patch
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3385) fixing 0.23 test build
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434743#comment-13434743 ]
Namit Jain commented on HIVE-3385:
----------------------------------
Thanks Sushanth
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Attachments: HIVE-3385.patch, HIVE-3385.patch.2
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3385) fixing 0.23 test build
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435760#comment-13435760 ]
Namit Jain commented on HIVE-3385:
----------------------------------
@Ashutosh, there is still some problem:
When I was trying to run:
ant test -Dhadoop.mr.rev=23 -Dtest.print.classpath=true -Dhadoop.version=2.0.0-alpha -Dhadoop.security.version=2.0.0-alpha -Dtestcase=TestCliDriver -Dqfile=tst.q
where tst.q had the line:
-- INCLUDE_HADOOP_MAJOR_VERSIONS(0.23)
I expected that test to go through, but that test was skipped.
[junit] Running org.apache.hadoop.hive.cli.TestCliDriver
[junit] Begin query: tst.q
[junit] QTestUtil: tst.q INCLUDE list does not contain Hadoop Version 0.20S. Skipping...
[junit] Cleaning up TestCliDriver
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 11.442 sec
Can you take a look ?
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Fix For: 0.10.0
>
> Attachments: HIVE-3385.patch, HIVE-3385.patch.2
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3385) fixing 0.23 test build
Posted by "Sushanth Sowmyan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434561#comment-13434561 ]
Sushanth Sowmyan commented on HIVE-3385:
----------------------------------------
It brings in client-common also as a dependency, but we should add it in explicitly if that's required for another test.
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Attachments: HIVE-3385.patch, HIVE-3385.patch.2
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3385) fixing 0.23 test build
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435320#comment-13435320 ]
Ashutosh Chauhan commented on HIVE-3385:
----------------------------------------
I can. Will commit if tests pass.
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Attachments: HIVE-3385.patch, HIVE-3385.patch.2
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3385) fixing 0.23 test build
Posted by "Sushanth Sowmyan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sushanth Sowmyan updated HIVE-3385:
-----------------------------------
Attachment: HIVE-3385.patch.2
Updated patch with explicit introduction of dependency on client-common
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Attachments: HIVE-3385.patch, HIVE-3385.patch.2
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3385) fixing 0.23 test build
Posted by "Sushanth Sowmyan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sushanth Sowmyan updated HIVE-3385:
-----------------------------------
Attachment: HIVE-3385.patch
Patch attached to bring in the .jar required - this solves the compile-time problem that popped up in HIVE-3341.
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Attachments: HIVE-3385.patch
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3385) fixing 0.23 test build
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435803#comment-13435803 ]
Hudson commented on HIVE-3385:
------------------------------
Integrated in Hive-trunk-h0.21 #1609 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1609/])
HIVE-3385 : fixing 0.23 test build (Sushanth Sowmyan via Ashutosh Chauhan) (Revision 1373680)
Result = FAILURE
hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1373680
Files :
* /hive/trunk/shims/ivy.xml
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Fix For: 0.10.0
>
> Attachments: HIVE-3385.patch, HIVE-3385.patch.2
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3385) fixing 0.23 test build
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435762#comment-13435762 ]
Namit Jain commented on HIVE-3385:
----------------------------------
@Sushanth, I haven't debugged this. The test classpath for 1l seems to be correct.
It is containing the jars from build/ivy/lib/hadoop0.23.shim.
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Fix For: 0.10.0
>
> Attachments: HIVE-3385.patch, HIVE-3385.patch.2
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3385) fixing 0.23 test build
Posted by "Sushanth Sowmyan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434615#comment-13434615 ]
Sushanth Sowmyan commented on HIVE-3385:
----------------------------------------
Also uploaded to phabricator : https://reviews.facebook.net/D4647
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Attachments: HIVE-3385.patch, HIVE-3385.patch.2
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3385) fixing 0.23 test build
Posted by "Sushanth Sowmyan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436496#comment-13436496 ]
Sushanth Sowmyan commented on HIVE-3385:
----------------------------------------
As commented on the HIVE-3389, that issue seems to be fixed by HIVE-3029
> fixing 0.23 test build
> ----------------------
>
> Key: HIVE-3385
> URL: https://issues.apache.org/jira/browse/HIVE-3385
> Project: Hive
> Issue Type: Bug
> Reporter: Sushanth Sowmyan
> Assignee: Sushanth Sowmyan
> Labels: build, test
> Fix For: 0.10.0
>
> Attachments: HIVE-3385.patch, HIVE-3385.patch.2
>
>
> Follow up jira after HIVE-3341, we need to make hive tests work on 0.23.
> For starters, we need to add in a jar into build/ivy/lib/hadoop0.23.shim/ that includes MiniMRCluster. With 0.23, MiniMRCluster has moved to hadoop-mapreduce-client-jobclient-{$version}-tests.jar and that needs to be included in as an ivy dependence.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira