You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Zhenxiao Luo (JIRA)" <ji...@apache.org> on 2012/07/19 01:09:33 UTC
[jira] [Created] (HIVE-3273) Add avro jars into hive execution
classpath
Zhenxiao Luo created HIVE-3273:
----------------------------------
Summary: Add avro jars into hive execution classpath
Key: HIVE-3273
URL: https://issues.apache.org/jira/browse/HIVE-3273
Project: Hive
Issue Type: Bug
Reporter: Zhenxiao Luo
Assignee: Zhenxiao Luo
avro*.jar should be added to hive execution classpath
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3273) Add avro jars into hive execution
classpath
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13417805#comment-13417805 ]
Zhenxiao Luo commented on HIVE-3273:
------------------------------------
Since Hadoop classpath is not setting correctly in build-common.xml "test" target, even currently we did not add avro jars into hive execution classpath, it is still running OK.
While, we may get class def not found error, if not putting avro jars into the hive mapreduce job execution classpath:
Caused by: java.lang.ClassNotFoundException: org.apache.avro.io.DatumReader
> Add avro jars into hive execution classpath
> -------------------------------------------
>
> Key: HIVE-3273
> URL: https://issues.apache.org/jira/browse/HIVE-3273
> Project: Hive
> Issue Type: Bug
> Reporter: Zhenxiao Luo
> Assignee: Zhenxiao Luo
>
> avro*.jar should be added to hive execution classpath
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3273) Add avro jars into hive execution
classpath
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-3273:
---------------------------------
Resolution: Fixed
Fix Version/s: 0.10.0
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Committed to trunk. Thanks Zhenxiao!
> Add avro jars into hive execution classpath
> -------------------------------------------
>
> Key: HIVE-3273
> URL: https://issues.apache.org/jira/browse/HIVE-3273
> Project: Hive
> Issue Type: Bug
> Components: Build Infrastructure
> Reporter: Zhenxiao Luo
> Assignee: Zhenxiao Luo
> Fix For: 0.10.0
>
> Attachments: HIVE-3273.1.patch.txt
>
>
> avro*.jar should be added to hive execution classpath
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3273) Add avro jars into hive execution
classpath
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13426321#comment-13426321 ]
Hudson commented on HIVE-3273:
------------------------------
Integrated in Hive-trunk-h0.21 #1581 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1581/])
HIVE-3273 [jira] Add avro jars into hive execution classpath
(Zhenxiao Luo via Carl Steinbach)
Summary:
HIVE-3273: Add avro jars into hive execution classpath
avro*.jar should be added to hive execution classpath
Test Plan: EMPTY
Reviewers: JIRA, cwsteinbach
Reviewed By: cwsteinbach
Differential Revision: https://reviews.facebook.net/D4209 (Revision 1367708)
Result = SUCCESS
cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1367708
Files :
* /hive/trunk/ql/build.xml
> Add avro jars into hive execution classpath
> -------------------------------------------
>
> Key: HIVE-3273
> URL: https://issues.apache.org/jira/browse/HIVE-3273
> Project: Hive
> Issue Type: Bug
> Components: Build Infrastructure
> Reporter: Zhenxiao Luo
> Assignee: Zhenxiao Luo
> Fix For: 0.10.0
>
> Attachments: HIVE-3273.1.patch.txt
>
>
> avro*.jar should be added to hive execution classpath
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3273) Add avro jars into hive execution
classpath
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-3273:
---------------------------------
Component/s: Build Infrastructure
> Add avro jars into hive execution classpath
> -------------------------------------------
>
> Key: HIVE-3273
> URL: https://issues.apache.org/jira/browse/HIVE-3273
> Project: Hive
> Issue Type: Bug
> Components: Build Infrastructure
> Reporter: Zhenxiao Luo
> Assignee: Zhenxiao Luo
> Attachments: HIVE-3273.1.patch.txt
>
>
> avro*.jar should be added to hive execution classpath
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3273) Add avro jars into hive execution
classpath
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13425365#comment-13425365 ]
Carl Steinbach commented on HIVE-3273:
--------------------------------------
+1. Will commit if tests pass.
> Add avro jars into hive execution classpath
> -------------------------------------------
>
> Key: HIVE-3273
> URL: https://issues.apache.org/jira/browse/HIVE-3273
> Project: Hive
> Issue Type: Bug
> Components: Build Infrastructure
> Reporter: Zhenxiao Luo
> Assignee: Zhenxiao Luo
> Attachments: HIVE-3273.1.patch.txt
>
>
> avro*.jar should be added to hive execution classpath
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3273) Add avro jars into hive execution
classpath
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-3273:
-------------------------------
Status: Patch Available (was: Open)
> Add avro jars into hive execution classpath
> -------------------------------------------
>
> Key: HIVE-3273
> URL: https://issues.apache.org/jira/browse/HIVE-3273
> Project: Hive
> Issue Type: Bug
> Reporter: Zhenxiao Luo
> Assignee: Zhenxiao Luo
> Attachments: HIVE-3273.1.patch.txt
>
>
> avro*.jar should be added to hive execution classpath
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3273) Add avro jars into hive execution
classpath
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418478#comment-13418478 ]
Zhenxiao Luo commented on HIVE-3273:
------------------------------------
@Edward:
I found this error when I am backporting HIVE-895 to an old version of Hive(CDH3), where I did not put avro jars into hive execution classpath, and kept having the following exception:
java.lang.ClassNotFoundException: org.apache.avro.io.DatumReader
We do not have this error on current trunk, since Hadoop classpath is not setting correctly in build-common.xml "test" target. I think this should be fixed in HIVE-3274.
I think fixing this would emphasis that it is not enough to put avro jars in the hive client classpath. Avro jars should be put in hive execution(the mapreduce job) classpath. This would prevent future bugs.
What do you think about it?
Thanks,
Zhenxiao
> Add avro jars into hive execution classpath
> -------------------------------------------
>
> Key: HIVE-3273
> URL: https://issues.apache.org/jira/browse/HIVE-3273
> Project: Hive
> Issue Type: Bug
> Reporter: Zhenxiao Luo
> Assignee: Zhenxiao Luo
> Attachments: HIVE-3273.1.patch.txt
>
>
> avro*.jar should be added to hive execution classpath
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3273) Add avro jars into hive execution
classpath
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13417807#comment-13417807 ]
Zhenxiao Luo commented on HIVE-3273:
------------------------------------
review request submitted:
https://reviews.facebook.net/D4209
> Add avro jars into hive execution classpath
> -------------------------------------------
>
> Key: HIVE-3273
> URL: https://issues.apache.org/jira/browse/HIVE-3273
> Project: Hive
> Issue Type: Bug
> Reporter: Zhenxiao Luo
> Assignee: Zhenxiao Luo
>
> avro*.jar should be added to hive execution classpath
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3273) Add avro jars into hive execution
classpath
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418210#comment-13418210 ]
Edward Capriolo commented on HIVE-3273:
---------------------------------------
I can see this happening but when exactly do we get this error?
> Add avro jars into hive execution classpath
> -------------------------------------------
>
> Key: HIVE-3273
> URL: https://issues.apache.org/jira/browse/HIVE-3273
> Project: Hive
> Issue Type: Bug
> Reporter: Zhenxiao Luo
> Assignee: Zhenxiao Luo
> Attachments: HIVE-3273.1.patch.txt
>
>
> avro*.jar should be added to hive execution classpath
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3273) Add avro jars into hive execution
classpath
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-3273:
-------------------------------
Attachment: HIVE-3273.1.patch.txt
> Add avro jars into hive execution classpath
> -------------------------------------------
>
> Key: HIVE-3273
> URL: https://issues.apache.org/jira/browse/HIVE-3273
> Project: Hive
> Issue Type: Bug
> Reporter: Zhenxiao Luo
> Assignee: Zhenxiao Luo
> Attachments: HIVE-3273.1.patch.txt
>
>
> avro*.jar should be added to hive execution classpath
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira