You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Kevin Wilfong (Created) (JIRA)" <ji...@apache.org> on 2012/01/10 22:46:43 UTC
[jira] [Created] (HIVE-2706) StackOverflowError when using custom
UDF after adding archive after adding jars
StackOverflowError when using custom UDF after adding archive after adding jars
-------------------------------------------------------------------------------
Key: HIVE-2706
URL: https://issues.apache.org/jira/browse/HIVE-2706
Project: Hive
Issue Type: Bug
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2706) StackOverflowError when using custom
UDF after adding archive after adding jars
Posted by "Phabricator (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13183844#comment-13183844 ]
Phabricator commented on HIVE-2706:
-----------------------------------
heyongqiang has committed the revision "HIVE-2706 [jira] StackOverflowError when using custom UDF after adding archive after adding jars".
REVISION DETAIL
https://reviews.facebook.net/D1167
COMMIT
https://reviews.facebook.net/rHIVE1229885
> StackOverflowError when using custom UDF after adding archive after adding jars
> -------------------------------------------------------------------------------
>
> Key: HIVE-2706
> URL: https://issues.apache.org/jira/browse/HIVE-2706
> Project: Hive
> Issue Type: Bug
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Attachments: HIVE-2706.D1167.1.patch, HIVE-2706.D1167.2.patch
>
>
> When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2706) StackOverflowError when using custom
UDF after adding archive after adding jars
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13183940#comment-13183940 ]
Hudson commented on HIVE-2706:
------------------------------
Integrated in Hive-trunk-h0.21 #1192 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1192/])
HIVE-2706 [jira] StackOverflowError when using custom UDF after adding archive
after adding jars
(Kevin Wilfong via Yongqiang He)
Summary:
https://issues.apache.org/jira/browse/HIVE-2706
The issue was that the current thread's classloader and the classloader in the
conf differed due to the prehook updating only the current thread's classloader
with new jars. Now, it updates both classloaders, fixing the issue.
When a custom UDF is used in a query after add an archive, such as a zip file,
after adding jars, the XMLEncoder enters an infinite loop when serializing the
map reduce task, as part of sending it to be executed. This results in a stack
overflow error.
Test Plan: Verified it fixed the stack overflow error.
Reviewers: JIRA, heyongqiang, njain
Reviewed By: heyongqiang
CC: heyongqiang
Differential Revision: https://reviews.facebook.net/D1167
heyongqiang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1229885
Files :
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/processors/AddResourceProcessor.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/processors/DeleteResourceProcessor.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
> StackOverflowError when using custom UDF after adding archive after adding jars
> -------------------------------------------------------------------------------
>
> Key: HIVE-2706
> URL: https://issues.apache.org/jira/browse/HIVE-2706
> Project: Hive
> Issue Type: Bug
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Attachments: HIVE-2706.D1167.1.patch, HIVE-2706.D1167.2.patch
>
>
> When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-2706) StackOverflowError when using custom
UDF after adding archive after adding jars
Posted by "He Yongqiang (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang resolved HIVE-2706.
--------------------------------
Resolution: Fixed
committed, thanks Kevin!
> StackOverflowError when using custom UDF after adding archive after adding jars
> -------------------------------------------------------------------------------
>
> Key: HIVE-2706
> URL: https://issues.apache.org/jira/browse/HIVE-2706
> Project: Hive
> Issue Type: Bug
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Attachments: HIVE-2706.D1167.1.patch, HIVE-2706.D1167.2.patch
>
>
> When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2706) StackOverflowError when using custom
UDF after adding archive after adding jars
Posted by "Phabricator (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13183840#comment-13183840 ]
Phabricator commented on HIVE-2706:
-----------------------------------
heyongqiang has accepted the revision "HIVE-2706 [jira] StackOverflowError when using custom UDF after adding archive after adding jars".
tests passed
REVISION DETAIL
https://reviews.facebook.net/D1167
> StackOverflowError when using custom UDF after adding archive after adding jars
> -------------------------------------------------------------------------------
>
> Key: HIVE-2706
> URL: https://issues.apache.org/jira/browse/HIVE-2706
> Project: Hive
> Issue Type: Bug
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Attachments: HIVE-2706.D1167.1.patch, HIVE-2706.D1167.2.patch
>
>
> When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2706) StackOverflowError when using custom
UDF after adding archive after adding jars
Posted by "Phabricator (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phabricator updated HIVE-2706:
------------------------------
Attachment: HIVE-2706.D1167.2.patch
kevinwilfong updated the revision "HIVE-2706 [jira] StackOverflowError when using custom UDF after adding archive after adding jars".
Reviewers: JIRA, heyongqiang, njain
Fixed imports.
REVISION DETAIL
https://reviews.facebook.net/D1167
AFFECTED FILES
ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java
ql/src/java/org/apache/hadoop/hive/ql/processors/AddResourceProcessor.java
ql/src/java/org/apache/hadoop/hive/ql/processors/DeleteResourceProcessor.java
> StackOverflowError when using custom UDF after adding archive after adding jars
> -------------------------------------------------------------------------------
>
> Key: HIVE-2706
> URL: https://issues.apache.org/jira/browse/HIVE-2706
> Project: Hive
> Issue Type: Bug
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Attachments: HIVE-2706.D1167.1.patch, HIVE-2706.D1167.2.patch
>
>
> When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2706) StackOverflowError when using custom
UDF after adding archive after adding jars
Posted by "Phabricator (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phabricator updated HIVE-2706:
------------------------------
Attachment: HIVE-2706.D1167.1.patch
kevinwilfong requested code review of "HIVE-2706 [jira] StackOverflowError when using custom UDF after adding archive after adding jars".
Reviewers: JIRA
https://issues.apache.org/jira/browse/HIVE-2706
The issue was that the current thread's classloader and the classloader in the conf differed due to the prehook updating only the current thread's classloader with new jars. Now, it updates both classloaders, fixing the issue.
When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error.
TEST PLAN
EMPTY
REVISION DETAIL
https://reviews.facebook.net/D1167
AFFECTED FILES
ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java
ql/src/java/org/apache/hadoop/hive/ql/processors/AddResourceProcessor.java
ql/src/java/org/apache/hadoop/hive/ql/processors/DeleteResourceProcessor.java
MANAGE HERALD DIFFERENTIAL RULES
https://reviews.facebook.net/herald/view/differential/
WHY DID I GET THIS EMAIL?
https://reviews.facebook.net/herald/transcript/2439/
Tip: use the X-Herald-Rules header to filter Herald messages in your client.
> StackOverflowError when using custom UDF after adding archive after adding jars
> -------------------------------------------------------------------------------
>
> Key: HIVE-2706
> URL: https://issues.apache.org/jira/browse/HIVE-2706
> Project: Hive
> Issue Type: Bug
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Attachments: HIVE-2706.D1167.1.patch
>
>
> When a custom UDF is used in a query after add an archive, such as a zip file, after adding jars, the XMLEncoder enters an infinite loop when serializing the map reduce task, as part of sending it to be executed. This results in a stack overflow error.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira