You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Carl Steinbach (Created) (JIRA)" <ji...@apache.org> on 2012/02/14 00:44:59 UTC
[jira] [Created] (HIVE-2804) Task log retrieval fails on secure
cluster
Task log retrieval fails on secure cluster
------------------------------------------
Key: HIVE-2804
URL: https://issues.apache.org/jira/browse/HIVE-2804
Project: Hive
Issue Type: Bug
Components: Diagnosability, Query Processor
Reporter: Carl Steinbach
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Attachment: HIVE-2804.2.patch.txt
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13266267#comment-13266267 ]
Zhenxiao Luo commented on HIVE-2804:
------------------------------------
The bug could be reproduced in a non-secure MR2 cluster. In non-secure MR1 cluster, everything works OK.
It is not related to secure-cluster at all.
The reason is for a Null Pointer Exception Killed MapReduce Job in MR2 cluster, no log generated for the MapReduce job.
Filed MAPREDUCE-4218 to track the problem.
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Open (was: Patch Available)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-2804:
---------------------------------
Status: Open (was: Patch Available)
@Zhenxiao: please address the review comments and then resubmit. Thanks!
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.D3057.1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13429671#comment-13429671 ]
Carl Steinbach commented on HIVE-2804:
--------------------------------------
+1. Will commit if tests pass.
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.8.patch.txt, HIVE-2804.9.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Open (was: Patch Available)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268728#comment-13268728 ]
Zhenxiao Luo commented on HIVE-2804:
------------------------------------
On Hive Side, when using MR1, Hive is generating the TaskLog URL manually, since no available MapReduce api yet.
when using MR2, Hive could be using the existing MapReduce api to generate TaskLog URLs.
Shims should be created to fix the Hive side problem.
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-2804:
---------------------------------
Status: Open (was: Patch Available)
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434869#comment-13434869 ]
Hudson commented on HIVE-2804:
------------------------------
Integrated in Hive-trunk-h0.21 #1606 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1606/])
HIVE-2804. Task log retrieval fails on Hadoop 0.23 (Zhenxiao Luo via cws) (Revision 1373145)
Result = FAILURE
cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1373145
Files :
* /hive/trunk/build-common.xml
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/JobDebugger.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/errors/TaskLogProcessor.java
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/udf/generic/GenericUDFEvaluateNPE.java
* /hive/trunk/ql/src/test/queries/clientnegative/cluster_tasklog_retrieval.q
* /hive/trunk/ql/src/test/results/clientnegative/cluster_tasklog_retrieval.q.out
* /hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java
* /hive/trunk/shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
* /hive/trunk/shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
* /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Fix For: 0.10.0
>
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.8.patch.txt, HIVE-2804.9.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Patch Available (was: Open)
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398052#comment-13398052 ]
Zhenxiao Luo commented on HIVE-2804:
------------------------------------
@rohithsharma:
Thanks a lot for the comment. Are you using MR1 or MR2 to reproduce the exception? I manually tested HIVE-2804.6.patch.txt on a real cluster for both MR1 and MR2. It was running OK. While, returning null could be a problem. I will attach an updated HIVE-2804.7.patch.txt, trying to fix the problem.
Thanks,
Zhenxiao
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Patch Available (was: Open)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Attachment: HIVE-2804.3.patch.txt
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-2804:
---------------------------------
Status: Open (was: Patch Available)
@Zhenxiao: Patch needs to be rebased against trunk. Thanks.
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.8.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "rohithsharma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398195#comment-13398195 ]
rohithsharma commented on HIVE-2804:
------------------------------------
I think,
adding "GenericUDFEvaluateNPE.java" only for test framework is not required. Existing below UDAF queries will catch above problem.
>> SELECT percentile(key,5) FROM src;
>> SELECT assert_true(key >= 100) FROM src;
We can add these queries into tests.
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Open (was: Patch Available)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Attachment: HIVE-2804.6.patch.txt
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-2804:
---------------------------------
Summary: Task log retrieval fails on Hadoop 0.23 (was: Task log retrieval fails on secure cluster)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Edward Capriolo (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13257964#comment-13257964 ]
Edward Capriolo commented on HIVE-2804:
---------------------------------------
It seems like you will have to make a shim or variable that can be used to generate a version dependent URL.
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398054#comment-13398054 ]
Zhenxiao Luo commented on HIVE-2804:
------------------------------------
@rohithsharma:
new patch attached: HIVE-2804.7.patch.txt
added null check for taskLogUrl construction.
Would you please try this patch, and if the exception still occurs, send me a note of the stack trace, I will do more investigation.
Thanks,
Zhenxiao
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Carl Steinbach (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13207354#comment-13207354 ]
Carl Steinbach commented on HIVE-2804:
--------------------------------------
On a secure Hadoop cluster TaskLogProcessor.getErrors() fails:
{noformat}
Ended Job = job_201202112025_0356 with errors
Error during job, obtaining debugging information...
Examining task ID: task_201202112025_0356_m_000003 (and more) from job job_201202112025_0356
Exception in thread "Thread-22" java.lang.RuntimeException: Error while reading from task log url
at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
at org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:211)
at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:81)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Server returned HTTP response code: 400 for URL: http://c0509.hal.cloudera.com:50060/tasklog?taskid=attempt_201202112025_0356_r_000000_1&start=-8193
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436)
at java.net.URL.openStream(URL.java:1010)
at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)
... 3 more
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
{noformat}
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Attachment: HIVE-2804.7.patch.txt
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Attachment: HIVE-2804.1.patch.txt
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.D3057.1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Zhenxiao Luo (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo reassigned HIVE-2804:
----------------------------------
Assignee: Zhenxiao Luo
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "rohithsharma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398234#comment-13398234 ]
rohithsharma commented on HIVE-2804:
------------------------------------
In TaskLogProcessor.java, there are 2 methods which construct URL. One is getError() and another is getStackTraces(). TaskLogProcessor.getStackTraces() is called only if 'hive.exec.job.debug.capture.stacktraces' is set to true.I think in your case this was not set false.
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Phabricator (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13269358#comment-13269358 ]
Phabricator commented on HIVE-2804:
-----------------------------------
zhenxiao has commented on the revision "HIVE-2804 [jira] Task log retrieval fails on secure cluster".
@Carl and Namit: Thanks a lot. My updated patch is attached.
1. The without the "if (true)" statement, compiler is complaining return is an unreachable command, and fails the compilation. I keeps this "if(true)".
2. GenericUDFEvaluateNPE is taking a string as parameter.
3. TaskLogServlet is not available as Hadoop library, HostUtil is the corresponding one. While, HostUtil.java is not available until Hadoop0.23, so in Hadoop0.20, still needs to manually construct the URL. I left comments there.
Your comments and suggestions are appreciated.
Thanks,
Zhenxiao
REVISION DETAIL
https://reviews.facebook.net/D3057
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398727#comment-13398727 ]
Zhenxiao Luo commented on HIVE-2804:
------------------------------------
Patch submitted for review at:
https://reviews.apache.org/r/5310/
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.8.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Attachment: HIVE-2804.5.patch.txt
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "rohithsharma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397421#comment-13397421 ]
rohithsharma commented on HIVE-2804:
------------------------------------
I also encountered the same problem with hive UDAF queries such as PERCENTILE and ASSERT_TRUE. I have applied given patch and run these 2 queries. This patch fails throwing following excetiption.
{noformat}
Error during job, obtaining debugging information...
Examining task ID: task_1340014683209_0037_m_000000 (and more) from job job_1340014683209_0037
Exception in thread "Thread-26" java.lang.RuntimeException: Bad task log url
at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getStackTraces(TaskLogProcessor.java:193)
at org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:227)
at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:94)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.MalformedURLException
at java.net.URL.<init>(URL.java:601)
at java.net.URL.<init>(URL.java:464)
at java.net.URL.<init>(URL.java:413)
at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getStackTraces(TaskLogProcessor.java:191)
... 3 more
{noformat}
Correct me if I am wrong ,
With my understanding problem is adding URI's into 'taskLogUrls', I feel we need null check while adding URI into 'taskLogUrls' because hadoop23shims returns null if the cluster is MR2. This URI construction fails since null is passed as argument when TaskLogProcessor.getErrors() or TaskLogProcessor.getStackTraces() is called and throws MalformedURLException.
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Phabricator (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13269382#comment-13269382 ]
Phabricator commented on HIVE-2804:
-----------------------------------
cwsteinbach has requested changes to the revision "HIVE-2804 [jira] Task log retrieval fails on secure cluster".
Looks good overall. Please make the changes I requested and I will test and commit. Thanks.
INLINE COMMENTS
shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:46 If this exception is thrown and we ignore it, then the next line is going to throw an NPE since taskTrackerHttpURL will be null. We should make the caller handle this exception instead of squelching it.
ql/src/java/org/apache/hadoop/hive/ql/exec/JobDebugger.java:108 Modify this to also throw MalformedUrlException.
ql/src/java/org/apache/hadoop/hive/ql/exec/JobDebugger.java:103 Modify this to catch Exception instead of IOException. We should also dump the exception stack trace at this point, but that involves modify LogHelper. We'll save that for another ticket.
REVISION DETAIL
https://reviews.facebook.net/D3057
BRANCH
HIVE-2804
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Patch Available (was: Open)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13263272#comment-13263272 ]
Zhenxiao Luo commented on HIVE-2804:
------------------------------------
By creating an ThrowNullPointer UDF, and running it in MiniMRCluster, could reproduce a MapReduce job failing.
When running on apache trunk(which is using MR1), get the following error message:
[junit] Begin query: throw_npe.q
[junit] Error during job, obtaining debugging information...
[junit] Examining task ID: task_20120426165633901_0001_m_000002 (and more) from job job_20120426165633901_0001
[junit]
[junit] Task with the most failures(4):
[junit] -----
[junit] Task ID:
[junit] task_20120426165633901_0001_m_000000
[junit]
[junit] URL:
[junit] http://localhost:50030/taskdetails.jsp?jobid=job_20120426165633901_0001&tipid=task_20120426165633901_0001_m_000000
[junit] -----
[junit]
[junit] Exception: Client Execution failed with error code = 9
And in the output file:
PREHOOK: Output: hdfs://rotor:35306/home/cloudera/Code/hive/build/ql/scratchdir/hive_2012-04-26_16-57-11_129_4964809859660696177/-mr-10000
Ended Job = job_20120426165633901_0001 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
So, on apache trunk, TaskLog retrieval is working OK.
Since our CDH4 branch could not run MiniMRCluster yet, will try on an MR2 cluster, and also try to run a local cluster in pseudo-distributed mode.
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Phabricator (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13269295#comment-13269295 ]
Phabricator commented on HIVE-2804:
-----------------------------------
cwsteinbach has requested changes to the revision "HIVE-2804 [jira] Task log retrieval fails on secure cluster".
INLINE COMMENTS
ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java:255 This doesn't belong here. The UDF is for testing purposes only. Users should not see it listed in the output of 'SHOW FUNCTIONS'.
ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFNPE.java:1 @Namit: Good point.
@Zhenxiao: Please put this in ql/src/test/org/apache/hadoop/hive/ql/udf/generic, and then take a look at ql/src/test/queries/clientpositive/create_genericudf.q for an example of how to register a temporary UDF.
ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFNPE.java:37 Might be good to change the name to "evaluate_npe" (and update the other comments accordingly) just to make it clear that the NPE is thrown in evaluate() as opposed to initialize().
ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFNPE.java:49 I'm curious if this if() block is really necessary. Does the Java compiler complain without it?
ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFNPE.java:42 Is it possible to write a GenericUDF that takes no input parameters (e.g. like UDFPI)? If so then I think we should do that here since we ignore the input anyway. If that isn't possible, then please change this to take a string as input since that will work better with the src table.
ql/src/test/queries/clientnegative/cluster_npe_tasklog.q:3 Referencing src_thrift may give people the impression that this test is somehow related to Thrift. Let's use the src table instead.
ql/src/test/queries/clientnegative/cluster_npe_tasklog.q:1 Please change the name to "cluster_tasklog_retrieval.q".
shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java:529 Can we call TaskLogServlet.getTaskLogUrl() here instead of manually constructing the URL? If the answer is no then please add a comment explaining why. Thanks.
shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java:33 Same question as above.
shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java:38 Please use the getHost() and getPort() methods that are provided by java.net.URL.
REVISION DETAIL
https://reviews.facebook.net/D3057
BRANCH
HIVE-2804
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.D3057.1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Phabricator (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13269133#comment-13269133 ]
Phabricator commented on HIVE-2804:
-----------------------------------
njain has commented on the revision "HIVE-2804 [jira] Task log retrieval fails on secure cluster".
INLINE COMMENTS
ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFNPE.java:1 Can this file be added in ql/src/test instead ?
You can add the relevant function in the test.
REVISION DETAIL
https://reviews.facebook.net/D3057
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.D3057.1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Zhenxiao Luo (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13257616#comment-13257616 ]
Zhenxiao Luo commented on HIVE-2804:
------------------------------------
Also relates to the following:
http://search-hadoop.com/m/LR0vP1Y5227&subj=Hive+Hadoop+Log+Retrieval+Problem
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Attachment: HIVE-2804.8.patch.txt
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.8.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Open (was: Patch Available)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Carl Steinbach (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-2804:
---------------------------------
Component/s: Security
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Patch Available (was: Open)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Phabricator (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phabricator updated HIVE-2804:
------------------------------
Attachment: HIVE-2804.D3057.3.patch
zhenxiao updated the revision "HIVE-2804 [jira] Task log retrieval fails on secure cluster".
Reviewers: JIRA, cwsteinbach
HIVE-2804 Handling MalformedUrlException in the caller
REVISION DETAIL
https://reviews.facebook.net/D3057
AFFECTED FILES
build-common.xml
ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
ql/src/java/org/apache/hadoop/hive/ql/exec/JobDebugger.java
ql/src/test/org/apache/hadoop/hive/ql/udf/generic/GenericUDFEvaluateNPE.java
ql/src/test/queries/clientnegative/cluster_tasklog_retrieval.q
ql/src/test/results/clientnegative/cluster_tasklog_retrieval.q.out
shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java
shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Patch Available (was: Open)
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.D3057.1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-2804:
---------------------------------
Resolution: Fixed
Fix Version/s: 0.10.0
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Committed to trunk. Thanks Zhenxiao!
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Fix For: 0.10.0
>
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.8.patch.txt, HIVE-2804.9.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Phabricator (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13278514#comment-13278514 ]
Phabricator commented on HIVE-2804:
-----------------------------------
cwsteinbach has accepted the revision "HIVE-2804 [jira] Task log retrieval fails on Hadoop 0.23".
+1. Will commit if tests pass.
REVISION DETAIL
https://reviews.facebook.net/D3219
BRANCH
HIVE-2804
To: JIRA, cwsteinbach, zhenxiao
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Attachment: HIVE-2804.4.patch.txt
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Phabricator (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phabricator updated HIVE-2804:
------------------------------
Attachment: HIVE-2804.D3057.2.patch
zhenxiao updated the revision "HIVE-2804 [jira] Task log retrieval fails on secure cluster".
Reviewers: JIRA, cwsteinbach
HIVE-2804 Task log retrieval fails on secure cluster
REVISION DETAIL
https://reviews.facebook.net/D3057
AFFECTED FILES
build-common.xml
ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
ql/src/java/org/apache/hadoop/hive/ql/exec/JobDebugger.java
ql/src/test/org/apache/hadoop/hive/ql/udf/generic/GenericUDFEvaluateNPE.java
ql/src/test/queries/clientnegative/cluster_tasklog_retrieval.q
ql/src/test/results/clientnegative/cluster_tasklog_retrieval.q.out
shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java
shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Open (was: Patch Available)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.8.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13429657#comment-13429657 ]
Zhenxiao Luo commented on HIVE-2804:
------------------------------------
Updated patch submitted for review at:
https://reviews.facebook.net/D4551
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.8.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Phabricator (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phabricator updated HIVE-2804:
------------------------------
Attachment: HIVE-2804.D3219.2.patch
zhenxiao updated the revision "HIVE-2804 [jira] Task log retrieval fails on Hadoop 0.23".
Reviewers: JIRA
Updated patch for HIVE-2804
REVISION DETAIL
https://reviews.facebook.net/D3219
AFFECTED FILES
build-common.xml
ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
ql/src/java/org/apache/hadoop/hive/ql/exec/JobDebugger.java
ql/src/java/org/apache/hadoop/hive/ql/exec/errors/TaskLogProcessor.java
ql/src/test/org/apache/hadoop/hive/ql/udf/generic/GenericUDFEvaluateNPE.java
ql/src/test/queries/clientnegative/cluster_tasklog_retrieval.q
ql/src/test/results/clientnegative/cluster_tasklog_retrieval.q.out
shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java
shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java
To: JIRA, zhenxiao
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Attachment: HIVE-2804.5.patch.txt
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Patch Available (was: Open)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Patch Available (was: Open)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.8.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "rohithsharma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398194#comment-13398194 ]
rohithsharma commented on HIVE-2804:
------------------------------------
@zhenxiao
>>> Are you using MR1 or MR2 to reproduce the exception?
I am using MR2 cluster.
Latest patch solved the problem, Thanks you :-)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Attachment: HIVE-2804.9.patch.txt
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.8.patch.txt, HIVE-2804.9.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "rohithsharma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397429#comment-13397429 ]
rohithsharma commented on HIVE-2804:
------------------------------------
In addition to above,
Currently, Once the job is failed, debug information is displayed along with URL. This 'taskUrl' displayed is specific to MR1 cluster. This 'taskUrl' construction should be based on MR cluster.
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398634#comment-13398634 ]
Zhenxiao Luo commented on HIVE-2804:
------------------------------------
@rohithsharma:
Thank you so much for the comment. I will update the patch, and submit for review soon.
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268729#comment-13268729 ]
Zhenxiao Luo commented on HIVE-2804:
------------------------------------
@Edward: Yes. Shims are to created to fix the bug. I will submit a patch soon.
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Patch Available (was: Open)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.4.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.5.patch.txt, HIVE-2804.6.patch.txt, HIVE-2804.7.patch.txt, HIVE-2804.8.patch.txt, HIVE-2804.9.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch, HIVE-2804.D3219.1.patch, HIVE-2804.D3219.2.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on Hadoop
0.23
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhenxiao Luo updated HIVE-2804:
-------------------------------
Status: Patch Available (was: Open)
> Task log retrieval fails on Hadoop 0.23
> ---------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.1.patch.txt, HIVE-2804.2.patch.txt, HIVE-2804.3.patch.txt, HIVE-2804.D3057.1.patch, HIVE-2804.D3057.2.patch, HIVE-2804.D3057.3.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Phabricator (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phabricator updated HIVE-2804:
------------------------------
Attachment: HIVE-2804.D3057.1.patch
zhenxiao requested code review of "HIVE-2804 [jira] Task log retrieval fails on secure cluster".
Reviewers: JIRA
HIVE-2804 Task log retrieval fails on secure cluster
TEST PLAN
EMPTY
REVISION DETAIL
https://reviews.facebook.net/D3057
AFFECTED FILES
build-common.xml
ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java
ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java
ql/src/java/org/apache/hadoop/hive/ql/exec/JobDebugger.java
ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFNPE.java
ql/src/test/queries/clientnegative/cluster_npe_tasklog.q
ql/src/test/results/clientnegative/cluster_npe_tasklog.q.out
shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java
shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java
shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java
shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java
MANAGE HERALD DIFFERENTIAL RULES
https://reviews.facebook.net/herald/view/differential/
WHY DID I GET THIS EMAIL?
https://reviews.facebook.net/herald/transcript/6927/
Tip: use the X-Herald-Rules header to filter Herald messages in your client.
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
> Attachments: HIVE-2804.D3057.1.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2804) Task log retrieval fails on secure
cluster
Posted by "Zhenxiao Luo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13266239#comment-13266239 ]
Zhenxiao Luo commented on HIVE-2804:
------------------------------------
When running in CDH4 branch(which is using MR2 cluster), in a real non-secure cluster, always getting the following exception:
Exception in thread "Thread-31" java.lang.RuntimeException: Error while reading from task log url
at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
at org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:222)
at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:82)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.io.IOException: Server returned HTTP response code: 400 for URL: http://c0409.hal.cloudera.com:8080/tasklog?attemptid=attempt_1335202931724_0600_m_000000_0
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1403)
at java.net.URL.openStream(URL.java:1029)
at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)
... 3 more
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
MapReduce Jobs Launched:
Job 0: Map: 2 HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 msec
After working a patch, using HostUtil.getTaskLogUrl() to retrieve the log, the same exception still happens.
Found out that, for this intentionally failed testcase, no log generated at all.
> Task log retrieval fails on secure cluster
> ------------------------------------------
>
> Key: HIVE-2804
> URL: https://issues.apache.org/jira/browse/HIVE-2804
> Project: Hive
> Issue Type: Bug
> Components: Diagnosability, Query Processor, Security
> Reporter: Carl Steinbach
> Assignee: Zhenxiao Luo
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira