You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2013/01/09 11:31:31 UTC
[jira] [Commented] (HIVE-2866) Cache local map reduce job errors
for additional logging
[ https://issues.apache.org/jira/browse/HIVE-2866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13548284#comment-13548284 ]
Hudson commented on HIVE-2866:
------------------------------
Integrated in Hive-trunk-hadoop2 #54 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/54/])
HIVE-2866 Cache local map reduce job errors for additional logging
(Kevin Wilfong via namit) (Revision 1307814)
Result = ABORTED
namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1307814
Files :
* /hive/trunk/common/src/java/org/apache/hadoop/hive/common/io/CachingPrintStream.java
* /hive/trunk/data/scripts/cat_error.py
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapRedTask.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapredLocalTask.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/hooks/VerifySessionStateLocalErrorsHook.java
* /hive/trunk/ql/src/test/queries/clientnegative/local_mapred_error_cache.q
* /hive/trunk/ql/src/test/results/clientnegative/local_mapred_error_cache.q.out
> Cache local map reduce job errors for additional logging
> --------------------------------------------------------
>
> Key: HIVE-2866
> URL: https://issues.apache.org/jira/browse/HIVE-2866
> Project: Hive
> Issue Type: Improvement
> Components: Logging
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Fix For: 0.9.0
>
> Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2866.D2277.1.patch
>
>
> Using the CachingPrintStream we are storing errors that occur locally in Hive, but because local map reduce jobs are run in a separate JVM we are not storing that occur for these. We can use this same construct to store errors written to the subprocesses error stream. This way, when we log failed queries, these will give us a decent idea of why those queries failed.
> See related issues:
> https://issues.apache.org/jira/browse/HIVE-2832
> https://issues.apache.org/jira/browse/HIVE-2858
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira