You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Harsh J (Commented) (JIRA)" <ji...@apache.org> on 2012/01/04 06:42:39 UTC
[jira] [Commented] (OOZIE-29) Support hadoop job log retrieval
through Oozie WS API
[ https://issues.apache.org/jira/browse/OOZIE-29?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179290#comment-13179290 ]
Harsh J commented on OOZIE-29:
------------------------------
I agree that this would be unnecessary complexity. We can pass on resource URIs, and that should suffice. Rest should be up to a client to do/build upon.
> Support hadoop job log retrieval through Oozie WS API
> -----------------------------------------------------
>
> Key: OOZIE-29
> URL: https://issues.apache.org/jira/browse/OOZIE-29
> Project: Oozie
> Issue Type: New Feature
> Reporter: Mohammad Kamrul Islam
>
> Users want to utilize Oozie as only entry/gateway to the Grid system. Currently they could get the Oozie log related to their jobs. They could also access to the corresponding hadoop job details through Oozie UI that redirect to the JT UI of that job.
> However, users strongly prefer to get the job log as Oozie WS API response or through Oozie CLI for the debugging purpose.
> This JIRA is to discuss the different options (if any) that Hadoop currently supports. And subsequent Oozie's action plan.
>
> Questions are:
> 1. Does hadoop provide any API to retrieve the job log?
> 2. Does hadoop provide any API to get the path(s) of hadoop job logs?
> 3. If the answer is no for the above questions:
> a. Is there any alternatives?
> b. Should we create a Hadoop JIRA for asking to support either of the options?
> At the same time, we have to make sure the followings:
> 1. Oozie will work as a pass-thru to hadoop.
> 2. Oozie will not store any hadoop log.
> 3. If hadoop restart loss the job log, oozie will return the same message that hadoop replies back
> 4. Oozie could retrieve the hadoop job log started by pig.
> Please comment.
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira