[jira] [Updated] (MAPREDUCE-1776) Hadoop should provide a simplified way of fetching user-logs

["Allen Wittenauer (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Allen Wittenauer updated MAPREDUCE-1776:
----------------------------------------

    Labels:   (was: HADOOP_FETCHING_LOGS)

> Hadoop should provide a simplified way of fetching user-logs
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-1776
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1776
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: tasktracker
>    Affects Versions: 0.20.1, 0.20.2
>            Reporter: Alok Singh
>
> Hi,
>    Currently , in both streaming and normal mode hadoop mapred program, user can't download the 
> logs programatically.
> jobclient.output.filter=ALL, allows user to print output in the stdout/stderr
> We need to have the ability to fetch the user logs from the framework.
> in 0.18, under the hod , we used to store the logs in the hdfs.
> For 0.20, as long as the jobhistory resides user can view the logs but then it's gone.
> So in short , I am proposing that hadoop 
> 1) provide the options to the JobClient (i.e jobconf var jobclient.output.logs.location), so that it will download the output in the hdfs location instead of printing to stdout.
> Thanks
> Alok
> Alok



--
This message was sent by Atlassian JIRA
(v6.2#6252)