You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Bill Au <bi...@gmail.com> on 2009/01/15 18:27:52 UTC

hadoop job -history

I am having trouble getting the hadoop command "job -hisotry" to work.  What
am I suppose to use for <jobOutputDir>?  I can see the job history from the
JobTracker web ui.  I tried specifing the history directory on the
JobTracker but it didn't work:

$ hadoop job -history logs/history/
Exception in thread "main" java.io.IOException: Not able to initialize
History viewer
        at
org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:88)
        at
org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1596)
        at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1560)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1727)
Caused by: java.io.IOException: History directory
logs/history/_logs/historydoes not exist
        at
org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:70)
        ... 5 more

Re: hadoop job -history

Posted by Amareshwari Sriramadasu <am...@yahoo-inc.com>.
<jobOutputDir> is the location specified by the configuration property "hadoop.job.history.user.location". If you don't specify anything for the property, the job history logs will be created in job's output directory. So, to view your history give your jobOutputDir, if you havent specified any location.
Hope this helps.

Thanks
Amareshwari


Bill Au wrote:
> I am having trouble getting the hadoop command "job -hisotry" to work.  What
> am I suppose to use for <jobOutputDir>?  I can see the job history from the
> JobTracker web ui.  I tried specifing the history directory on the
> JobTracker but it didn't work:
>
> $ hadoop job -history logs/history/
> Exception in thread "main" java.io.IOException: Not able to initialize
> History viewer
>         at
> org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:88)
>         at
> org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1596)
>         at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1560)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1727)
> Caused by: java.io.IOException: History directory
> logs/history/_logs/historydoes not exist
>         at
> org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:70)
>         ... 5 more
>
>