You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Avinash Kujur <av...@gmail.com> on 2014/03/07 10:59:35 UTC

History viewer issue

[cloudera@localhost bin]$ hadoop job -history ~/1
DEPRECATED: Use of this script to execute mapred command is deprecated.
Instead use the mapred command for it.

Exception in thread "main" java.io.IOException: Not able to initialize
History viewer
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)
    at org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1945)
    at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1894)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
    at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2162)
Caused by: java.io.IOException: History directory
/home/cloudera/1/_logs/historydoes not exist
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)


do i need to make directory for history?

RE: History viewer issue

Posted by Brahma Reddy Battula <br...@huawei.com>.
we need to pass the jhist file,(Get the jhist file location from HDFS after running the job)





E.G:





hdpuser@host-10-18-40-132<ma...@host-10-18-40-132>:~> mapred job -history /home/hdpuser<ma...@host-10-18-40-132>-word+count-1394189895136-1-1-SUCCEEDED-a-1394189882729.jhist

Hadoop job: job_1394167487634_0004

=====================================

User: hdpuser<ma...@host-10-18-40-132>

JobName: word count

JobConf: hdfs://hacluster/home/hdpuser<ma...@host-10-18-40-132>/.staging/job_1394167487634_0004/job.xml

Submitted At: 7-Mar-2014 16:27:57

Launched At: 7-Mar-2014 16:28:02 (4sec)

Finished At: 7-Mar-2014 16:28:15 (12sec)

Status: SUCCEEDED

Counters:

|Group Name |Counter name |Map Value |Reduce Value|Total Value|











Thanks & Regards



Brahma Reddy Battula



________________________________

From: Avinash Kujur [avinz50@gmail.com]
Sent: Friday, March 07, 2014 3:29 PM
To: user@hadoop.apache.org
Subject: History viewer issue

[cloudera@localhost bin]$ hadoop job -history ~/1
DEPRECATED: Use of this script to execute mapred command is deprecated.
Instead use the mapred command for it.

Exception in thread "main" java.io.IOException: Not able to initialize History viewer
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)
    at org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1945)
    at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1894)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
    at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2162)
Caused by: java.io.IOException: History directory /home/cloudera/1/_logs/historydoes not exist
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)


do i need to make directory for history?

RE: History viewer issue

Posted by Brahma Reddy Battula <br...@huawei.com>.
we need to pass the jhist file,(Get the jhist file location from HDFS after running the job)





E.G:





hdpuser@host-10-18-40-132<ma...@host-10-18-40-132>:~> mapred job -history /home/hdpuser<ma...@host-10-18-40-132>-word+count-1394189895136-1-1-SUCCEEDED-a-1394189882729.jhist

Hadoop job: job_1394167487634_0004

=====================================

User: hdpuser<ma...@host-10-18-40-132>

JobName: word count

JobConf: hdfs://hacluster/home/hdpuser<ma...@host-10-18-40-132>/.staging/job_1394167487634_0004/job.xml

Submitted At: 7-Mar-2014 16:27:57

Launched At: 7-Mar-2014 16:28:02 (4sec)

Finished At: 7-Mar-2014 16:28:15 (12sec)

Status: SUCCEEDED

Counters:

|Group Name |Counter name |Map Value |Reduce Value|Total Value|











Thanks & Regards



Brahma Reddy Battula



________________________________

From: Avinash Kujur [avinz50@gmail.com]
Sent: Friday, March 07, 2014 3:29 PM
To: user@hadoop.apache.org
Subject: History viewer issue

[cloudera@localhost bin]$ hadoop job -history ~/1
DEPRECATED: Use of this script to execute mapred command is deprecated.
Instead use the mapred command for it.

Exception in thread "main" java.io.IOException: Not able to initialize History viewer
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)
    at org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1945)
    at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1894)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
    at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2162)
Caused by: java.io.IOException: History directory /home/cloudera/1/_logs/historydoes not exist
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)


do i need to make directory for history?

RE: History viewer issue

Posted by Brahma Reddy Battula <br...@huawei.com>.
we need to pass the jhist file,(Get the jhist file location from HDFS after running the job)





E.G:





hdpuser@host-10-18-40-132<ma...@host-10-18-40-132>:~> mapred job -history /home/hdpuser<ma...@host-10-18-40-132>-word+count-1394189895136-1-1-SUCCEEDED-a-1394189882729.jhist

Hadoop job: job_1394167487634_0004

=====================================

User: hdpuser<ma...@host-10-18-40-132>

JobName: word count

JobConf: hdfs://hacluster/home/hdpuser<ma...@host-10-18-40-132>/.staging/job_1394167487634_0004/job.xml

Submitted At: 7-Mar-2014 16:27:57

Launched At: 7-Mar-2014 16:28:02 (4sec)

Finished At: 7-Mar-2014 16:28:15 (12sec)

Status: SUCCEEDED

Counters:

|Group Name |Counter name |Map Value |Reduce Value|Total Value|











Thanks & Regards



Brahma Reddy Battula



________________________________

From: Avinash Kujur [avinz50@gmail.com]
Sent: Friday, March 07, 2014 3:29 PM
To: user@hadoop.apache.org
Subject: History viewer issue

[cloudera@localhost bin]$ hadoop job -history ~/1
DEPRECATED: Use of this script to execute mapred command is deprecated.
Instead use the mapred command for it.

Exception in thread "main" java.io.IOException: Not able to initialize History viewer
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)
    at org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1945)
    at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1894)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
    at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2162)
Caused by: java.io.IOException: History directory /home/cloudera/1/_logs/historydoes not exist
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)


do i need to make directory for history?

RE: History viewer issue

Posted by Brahma Reddy Battula <br...@huawei.com>.
we need to pass the jhist file,(Get the jhist file location from HDFS after running the job)





E.G:





hdpuser@host-10-18-40-132<ma...@host-10-18-40-132>:~> mapred job -history /home/hdpuser<ma...@host-10-18-40-132>-word+count-1394189895136-1-1-SUCCEEDED-a-1394189882729.jhist

Hadoop job: job_1394167487634_0004

=====================================

User: hdpuser<ma...@host-10-18-40-132>

JobName: word count

JobConf: hdfs://hacluster/home/hdpuser<ma...@host-10-18-40-132>/.staging/job_1394167487634_0004/job.xml

Submitted At: 7-Mar-2014 16:27:57

Launched At: 7-Mar-2014 16:28:02 (4sec)

Finished At: 7-Mar-2014 16:28:15 (12sec)

Status: SUCCEEDED

Counters:

|Group Name |Counter name |Map Value |Reduce Value|Total Value|











Thanks & Regards



Brahma Reddy Battula



________________________________

From: Avinash Kujur [avinz50@gmail.com]
Sent: Friday, March 07, 2014 3:29 PM
To: user@hadoop.apache.org
Subject: History viewer issue

[cloudera@localhost bin]$ hadoop job -history ~/1
DEPRECATED: Use of this script to execute mapred command is deprecated.
Instead use the mapred command for it.

Exception in thread "main" java.io.IOException: Not able to initialize History viewer
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:95)
    at org.apache.hadoop.mapred.JobClient.viewHistory(JobClient.java:1945)
    at org.apache.hadoop.mapred.JobClient.run(JobClient.java:1894)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
    at org.apache.hadoop.mapred.JobClient.main(JobClient.java:2162)
Caused by: java.io.IOException: History directory /home/cloudera/1/_logs/historydoes not exist
    at org.apache.hadoop.mapred.HistoryViewer.<init>(HistoryViewer.java:76)


do i need to make directory for history?