You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Runping Qi (JIRA)" <ji...@apache.org> on 2009/03/02 19:38:56 UTC

[jira] Created: (HADOOP-5378) Error in displaying job history

Error in displaying job history
-------------------------------

                 Key: HADOOP-5378
                 URL: https://issues.apache.org/jira/browse/HADOOP-5378
             Project: Hadoop Core
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.19.0
            Reporter: Runping Qi



The job history page is broken for some reason. When clicked, the page return the following:

HTTP ERROR: 500

1

RequestURI=/jobhistory.jsp

Powered by Jetty://



When I check the JobTracker log, I saw the following exception:


2009-03-02 10:29:00,916 WARN /: /jobhistory.jsp: 
java.lang.ArrayIndexOutOfBoundsException: 1
	at org.apache.hadoop.mapred.jobhistory_jsp$2.compare(jobhistory_jsp.java:109)
	at org.apache.hadoop.mapred.jobhistory_jsp$2.compare(jobhistory_jsp.java:93)
	at java.util.Arrays.mergeSort(Arrays.java:1270)
	at java.util.Arrays.mergeSort(Arrays.java:1281)
	at java.util.Arrays.mergeSort(Arrays.java:1281)
	at java.util.Arrays.mergeSort(Arrays.java:1281)
	at java.util.Arrays.mergeSort(Arrays.java:1281)
	at java.util.Arrays.mergeSort(Arrays.java:1281)
	at java.util.Arrays.sort(Arrays.java:1210)
	at org.apache.hadoop.mapred.jobhistory_jsp._jspService(jobhistory_jsp.java:93)
	at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
	at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
	at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
	at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
	at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
	at org.mortbay.http.HttpServer.service(HttpServer.java:954)
	at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
	at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
	at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
	at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
	at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
	at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5378) Error in displaying job history

Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678157#action_12678157 ] 

Runping Qi commented on HADOOP-5378:
------------------------------------


Looks like that under the job history log directory on the jobtracker node,
the job log files of both the old jobs (prior to upgrade) and the new jobs (after upgrade) co-exist.
The Hadoop 0.19 does not recognize the format of the old jobs.
To workaround, just remove the old files under the history dir.
 

> Error in displaying job history
> -------------------------------
>
>                 Key: HADOOP-5378
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5378
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>            Reporter: Runping Qi
>
> The job history page is broken for some reason. When clicked, the page return the following:
> HTTP ERROR: 500
> 1
> RequestURI=/jobhistory.jsp
> Powered by Jetty://
> When I check the JobTracker log, I saw the following exception:
> 2009-03-02 10:29:00,916 WARN /: /jobhistory.jsp: 
> java.lang.ArrayIndexOutOfBoundsException: 1
> 	at org.apache.hadoop.mapred.jobhistory_jsp$2.compare(jobhistory_jsp.java:109)
> 	at org.apache.hadoop.mapred.jobhistory_jsp$2.compare(jobhistory_jsp.java:93)
> 	at java.util.Arrays.mergeSort(Arrays.java:1270)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.sort(Arrays.java:1210)
> 	at org.apache.hadoop.mapred.jobhistory_jsp._jspService(jobhistory_jsp.java:93)
> 	at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
> 	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
> 	at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
> 	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
> 	at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
> 	at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
> 	at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
> 	at org.mortbay.http.HttpServer.service(HttpServer.java:954)
> 	at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
> 	at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
> 	at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
> 	at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
> 	at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> 	at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5378) Error in displaying job history

Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678241#action_12678241 ] 

Runping Qi commented on HADOOP-5378:
------------------------------------


The old job log files I removed are in the form of JTStartTime_job_...

Also, I had to remove JobHistory.log



> Error in displaying job history
> -------------------------------
>
>                 Key: HADOOP-5378
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5378
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>            Reporter: Runping Qi
>
> The job history page is broken for some reason. When clicked, the page return the following:
> HTTP ERROR: 500
> 1
> RequestURI=/jobhistory.jsp
> Powered by Jetty://
> When I check the JobTracker log, I saw the following exception:
> 2009-03-02 10:29:00,916 WARN /: /jobhistory.jsp: 
> java.lang.ArrayIndexOutOfBoundsException: 1
> 	at org.apache.hadoop.mapred.jobhistory_jsp$2.compare(jobhistory_jsp.java:109)
> 	at org.apache.hadoop.mapred.jobhistory_jsp$2.compare(jobhistory_jsp.java:93)
> 	at java.util.Arrays.mergeSort(Arrays.java:1270)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.sort(Arrays.java:1210)
> 	at org.apache.hadoop.mapred.jobhistory_jsp._jspService(jobhistory_jsp.java:93)
> 	at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
> 	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
> 	at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
> 	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
> 	at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
> 	at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
> 	at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
> 	at org.mortbay.http.HttpServer.service(HttpServer.java:954)
> 	at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
> 	at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
> 	at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
> 	at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
> 	at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> 	at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5378) Error in displaying job history

Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678228#action_12678228 ] 

Amar Kamat commented on HADOOP-5378:
------------------------------------

Runping, what is the format of the files you removed? Currently the job history file format is jobtracker-hostname_jobtracker-start-time_jobid_username_jobname.

> Error in displaying job history
> -------------------------------
>
>                 Key: HADOOP-5378
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5378
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>            Reporter: Runping Qi
>
> The job history page is broken for some reason. When clicked, the page return the following:
> HTTP ERROR: 500
> 1
> RequestURI=/jobhistory.jsp
> Powered by Jetty://
> When I check the JobTracker log, I saw the following exception:
> 2009-03-02 10:29:00,916 WARN /: /jobhistory.jsp: 
> java.lang.ArrayIndexOutOfBoundsException: 1
> 	at org.apache.hadoop.mapred.jobhistory_jsp$2.compare(jobhistory_jsp.java:109)
> 	at org.apache.hadoop.mapred.jobhistory_jsp$2.compare(jobhistory_jsp.java:93)
> 	at java.util.Arrays.mergeSort(Arrays.java:1270)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.sort(Arrays.java:1210)
> 	at org.apache.hadoop.mapred.jobhistory_jsp._jspService(jobhistory_jsp.java:93)
> 	at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
> 	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
> 	at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
> 	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
> 	at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
> 	at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
> 	at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
> 	at org.mortbay.http.HttpServer.service(HttpServer.java:954)
> 	at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
> 	at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
> 	at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
> 	at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
> 	at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> 	at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5378) Error in displaying job history

Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12678263#action_12678263 ] 

Amareshwari Sriramadasu commented on HADOOP-5378:
-------------------------------------------------

HADOOP-5149 fixes ArrayIndexOutOfBoundsException.

> Error in displaying job history
> -------------------------------
>
>                 Key: HADOOP-5378
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5378
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>            Reporter: Runping Qi
>
> The job history page is broken for some reason. When clicked, the page return the following:
> HTTP ERROR: 500
> 1
> RequestURI=/jobhistory.jsp
> Powered by Jetty://
> When I check the JobTracker log, I saw the following exception:
> 2009-03-02 10:29:00,916 WARN /: /jobhistory.jsp: 
> java.lang.ArrayIndexOutOfBoundsException: 1
> 	at org.apache.hadoop.mapred.jobhistory_jsp$2.compare(jobhistory_jsp.java:109)
> 	at org.apache.hadoop.mapred.jobhistory_jsp$2.compare(jobhistory_jsp.java:93)
> 	at java.util.Arrays.mergeSort(Arrays.java:1270)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.sort(Arrays.java:1210)
> 	at org.apache.hadoop.mapred.jobhistory_jsp._jspService(jobhistory_jsp.java:93)
> 	at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
> 	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
> 	at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
> 	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
> 	at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
> 	at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
> 	at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
> 	at org.mortbay.http.HttpServer.service(HttpServer.java:954)
> 	at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
> 	at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
> 	at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
> 	at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
> 	at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> 	at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-5378) Error in displaying job history

Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amareshwari Sriramadasu resolved HADOOP-5378.
---------------------------------------------

    Resolution: Invalid

This is due to history file format change (incompatible change) for HADOOP-2178. From 0.17 onwards, If history files pre-0.17 are present in history directory, they have to be removed.

> Error in displaying job history
> -------------------------------
>
>                 Key: HADOOP-5378
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5378
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>            Reporter: Runping Qi
>
> The job history page is broken for some reason. When clicked, the page return the following:
> HTTP ERROR: 500
> 1
> RequestURI=/jobhistory.jsp
> Powered by Jetty://
> When I check the JobTracker log, I saw the following exception:
> 2009-03-02 10:29:00,916 WARN /: /jobhistory.jsp: 
> java.lang.ArrayIndexOutOfBoundsException: 1
> 	at org.apache.hadoop.mapred.jobhistory_jsp$2.compare(jobhistory_jsp.java:109)
> 	at org.apache.hadoop.mapred.jobhistory_jsp$2.compare(jobhistory_jsp.java:93)
> 	at java.util.Arrays.mergeSort(Arrays.java:1270)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.mergeSort(Arrays.java:1281)
> 	at java.util.Arrays.sort(Arrays.java:1210)
> 	at org.apache.hadoop.mapred.jobhistory_jsp._jspService(jobhistory_jsp.java:93)
> 	at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
> 	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
> 	at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
> 	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
> 	at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
> 	at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
> 	at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
> 	at org.mortbay.http.HttpServer.service(HttpServer.java:954)
> 	at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
> 	at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
> 	at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
> 	at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
> 	at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> 	at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.