You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Devaraj Das (JIRA)" <ji...@apache.org> on 2007/05/13 21:05:15 UTC

[jira] Created: (HADOOP-1352) JobTracker consistently throws ArrayIndexOutOfBoundsException for some jobs accessed via the job-history

JobTracker consistently throws ArrayIndexOutOfBoundsException for some jobs accessed via the job-history
--------------------------------------------------------------------------------------------------------

                 Key: HADOOP-1352
                 URL: https://issues.apache.org/jira/browse/HADOOP-1352
             Project: Hadoop
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.12.3
            Reporter: Devaraj Das
             Fix For: 0.14.0


This is the exception from the jobtracker when I attempted to access the via the job history. It consistently threw this exception for that particular job whereas for other jobs in the history it worked fine..

2007-05-13 18:51:07,343 WARN /: /analysejobhistory.jsp?jobid=job_0002&jobTrackerId=1179059464110:
java.lang.ArrayIndexOutOfBoundsException: 79647
        at org.apache.hadoop.mapred.analysejobhistory_jsp._jspService(analysejobhistory_jsp.java:107)
        at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
        at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
        at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
        at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
        at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
        at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
        at org.mortbay.http.HttpServer.service(HttpServer.java:954)
        at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
        at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
        at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
        at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
        at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
        at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-1352) JobTracker consistently throws ArrayIndexOutOfBoundsException for some jobs accessed via the job-history

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy resolved HADOOP-1352.
-----------------------------------

    Resolution: Cannot Reproduce

I've tried to reproduce this without luck and even the actual jobhistory file didn't bring up the ArrayIndexOutOfBoundsException... closing this for now, can reopen later if required.

> JobTracker consistently throws ArrayIndexOutOfBoundsException for some jobs accessed via the job-history
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1352
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1352
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Devaraj Das
>            Assignee: Arun C Murthy
>             Fix For: 0.14.0
>
>
> This is the exception from the jobtracker when I attempted to access the via the job history. It consistently threw this exception for that particular job whereas for other jobs in the history it worked fine..
> 2007-05-13 18:51:07,343 WARN /: /analysejobhistory.jsp?jobid=job_0002&jobTrackerId=1179059464110:
> java.lang.ArrayIndexOutOfBoundsException: 79647
>         at org.apache.hadoop.mapred.analysejobhistory_jsp._jspService(analysejobhistory_jsp.java:107)
>         at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>         at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
>         at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
>         at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
>         at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
>         at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
>         at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
>         at org.mortbay.http.HttpServer.service(HttpServer.java:954)
>         at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
>         at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
>         at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
>         at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
>         at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
>         at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1352) JobTracker consistently throws ArrayIndexOutOfBoundsException for some jobs accessed via the job-history

Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12495544 ] 

Devaraj Das commented on HADOOP-1352:
-------------------------------------

This is the JobHistory.log content for that run of the JobTracker:

Jobtracker START_TIME="1179059464110"
Job JOBID="job_0001" JOBNAME="random-writer" USER="hadoopqa" SUBMIT_TIME="1179059464102" JOBCONF="/dfstmp/mapred/system/submit_gymtp0/job.xml"
Job JOBID="job_0001" LAUNCH_TIME="1179059464807" TOTAL_MAPS="8850" TOTAL_REDUCES="1"
Job JOBID="job_0001" FINISH_TIME="1179061474938" JOB_STATUS="SUCCESS" FINISHED_MAPS="8850" FINISHED_REDUCES="1"
Job JOBID="job_0002" JOBNAME="sorter" USER="hadoopqa" SUBMIT_TIME="1179061540518" JOBCONF="/dfstmp/mapred/system/submit_37xwkd/job.xml"
Job JOBID="job_0002" LAUNCH_TIME="1179061548051" TOTAL_MAPS="79650" TOTAL_REDUCES="1710"
Job JOBID="job_0002" FINISH_TIME="1179080590513" JOB_STATUS="SUCCESS" FINISHED_MAPS="79647" FINISHED_REDUCES="1710"
Job JOBID="job_0003" JOBNAME="sortvalidate-recordstats-checker" USER="hadoopqa" SUBMIT_TIME="1179080642426" JOBCONF="/dfstmp/mapred/system/submit_5vgo2y/job.xml"
Job JOBID="job_0003" LAUNCH_TIME="1179080642617" TOTAL_MAPS="10560" TOTAL_REDUCES="1"
Job JOBID="job_0003" FINISH_TIME="1179082523881" JOB_STATUS="SUCCESS" FINISHED_MAPS="10559" FINISHED_REDUCES="1"


> JobTracker consistently throws ArrayIndexOutOfBoundsException for some jobs accessed via the job-history
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1352
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1352
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Devaraj Das
>             Fix For: 0.14.0
>
>
> This is the exception from the jobtracker when I attempted to access the via the job history. It consistently threw this exception for that particular job whereas for other jobs in the history it worked fine..
> 2007-05-13 18:51:07,343 WARN /: /analysejobhistory.jsp?jobid=job_0002&jobTrackerId=1179059464110:
> java.lang.ArrayIndexOutOfBoundsException: 79647
>         at org.apache.hadoop.mapred.analysejobhistory_jsp._jspService(analysejobhistory_jsp.java:107)
>         at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>         at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
>         at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
>         at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
>         at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
>         at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
>         at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
>         at org.mortbay.http.HttpServer.service(HttpServer.java:954)
>         at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
>         at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
>         at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
>         at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
>         at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
>         at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HADOOP-1352) JobTracker consistently throws ArrayIndexOutOfBoundsException for some jobs accessed via the job-history

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy reassigned HADOOP-1352:
-------------------------------------

    Assignee: Arun C Murthy

> JobTracker consistently throws ArrayIndexOutOfBoundsException for some jobs accessed via the job-history
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1352
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1352
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.12.3
>            Reporter: Devaraj Das
>         Assigned To: Arun C Murthy
>             Fix For: 0.14.0
>
>
> This is the exception from the jobtracker when I attempted to access the via the job history. It consistently threw this exception for that particular job whereas for other jobs in the history it worked fine..
> 2007-05-13 18:51:07,343 WARN /: /analysejobhistory.jsp?jobid=job_0002&jobTrackerId=1179059464110:
> java.lang.ArrayIndexOutOfBoundsException: 79647
>         at org.apache.hadoop.mapred.analysejobhistory_jsp._jspService(analysejobhistory_jsp.java:107)
>         at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>         at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
>         at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
>         at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
>         at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
>         at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
>         at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
>         at org.mortbay.http.HttpServer.service(HttpServer.java:954)
>         at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
>         at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
>         at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
>         at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
>         at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
>         at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.