You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Konstantin Shvachko (JIRA)" <ji...@apache.org> on 2006/09/07 00:23:24 UTC
[jira] Created: (HADOOP-513) IllegalStateException is thrown by
TaskTracker
IllegalStateException is thrown by TaskTracker
----------------------------------------------
Key: HADOOP-513
URL: http://issues.apache.org/jira/browse/HADOOP-513
Project: Hadoop
Issue Type: Bug
Affects Versions: 0.5.0
Reporter: Konstantin Shvachko
I am running TestDFSIO on a one node cluster and getting IllegalStateException for each map task run as listed below.
The same exceptions are flooding logs for TestMiniMRWithDFS on my nightly build for quite a while now.
Does anybody know what that is?
My understanding is that if it is "illegal", then tests should fail.
If not then it should be caught and ignored INTERNALLY.
06/09/06 14:54:50 INFO mapred.TaskTracker: task_0002_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) >
06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Need 1 map output(s)
06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Got 1 known map output location(s); scheduling...
06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Scheduled 1 of 1 known outputs (0 slow hosts and 0 dup hosts)
06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Copying task_0002_m_000003_0 output from ENO.
06/09/06 14:54:50 WARN /: /getMapOutput.jsp?map=task_0002_m_000003_0&reduce=0:
java.lang.IllegalStateException
at org.mortbay.jetty.servlet.ServletHttpResponse.getWriter(ServletHttpResponse.java:561)
at org.apache.jasper.runtime.JspWriterImpl.initOut(JspWriterImpl.java:122)
at org.apache.jasper.runtime.JspWriterImpl.flushBuffer(JspWriterImpl.java:115)
at org.apache.jasper.runtime.PageContextImpl.release(PageContextImpl.java:190)
at org.apache.jasper.runtime.JspFactoryImpl.internalReleasePageContext(JspFactoryImpl.java:115)
at org.apache.jasper.runtime.JspFactoryImpl.releasePageContext(JspFactoryImpl.java:75)
at org.apache.hadoop.mapred.getMapOutput_jsp._jspService(getMapOutput_jsp.java:100)
at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
at org.mortbay.http.HttpServer.service(HttpServer.java:954)
at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)
06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 done copying task_0002_m_000003_0 output from ENO.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-513) IllegalStateException is thrown by
TaskTracker
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-513?page=all ]
Doug Cutting updated HADOOP-513:
--------------------------------
Status: Resolved (was: Patch Available)
Resolution: Fixed
I just committed this. Thanks, Owen!
> IllegalStateException is thrown by TaskTracker
> ----------------------------------------------
>
> Key: HADOOP-513
> URL: http://issues.apache.org/jira/browse/HADOOP-513
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.5.0
> Reporter: Konstantin Shvachko
> Assigned To: Owen O'Malley
> Fix For: 0.7.0
>
> Attachments: map-out-servlet.patch
>
>
> I am running TestDFSIO on a one node cluster and getting IllegalStateException for each map task run as listed below.
> The same exceptions are flooding logs for TestMiniMRWithDFS on my nightly build for quite a while now.
> Does anybody know what that is?
> My understanding is that if it is "illegal", then tests should fail.
> If not then it should be caught and ignored INTERNALLY.
> 06/09/06 14:54:50 INFO mapred.TaskTracker: task_0002_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) >
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Need 1 map output(s)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Got 1 known map output location(s); scheduling...
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Scheduled 1 of 1 known outputs (0 slow hosts and 0 dup hosts)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Copying task_0002_m_000003_0 output from ENO.
> 06/09/06 14:54:50 WARN /: /getMapOutput.jsp?map=task_0002_m_000003_0&reduce=0:
> java.lang.IllegalStateException
> at org.mortbay.jetty.servlet.ServletHttpResponse.getWriter(ServletHttpResponse.java:561)
> at org.apache.jasper.runtime.JspWriterImpl.initOut(JspWriterImpl.java:122)
> at org.apache.jasper.runtime.JspWriterImpl.flushBuffer(JspWriterImpl.java:115)
> at org.apache.jasper.runtime.PageContextImpl.release(PageContextImpl.java:190)
> at org.apache.jasper.runtime.JspFactoryImpl.internalReleasePageContext(JspFactoryImpl.java:115)
> at org.apache.jasper.runtime.JspFactoryImpl.releasePageContext(JspFactoryImpl.java:75)
> at org.apache.hadoop.mapred.getMapOutput_jsp._jspService(getMapOutput_jsp.java:100)
> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
> at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
> at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
> at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
> at org.mortbay.http.HttpServer.service(HttpServer.java:954)
> at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
> at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
> at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
> at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
> at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 done copying task_0002_m_000003_0 output from ENO.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Assigned: (HADOOP-513) IllegalStateException is thrown by
TaskTracker
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-513?page=all ]
Owen O'Malley reassigned HADOOP-513:
------------------------------------
Assignee: Owen O'Malley
> IllegalStateException is thrown by TaskTracker
> ----------------------------------------------
>
> Key: HADOOP-513
> URL: http://issues.apache.org/jira/browse/HADOOP-513
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.5.0
> Reporter: Konstantin Shvachko
> Assigned To: Owen O'Malley
>
> I am running TestDFSIO on a one node cluster and getting IllegalStateException for each map task run as listed below.
> The same exceptions are flooding logs for TestMiniMRWithDFS on my nightly build for quite a while now.
> Does anybody know what that is?
> My understanding is that if it is "illegal", then tests should fail.
> If not then it should be caught and ignored INTERNALLY.
> 06/09/06 14:54:50 INFO mapred.TaskTracker: task_0002_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) >
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Need 1 map output(s)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Got 1 known map output location(s); scheduling...
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Scheduled 1 of 1 known outputs (0 slow hosts and 0 dup hosts)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Copying task_0002_m_000003_0 output from ENO.
> 06/09/06 14:54:50 WARN /: /getMapOutput.jsp?map=task_0002_m_000003_0&reduce=0:
> java.lang.IllegalStateException
> at org.mortbay.jetty.servlet.ServletHttpResponse.getWriter(ServletHttpResponse.java:561)
> at org.apache.jasper.runtime.JspWriterImpl.initOut(JspWriterImpl.java:122)
> at org.apache.jasper.runtime.JspWriterImpl.flushBuffer(JspWriterImpl.java:115)
> at org.apache.jasper.runtime.PageContextImpl.release(PageContextImpl.java:190)
> at org.apache.jasper.runtime.JspFactoryImpl.internalReleasePageContext(JspFactoryImpl.java:115)
> at org.apache.jasper.runtime.JspFactoryImpl.releasePageContext(JspFactoryImpl.java:75)
> at org.apache.hadoop.mapred.getMapOutput_jsp._jspService(getMapOutput_jsp.java:100)
> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
> at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
> at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
> at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
> at org.mortbay.http.HttpServer.service(HttpServer.java:954)
> at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
> at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
> at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
> at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
> at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 done copying task_0002_m_000003_0 output from ENO.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-513) IllegalStateException is thrown by
TaskTracker
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-513?page=all ]
Owen O'Malley updated HADOOP-513:
---------------------------------
Status: Patch Available (was: In Progress)
Fix Version/s: 0.7.0
> IllegalStateException is thrown by TaskTracker
> ----------------------------------------------
>
> Key: HADOOP-513
> URL: http://issues.apache.org/jira/browse/HADOOP-513
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.5.0
> Reporter: Konstantin Shvachko
> Assigned To: Owen O'Malley
> Fix For: 0.7.0
>
> Attachments: map-out-servlet.patch
>
>
> I am running TestDFSIO on a one node cluster and getting IllegalStateException for each map task run as listed below.
> The same exceptions are flooding logs for TestMiniMRWithDFS on my nightly build for quite a while now.
> Does anybody know what that is?
> My understanding is that if it is "illegal", then tests should fail.
> If not then it should be caught and ignored INTERNALLY.
> 06/09/06 14:54:50 INFO mapred.TaskTracker: task_0002_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) >
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Need 1 map output(s)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Got 1 known map output location(s); scheduling...
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Scheduled 1 of 1 known outputs (0 slow hosts and 0 dup hosts)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Copying task_0002_m_000003_0 output from ENO.
> 06/09/06 14:54:50 WARN /: /getMapOutput.jsp?map=task_0002_m_000003_0&reduce=0:
> java.lang.IllegalStateException
> at org.mortbay.jetty.servlet.ServletHttpResponse.getWriter(ServletHttpResponse.java:561)
> at org.apache.jasper.runtime.JspWriterImpl.initOut(JspWriterImpl.java:122)
> at org.apache.jasper.runtime.JspWriterImpl.flushBuffer(JspWriterImpl.java:115)
> at org.apache.jasper.runtime.PageContextImpl.release(PageContextImpl.java:190)
> at org.apache.jasper.runtime.JspFactoryImpl.internalReleasePageContext(JspFactoryImpl.java:115)
> at org.apache.jasper.runtime.JspFactoryImpl.releasePageContext(JspFactoryImpl.java:75)
> at org.apache.hadoop.mapred.getMapOutput_jsp._jspService(getMapOutput_jsp.java:100)
> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
> at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
> at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
> at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
> at org.mortbay.http.HttpServer.service(HttpServer.java:954)
> at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
> at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
> at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
> at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
> at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 done copying task_0002_m_000003_0 output from ENO.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-513) IllegalStateException is thrown by
TaskTracker
Posted by "Sameer Paranjpye (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-513?page=all ]
Sameer Paranjpye updated HADOOP-513:
------------------------------------
Component/s: mapred
> IllegalStateException is thrown by TaskTracker
> ----------------------------------------------
>
> Key: HADOOP-513
> URL: http://issues.apache.org/jira/browse/HADOOP-513
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.5.0
> Reporter: Konstantin Shvachko
>
> I am running TestDFSIO on a one node cluster and getting IllegalStateException for each map task run as listed below.
> The same exceptions are flooding logs for TestMiniMRWithDFS on my nightly build for quite a while now.
> Does anybody know what that is?
> My understanding is that if it is "illegal", then tests should fail.
> If not then it should be caught and ignored INTERNALLY.
> 06/09/06 14:54:50 INFO mapred.TaskTracker: task_0002_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) >
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Need 1 map output(s)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Got 1 known map output location(s); scheduling...
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Scheduled 1 of 1 known outputs (0 slow hosts and 0 dup hosts)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Copying task_0002_m_000003_0 output from ENO.
> 06/09/06 14:54:50 WARN /: /getMapOutput.jsp?map=task_0002_m_000003_0&reduce=0:
> java.lang.IllegalStateException
> at org.mortbay.jetty.servlet.ServletHttpResponse.getWriter(ServletHttpResponse.java:561)
> at org.apache.jasper.runtime.JspWriterImpl.initOut(JspWriterImpl.java:122)
> at org.apache.jasper.runtime.JspWriterImpl.flushBuffer(JspWriterImpl.java:115)
> at org.apache.jasper.runtime.PageContextImpl.release(PageContextImpl.java:190)
> at org.apache.jasper.runtime.JspFactoryImpl.internalReleasePageContext(JspFactoryImpl.java:115)
> at org.apache.jasper.runtime.JspFactoryImpl.releasePageContext(JspFactoryImpl.java:75)
> at org.apache.hadoop.mapred.getMapOutput_jsp._jspService(getMapOutput_jsp.java:100)
> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
> at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
> at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
> at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
> at org.mortbay.http.HttpServer.service(HttpServer.java:954)
> at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
> at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
> at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
> at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
> at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 done copying task_0002_m_000003_0 output from ENO.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Work started: (HADOOP-513) IllegalStateException is thrown
by TaskTracker
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-513?page=all ]
Work on HADOOP-513 started by Owen O'Malley.
> IllegalStateException is thrown by TaskTracker
> ----------------------------------------------
>
> Key: HADOOP-513
> URL: http://issues.apache.org/jira/browse/HADOOP-513
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.5.0
> Reporter: Konstantin Shvachko
> Assigned To: Owen O'Malley
>
> I am running TestDFSIO on a one node cluster and getting IllegalStateException for each map task run as listed below.
> The same exceptions are flooding logs for TestMiniMRWithDFS on my nightly build for quite a while now.
> Does anybody know what that is?
> My understanding is that if it is "illegal", then tests should fail.
> If not then it should be caught and ignored INTERNALLY.
> 06/09/06 14:54:50 INFO mapred.TaskTracker: task_0002_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) >
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Need 1 map output(s)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Got 1 known map output location(s); scheduling...
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Scheduled 1 of 1 known outputs (0 slow hosts and 0 dup hosts)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Copying task_0002_m_000003_0 output from ENO.
> 06/09/06 14:54:50 WARN /: /getMapOutput.jsp?map=task_0002_m_000003_0&reduce=0:
> java.lang.IllegalStateException
> at org.mortbay.jetty.servlet.ServletHttpResponse.getWriter(ServletHttpResponse.java:561)
> at org.apache.jasper.runtime.JspWriterImpl.initOut(JspWriterImpl.java:122)
> at org.apache.jasper.runtime.JspWriterImpl.flushBuffer(JspWriterImpl.java:115)
> at org.apache.jasper.runtime.PageContextImpl.release(PageContextImpl.java:190)
> at org.apache.jasper.runtime.JspFactoryImpl.internalReleasePageContext(JspFactoryImpl.java:115)
> at org.apache.jasper.runtime.JspFactoryImpl.releasePageContext(JspFactoryImpl.java:75)
> at org.apache.hadoop.mapred.getMapOutput_jsp._jspService(getMapOutput_jsp.java:100)
> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
> at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
> at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
> at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
> at org.mortbay.http.HttpServer.service(HttpServer.java:954)
> at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
> at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
> at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
> at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
> at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 done copying task_0002_m_000003_0 output from ENO.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-513) IllegalStateException is thrown by
TaskTracker
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-513?page=all ]
Owen O'Malley updated HADOOP-513:
---------------------------------
Attachment: map-out-servlet.patch
This patch replaces the getMapOutput.jsp with a Servlet.
The problem was that the getMapOutput.jsp was closing the output stream and the wrapper code was trying to close it again, which would sometimes generate the IllegalStateException.
The new servlet is more careful to handle errors including setting an error response if something goes wrong. It also sets the content-length with the length of the file.
> IllegalStateException is thrown by TaskTracker
> ----------------------------------------------
>
> Key: HADOOP-513
> URL: http://issues.apache.org/jira/browse/HADOOP-513
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.5.0
> Reporter: Konstantin Shvachko
> Assigned To: Owen O'Malley
> Fix For: 0.7.0
>
> Attachments: map-out-servlet.patch
>
>
> I am running TestDFSIO on a one node cluster and getting IllegalStateException for each map task run as listed below.
> The same exceptions are flooding logs for TestMiniMRWithDFS on my nightly build for quite a while now.
> Does anybody know what that is?
> My understanding is that if it is "illegal", then tests should fail.
> If not then it should be caught and ignored INTERNALLY.
> 06/09/06 14:54:50 INFO mapred.TaskTracker: task_0002_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) >
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Need 1 map output(s)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Got 1 known map output location(s); scheduling...
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Scheduled 1 of 1 known outputs (0 slow hosts and 0 dup hosts)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Copying task_0002_m_000003_0 output from ENO.
> 06/09/06 14:54:50 WARN /: /getMapOutput.jsp?map=task_0002_m_000003_0&reduce=0:
> java.lang.IllegalStateException
> at org.mortbay.jetty.servlet.ServletHttpResponse.getWriter(ServletHttpResponse.java:561)
> at org.apache.jasper.runtime.JspWriterImpl.initOut(JspWriterImpl.java:122)
> at org.apache.jasper.runtime.JspWriterImpl.flushBuffer(JspWriterImpl.java:115)
> at org.apache.jasper.runtime.PageContextImpl.release(PageContextImpl.java:190)
> at org.apache.jasper.runtime.JspFactoryImpl.internalReleasePageContext(JspFactoryImpl.java:115)
> at org.apache.jasper.runtime.JspFactoryImpl.releasePageContext(JspFactoryImpl.java:75)
> at org.apache.hadoop.mapred.getMapOutput_jsp._jspService(getMapOutput_jsp.java:100)
> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
> at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
> at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
> at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
> at org.mortbay.http.HttpServer.service(HttpServer.java:954)
> at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
> at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
> at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
> at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
> at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 done copying task_0002_m_000003_0 output from ENO.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira