You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Nishan Shetty (JIRA)" <ji...@apache.org> on 2012/05/30 14:06:23 UTC
[jira] [Created] (MAPREDUCE-4294) Submitting job by enabling task
profiling gives IOException
Nishan Shetty created MAPREDUCE-4294:
----------------------------------------
Summary: Submitting job by enabling task profiling gives IOException
Key: MAPREDUCE-4294
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4294
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 2.0.0-alpha, 3.0.0
Reporter: Nishan Shetty
{noformat}
java.io.IOException: Server returned HTTP response code: 400 for URL: http://HOST-10-18-52-224:8080/tasklog?plaintext=true&attemptid=attempt_1338370885386_0006_m_000000_0&filter=profile
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1290)
at org.apache.hadoop.mapreduce.Job.downloadProfile(Job.java:1421)
at org.apache.hadoop.mapreduce.Job.printTaskEvents(Job.java:1376)
at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1310)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1247)
at org.apache.hadoop.examples.WordCount.main(WordCount.java:84)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:200)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-4294) Submitting job by enabling task
profiling gives IOException
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj K reassigned MAPREDUCE-4294:
------------------------------------
Assignee: Devaraj K
> Submitting job by enabling task profiling gives IOException
> -----------------------------------------------------------
>
> Key: MAPREDUCE-4294
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4294
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Nishan Shetty
> Assignee: Devaraj K
>
> {noformat}
> java.io.IOException: Server returned HTTP response code: 400 for URL: http://HOST-10-18-52-224:8080/tasklog?plaintext=true&attemptid=attempt_1338370885386_0006_m_000000_0&filter=profile
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1290)
> at org.apache.hadoop.mapreduce.Job.downloadProfile(Job.java:1421)
> at org.apache.hadoop.mapreduce.Job.printTaskEvents(Job.java:1376)
> at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1310)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1247)
> at org.apache.hadoop.examples.WordCount.main(WordCount.java:84)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144)
> at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:200)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4294) Submitting job by enabling task
profiling gives IOException
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285646#comment-13285646 ]
Robert Joseph Evans commented on MAPREDUCE-4294:
------------------------------------------------
@Nishan,
Could you please explain in more detail how to reproduce this issue? Perhaps it is just me but I don't know how to enable task profiling.
> Submitting job by enabling task profiling gives IOException
> -----------------------------------------------------------
>
> Key: MAPREDUCE-4294
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4294
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Nishan Shetty
>
> {noformat}
> java.io.IOException: Server returned HTTP response code: 400 for URL: http://HOST-10-18-52-224:8080/tasklog?plaintext=true&attemptid=attempt_1338370885386_0006_m_000000_0&filter=profile
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1290)
> at org.apache.hadoop.mapreduce.Job.downloadProfile(Job.java:1421)
> at org.apache.hadoop.mapreduce.Job.printTaskEvents(Job.java:1376)
> at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1310)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1247)
> at org.apache.hadoop.examples.WordCount.main(WordCount.java:84)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144)
> at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:200)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4294) Submitting job by enabling task
profiling gives IOException
Posted by "Devaraj K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13285656#comment-13285656 ]
Devaraj K commented on MAPREDUCE-4294:
--------------------------------------
If we execute wordcount example by enabling profiling like below, it is occurring always.
{code:xml}
>bin# ./yarn jar ../share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar
wordcount -Dmapreduce.task.profile=true /in /out
{code}
Job Client is trying to get task attempt logs using TaskLogServlet (i.e tasklog url pattern) which doesn't exist in the latest code and causing 400 error.
> Submitting job by enabling task profiling gives IOException
> -----------------------------------------------------------
>
> Key: MAPREDUCE-4294
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4294
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Nishan Shetty
>
> {noformat}
> java.io.IOException: Server returned HTTP response code: 400 for URL: http://HOST-10-18-52-224:8080/tasklog?plaintext=true&attemptid=attempt_1338370885386_0006_m_000000_0&filter=profile
> at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1290)
> at org.apache.hadoop.mapreduce.Job.downloadProfile(Job.java:1421)
> at org.apache.hadoop.mapreduce.Job.printTaskEvents(Job.java:1376)
> at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1310)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1247)
> at org.apache.hadoop.examples.WordCount.main(WordCount.java:84)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
> at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144)
> at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:200)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira