You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Devaraj K (Created) (JIRA)" <ji...@apache.org> on 2011/10/21 18:26:33 UTC
[jira] [Created] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
(Rumen)TraceBuilder throws IllegalArgumentException
---------------------------------------------------
Key: MAPREDUCE-3241
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 0.24.0
Reporter: Devaraj K
Assignee: Devaraj K
When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
{code}
2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140334#comment-13140334 ]
Hudson commented on MAPREDUCE-3241:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #122 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/122/])
MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Eli Collins (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated MAPREDUCE-3241:
-----------------------------------
Target Version/s: (was: 0.24.0)
Fix Version/s: 0.23.1
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.23.1, 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133274#comment-13133274 ]
Amar Kamat commented on MAPREDUCE-3241:
---------------------------------------
Devaraj,
Can you tell us how to reproduce this issue? What is the version of the JobHistory files?
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140678#comment-13140678 ]
Hudson commented on MAPREDUCE-3241:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #58 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/58/])
MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140266#comment-13140266 ]
Vinod Kumar Vavilapalli commented on MAPREDUCE-3241:
----------------------------------------------------
bq. I just committed the attached patch to trunk.
Need in branch-0.23 too?
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140293#comment-13140293 ]
Amar Kamat commented on MAPREDUCE-3241:
---------------------------------------
bq. Need in branch-0.23 too?
Already committed to branch 0.23.
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Siddharth Seth (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139954#comment-13139954 ]
Siddharth Seth commented on MAPREDUCE-3241:
-------------------------------------------
Tried the patch - TraceBuilder works with it applied. Looks good, with a follow up jira to handle the AMStarted event.
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Amar Kamat (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated MAPREDUCE-3241:
----------------------------------
Attachment: mapreduce-3241-v1.1.patch
Attaching a patch which ignores the AMStart event.
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140385#comment-13140385 ]
Hudson commented on MAPREDUCE-3241:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #57 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/57/])
MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133850#comment-13133850 ]
Amar Kamat commented on MAPREDUCE-3241:
---------------------------------------
Thanks for the explanation Devaraj. I am not sure why AM related events should surface in a MapReduce job's history. Requesting Ravi to look into this.
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140252#comment-13140252 ]
Hudson commented on MAPREDUCE-3241:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1281 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1281/])
MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140250#comment-13140250 ]
Hudson commented on MAPREDUCE-3241:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1205 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1205/])
MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140272#comment-13140272 ]
Hudson commented on MAPREDUCE-3241:
-----------------------------------
Integrated in Hadoop-Common-0.23-Commit #113 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/113/])
MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3241:
-------------------------------------
Fix Version/s: (was: 0.23.1)
0.23.0
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.23.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141174#comment-13141174 ]
Hudson commented on MAPREDUCE-3241:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #884 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/884/])
MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Devaraj K (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133837#comment-13133837 ]
Devaraj K commented on MAPREDUCE-3241:
--------------------------------------
It is reproducible with the latest trunk code. You can run the below command using the latest job history file.
{code:xml}
./yarn jar hadoop-mapreduce-tools-0.24.0-SNAPSHOT.jar org.apache.hadoop.tools.rumen.TraceBuilder
-recursive <jobtrace-output> <topology-output> <inputs>
{code}
Recently AM_STARTED event record has added in the history file, but it is not handled in the rumen.
{code:title=JobBuilder.java|borderStyle=solid}
public void process(HistoryEvent event) {
.......
.......
} else if (event instanceof TaskUpdatedEvent) {
processTaskUpdatedEvent((TaskUpdatedEvent) event);
} else
throw new IllegalArgumentException(
"JobBuilder.process(HistoryEvent): unknown event type");
}
{code}
Here for AM_STARTED record, AMStartedEvent is not able to parse and throwing the IllegalArgumentException.
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Devaraj K
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140271#comment-13140271 ]
Hudson commented on MAPREDUCE-3241:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #114 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/114/])
MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195548
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140273#comment-13140273 ]
Hudson commented on MAPREDUCE-3241:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1231 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1231/])
MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141140#comment-13141140 ]
Hudson commented on MAPREDUCE-3241:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #850 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/850/])
MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1195535
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/rumen/JobBuilder.java
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3241) (Rumen)TraceBuilder throws
IllegalArgumentException
Posted by "Amar Kamat (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat resolved MAPREDUCE-3241.
-----------------------------------
Resolution: Fixed
Fix Version/s: 0.24.0
Assignee: Amar Kamat (was: Devaraj K)
Target Version/s: 0.24.0
Release Note: Rumen is fixed to ignore the AMRestartedEvent.
I just committed the attached patch to trunk.
> (Rumen)TraceBuilder throws IllegalArgumentException
> ---------------------------------------------------
>
> Key: MAPREDUCE-3241
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3241
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.24.0
> Reporter: Devaraj K
> Assignee: Amar Kamat
> Fix For: 0.24.0
>
> Attachments: mapreduce-3241-v1.1.patch
>
>
> When we run the TraceBuilder, we get this exception. Output of the TraceBuilder doesn't contain the map and reduce task information.
> {code}
> 2011-10-21 22:07:17,268 WARN rumen.TraceBuilder (TraceBuilder.java:run(272)) - TraceBuilder got an error while processing the [possibly virtual] file job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist within Path hdfs://10.18.52.57:9000/user/root/null/history/done_intermediate/root/job_1319214405771_0002-1319214846458-root-word+count-1319214871038-1-1-SUCCEEDED.jhist
> java.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type
> at org.apache.hadoop.tools.rumen.JobBuilder.process(JobBuilder.java:165)
> at org.apache.hadoop.tools.rumen.TraceBuilder.processJobHistory(TraceBuilder.java:304)
> at org.apache.hadoop.tools.rumen.TraceBuilder.run(TraceBuilder.java:258)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
> at org.apache.hadoop.tools.rumen.TraceBuilder.main(TraceBuilder.java:185)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira