You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Arun C Murthy (JIRA)" <ji...@apache.org> on 2007/10/26 13:58:51 UTC
[jira] Created: (HADOOP-2107) Hadoop examples cannot execute on a
single-node cluster post HADOOP-1622
Hadoop examples cannot execute on a single-node cluster post HADOOP-1622
------------------------------------------------------------------------
Key: HADOOP-2107
URL: https://issues.apache.org/jira/browse/HADOOP-2107
Project: Hadoop
Issue Type: Bug
Components: mapred
Affects Versions: 0.16.0
Reporter: Arun C Murthy
Priority: Blocker
Fix For: 0.16.0
All hadoop examples on single-node cluster, post HADOOP-1622, fail with:
{noformat}
Running 10 maps.
Job started: Fri Oct 26 17:23:51 IST 2007
07/10/26 17:23:51 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
07/10/26 17:23:52 INFO mapred.JobClient: Running job: job_200710261722_0001
07/10/26 17:23:53 INFO mapred.JobClient: map 0% reduce 0%
07/10/26 17:24:07 INFO mapred.JobClient: Task Id : task_200710261722_0001_m_000000_0, Status : FAILED
java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:576)
at org.apache.hadoop.mapred.JobConf.getInputFormat(JobConf.java:512)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:156)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1936)
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:544)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:568)
... 3 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:242)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:524)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:542)
... 4 more
{noformat}
The examples work once I reverted the HADOOP-1622 patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2107) Hadoop examples cannot execute on a
single-node cluster post HADOOP-1622
Posted by "Dennis Kubes (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538165 ]
Dennis Kubes commented on HADOOP-2107:
--------------------------------------
This is due to a bug in the createJobJar method in JobClient not using the context classloader to resolve classes. I have created a patch for this and am in final testing right now. I have also brought the patch up to the current trunk level. Patch should be posted within an hour.
> Hadoop examples cannot execute on a single-node cluster post HADOOP-1622
> ------------------------------------------------------------------------
>
> Key: HADOOP-2107
> URL: https://issues.apache.org/jira/browse/HADOOP-2107
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.16.0
> Reporter: Arun C Murthy
> Assignee: Dennis Kubes
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: err.txt
>
>
> All hadoop examples on single-node cluster, post HADOOP-1622, fail with:
> {noformat}
> Running 10 maps.
> Job started: Fri Oct 26 17:23:51 IST 2007
> 07/10/26 17:23:51 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
> 07/10/26 17:23:52 INFO mapred.JobClient: Running job: job_200710261722_0001
> 07/10/26 17:23:53 INFO mapred.JobClient: map 0% reduce 0%
> 07/10/26 17:24:07 INFO mapred.JobClient: Task Id : task_200710261722_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:576)
> at org.apache.hadoop.mapred.JobConf.getInputFormat(JobConf.java:512)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:156)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1936)
> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:544)
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:568)
> ... 3 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:242)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:524)
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:542)
> ... 4 more
> {noformat}
> The examples work once I reverted the HADOOP-1622 patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-2107) Hadoop examples cannot execute on a
single-node cluster post HADOOP-1622
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley resolved HADOOP-2107.
-----------------------------------
Resolution: Duplicate
I rolled back HADOOP-1622.
> Hadoop examples cannot execute on a single-node cluster post HADOOP-1622
> ------------------------------------------------------------------------
>
> Key: HADOOP-2107
> URL: https://issues.apache.org/jira/browse/HADOOP-2107
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.16.0
> Reporter: Arun C Murthy
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: err.txt
>
>
> All hadoop examples on single-node cluster, post HADOOP-1622, fail with:
> {noformat}
> Running 10 maps.
> Job started: Fri Oct 26 17:23:51 IST 2007
> 07/10/26 17:23:51 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
> 07/10/26 17:23:52 INFO mapred.JobClient: Running job: job_200710261722_0001
> 07/10/26 17:23:53 INFO mapred.JobClient: map 0% reduce 0%
> 07/10/26 17:24:07 INFO mapred.JobClient: Task Id : task_200710261722_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:576)
> at org.apache.hadoop.mapred.JobConf.getInputFormat(JobConf.java:512)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:156)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1936)
> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:544)
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:568)
> ... 3 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:242)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:524)
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:542)
> ... 4 more
> {noformat}
> The examples work once I reverted the HADOOP-1622 patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-2107) Hadoop examples cannot execute on a
single-node cluster post HADOOP-1622
Posted by "Dennis Kubes (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dennis Kubes reassigned HADOOP-2107:
------------------------------------
Assignee: Dennis Kubes
> Hadoop examples cannot execute on a single-node cluster post HADOOP-1622
> ------------------------------------------------------------------------
>
> Key: HADOOP-2107
> URL: https://issues.apache.org/jira/browse/HADOOP-2107
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.16.0
> Reporter: Arun C Murthy
> Assignee: Dennis Kubes
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: err.txt
>
>
> All hadoop examples on single-node cluster, post HADOOP-1622, fail with:
> {noformat}
> Running 10 maps.
> Job started: Fri Oct 26 17:23:51 IST 2007
> 07/10/26 17:23:51 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
> 07/10/26 17:23:52 INFO mapred.JobClient: Running job: job_200710261722_0001
> 07/10/26 17:23:53 INFO mapred.JobClient: map 0% reduce 0%
> 07/10/26 17:24:07 INFO mapred.JobClient: Task Id : task_200710261722_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:576)
> at org.apache.hadoop.mapred.JobConf.getInputFormat(JobConf.java:512)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:156)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1936)
> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:544)
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:568)
> ... 3 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:242)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:524)
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:542)
> ... 4 more
> {noformat}
> The examples work once I reverted the HADOOP-1622 patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2107) Hadoop examples cannot execute on a
single-node cluster post HADOOP-1622
Posted by "Dennis Kubes (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538385 ]
Dennis Kubes commented on HADOOP-2107:
--------------------------------------
This issue has been resolved and a patch posted to HADOOP-1622.
> Hadoop examples cannot execute on a single-node cluster post HADOOP-1622
> ------------------------------------------------------------------------
>
> Key: HADOOP-2107
> URL: https://issues.apache.org/jira/browse/HADOOP-2107
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.16.0
> Reporter: Arun C Murthy
> Assignee: Dennis Kubes
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: err.txt
>
>
> All hadoop examples on single-node cluster, post HADOOP-1622, fail with:
> {noformat}
> Running 10 maps.
> Job started: Fri Oct 26 17:23:51 IST 2007
> 07/10/26 17:23:51 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
> 07/10/26 17:23:52 INFO mapred.JobClient: Running job: job_200710261722_0001
> 07/10/26 17:23:53 INFO mapred.JobClient: map 0% reduce 0%
> 07/10/26 17:24:07 INFO mapred.JobClient: Task Id : task_200710261722_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:576)
> at org.apache.hadoop.mapred.JobConf.getInputFormat(JobConf.java:512)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:156)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1936)
> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:544)
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:568)
> ... 3 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:242)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:524)
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:542)
> ... 4 more
> {noformat}
> The examples work once I reverted the HADOOP-1622 patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2107) Hadoop examples cannot execute on a
single-node cluster post HADOOP-1622
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2107:
----------------------------------
Attachment: err.txt
The command to run the examples was:
{noformat}
$ hadoop jar build/hadoop-0.16.0-dev-examples.jar randomwriter -Dtest.randomwrite.bytes_per_map=1000000 /rw/in
{noformat}
I've attached the complete error file.
> Hadoop examples cannot execute on a single-node cluster post HADOOP-1622
> ------------------------------------------------------------------------
>
> Key: HADOOP-2107
> URL: https://issues.apache.org/jira/browse/HADOOP-2107
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.16.0
> Reporter: Arun C Murthy
> Priority: Blocker
> Fix For: 0.16.0
>
> Attachments: err.txt
>
>
> All hadoop examples on single-node cluster, post HADOOP-1622, fail with:
> {noformat}
> Running 10 maps.
> Job started: Fri Oct 26 17:23:51 IST 2007
> 07/10/26 17:23:51 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
> 07/10/26 17:23:52 INFO mapred.JobClient: Running job: job_200710261722_0001
> 07/10/26 17:23:53 INFO mapred.JobClient: map 0% reduce 0%
> 07/10/26 17:24:07 INFO mapred.JobClient: Task Id : task_200710261722_0001_m_000000_0, Status : FAILED
> java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:576)
> at org.apache.hadoop.mapred.JobConf.getInputFormat(JobConf.java:512)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:156)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1936)
> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:544)
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:568)
> ... 3 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.examples.RandomWriter$RandomInputFormat
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:242)
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:524)
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:542)
> ... 4 more
> {noformat}
> The examples work once I reverted the HADOOP-1622 patch.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.