You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Majid Azimi <ma...@gmail.com> on 2011/10/15 22:51:03 UTC

Unrecognized option: -jvm

Hi guys,

I'm realy new to hadoop. I have configured a single node hadoop cluster. but
seems that my data node is not working. job tracker log file shows this
message(alot of them per 10 second):
********************************************************************
2011-10-16 00:01:15,558 WARN org.apache.hadoop.mapred.JobTracker:
Retrying...
2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: DataStreamer
Exception: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
/tmp/hadoop-root/mapred/system/jobtracker.info could only be replicated to 0
nodes, instead of 1
    at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
    at
org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:616)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:416)
    at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)

    at org.apache.hadoop.ipc.Client.call(Client.java:1030)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224)
    at $Proxy5.addBlock(Unknown Source)
    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:616)
    at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
    at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
    at $Proxy5.addBlock(Unknown Source)
    at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:3104)
    at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2975)
    at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2255)
    at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2446)

2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: Error
Recovery for block null bad datanode[0] nodes == null
2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: Could not get
block locations. Source file "/tmp/hadoop-root/mapred/system/jobtracker.info"
- Aborting...
2011-10-16 00:01:15,590 WARN org.apache.hadoop.mapred.JobTracker: Writing to
file hdfs://localhost/tmp/hadoop-root/mapred/system/jobtracker.info failed!
2011-10-16 00:01:15,593 WARN org.apache.hadoop.mapred.JobTracker: FileSystem
is not ready yet!
2011-10-16 00:01:15,603 WARN org.apache.hadoop.mapred.JobTracker: Failed to
initialize recovery manager.
org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
/tmp/hadoop-root/mapred/system/jobtracker.info could only be replicated to 0
nodes, instead of 1
    at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
    at
org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:616)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:416)
    at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)

    at org.apache.hadoop.ipc.Client.call(Client.java:1030)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224)
    at $Proxy5.addBlock(Unknown Source)
    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:616)
    at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
    at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
    at $Proxy5.addBlock(Unknown Source)
    at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:3104)
    at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2975)
    at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2255)
    at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2446)
********************************************************************
The name node generates this:
2011-10-16 00:01:15,587 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 8020, call addBlock(/tmp/hadoop-root/mapred/system/
jobtracker.info, DFSClient_-284777799) from 127.0.0.1:48484: error:
java.io.IOException: File
/tmp/hadoop-root/mapred/system/jobtracker.infocould only be replicated
to 0 nodes, instead of 1
java.io.IOException: File
/tmp/hadoop-root/mapred/system/jobtracker.infocould only be replicated
to 0 nodes, instead of 1
    at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
    at
org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:616)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:416)
    at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
********************************************************************
and the data node log file generates:
Unrecognized option: -jvm
Could not create the Java virtual machine.

I did all the step "Hadoop the definitive guide said in appendix A"
Could anyone help? I'm using fedora 15 and openjdk.
Sorry for large email.

Re: Unrecognized option: -jvm

Posted by Mayuresh Kshirsagar <ma...@gmail.com>.
Have you tried with sun java rather than openjdk?

Majid Azimi <ma...@gmail.com> wrote:

>Hi guys,
>
>I'm realy new to hadoop. I have configured a single node hadoop
>cluster. but
>seems that my data node is not working. job tracker log file shows this
>message(alot of them per 10 second):
>********************************************************************
>2011-10-16 00:01:15,558 WARN org.apache.hadoop.mapred.JobTracker:
>Retrying...
>2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient:
>DataStreamer
>Exception: org.apache.hadoop.ipc.RemoteException: java.io.IOException:
>File
>/tmp/hadoop-root/mapred/system/jobtracker.info could only be replicated
>to 0
>nodes, instead of 1
>    at
>org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
>    at
>org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
>    at java.security.AccessController.doPrivileged(Native Method)
>    at javax.security.auth.Subject.doAs(Subject.java:416)
>    at
>org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
>
>    at org.apache.hadoop.ipc.Client.call(Client.java:1030)
>    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224)
>    at $Proxy5.addBlock(Unknown Source)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>    at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>    at $Proxy5.addBlock(Unknown Source)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:3104)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2975)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2255)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2446)
>
>2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: Error
>Recovery for block null bad datanode[0] nodes == null
>2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: Could
>not get
>block locations. Source file
>"/tmp/hadoop-root/mapred/system/jobtracker.info"
>- Aborting...
>2011-10-16 00:01:15,590 WARN org.apache.hadoop.mapred.JobTracker:
>Writing to
>file hdfs://localhost/tmp/hadoop-root/mapred/system/jobtracker.info
>failed!
>2011-10-16 00:01:15,593 WARN org.apache.hadoop.mapred.JobTracker:
>FileSystem
>is not ready yet!
>2011-10-16 00:01:15,603 WARN org.apache.hadoop.mapred.JobTracker:
>Failed to
>initialize recovery manager.
>org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
>/tmp/hadoop-root/mapred/system/jobtracker.info could only be replicated
>to 0
>nodes, instead of 1
>    at
>org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
>    at
>org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
>    at java.security.AccessController.doPrivileged(Native Method)
>    at javax.security.auth.Subject.doAs(Subject.java:416)
>    at
>org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
>
>    at org.apache.hadoop.ipc.Client.call(Client.java:1030)
>    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224)
>    at $Proxy5.addBlock(Unknown Source)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>    at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>    at $Proxy5.addBlock(Unknown Source)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:3104)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2975)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2255)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2446)
>********************************************************************
>The name node generates this:
>2011-10-16 00:01:15,587 INFO org.apache.hadoop.ipc.Server: IPC Server
>handler 9 on 8020, call addBlock(/tmp/hadoop-root/mapred/system/
>jobtracker.info, DFSClient_-284777799) from 127.0.0.1:48484: error:
>java.io.IOException: File
>/tmp/hadoop-root/mapred/system/jobtracker.infocould only be replicated
>to 0 nodes, instead of 1
>java.io.IOException: File
>/tmp/hadoop-root/mapred/system/jobtracker.infocould only be replicated
>to 0 nodes, instead of 1
>    at
>org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
>    at
>org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
>    at java.security.AccessController.doPrivileged(Native Method)
>    at javax.security.auth.Subject.doAs(Subject.java:416)
>    at
>org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
>********************************************************************
>and the data node log file generates:
>Unrecognized option: -jvm
>Could not create the Java virtual machine.
>
>I did all the step "Hadoop the definitive guide said in appendix A"
>Could anyone help? I'm using fedora 15 and openjdk.
>Sorry for large email.

-- 
Sent from my Android phone with K-9 Mail. Please excuse my brevity.

Re: Unrecognized option: -jvm

Posted by Mayuresh Kshirsagar <ma...@gmail.com>.
Have you tried with sun java rather than openjdk?

Majid Azimi <ma...@gmail.com> wrote:

>Hi guys,
>
>I'm realy new to hadoop. I have configured a single node hadoop
>cluster. but
>seems that my data node is not working. job tracker log file shows this
>message(alot of them per 10 second):
>********************************************************************
>2011-10-16 00:01:15,558 WARN org.apache.hadoop.mapred.JobTracker:
>Retrying...
>2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient:
>DataStreamer
>Exception: org.apache.hadoop.ipc.RemoteException: java.io.IOException:
>File
>/tmp/hadoop-root/mapred/system/jobtracker.info could only be replicated
>to 0
>nodes, instead of 1
>    at
>org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
>    at
>org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
>    at java.security.AccessController.doPrivileged(Native Method)
>    at javax.security.auth.Subject.doAs(Subject.java:416)
>    at
>org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
>
>    at org.apache.hadoop.ipc.Client.call(Client.java:1030)
>    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224)
>    at $Proxy5.addBlock(Unknown Source)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>    at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>    at $Proxy5.addBlock(Unknown Source)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:3104)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2975)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2255)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2446)
>
>2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: Error
>Recovery for block null bad datanode[0] nodes == null
>2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: Could
>not get
>block locations. Source file
>"/tmp/hadoop-root/mapred/system/jobtracker.info"
>- Aborting...
>2011-10-16 00:01:15,590 WARN org.apache.hadoop.mapred.JobTracker:
>Writing to
>file hdfs://localhost/tmp/hadoop-root/mapred/system/jobtracker.info
>failed!
>2011-10-16 00:01:15,593 WARN org.apache.hadoop.mapred.JobTracker:
>FileSystem
>is not ready yet!
>2011-10-16 00:01:15,603 WARN org.apache.hadoop.mapred.JobTracker:
>Failed to
>initialize recovery manager.
>org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
>/tmp/hadoop-root/mapred/system/jobtracker.info could only be replicated
>to 0
>nodes, instead of 1
>    at
>org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
>    at
>org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
>    at java.security.AccessController.doPrivileged(Native Method)
>    at javax.security.auth.Subject.doAs(Subject.java:416)
>    at
>org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
>
>    at org.apache.hadoop.ipc.Client.call(Client.java:1030)
>    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224)
>    at $Proxy5.addBlock(Unknown Source)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>    at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>    at $Proxy5.addBlock(Unknown Source)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:3104)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2975)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2255)
>    at
>org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2446)
>********************************************************************
>The name node generates this:
>2011-10-16 00:01:15,587 INFO org.apache.hadoop.ipc.Server: IPC Server
>handler 9 on 8020, call addBlock(/tmp/hadoop-root/mapred/system/
>jobtracker.info, DFSClient_-284777799) from 127.0.0.1:48484: error:
>java.io.IOException: File
>/tmp/hadoop-root/mapred/system/jobtracker.infocould only be replicated
>to 0 nodes, instead of 1
>java.io.IOException: File
>/tmp/hadoop-root/mapred/system/jobtracker.infocould only be replicated
>to 0 nodes, instead of 1
>    at
>org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
>    at
>org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
>    at java.security.AccessController.doPrivileged(Native Method)
>    at javax.security.auth.Subject.doAs(Subject.java:416)
>    at
>org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
>********************************************************************
>and the data node log file generates:
>Unrecognized option: -jvm
>Could not create the Java virtual machine.
>
>I did all the step "Hadoop the definitive guide said in appendix A"
>Could anyone help? I'm using fedora 15 and openjdk.
>Sorry for large email.

-- 
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
-- 
Sent from my Android phone with K-9 Mail. Please excuse my brevity.

Re: Unrecognized option: -jvm

Posted by Konstantin Boudnik <co...@apache.org>.
You masta been using some awkward version of Hadoop...

The issues has been fixed a number of times (see HDFS-1943 for example).

Cos

On Sun, Oct 16, 2011 at 12:21AM, Majid Azimi wrote:
> Hi guys,
> 
> I'm realy new to hadoop. I have configured a single node hadoop cluster. but
> seems that my data node is not working. job tracker log file shows this
> message(alot of them per 10 second):
> ********************************************************************
> 2011-10-16 00:01:15,558 WARN org.apache.hadoop.mapred.JobTracker:
> Retrying...
> 2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: DataStreamer
> Exception: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
> /tmp/hadoop-root/mapred/system/jobtracker.info could only be replicated to 0
> nodes, instead of 1
>     at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
>     at
> org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
>     at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:616)
>     at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
>     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
>     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:416)
>     at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
> 
>     at org.apache.hadoop.ipc.Client.call(Client.java:1030)
>     at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224)
>     at $Proxy5.addBlock(Unknown Source)
>     at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:616)
>     at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>     at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>     at $Proxy5.addBlock(Unknown Source)
>     at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:3104)
>     at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2975)
>     at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2255)
>     at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2446)
> 
> 2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: Error
> Recovery for block null bad datanode[0] nodes == null
> 2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: Could not get
> block locations. Source file "/tmp/hadoop-root/mapred/system/jobtracker.info"
> - Aborting...
> 2011-10-16 00:01:15,590 WARN org.apache.hadoop.mapred.JobTracker: Writing to
> file hdfs://localhost/tmp/hadoop-root/mapred/system/jobtracker.info failed!
> 2011-10-16 00:01:15,593 WARN org.apache.hadoop.mapred.JobTracker: FileSystem
> is not ready yet!
> 2011-10-16 00:01:15,603 WARN org.apache.hadoop.mapred.JobTracker: Failed to
> initialize recovery manager.
> org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
> /tmp/hadoop-root/mapred/system/jobtracker.info could only be replicated to 0
> nodes, instead of 1
>     at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
>     at
> org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
>     at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:616)
>     at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
>     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
>     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:416)
>     at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
> 
>     at org.apache.hadoop.ipc.Client.call(Client.java:1030)
>     at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224)
>     at $Proxy5.addBlock(Unknown Source)
>     at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:616)
>     at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>     at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>     at $Proxy5.addBlock(Unknown Source)
>     at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:3104)
>     at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2975)
>     at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2255)
>     at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2446)
> ********************************************************************
> The name node generates this:
> 2011-10-16 00:01:15,587 INFO org.apache.hadoop.ipc.Server: IPC Server
> handler 9 on 8020, call addBlock(/tmp/hadoop-root/mapred/system/
> jobtracker.info, DFSClient_-284777799) from 127.0.0.1:48484: error:
> java.io.IOException: File
> /tmp/hadoop-root/mapred/system/jobtracker.infocould only be replicated
> to 0 nodes, instead of 1
> java.io.IOException: File
> /tmp/hadoop-root/mapred/system/jobtracker.infocould only be replicated
> to 0 nodes, instead of 1
>     at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
>     at
> org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
>     at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:616)
>     at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
>     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
>     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:416)
>     at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
> ********************************************************************
> and the data node log file generates:
> Unrecognized option: -jvm
> Could not create the Java virtual machine.
> 
> I did all the step "Hadoop the definitive guide said in appendix A"
> Could anyone help? I'm using fedora 15 and openjdk.
> Sorry for large email.

Re: Unrecognized option: -jvm

Posted by Harsh J <ha...@cloudera.com>.
As a quick workaround, you can try not starting as user 'root' but as
another user instead. You can revisit this issue later when you
require security.

On Sun, Oct 16, 2011 at 11:02 PM, Majid Azimi <ma...@gmail.com> wrote:
> I have tested both 0.20.204.0 and 0.20.203.0. But problem still not solved.
> I'm going to test another jvm. I'm using openjdk now.
>
> On Sun, Oct 16, 2011 at 2:53 PM, Uma Maheswara Rao G 72686 <
> maheswara@huawei.com> wrote:
>
>> You are using Which version of Hadoop ?
>>
>> Please check the recent discussion, which will help you related to this
>> problem.
>> http://search-hadoop.com/m/PPgvNPUoL2&subj=Re+Starting+Datanode
>>
>> Regards,
>> Uma
>>
>



-- 
Harsh J

Re: Unrecognized option: -jvm

Posted by Shrinivas Joshi <js...@gmail.com>.
Check bin/hadoop script and search -jvm option in there that is getting
passed to datanode launch command. Removing it should get around this issue.
I am not aware of significance of this flag though.
On Oct 16, 2011 12:32 PM, "Majid Azimi" <ma...@gmail.com> wrote:

> I have tested both 0.20.204.0 and 0.20.203.0. But problem still not solved.
> I'm going to test another jvm. I'm using openjdk now.
>
> On Sun, Oct 16, 2011 at 2:53 PM, Uma Maheswara Rao G 72686 <
> maheswara@huawei.com> wrote:
>
> > You are using Which version of Hadoop ?
> >
> > Please check the recent discussion, which will help you related to this
> > problem.
> > http://search-hadoop.com/m/PPgvNPUoL2&subj=Re+Starting+Datanode
> >
> > Regards,
> > Uma
> >
>

Re: Unrecognized option: -jvm

Posted by Majid Azimi <ma...@gmail.com>.
I have tested both 0.20.204.0 and 0.20.203.0. But problem still not solved.
I'm going to test another jvm. I'm using openjdk now.

On Sun, Oct 16, 2011 at 2:53 PM, Uma Maheswara Rao G 72686 <
maheswara@huawei.com> wrote:

> You are using Which version of Hadoop ?
>
> Please check the recent discussion, which will help you related to this
> problem.
> http://search-hadoop.com/m/PPgvNPUoL2&subj=Re+Starting+Datanode
>
> Regards,
> Uma
>

Re: Unrecognized option: -jvm

Posted by Uma Maheswara Rao G 72686 <ma...@huawei.com>.
You are using Which version of Hadoop ?

Please check the recent discussion, which will help you related to this problem.
http://search-hadoop.com/m/PPgvNPUoL2&subj=Re+Starting+Datanode

Regards,
Uma

----- Original Message -----
From: Majid Azimi <ma...@gmail.com>
Date: Sunday, October 16, 2011 2:22 am
Subject: Unrecognized option: -jvm
To: common-user@hadoop.apache.org

> Hi guys,
> 
> I'm realy new to hadoop. I have configured a single node hadoop 
> cluster. but
> seems that my data node is not working. job tracker log file shows 
> thismessage(alot of them per 10 second):
> ********************************************************************
> 2011-10-16 00:01:15,558 WARN org.apache.hadoop.mapred.JobTracker:
> Retrying...
> 2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: 
> DataStreamerException: org.apache.hadoop.ipc.RemoteException: 
> java.io.IOException: File
> /tmp/hadoop-root/mapred/system/jobtracker.info could only be 
> replicated to 0
> nodes, instead of 1
>    at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
>    at
> org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
>    at java.security.AccessController.doPrivileged(Native Method)
>    at javax.security.auth.Subject.doAs(Subject.java:416)
>    at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
> 
>    at org.apache.hadoop.ipc.Client.call(Client.java:1030)
>    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224)
>    at $Proxy5.addBlock(Unknown Source)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>    at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>    at $Proxy5.addBlock(Unknown Source)
>    at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:3104)
>    at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2975)
>    at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2255)
>    at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2446)
> 
> 2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: Error
> Recovery for block null bad datanode[0] nodes == null
> 2011-10-16 00:01:15,589 WARN org.apache.hadoop.hdfs.DFSClient: 
> Could not get
> block locations. Source file "/tmp/hadoop-
> root/mapred/system/jobtracker.info"- Aborting...
> 2011-10-16 00:01:15,590 WARN org.apache.hadoop.mapred.JobTracker: 
> Writing to
> file hdfs://localhost/tmp/hadoop-root/mapred/system/jobtracker.info 
> failed!2011-10-16 00:01:15,593 WARN 
> org.apache.hadoop.mapred.JobTracker: FileSystem
> is not ready yet!
> 2011-10-16 00:01:15,603 WARN org.apache.hadoop.mapred.JobTracker: 
> Failed to
> initialize recovery manager.
> org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
> /tmp/hadoop-root/mapred/system/jobtracker.info could only be 
> replicated to 0
> nodes, instead of 1
>    at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
>    at
> org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
>    at java.security.AccessController.doPrivileged(Native Method)
>    at javax.security.auth.Subject.doAs(Subject.java:416)
>    at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
> 
>    at org.apache.hadoop.ipc.Client.call(Client.java:1030)
>    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:224)
>    at $Proxy5.addBlock(Unknown Source)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>    at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>    at $Proxy5.addBlock(Unknown Source)
>    at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:3104)
>    at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2975)
>    at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2255)
>    at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2446)
> ********************************************************************
> The name node generates this:
> 2011-10-16 00:01:15,587 INFO org.apache.hadoop.ipc.Server: IPC Server
> handler 9 on 8020, call addBlock(/tmp/hadoop-root/mapred/system/
> jobtracker.info, DFSClient_-284777799) from 127.0.0.1:48484: error:
> java.io.IOException: File
> /tmp/hadoop-root/mapred/system/jobtracker.infocould only be replicated
> to 0 nodes, instead of 1
> java.io.IOException: File
> /tmp/hadoop-root/mapred/system/jobtracker.infocould only be replicated
> to 0 nodes, instead of 1
>    at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1417)
>    at
> org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:596)
>    at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>    at java.lang.reflect.Method.invoke(Method.java:616)
>    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:523)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1383)
>    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1379)
>    at java.security.AccessController.doPrivileged(Native Method)
>    at javax.security.auth.Subject.doAs(Subject.java:416)
>    at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1377)
> ********************************************************************
> and the data node log file generates:
> Unrecognized option: -jvm
> Could not create the Java virtual machine.
> 
> I did all the step "Hadoop the definitive guide said in appendix A"
> Could anyone help? I'm using fedora 15 and openjdk.
> Sorry for large email.
>