You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hadoop.apache.org by yogesh dhari <yo...@live.com> on 2012/11/23 06:43:39 UTC

hadoop-1.0.4 installation error

Hello,

I am facing error while installing Apache hadoop-1.0.4. TaskTracker and DataNode doesn't start.

Log file shows.

TT's Log file::

2012-11-23 10:54:31,116 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yogesh cause:java.io.IOException: Call to localhost/127.0.0.1:8001 failed on local exception: java.io.IOException: Connection reset by peer
2012-11-23 10:54:31,117 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because java.io.IOException: Call to localhost/127.0.0.1:8001 failed on local exception: java.io.IOException: Connection reset by peer
    at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
    at org.apache.hadoop.ipc.Client.call(Client.java:1075)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
    at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown Source)
    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)



DN's Log file::  (Although files exists with file permission 755 )

2012-11-23 10:50:16,753 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: All specified directories are not accessible or do not exist.
    at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:139)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:385)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:299)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539)


Please suggest

Thanks & regards
Yogesh Kumar

RE: hadoop-1.0.4 installation error

Posted by yogesh dhari <yo...@live.com>.

Thanks Mohammad,

If I login as a root then it works fine but if as other then TT n DN fail to run.(hadoop-1.0.4)

But this issue wasn't with hadoop-0.20.2.

Is there any specific reason or just file permissions?

Regards
Yogesh Kumar

From: dontariq@gmail.com
Date: Fri, 23 Nov 2012 11:20:17 +0530
Subject: Re: hadoop-1.0.4 installation error
To: user@hadoop.apache.org

Hello Yogesh,
    Just make sure you are operating from the correct user.Regards,    Mohammad Tariq



On Fri, Nov 23, 2012 at 11:13 AM, yogesh dhari <yo...@live.com> wrote:






Hello,

I am facing error while installing Apache hadoop-1.0.4. TaskTracker and DataNode doesn't start.

Log file shows.

TT's Log file::

2012-11-23 10:54:31,116 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yogesh cause:java.io.IOException: Call to localhost/127.0.0.1:8001 failed on local exception: java.io.IOException: Connection reset by peer


2012-11-23 10:54:31,117 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because java.io.IOException: Call to localhost/127.0.0.1:8001 failed on local exception: java.io.IOException: Connection reset by peer


    at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
    at org.apache.hadoop.ipc.Client.call(Client.java:1075)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
    at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown Source)


    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)



DN's Log file::  (Although files exists with file permission 755 )

2012-11-23 10:50:16,753 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: All specified directories are not accessible or do not exist.


    at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:139)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:385)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:299)


    at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539)




Please suggest

Thanks & regards
Yogesh Kumar

RE: hadoop-1.0.4 installation error

Posted by yogesh dhari <yo...@live.com>.

Thanks Mohammad,

If I login as a root then it works fine but if as other then TT n DN fail to run.(hadoop-1.0.4)

But this issue wasn't with hadoop-0.20.2.

Is there any specific reason or just file permissions?

Regards
Yogesh Kumar

From: dontariq@gmail.com
Date: Fri, 23 Nov 2012 11:20:17 +0530
Subject: Re: hadoop-1.0.4 installation error
To: user@hadoop.apache.org

Hello Yogesh,
    Just make sure you are operating from the correct user.Regards,    Mohammad Tariq



On Fri, Nov 23, 2012 at 11:13 AM, yogesh dhari <yo...@live.com> wrote:






Hello,

I am facing error while installing Apache hadoop-1.0.4. TaskTracker and DataNode doesn't start.

Log file shows.

TT's Log file::

2012-11-23 10:54:31,116 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yogesh cause:java.io.IOException: Call to localhost/127.0.0.1:8001 failed on local exception: java.io.IOException: Connection reset by peer


2012-11-23 10:54:31,117 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because java.io.IOException: Call to localhost/127.0.0.1:8001 failed on local exception: java.io.IOException: Connection reset by peer


    at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
    at org.apache.hadoop.ipc.Client.call(Client.java:1075)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
    at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown Source)


    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)



DN's Log file::  (Although files exists with file permission 755 )

2012-11-23 10:50:16,753 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: All specified directories are not accessible or do not exist.


    at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:139)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:385)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:299)


    at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539)




Please suggest

Thanks & regards
Yogesh Kumar

RE: hadoop-1.0.4 installation error

Posted by yogesh dhari <yo...@live.com>.

Thanks Mohammad,

If I login as a root then it works fine but if as other then TT n DN fail to run.(hadoop-1.0.4)

But this issue wasn't with hadoop-0.20.2.

Is there any specific reason or just file permissions?

Regards
Yogesh Kumar

From: dontariq@gmail.com
Date: Fri, 23 Nov 2012 11:20:17 +0530
Subject: Re: hadoop-1.0.4 installation error
To: user@hadoop.apache.org

Hello Yogesh,
    Just make sure you are operating from the correct user.Regards,    Mohammad Tariq



On Fri, Nov 23, 2012 at 11:13 AM, yogesh dhari <yo...@live.com> wrote:






Hello,

I am facing error while installing Apache hadoop-1.0.4. TaskTracker and DataNode doesn't start.

Log file shows.

TT's Log file::

2012-11-23 10:54:31,116 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yogesh cause:java.io.IOException: Call to localhost/127.0.0.1:8001 failed on local exception: java.io.IOException: Connection reset by peer


2012-11-23 10:54:31,117 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because java.io.IOException: Call to localhost/127.0.0.1:8001 failed on local exception: java.io.IOException: Connection reset by peer


    at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
    at org.apache.hadoop.ipc.Client.call(Client.java:1075)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
    at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown Source)


    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)



DN's Log file::  (Although files exists with file permission 755 )

2012-11-23 10:50:16,753 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: All specified directories are not accessible or do not exist.


    at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:139)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:385)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:299)


    at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539)




Please suggest

Thanks & regards
Yogesh Kumar

RE: hadoop-1.0.4 installation error

Posted by yogesh dhari <yo...@live.com>.

Thanks Mohammad,

If I login as a root then it works fine but if as other then TT n DN fail to run.(hadoop-1.0.4)

But this issue wasn't with hadoop-0.20.2.

Is there any specific reason or just file permissions?

Regards
Yogesh Kumar

From: dontariq@gmail.com
Date: Fri, 23 Nov 2012 11:20:17 +0530
Subject: Re: hadoop-1.0.4 installation error
To: user@hadoop.apache.org

Hello Yogesh,
    Just make sure you are operating from the correct user.Regards,    Mohammad Tariq



On Fri, Nov 23, 2012 at 11:13 AM, yogesh dhari <yo...@live.com> wrote:






Hello,

I am facing error while installing Apache hadoop-1.0.4. TaskTracker and DataNode doesn't start.

Log file shows.

TT's Log file::

2012-11-23 10:54:31,116 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yogesh cause:java.io.IOException: Call to localhost/127.0.0.1:8001 failed on local exception: java.io.IOException: Connection reset by peer


2012-11-23 10:54:31,117 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because java.io.IOException: Call to localhost/127.0.0.1:8001 failed on local exception: java.io.IOException: Connection reset by peer


    at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
    at org.apache.hadoop.ipc.Client.call(Client.java:1075)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
    at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown Source)


    at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)



DN's Log file::  (Although files exists with file permission 755 )

2012-11-23 10:50:16,753 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: All specified directories are not accessible or do not exist.


    at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:139)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:385)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:299)


    at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521)
    at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539)




Please suggest

Thanks & regards
Yogesh Kumar

Re: hadoop-1.0.4 installation error

Posted by Mohammad Tariq <do...@gmail.com>.

Hello Yogesh,

    Just make sure you are operating from the correct user.

Regards,
    Mohammad Tariq



On Fri, Nov 23, 2012 at 11:13 AM, yogesh dhari <yo...@live.com> wrote:

>  Hello,
>
> I am facing error while installing Apache hadoop-1.0.4. TaskTracker and
> DataNode doesn't start.
>
> Log file shows.
>
> TT's Log file::
>
> 2012-11-23 10:54:31,116 ERROR
> org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
> as:yogesh cause:java.io.IOException: Call to localhost/127.0.0.1:8001failed on local exception: java.io.IOException: Connection reset by peer
> 2012-11-23 10:54:31,117 ERROR org.apache.hadoop.mapred.TaskTracker: Can
> not start task tracker because java.io.IOException: Call to localhost/
> 127.0.0.1:8001 failed on local exception: java.io.IOException: Connection
> reset by peer
>     at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
>     at org.apache.hadoop.ipc.Client.call(Client.java:1075)
>     at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
>     at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown Source)
>     at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
>
>
>
> DN's Log file::  (Although files exists with file permission 755 )
>
> 2012-11-23 10:50:16,753 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: All
> specified directories are not accessible or do not exist.
>     at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:139)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:385)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:299)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539)
>
>
> Please suggest
>
> Thanks & regards
> Yogesh Kumar
>

Re: hadoop-1.0.4 installation error

Posted by Mohammad Tariq <do...@gmail.com>.

Hello Yogesh,

    Just make sure you are operating from the correct user.

Regards,
    Mohammad Tariq



On Fri, Nov 23, 2012 at 11:13 AM, yogesh dhari <yo...@live.com> wrote:

>  Hello,
>
> I am facing error while installing Apache hadoop-1.0.4. TaskTracker and
> DataNode doesn't start.
>
> Log file shows.
>
> TT's Log file::
>
> 2012-11-23 10:54:31,116 ERROR
> org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
> as:yogesh cause:java.io.IOException: Call to localhost/127.0.0.1:8001failed on local exception: java.io.IOException: Connection reset by peer
> 2012-11-23 10:54:31,117 ERROR org.apache.hadoop.mapred.TaskTracker: Can
> not start task tracker because java.io.IOException: Call to localhost/
> 127.0.0.1:8001 failed on local exception: java.io.IOException: Connection
> reset by peer
>     at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
>     at org.apache.hadoop.ipc.Client.call(Client.java:1075)
>     at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
>     at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown Source)
>     at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
>
>
>
> DN's Log file::  (Although files exists with file permission 755 )
>
> 2012-11-23 10:50:16,753 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: All
> specified directories are not accessible or do not exist.
>     at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:139)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:385)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:299)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539)
>
>
> Please suggest
>
> Thanks & regards
> Yogesh Kumar
>

Re: hadoop-1.0.4 installation error

Posted by Mohammad Tariq <do...@gmail.com>.

Hello Yogesh,

    Just make sure you are operating from the correct user.

Regards,
    Mohammad Tariq



On Fri, Nov 23, 2012 at 11:13 AM, yogesh dhari <yo...@live.com> wrote:

>  Hello,
>
> I am facing error while installing Apache hadoop-1.0.4. TaskTracker and
> DataNode doesn't start.
>
> Log file shows.
>
> TT's Log file::
>
> 2012-11-23 10:54:31,116 ERROR
> org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
> as:yogesh cause:java.io.IOException: Call to localhost/127.0.0.1:8001failed on local exception: java.io.IOException: Connection reset by peer
> 2012-11-23 10:54:31,117 ERROR org.apache.hadoop.mapred.TaskTracker: Can
> not start task tracker because java.io.IOException: Call to localhost/
> 127.0.0.1:8001 failed on local exception: java.io.IOException: Connection
> reset by peer
>     at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
>     at org.apache.hadoop.ipc.Client.call(Client.java:1075)
>     at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
>     at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown Source)
>     at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
>
>
>
> DN's Log file::  (Although files exists with file permission 755 )
>
> 2012-11-23 10:50:16,753 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: All
> specified directories are not accessible or do not exist.
>     at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:139)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:385)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:299)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539)
>
>
> Please suggest
>
> Thanks & regards
> Yogesh Kumar
>

Re: hadoop-1.0.4 installation error

Posted by Mohammad Tariq <do...@gmail.com>.

Hello Yogesh,

    Just make sure you are operating from the correct user.

Regards,
    Mohammad Tariq



On Fri, Nov 23, 2012 at 11:13 AM, yogesh dhari <yo...@live.com> wrote:

>  Hello,
>
> I am facing error while installing Apache hadoop-1.0.4. TaskTracker and
> DataNode doesn't start.
>
> Log file shows.
>
> TT's Log file::
>
> 2012-11-23 10:54:31,116 ERROR
> org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
> as:yogesh cause:java.io.IOException: Call to localhost/127.0.0.1:8001failed on local exception: java.io.IOException: Connection reset by peer
> 2012-11-23 10:54:31,117 ERROR org.apache.hadoop.mapred.TaskTracker: Can
> not start task tracker because java.io.IOException: Call to localhost/
> 127.0.0.1:8001 failed on local exception: java.io.IOException: Connection
> reset by peer
>     at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
>     at org.apache.hadoop.ipc.Client.call(Client.java:1075)
>     at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
>     at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown Source)
>     at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
>
>
>
> DN's Log file::  (Although files exists with file permission 755 )
>
> 2012-11-23 10:50:16,753 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: All
> specified directories are not accessible or do not exist.
>     at
> org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:139)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:385)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:299)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521)
>     at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539)
>
>
> Please suggest
>
> Thanks & regards
> Yogesh Kumar
>