You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-user@hadoop.apache.org by iwannaplay games <fu...@gmail.com> on 2012/08/23 15:47:47 UTC

Live nodes count not incremented with the addition of new nodes

Hi

I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.

Ran these commands
hadoop dfsadmin -refreshNodes
hadoop mradmin -refreshNodes

But still when i check through fsck or http://master:50070
i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly
it picks anyone)

Can anybody tell me why its not updating the count of live nodes to 4.

Regards
Prabhjot

Re: Live nodes count not incremented with the addition of new nodes

Posted by Harsh J <ha...@cloudera.com>.

Each of your DN needs its own dfs.data.dir directory (configurable in
hdfs-site.xml), unique from others. Otherwise, it may not work the way
you intend it to.

On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games
<fu...@gmail.com> wrote:
> yeah installation is proper but it seems they are sharing the same storage id'
> Do i need to make any change in slaves configuration.I have copied the
> slaves image on other nodes.
> Check this log file:
> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> blocks
> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> processing time: 1 msecs
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node registration from
> 192.168.0.122:50010 storage
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> replaced by 192.168.0.122:50010 with the same storageID
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Removing a node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.122:50010
>
>
> Why with another node registration previous node is removed?
>
> Regards
> Prabhjot
>
> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
>>
>> I'd first check if your additional nodes came up fine (check the
>> services' logs) and connected to the master alright.
>>
>> On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
>> <fu...@gmail.com> wrote:
>> >
>> >
>> > Hi
>> >
>> > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.
>> >
>> > Ran these commands
>> > hadoop dfsadmin -refreshNodes
>> > hadoop mradmin -refreshNodes
>> >
>> > But still when i check through fsck or http://master:50070
>> > i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly it
>> > picks anyone)
>> >
>> > Can anybody tell me why its not updating the count of live nodes to 4.
>> >
>> > Regards
>> > Prabhjot
>> >
>>
>>
>>
>> --
>> Harsh J



-- 
Harsh J

Re: Live nodes count not incremented with the addition of new nodes

Posted by Mohammad Tariq <do...@gmail.com>.

what do you mean by "same storage space"??every node will have its own
disk.right??also make sure you are dding the names of newly added nodes to
your slaves file.

Regards,
    Mohammad Tariq



On Fri, Aug 24, 2012 at 4:02 PM, iwannaplay games <
funnlearnforkids@gmail.com> wrote:

> I ran it
> Its not working
> It seems that as soon as another node registers ,previous node occupy
> the same storage space and removes the previous one.
>
> For all the slave nodes,i have kept the same configuration.Is there
> any change in hadoop installation
>
> Regards
> Prabhjot
> On 8/24/12, Mohammad Tariq <do...@gmail.com> wrote:
> > Run the balancer once and see if it works.
> >
> > Regards,
> >     Mohammad Tariq
> >
> >
> >
> > On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
> > funnlearnforkids@gmail.com> wrote:
> >
> >> yeah installation is proper but it seems they are sharing the same
> >> storage
> >> id'
> >> Do i need to make any change in slaves configuration.I have copied the
> >> slaves image on other nodes.
> >> Check this log file:
> >> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> >> Adding a new node: /default-rack/192.168.0.190:50010
> >> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> >> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> >> blocks
> >> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> >> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> >> processing time: 1 msecs
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> >> BLOCK* NameSystem.registerDatanode: node registration from
> >> 192.168.0.122:50010 storage
> >> DS-2050366683-192.168.0.122-50010-1344447057014
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> >> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> >> replaced by 192.168.0.122:50010 with the same storageID
> >> DS-2050366683-192.168.0.122-50010-1344447057014
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> >> Removing a node: /default-rack/192.168.0.190:50010
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> >> Adding a new node: /default-rack/192.168.0.122:50010
> >>
> >>
> >> Why with another node registration previous node is removed?
> >>
> >> Regards
> >> Prabhjot
> >>
> >> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
> >> >
> >> > I'd first check if your additional nodes came up fine (check the
> >> > services' logs) and connected to the master alright.
> >> >
> >> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> >> > <fu...@gmail.com> wrote:
> >> > >
> >> > >
> >> > > Hi
> >> > >
> >> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
> >> cluster.
> >> > >
> >> > > Ran these commands
> >> > > hadoop dfsadmin -refreshNodes
> >> > > hadoop mradmin -refreshNodes
> >> > >
> >> > > But still when i check through fsck or http://master:50070
> >> > > i get only 2 live nodes,one master and one slave(out of 3
> >> slaves,randomly it
> >> > > picks anyone)
> >> > >
> >> > > Can anybody tell me why its not updating the count of live nodes to
> >> > > 4.
> >> > >
> >> > > Regards
> >> > > Prabhjot
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > Harsh J
> >>
> >
>

Re: Live nodes count not incremented with the addition of new nodes

Posted by Mohammad Tariq <do...@gmail.com>.

what do you mean by "same storage space"??every node will have its own
disk.right??also make sure you are dding the names of newly added nodes to
your slaves file.

Regards,
    Mohammad Tariq



On Fri, Aug 24, 2012 at 4:02 PM, iwannaplay games <
funnlearnforkids@gmail.com> wrote:

> I ran it
> Its not working
> It seems that as soon as another node registers ,previous node occupy
> the same storage space and removes the previous one.
>
> For all the slave nodes,i have kept the same configuration.Is there
> any change in hadoop installation
>
> Regards
> Prabhjot
> On 8/24/12, Mohammad Tariq <do...@gmail.com> wrote:
> > Run the balancer once and see if it works.
> >
> > Regards,
> >     Mohammad Tariq
> >
> >
> >
> > On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
> > funnlearnforkids@gmail.com> wrote:
> >
> >> yeah installation is proper but it seems they are sharing the same
> >> storage
> >> id'
> >> Do i need to make any change in slaves configuration.I have copied the
> >> slaves image on other nodes.
> >> Check this log file:
> >> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> >> Adding a new node: /default-rack/192.168.0.190:50010
> >> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> >> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> >> blocks
> >> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> >> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> >> processing time: 1 msecs
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> >> BLOCK* NameSystem.registerDatanode: node registration from
> >> 192.168.0.122:50010 storage
> >> DS-2050366683-192.168.0.122-50010-1344447057014
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> >> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> >> replaced by 192.168.0.122:50010 with the same storageID
> >> DS-2050366683-192.168.0.122-50010-1344447057014
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> >> Removing a node: /default-rack/192.168.0.190:50010
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> >> Adding a new node: /default-rack/192.168.0.122:50010
> >>
> >>
> >> Why with another node registration previous node is removed?
> >>
> >> Regards
> >> Prabhjot
> >>
> >> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
> >> >
> >> > I'd first check if your additional nodes came up fine (check the
> >> > services' logs) and connected to the master alright.
> >> >
> >> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> >> > <fu...@gmail.com> wrote:
> >> > >
> >> > >
> >> > > Hi
> >> > >
> >> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
> >> cluster.
> >> > >
> >> > > Ran these commands
> >> > > hadoop dfsadmin -refreshNodes
> >> > > hadoop mradmin -refreshNodes
> >> > >
> >> > > But still when i check through fsck or http://master:50070
> >> > > i get only 2 live nodes,one master and one slave(out of 3
> >> slaves,randomly it
> >> > > picks anyone)
> >> > >
> >> > > Can anybody tell me why its not updating the count of live nodes to
> >> > > 4.
> >> > >
> >> > > Regards
> >> > > Prabhjot
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > Harsh J
> >>
> >
>

Re: Live nodes count not incremented with the addition of new nodes

Posted by Mohammad Tariq <do...@gmail.com>.

what do you mean by "same storage space"??every node will have its own
disk.right??also make sure you are dding the names of newly added nodes to
your slaves file.

Regards,
    Mohammad Tariq



On Fri, Aug 24, 2012 at 4:02 PM, iwannaplay games <
funnlearnforkids@gmail.com> wrote:

> I ran it
> Its not working
> It seems that as soon as another node registers ,previous node occupy
> the same storage space and removes the previous one.
>
> For all the slave nodes,i have kept the same configuration.Is there
> any change in hadoop installation
>
> Regards
> Prabhjot
> On 8/24/12, Mohammad Tariq <do...@gmail.com> wrote:
> > Run the balancer once and see if it works.
> >
> > Regards,
> >     Mohammad Tariq
> >
> >
> >
> > On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
> > funnlearnforkids@gmail.com> wrote:
> >
> >> yeah installation is proper but it seems they are sharing the same
> >> storage
> >> id'
> >> Do i need to make any change in slaves configuration.I have copied the
> >> slaves image on other nodes.
> >> Check this log file:
> >> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> >> Adding a new node: /default-rack/192.168.0.190:50010
> >> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> >> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> >> blocks
> >> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> >> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> >> processing time: 1 msecs
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> >> BLOCK* NameSystem.registerDatanode: node registration from
> >> 192.168.0.122:50010 storage
> >> DS-2050366683-192.168.0.122-50010-1344447057014
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> >> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> >> replaced by 192.168.0.122:50010 with the same storageID
> >> DS-2050366683-192.168.0.122-50010-1344447057014
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> >> Removing a node: /default-rack/192.168.0.190:50010
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> >> Adding a new node: /default-rack/192.168.0.122:50010
> >>
> >>
> >> Why with another node registration previous node is removed?
> >>
> >> Regards
> >> Prabhjot
> >>
> >> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
> >> >
> >> > I'd first check if your additional nodes came up fine (check the
> >> > services' logs) and connected to the master alright.
> >> >
> >> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> >> > <fu...@gmail.com> wrote:
> >> > >
> >> > >
> >> > > Hi
> >> > >
> >> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
> >> cluster.
> >> > >
> >> > > Ran these commands
> >> > > hadoop dfsadmin -refreshNodes
> >> > > hadoop mradmin -refreshNodes
> >> > >
> >> > > But still when i check through fsck or http://master:50070
> >> > > i get only 2 live nodes,one master and one slave(out of 3
> >> slaves,randomly it
> >> > > picks anyone)
> >> > >
> >> > > Can anybody tell me why its not updating the count of live nodes to
> >> > > 4.
> >> > >
> >> > > Regards
> >> > > Prabhjot
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > Harsh J
> >>
> >
>

Re: Live nodes count not incremented with the addition of new nodes

Posted by Mohammad Tariq <do...@gmail.com>.

what do you mean by "same storage space"??every node will have its own
disk.right??also make sure you are dding the names of newly added nodes to
your slaves file.

Regards,
    Mohammad Tariq



On Fri, Aug 24, 2012 at 4:02 PM, iwannaplay games <
funnlearnforkids@gmail.com> wrote:

> I ran it
> Its not working
> It seems that as soon as another node registers ,previous node occupy
> the same storage space and removes the previous one.
>
> For all the slave nodes,i have kept the same configuration.Is there
> any change in hadoop installation
>
> Regards
> Prabhjot
> On 8/24/12, Mohammad Tariq <do...@gmail.com> wrote:
> > Run the balancer once and see if it works.
> >
> > Regards,
> >     Mohammad Tariq
> >
> >
> >
> > On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
> > funnlearnforkids@gmail.com> wrote:
> >
> >> yeah installation is proper but it seems they are sharing the same
> >> storage
> >> id'
> >> Do i need to make any change in slaves configuration.I have copied the
> >> slaves image on other nodes.
> >> Check this log file:
> >> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> >> Adding a new node: /default-rack/192.168.0.190:50010
> >> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> >> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> >> blocks
> >> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> >> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> >> processing time: 1 msecs
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> >> BLOCK* NameSystem.registerDatanode: node registration from
> >> 192.168.0.122:50010 storage
> >> DS-2050366683-192.168.0.122-50010-1344447057014
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> >> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> >> replaced by 192.168.0.122:50010 with the same storageID
> >> DS-2050366683-192.168.0.122-50010-1344447057014
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> >> Removing a node: /default-rack/192.168.0.190:50010
> >> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> >> Adding a new node: /default-rack/192.168.0.122:50010
> >>
> >>
> >> Why with another node registration previous node is removed?
> >>
> >> Regards
> >> Prabhjot
> >>
> >> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
> >> >
> >> > I'd first check if your additional nodes came up fine (check the
> >> > services' logs) and connected to the master alright.
> >> >
> >> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> >> > <fu...@gmail.com> wrote:
> >> > >
> >> > >
> >> > > Hi
> >> > >
> >> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
> >> cluster.
> >> > >
> >> > > Ran these commands
> >> > > hadoop dfsadmin -refreshNodes
> >> > > hadoop mradmin -refreshNodes
> >> > >
> >> > > But still when i check through fsck or http://master:50070
> >> > > i get only 2 live nodes,one master and one slave(out of 3
> >> slaves,randomly it
> >> > > picks anyone)
> >> > >
> >> > > Can anybody tell me why its not updating the count of live nodes to
> >> > > 4.
> >> > >
> >> > > Regards
> >> > > Prabhjot
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > Harsh J
> >>
> >
>

Re: Live nodes count not incremented with the addition of new nodes

Posted by iwannaplay games <fu...@gmail.com>.

I ran it
Its not working
It seems that as soon as another node registers ,previous node occupy
the same storage space and removes the previous one.

For all the slave nodes,i have kept the same configuration.Is there
any change in hadoop installation

Regards
Prabhjot
On 8/24/12, Mohammad Tariq <do...@gmail.com> wrote:
> Run the balancer once and see if it works.
>
> Regards,
>     Mohammad Tariq
>
>
>
> On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
> funnlearnforkids@gmail.com> wrote:
>
>> yeah installation is proper but it seems they are sharing the same
>> storage
>> id'
>> Do i need to make any change in slaves configuration.I have copied the
>> slaves image on other nodes.
>> Check this log file:
>> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
>> Adding a new node: /default-rack/192.168.0.190:50010
>> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
>> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
>> blocks
>> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
>> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
>> processing time: 1 msecs
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
>> BLOCK* NameSystem.registerDatanode: node registration from
>> 192.168.0.122:50010 storage
>> DS-2050366683-192.168.0.122-50010-1344447057014
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
>> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
>> replaced by 192.168.0.122:50010 with the same storageID
>> DS-2050366683-192.168.0.122-50010-1344447057014
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
>> Removing a node: /default-rack/192.168.0.190:50010
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
>> Adding a new node: /default-rack/192.168.0.122:50010
>>
>>
>> Why with another node registration previous node is removed?
>>
>> Regards
>> Prabhjot
>>
>> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
>> >
>> > I'd first check if your additional nodes came up fine (check the
>> > services' logs) and connected to the master alright.
>> >
>> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
>> > <fu...@gmail.com> wrote:
>> > >
>> > >
>> > > Hi
>> > >
>> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
>> cluster.
>> > >
>> > > Ran these commands
>> > > hadoop dfsadmin -refreshNodes
>> > > hadoop mradmin -refreshNodes
>> > >
>> > > But still when i check through fsck or http://master:50070
>> > > i get only 2 live nodes,one master and one slave(out of 3
>> slaves,randomly it
>> > > picks anyone)
>> > >
>> > > Can anybody tell me why its not updating the count of live nodes to
>> > > 4.
>> > >
>> > > Regards
>> > > Prabhjot
>> > >
>> >
>> >
>> >
>> > --
>> > Harsh J
>>
>

Re: Live nodes count not incremented with the addition of new nodes

Posted by iwannaplay games <fu...@gmail.com>.

I ran it
Its not working
It seems that as soon as another node registers ,previous node occupy
the same storage space and removes the previous one.

For all the slave nodes,i have kept the same configuration.Is there
any change in hadoop installation

Regards
Prabhjot
On 8/24/12, Mohammad Tariq <do...@gmail.com> wrote:
> Run the balancer once and see if it works.
>
> Regards,
>     Mohammad Tariq
>
>
>
> On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
> funnlearnforkids@gmail.com> wrote:
>
>> yeah installation is proper but it seems they are sharing the same
>> storage
>> id'
>> Do i need to make any change in slaves configuration.I have copied the
>> slaves image on other nodes.
>> Check this log file:
>> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
>> Adding a new node: /default-rack/192.168.0.190:50010
>> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
>> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
>> blocks
>> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
>> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
>> processing time: 1 msecs
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
>> BLOCK* NameSystem.registerDatanode: node registration from
>> 192.168.0.122:50010 storage
>> DS-2050366683-192.168.0.122-50010-1344447057014
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
>> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
>> replaced by 192.168.0.122:50010 with the same storageID
>> DS-2050366683-192.168.0.122-50010-1344447057014
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
>> Removing a node: /default-rack/192.168.0.190:50010
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
>> Adding a new node: /default-rack/192.168.0.122:50010
>>
>>
>> Why with another node registration previous node is removed?
>>
>> Regards
>> Prabhjot
>>
>> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
>> >
>> > I'd first check if your additional nodes came up fine (check the
>> > services' logs) and connected to the master alright.
>> >
>> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
>> > <fu...@gmail.com> wrote:
>> > >
>> > >
>> > > Hi
>> > >
>> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
>> cluster.
>> > >
>> > > Ran these commands
>> > > hadoop dfsadmin -refreshNodes
>> > > hadoop mradmin -refreshNodes
>> > >
>> > > But still when i check through fsck or http://master:50070
>> > > i get only 2 live nodes,one master and one slave(out of 3
>> slaves,randomly it
>> > > picks anyone)
>> > >
>> > > Can anybody tell me why its not updating the count of live nodes to
>> > > 4.
>> > >
>> > > Regards
>> > > Prabhjot
>> > >
>> >
>> >
>> >
>> > --
>> > Harsh J
>>
>

Re: Live nodes count not incremented with the addition of new nodes

Posted by iwannaplay games <fu...@gmail.com>.

I ran it
Its not working
It seems that as soon as another node registers ,previous node occupy
the same storage space and removes the previous one.

For all the slave nodes,i have kept the same configuration.Is there
any change in hadoop installation

Regards
Prabhjot
On 8/24/12, Mohammad Tariq <do...@gmail.com> wrote:
> Run the balancer once and see if it works.
>
> Regards,
>     Mohammad Tariq
>
>
>
> On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
> funnlearnforkids@gmail.com> wrote:
>
>> yeah installation is proper but it seems they are sharing the same
>> storage
>> id'
>> Do i need to make any change in slaves configuration.I have copied the
>> slaves image on other nodes.
>> Check this log file:
>> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
>> Adding a new node: /default-rack/192.168.0.190:50010
>> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
>> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
>> blocks
>> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
>> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
>> processing time: 1 msecs
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
>> BLOCK* NameSystem.registerDatanode: node registration from
>> 192.168.0.122:50010 storage
>> DS-2050366683-192.168.0.122-50010-1344447057014
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
>> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
>> replaced by 192.168.0.122:50010 with the same storageID
>> DS-2050366683-192.168.0.122-50010-1344447057014
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
>> Removing a node: /default-rack/192.168.0.190:50010
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
>> Adding a new node: /default-rack/192.168.0.122:50010
>>
>>
>> Why with another node registration previous node is removed?
>>
>> Regards
>> Prabhjot
>>
>> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
>> >
>> > I'd first check if your additional nodes came up fine (check the
>> > services' logs) and connected to the master alright.
>> >
>> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
>> > <fu...@gmail.com> wrote:
>> > >
>> > >
>> > > Hi
>> > >
>> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
>> cluster.
>> > >
>> > > Ran these commands
>> > > hadoop dfsadmin -refreshNodes
>> > > hadoop mradmin -refreshNodes
>> > >
>> > > But still when i check through fsck or http://master:50070
>> > > i get only 2 live nodes,one master and one slave(out of 3
>> slaves,randomly it
>> > > picks anyone)
>> > >
>> > > Can anybody tell me why its not updating the count of live nodes to
>> > > 4.
>> > >
>> > > Regards
>> > > Prabhjot
>> > >
>> >
>> >
>> >
>> > --
>> > Harsh J
>>
>

Re: Live nodes count not incremented with the addition of new nodes

Posted by iwannaplay games <fu...@gmail.com>.

I ran it
Its not working
It seems that as soon as another node registers ,previous node occupy
the same storage space and removes the previous one.

For all the slave nodes,i have kept the same configuration.Is there
any change in hadoop installation

Regards
Prabhjot
On 8/24/12, Mohammad Tariq <do...@gmail.com> wrote:
> Run the balancer once and see if it works.
>
> Regards,
>     Mohammad Tariq
>
>
>
> On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
> funnlearnforkids@gmail.com> wrote:
>
>> yeah installation is proper but it seems they are sharing the same
>> storage
>> id'
>> Do i need to make any change in slaves configuration.I have copied the
>> slaves image on other nodes.
>> Check this log file:
>> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
>> Adding a new node: /default-rack/192.168.0.190:50010
>> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
>> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
>> blocks
>> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
>> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
>> processing time: 1 msecs
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
>> BLOCK* NameSystem.registerDatanode: node registration from
>> 192.168.0.122:50010 storage
>> DS-2050366683-192.168.0.122-50010-1344447057014
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
>> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
>> replaced by 192.168.0.122:50010 with the same storageID
>> DS-2050366683-192.168.0.122-50010-1344447057014
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
>> Removing a node: /default-rack/192.168.0.190:50010
>> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
>> Adding a new node: /default-rack/192.168.0.122:50010
>>
>>
>> Why with another node registration previous node is removed?
>>
>> Regards
>> Prabhjot
>>
>> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
>> >
>> > I'd first check if your additional nodes came up fine (check the
>> > services' logs) and connected to the master alright.
>> >
>> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
>> > <fu...@gmail.com> wrote:
>> > >
>> > >
>> > > Hi
>> > >
>> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
>> cluster.
>> > >
>> > > Ran these commands
>> > > hadoop dfsadmin -refreshNodes
>> > > hadoop mradmin -refreshNodes
>> > >
>> > > But still when i check through fsck or http://master:50070
>> > > i get only 2 live nodes,one master and one slave(out of 3
>> slaves,randomly it
>> > > picks anyone)
>> > >
>> > > Can anybody tell me why its not updating the count of live nodes to
>> > > 4.
>> > >
>> > > Regards
>> > > Prabhjot
>> > >
>> >
>> >
>> >
>> > --
>> > Harsh J
>>
>

Re: Live nodes count not incremented with the addition of new nodes

Posted by Mohammad Tariq <do...@gmail.com>.

Run the balancer once and see if it works.

Regards,
    Mohammad Tariq



On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
funnlearnforkids@gmail.com> wrote:

> yeah installation is proper but it seems they are sharing the same storage
> id'
> Do i need to make any change in slaves configuration.I have copied the
> slaves image on other nodes.
> Check this log file:
> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> blocks
> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> processing time: 1 msecs
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node registration from
> 192.168.0.122:50010 storage
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> replaced by 192.168.0.122:50010 with the same storageID
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Removing a node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.122:50010
>
>
> Why with another node registration previous node is removed?
>
> Regards
> Prabhjot
>
> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
> >
> > I'd first check if your additional nodes came up fine (check the
> > services' logs) and connected to the master alright.
> >
> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> > <fu...@gmail.com> wrote:
> > >
> > >
> > > Hi
> > >
> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
> cluster.
> > >
> > > Ran these commands
> > > hadoop dfsadmin -refreshNodes
> > > hadoop mradmin -refreshNodes
> > >
> > > But still when i check through fsck or http://master:50070
> > > i get only 2 live nodes,one master and one slave(out of 3
> slaves,randomly it
> > > picks anyone)
> > >
> > > Can anybody tell me why its not updating the count of live nodes to 4.
> > >
> > > Regards
> > > Prabhjot
> > >
> >
> >
> >
> > --
> > Harsh J
>

Re: Live nodes count not incremented with the addition of new nodes

Posted by Mohammad Tariq <do...@gmail.com>.

Run the balancer once and see if it works.

Regards,
    Mohammad Tariq



On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
funnlearnforkids@gmail.com> wrote:

> yeah installation is proper but it seems they are sharing the same storage
> id'
> Do i need to make any change in slaves configuration.I have copied the
> slaves image on other nodes.
> Check this log file:
> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> blocks
> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> processing time: 1 msecs
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node registration from
> 192.168.0.122:50010 storage
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> replaced by 192.168.0.122:50010 with the same storageID
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Removing a node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.122:50010
>
>
> Why with another node registration previous node is removed?
>
> Regards
> Prabhjot
>
> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
> >
> > I'd first check if your additional nodes came up fine (check the
> > services' logs) and connected to the master alright.
> >
> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> > <fu...@gmail.com> wrote:
> > >
> > >
> > > Hi
> > >
> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
> cluster.
> > >
> > > Ran these commands
> > > hadoop dfsadmin -refreshNodes
> > > hadoop mradmin -refreshNodes
> > >
> > > But still when i check through fsck or http://master:50070
> > > i get only 2 live nodes,one master and one slave(out of 3
> slaves,randomly it
> > > picks anyone)
> > >
> > > Can anybody tell me why its not updating the count of live nodes to 4.
> > >
> > > Regards
> > > Prabhjot
> > >
> >
> >
> >
> > --
> > Harsh J
>

Re: Live nodes count not incremented with the addition of new nodes

Posted by Mohammad Tariq <do...@gmail.com>.

Run the balancer once and see if it works.

Regards,
    Mohammad Tariq



On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
funnlearnforkids@gmail.com> wrote:

> yeah installation is proper but it seems they are sharing the same storage
> id'
> Do i need to make any change in slaves configuration.I have copied the
> slaves image on other nodes.
> Check this log file:
> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> blocks
> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> processing time: 1 msecs
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node registration from
> 192.168.0.122:50010 storage
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> replaced by 192.168.0.122:50010 with the same storageID
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Removing a node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.122:50010
>
>
> Why with another node registration previous node is removed?
>
> Regards
> Prabhjot
>
> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
> >
> > I'd first check if your additional nodes came up fine (check the
> > services' logs) and connected to the master alright.
> >
> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> > <fu...@gmail.com> wrote:
> > >
> > >
> > > Hi
> > >
> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
> cluster.
> > >
> > > Ran these commands
> > > hadoop dfsadmin -refreshNodes
> > > hadoop mradmin -refreshNodes
> > >
> > > But still when i check through fsck or http://master:50070
> > > i get only 2 live nodes,one master and one slave(out of 3
> slaves,randomly it
> > > picks anyone)
> > >
> > > Can anybody tell me why its not updating the count of live nodes to 4.
> > >
> > > Regards
> > > Prabhjot
> > >
> >
> >
> >
> > --
> > Harsh J
>

Re: Live nodes count not incremented with the addition of new nodes

Posted by Harsh J <ha...@cloudera.com>.

Each of your DN needs its own dfs.data.dir directory (configurable in
hdfs-site.xml), unique from others. Otherwise, it may not work the way
you intend it to.

On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games
<fu...@gmail.com> wrote:
> yeah installation is proper but it seems they are sharing the same storage id'
> Do i need to make any change in slaves configuration.I have copied the
> slaves image on other nodes.
> Check this log file:
> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> blocks
> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> processing time: 1 msecs
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node registration from
> 192.168.0.122:50010 storage
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> replaced by 192.168.0.122:50010 with the same storageID
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Removing a node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.122:50010
>
>
> Why with another node registration previous node is removed?
>
> Regards
> Prabhjot
>
> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
>>
>> I'd first check if your additional nodes came up fine (check the
>> services' logs) and connected to the master alright.
>>
>> On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
>> <fu...@gmail.com> wrote:
>> >
>> >
>> > Hi
>> >
>> > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.
>> >
>> > Ran these commands
>> > hadoop dfsadmin -refreshNodes
>> > hadoop mradmin -refreshNodes
>> >
>> > But still when i check through fsck or http://master:50070
>> > i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly it
>> > picks anyone)
>> >
>> > Can anybody tell me why its not updating the count of live nodes to 4.
>> >
>> > Regards
>> > Prabhjot
>> >
>>
>>
>>
>> --
>> Harsh J



-- 
Harsh J

Re: Live nodes count not incremented with the addition of new nodes

Posted by Harsh J <ha...@cloudera.com>.

Each of your DN needs its own dfs.data.dir directory (configurable in
hdfs-site.xml), unique from others. Otherwise, it may not work the way
you intend it to.

On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games
<fu...@gmail.com> wrote:
> yeah installation is proper but it seems they are sharing the same storage id'
> Do i need to make any change in slaves configuration.I have copied the
> slaves image on other nodes.
> Check this log file:
> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> blocks
> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> processing time: 1 msecs
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node registration from
> 192.168.0.122:50010 storage
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> replaced by 192.168.0.122:50010 with the same storageID
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Removing a node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.122:50010
>
>
> Why with another node registration previous node is removed?
>
> Regards
> Prabhjot
>
> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
>>
>> I'd first check if your additional nodes came up fine (check the
>> services' logs) and connected to the master alright.
>>
>> On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
>> <fu...@gmail.com> wrote:
>> >
>> >
>> > Hi
>> >
>> > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.
>> >
>> > Ran these commands
>> > hadoop dfsadmin -refreshNodes
>> > hadoop mradmin -refreshNodes
>> >
>> > But still when i check through fsck or http://master:50070
>> > i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly it
>> > picks anyone)
>> >
>> > Can anybody tell me why its not updating the count of live nodes to 4.
>> >
>> > Regards
>> > Prabhjot
>> >
>>
>>
>>
>> --
>> Harsh J



-- 
Harsh J

Re: Live nodes count not incremented with the addition of new nodes

Posted by Harsh J <ha...@cloudera.com>.

Each of your DN needs its own dfs.data.dir directory (configurable in
hdfs-site.xml), unique from others. Otherwise, it may not work the way
you intend it to.

On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games
<fu...@gmail.com> wrote:
> yeah installation is proper but it seems they are sharing the same storage id'
> Do i need to make any change in slaves configuration.I have copied the
> slaves image on other nodes.
> Check this log file:
> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> blocks
> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> processing time: 1 msecs
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node registration from
> 192.168.0.122:50010 storage
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> replaced by 192.168.0.122:50010 with the same storageID
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Removing a node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.122:50010
>
>
> Why with another node registration previous node is removed?
>
> Regards
> Prabhjot
>
> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
>>
>> I'd first check if your additional nodes came up fine (check the
>> services' logs) and connected to the master alright.
>>
>> On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
>> <fu...@gmail.com> wrote:
>> >
>> >
>> > Hi
>> >
>> > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.
>> >
>> > Ran these commands
>> > hadoop dfsadmin -refreshNodes
>> > hadoop mradmin -refreshNodes
>> >
>> > But still when i check through fsck or http://master:50070
>> > i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly it
>> > picks anyone)
>> >
>> > Can anybody tell me why its not updating the count of live nodes to 4.
>> >
>> > Regards
>> > Prabhjot
>> >
>>
>>
>>
>> --
>> Harsh J



-- 
Harsh J

Re: Live nodes count not incremented with the addition of new nodes

Posted by Mohammad Tariq <do...@gmail.com>.

Run the balancer once and see if it works.

Regards,
    Mohammad Tariq



On Fri, Aug 24, 2012 at 2:27 PM, iwannaplay games <
funnlearnforkids@gmail.com> wrote:

> yeah installation is proper but it seems they are sharing the same storage
> id'
> Do i need to make any change in slaves configuration.I have copied the
> slaves image on other nodes.
> Check this log file:
> 2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
> blocks
> 2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
> *BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
> processing time: 1 msecs
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node registration from
> 192.168.0.122:50010 storage
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
> BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
> replaced by 192.168.0.122:50010 with the same storageID
> DS-2050366683-192.168.0.122-50010-1344447057014
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Removing a node: /default-rack/192.168.0.190:50010
> 2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
> Adding a new node: /default-rack/192.168.0.122:50010
>
>
> Why with another node registration previous node is removed?
>
> Regards
> Prabhjot
>
> On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
> >
> > I'd first check if your additional nodes came up fine (check the
> > services' logs) and connected to the master alright.
> >
> > On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> > <fu...@gmail.com> wrote:
> > >
> > >
> > > Hi
> > >
> > > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop
> cluster.
> > >
> > > Ran these commands
> > > hadoop dfsadmin -refreshNodes
> > > hadoop mradmin -refreshNodes
> > >
> > > But still when i check through fsck or http://master:50070
> > > i get only 2 live nodes,one master and one slave(out of 3
> slaves,randomly it
> > > picks anyone)
> > >
> > > Can anybody tell me why its not updating the count of live nodes to 4.
> > >
> > > Regards
> > > Prabhjot
> > >
> >
> >
> >
> > --
> > Harsh J
>

Re: Live nodes count not incremented with the addition of new nodes

Posted by iwannaplay games <fu...@gmail.com>.

yeah installation is proper but it seems they are sharing the same storage id'
Do i need to make any change in slaves configuration.I have copied the
slaves image on other nodes.
Check this log file:
2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
Adding a new node: /default-rack/192.168.0.190:50010
2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
*BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
blocks
2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
*BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
processing time: 1 msecs
2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
BLOCK* NameSystem.registerDatanode: node registration from
192.168.0.122:50010 storage
DS-2050366683-192.168.0.122-50010-1344447057014
2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
replaced by 192.168.0.122:50010 with the same storageID
DS-2050366683-192.168.0.122-50010-1344447057014
2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
Removing a node: /default-rack/192.168.0.190:50010
2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
Adding a new node: /default-rack/192.168.0.122:50010

Why with another node registration previous node is removed?

Regards
Prabhjot

On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
>
> I'd first check if your additional nodes came up fine (check the
> services' logs) and connected to the master alright.
>
> On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> <fu...@gmail.com> wrote:
> >
> >
> > Hi
> >
> > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.
> >
> > Ran these commands
> > hadoop dfsadmin -refreshNodes
> > hadoop mradmin -refreshNodes
> >
> > But still when i check through fsck or http://master:50070
> > i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly it
> > picks anyone)
> >
> > Can anybody tell me why its not updating the count of live nodes to 4.
> >
> > Regards
> > Prabhjot
> >
>
>
>
> --
> Harsh J

Re: Live nodes count not incremented with the addition of new nodes

Posted by iwannaplay games <fu...@gmail.com>.

yeah installation is proper but it seems they are sharing the same storage id'
Do i need to make any change in slaves configuration.I have copied the
slaves image on other nodes.
Check this log file:
2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
Adding a new node: /default-rack/192.168.0.190:50010
2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
*BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
blocks
2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
*BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
processing time: 1 msecs
2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
BLOCK* NameSystem.registerDatanode: node registration from
192.168.0.122:50010 storage
DS-2050366683-192.168.0.122-50010-1344447057014
2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
replaced by 192.168.0.122:50010 with the same storageID
DS-2050366683-192.168.0.122-50010-1344447057014
2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
Removing a node: /default-rack/192.168.0.190:50010
2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
Adding a new node: /default-rack/192.168.0.122:50010

Why with another node registration previous node is removed?

Regards
Prabhjot

On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
>
> I'd first check if your additional nodes came up fine (check the
> services' logs) and connected to the master alright.
>
> On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> <fu...@gmail.com> wrote:
> >
> >
> > Hi
> >
> > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.
> >
> > Ran these commands
> > hadoop dfsadmin -refreshNodes
> > hadoop mradmin -refreshNodes
> >
> > But still when i check through fsck or http://master:50070
> > i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly it
> > picks anyone)
> >
> > Can anybody tell me why its not updating the count of live nodes to 4.
> >
> > Regards
> > Prabhjot
> >
>
>
>
> --
> Harsh J

Re: Live nodes count not incremented with the addition of new nodes

Posted by iwannaplay games <fu...@gmail.com>.

yeah installation is proper but it seems they are sharing the same storage id'
Do i need to make any change in slaves configuration.I have copied the
slaves image on other nodes.
Check this log file:
2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
Adding a new node: /default-rack/192.168.0.190:50010
2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
*BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
blocks
2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
*BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
processing time: 1 msecs
2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
BLOCK* NameSystem.registerDatanode: node registration from
192.168.0.122:50010 storage
DS-2050366683-192.168.0.122-50010-1344447057014
2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
replaced by 192.168.0.122:50010 with the same storageID
DS-2050366683-192.168.0.122-50010-1344447057014
2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
Removing a node: /default-rack/192.168.0.190:50010
2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
Adding a new node: /default-rack/192.168.0.122:50010

Why with another node registration previous node is removed?

Regards
Prabhjot

On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
>
> I'd first check if your additional nodes came up fine (check the
> services' logs) and connected to the master alright.
>
> On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> <fu...@gmail.com> wrote:
> >
> >
> > Hi
> >
> > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.
> >
> > Ran these commands
> > hadoop dfsadmin -refreshNodes
> > hadoop mradmin -refreshNodes
> >
> > But still when i check through fsck or http://master:50070
> > i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly it
> > picks anyone)
> >
> > Can anybody tell me why its not updating the count of live nodes to 4.
> >
> > Regards
> > Prabhjot
> >
>
>
>
> --
> Harsh J

Re: Live nodes count not incremented with the addition of new nodes

Posted by iwannaplay games <fu...@gmail.com>.

yeah installation is proper but it seems they are sharing the same storage id'
Do i need to make any change in slaves configuration.I have copied the
slaves image on other nodes.
Check this log file:
2012-08-24 19:46:18,179 INFO org.apache.hadoop.net.NetworkTopology:
Adding a new node: /default-rack/192.168.0.190:50010
2012-08-24 19:46:18,188 INFO org.apache.hadoop.hdfs.StateChange:
*BLOCK* NameNode.blocksBeingWrittenReport: from 192.168.0.190:50010 0
blocks
2012-08-24 19:46:18,215 INFO org.apache.hadoop.hdfs.StateChange:
*BLOCK* NameSystem.processReport: from 192.168.0.190:50010, blocks: 0,
processing time: 1 msecs
2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
BLOCK* NameSystem.registerDatanode: node registration from
192.168.0.122:50010 storage
DS-2050366683-192.168.0.122-50010-1344447057014
2012-08-24 19:46:18,276 INFO org.apache.hadoop.hdfs.StateChange:
BLOCK* NameSystem.registerDatanode: node 192.168.0.190:50010 is
replaced by 192.168.0.122:50010 with the same storageID
DS-2050366683-192.168.0.122-50010-1344447057014
2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
Removing a node: /default-rack/192.168.0.190:50010
2012-08-24 19:46:18,276 INFO org.apache.hadoop.net.NetworkTopology:
Adding a new node: /default-rack/192.168.0.122:50010

Why with another node registration previous node is removed?

Regards
Prabhjot

On Thu, Aug 23, 2012 at 7:24 PM, Harsh J <ha...@cloudera.com> wrote:
>
> I'd first check if your additional nodes came up fine (check the
> services' logs) and connected to the master alright.
>
> On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
> <fu...@gmail.com> wrote:
> >
> >
> > Hi
> >
> > I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.
> >
> > Ran these commands
> > hadoop dfsadmin -refreshNodes
> > hadoop mradmin -refreshNodes
> >
> > But still when i check through fsck or http://master:50070
> > i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly it
> > picks anyone)
> >
> > Can anybody tell me why its not updating the count of live nodes to 4.
> >
> > Regards
> > Prabhjot
> >
>
>
>
> --
> Harsh J

Re: Live nodes count not incremented with the addition of new nodes

Posted by Harsh J <ha...@cloudera.com>.

I'd first check if your additional nodes came up fine (check the
services' logs) and connected to the master alright.

On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
<fu...@gmail.com> wrote:
>
>
> Hi
>
> I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.
>
> Ran these commands
> hadoop dfsadmin -refreshNodes
> hadoop mradmin -refreshNodes
>
> But still when i check through fsck or http://master:50070
> i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly it
> picks anyone)
>
> Can anybody tell me why its not updating the count of live nodes to 4.
>
> Regards
> Prabhjot
>



-- 
Harsh J

Re: Live nodes count not incremented with the addition of new nodes

Posted by Harsh J <ha...@cloudera.com>.

I'd first check if your additional nodes came up fine (check the
services' logs) and connected to the master alright.

On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
<fu...@gmail.com> wrote:
>
>
> Hi
>
> I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.
>
> Ran these commands
> hadoop dfsadmin -refreshNodes
> hadoop mradmin -refreshNodes
>
> But still when i check through fsck or http://master:50070
> i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly it
> picks anyone)
>
> Can anybody tell me why its not updating the count of live nodes to 4.
>
> Regards
> Prabhjot
>



-- 
Harsh J

Re: Live nodes count not incremented with the addition of new nodes

Posted by Harsh J <ha...@cloudera.com>.

I'd first check if your additional nodes came up fine (check the
services' logs) and connected to the master alright.

On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
<fu...@gmail.com> wrote:
>
>
> Hi
>
> I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.
>
> Ran these commands
> hadoop dfsadmin -refreshNodes
> hadoop mradmin -refreshNodes
>
> But still when i check through fsck or http://master:50070
> i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly it
> picks anyone)
>
> Can anybody tell me why its not updating the count of live nodes to 4.
>
> Regards
> Prabhjot
>



-- 
Harsh J

Re: Live nodes count not incremented with the addition of new nodes

Posted by Harsh J <ha...@cloudera.com>.

I'd first check if your additional nodes came up fine (check the
services' logs) and connected to the master alright.

On Thu, Aug 23, 2012 at 7:18 PM, iwannaplay games
<fu...@gmail.com> wrote:
>
>
> Hi
>
> I had a 2 node cluster earlier.I added 2 nodes on the fly in hadoop cluster.
>
> Ran these commands
> hadoop dfsadmin -refreshNodes
> hadoop mradmin -refreshNodes
>
> But still when i check through fsck or http://master:50070
> i get only 2 live nodes,one master and one slave(out of 3 slaves,randomly it
> picks anyone)
>
> Can anybody tell me why its not updating the count of live nodes to 4.
>
> Regards
> Prabhjot
>



-- 
Harsh J