You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Bharath Kumar <bh...@gmail.com> on 2014/05/12 09:18:24 UTC
LVM to JBOD conversion without data loss
Hi I am a query regarding JBOD ,
I sit possible to migrate from LVM to JBOD without loosing data ? Is there
any reference documentation ?
The steps which i can think of is
1) reduce the replication
2) change the hdfs-site.xml in namenode
3) add the data node back with new JBOD directory structure for haddop
4) rebalance the cluster
repeat 1 -4 for all data nodes is the steps correct ?
--
Warm Regards,
*Bharath Kumar *
Re: LVM to JBOD conversion without data loss
Posted by Ravi Prakash <ra...@ymail.com>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
One way I can think of is decomissioning the nodes and then basically
re-imaging it however you want to. Is that not an option?
On 05/12/14 00:18, Bharath Kumar wrote:
> Hi I am a query regarding JBOD ,
>
> I sit possible to migrate from LVM to JBOD without loosing data ? Is there
> any reference documentation ?
>
> The steps which i can think of is
>
> 1) reduce the replication
>
> 2) change the hdfs-site.xml in namenode
>
> 3) add the data node back with new JBOD directory structure for haddop
>
> 4) rebalance the cluster
>
> repeat 1 -4 for all data nodes is the steps correct ?
>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iQIcBAEBAgAGBQJTcbU5AAoJEGunL/HJl4XecH0P/0FIpstANjdkzpxKD2of1TRd
LZKbyWUAbj3EZB06yDMunNCsj9Bg5BwsuRV3LFVUmwRv1ymW/hXQMgn8torPiu45
csmYX2ihMNlMqQO7u3HyaDHpHnTkBTmtypfWWXVe2LNjnrpmkcJpl8dU2FuEm7ga
E8w46pnvB/vSGFQQ3tWOCdCknKM+0ykcrcy64Xpe0gx92MSgyEL5I2yxrOA3sSru
QvU4ko4q8Q5OT6oOFBw5lNiVJ6FyiQj0y5499o9zV5xUFL39a+R/nqZpiJ0Pgm2d
ytZVheHLYZZSt2gZYjAGvikLveez/ycCJEx4YA2j5FlpMycpeshLmJ1K/EAbIY/a
Yv2hsf2GQB6pVZisOfL179TwTcII8xJ3/JviyrdRb93anVT9sgicgJJrFtQN+mcy
exrT4R5Y/Fl1pxkFUHJj4qz9rSuwC2WlUjpjGpA8Lf9DsIC5ONzzDTSux+e4WfCD
wBjSd2fZ8F6/KPoHMvfMUVwMoT7RLtUuWpw87P5GshdzjD0Bx0HhEMK5+XGn/GyP
VU2ahcFrjFok5FoaysbY8QjKqn7gMT2b1hG7jM8bm/4MPLOYWfYKpRghClQFGbD1
Xb7p5pshqlctZw1X+ZfxyB2khrSsvd3GCI1PwK62mdehL59klpVkNQs+FXILQ6sF
1lodqxtUgXcRE0hXwhV7
=CR33
-----END PGP SIGNATURE-----
Re: LVM to JBOD conversion without data loss
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Bharath,
The steps are not correct for me. Data loss can happen if you reduce the
replication and remove a DataNode at the same time.
1) decomission a DataNode (or some DataNodes)
2) change the configuration of the DataNode(s)
3) add the DataNode(s) to the cluster
repeat 1) - 3) for all the DataNodes.
Regards,
Akira
(2014/05/12 16:18), Bharath Kumar wrote:
> Hi I am a query regarding JBOD ,
>
> I sit possible to migrate from LVM to JBOD without loosing data ? Is
> there any reference documentation ?
>
> The steps which i can think of is
>
> 1) reduce the replication
>
> 2) change the hdfs-site.xml in namenode
>
> 3) add the data node back with new JBOD directory structure for haddop
>
> 4) rebalance the cluster
>
> repeat 1 -4 for all data nodes is the steps correct ?
>
> --
> Warm Regards,
> /Bharath Kumar /
>
Re: LVM to JBOD conversion without data loss
Posted by Ravi Prakash <ra...@ymail.com>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
One way I can think of is decomissioning the nodes and then basically
re-imaging it however you want to. Is that not an option?
On 05/12/14 00:18, Bharath Kumar wrote:
> Hi I am a query regarding JBOD ,
>
> I sit possible to migrate from LVM to JBOD without loosing data ? Is there
> any reference documentation ?
>
> The steps which i can think of is
>
> 1) reduce the replication
>
> 2) change the hdfs-site.xml in namenode
>
> 3) add the data node back with new JBOD directory structure for haddop
>
> 4) rebalance the cluster
>
> repeat 1 -4 for all data nodes is the steps correct ?
>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iQIcBAEBAgAGBQJTcbU5AAoJEGunL/HJl4XecH0P/0FIpstANjdkzpxKD2of1TRd
LZKbyWUAbj3EZB06yDMunNCsj9Bg5BwsuRV3LFVUmwRv1ymW/hXQMgn8torPiu45
csmYX2ihMNlMqQO7u3HyaDHpHnTkBTmtypfWWXVe2LNjnrpmkcJpl8dU2FuEm7ga
E8w46pnvB/vSGFQQ3tWOCdCknKM+0ykcrcy64Xpe0gx92MSgyEL5I2yxrOA3sSru
QvU4ko4q8Q5OT6oOFBw5lNiVJ6FyiQj0y5499o9zV5xUFL39a+R/nqZpiJ0Pgm2d
ytZVheHLYZZSt2gZYjAGvikLveez/ycCJEx4YA2j5FlpMycpeshLmJ1K/EAbIY/a
Yv2hsf2GQB6pVZisOfL179TwTcII8xJ3/JviyrdRb93anVT9sgicgJJrFtQN+mcy
exrT4R5Y/Fl1pxkFUHJj4qz9rSuwC2WlUjpjGpA8Lf9DsIC5ONzzDTSux+e4WfCD
wBjSd2fZ8F6/KPoHMvfMUVwMoT7RLtUuWpw87P5GshdzjD0Bx0HhEMK5+XGn/GyP
VU2ahcFrjFok5FoaysbY8QjKqn7gMT2b1hG7jM8bm/4MPLOYWfYKpRghClQFGbD1
Xb7p5pshqlctZw1X+ZfxyB2khrSsvd3GCI1PwK62mdehL59klpVkNQs+FXILQ6sF
1lodqxtUgXcRE0hXwhV7
=CR33
-----END PGP SIGNATURE-----
Re: LVM to JBOD conversion without data loss
Posted by Ravi Prakash <ra...@ymail.com>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
One way I can think of is decomissioning the nodes and then basically
re-imaging it however you want to. Is that not an option?
On 05/12/14 00:18, Bharath Kumar wrote:
> Hi I am a query regarding JBOD ,
>
> I sit possible to migrate from LVM to JBOD without loosing data ? Is there
> any reference documentation ?
>
> The steps which i can think of is
>
> 1) reduce the replication
>
> 2) change the hdfs-site.xml in namenode
>
> 3) add the data node back with new JBOD directory structure for haddop
>
> 4) rebalance the cluster
>
> repeat 1 -4 for all data nodes is the steps correct ?
>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iQIcBAEBAgAGBQJTcbU5AAoJEGunL/HJl4XecH0P/0FIpstANjdkzpxKD2of1TRd
LZKbyWUAbj3EZB06yDMunNCsj9Bg5BwsuRV3LFVUmwRv1ymW/hXQMgn8torPiu45
csmYX2ihMNlMqQO7u3HyaDHpHnTkBTmtypfWWXVe2LNjnrpmkcJpl8dU2FuEm7ga
E8w46pnvB/vSGFQQ3tWOCdCknKM+0ykcrcy64Xpe0gx92MSgyEL5I2yxrOA3sSru
QvU4ko4q8Q5OT6oOFBw5lNiVJ6FyiQj0y5499o9zV5xUFL39a+R/nqZpiJ0Pgm2d
ytZVheHLYZZSt2gZYjAGvikLveez/ycCJEx4YA2j5FlpMycpeshLmJ1K/EAbIY/a
Yv2hsf2GQB6pVZisOfL179TwTcII8xJ3/JviyrdRb93anVT9sgicgJJrFtQN+mcy
exrT4R5Y/Fl1pxkFUHJj4qz9rSuwC2WlUjpjGpA8Lf9DsIC5ONzzDTSux+e4WfCD
wBjSd2fZ8F6/KPoHMvfMUVwMoT7RLtUuWpw87P5GshdzjD0Bx0HhEMK5+XGn/GyP
VU2ahcFrjFok5FoaysbY8QjKqn7gMT2b1hG7jM8bm/4MPLOYWfYKpRghClQFGbD1
Xb7p5pshqlctZw1X+ZfxyB2khrSsvd3GCI1PwK62mdehL59klpVkNQs+FXILQ6sF
1lodqxtUgXcRE0hXwhV7
=CR33
-----END PGP SIGNATURE-----
Re: LVM to JBOD conversion without data loss
Posted by Ravi Prakash <ra...@ymail.com>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
One way I can think of is decomissioning the nodes and then basically
re-imaging it however you want to. Is that not an option?
On 05/12/14 00:18, Bharath Kumar wrote:
> Hi I am a query regarding JBOD ,
>
> I sit possible to migrate from LVM to JBOD without loosing data ? Is there
> any reference documentation ?
>
> The steps which i can think of is
>
> 1) reduce the replication
>
> 2) change the hdfs-site.xml in namenode
>
> 3) add the data node back with new JBOD directory structure for haddop
>
> 4) rebalance the cluster
>
> repeat 1 -4 for all data nodes is the steps correct ?
>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iQIcBAEBAgAGBQJTcbU5AAoJEGunL/HJl4XecH0P/0FIpstANjdkzpxKD2of1TRd
LZKbyWUAbj3EZB06yDMunNCsj9Bg5BwsuRV3LFVUmwRv1ymW/hXQMgn8torPiu45
csmYX2ihMNlMqQO7u3HyaDHpHnTkBTmtypfWWXVe2LNjnrpmkcJpl8dU2FuEm7ga
E8w46pnvB/vSGFQQ3tWOCdCknKM+0ykcrcy64Xpe0gx92MSgyEL5I2yxrOA3sSru
QvU4ko4q8Q5OT6oOFBw5lNiVJ6FyiQj0y5499o9zV5xUFL39a+R/nqZpiJ0Pgm2d
ytZVheHLYZZSt2gZYjAGvikLveez/ycCJEx4YA2j5FlpMycpeshLmJ1K/EAbIY/a
Yv2hsf2GQB6pVZisOfL179TwTcII8xJ3/JviyrdRb93anVT9sgicgJJrFtQN+mcy
exrT4R5Y/Fl1pxkFUHJj4qz9rSuwC2WlUjpjGpA8Lf9DsIC5ONzzDTSux+e4WfCD
wBjSd2fZ8F6/KPoHMvfMUVwMoT7RLtUuWpw87P5GshdzjD0Bx0HhEMK5+XGn/GyP
VU2ahcFrjFok5FoaysbY8QjKqn7gMT2b1hG7jM8bm/4MPLOYWfYKpRghClQFGbD1
Xb7p5pshqlctZw1X+ZfxyB2khrSsvd3GCI1PwK62mdehL59klpVkNQs+FXILQ6sF
1lodqxtUgXcRE0hXwhV7
=CR33
-----END PGP SIGNATURE-----
Re: LVM to JBOD conversion without data loss
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Bharath,
The steps are not correct for me. Data loss can happen if you reduce the
replication and remove a DataNode at the same time.
1) decomission a DataNode (or some DataNodes)
2) change the configuration of the DataNode(s)
3) add the DataNode(s) to the cluster
repeat 1) - 3) for all the DataNodes.
Regards,
Akira
(2014/05/12 16:18), Bharath Kumar wrote:
> Hi I am a query regarding JBOD ,
>
> I sit possible to migrate from LVM to JBOD without loosing data ? Is
> there any reference documentation ?
>
> The steps which i can think of is
>
> 1) reduce the replication
>
> 2) change the hdfs-site.xml in namenode
>
> 3) add the data node back with new JBOD directory structure for haddop
>
> 4) rebalance the cluster
>
> repeat 1 -4 for all data nodes is the steps correct ?
>
> --
> Warm Regards,
> /Bharath Kumar /
>
Re: LVM to JBOD conversion without data loss
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Bharath,
The steps are not correct for me. Data loss can happen if you reduce the
replication and remove a DataNode at the same time.
1) decomission a DataNode (or some DataNodes)
2) change the configuration of the DataNode(s)
3) add the DataNode(s) to the cluster
repeat 1) - 3) for all the DataNodes.
Regards,
Akira
(2014/05/12 16:18), Bharath Kumar wrote:
> Hi I am a query regarding JBOD ,
>
> I sit possible to migrate from LVM to JBOD without loosing data ? Is
> there any reference documentation ?
>
> The steps which i can think of is
>
> 1) reduce the replication
>
> 2) change the hdfs-site.xml in namenode
>
> 3) add the data node back with new JBOD directory structure for haddop
>
> 4) rebalance the cluster
>
> repeat 1 -4 for all data nodes is the steps correct ?
>
> --
> Warm Regards,
> /Bharath Kumar /
>
Re: LVM to JBOD conversion without data loss
Posted by Akira AJISAKA <aj...@oss.nttdata.co.jp>.
Hi Bharath,
The steps are not correct for me. Data loss can happen if you reduce the
replication and remove a DataNode at the same time.
1) decomission a DataNode (or some DataNodes)
2) change the configuration of the DataNode(s)
3) add the DataNode(s) to the cluster
repeat 1) - 3) for all the DataNodes.
Regards,
Akira
(2014/05/12 16:18), Bharath Kumar wrote:
> Hi I am a query regarding JBOD ,
>
> I sit possible to migrate from LVM to JBOD without loosing data ? Is
> there any reference documentation ?
>
> The steps which i can think of is
>
> 1) reduce the replication
>
> 2) change the hdfs-site.xml in namenode
>
> 3) add the data node back with new JBOD directory structure for haddop
>
> 4) rebalance the cluster
>
> repeat 1 -4 for all data nodes is the steps correct ?
>
> --
> Warm Regards,
> /Bharath Kumar /
>