You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Viswanathan J <ja...@gmail.com> on 2016/12/08 10:41:27 UTC
[Urgent] - CDH upgrade v5.4.5 to v5.8 - Cluster to different Cluster upgrade
Hi Guys,
Currently we are running CDH version of 5.4.5 and planning to upgrade CDH
v5.8 in different cluster. We are planning to migrate data to the new
cluster through distcp after cluster upgrade.
*CDH (v5.4.5) :*
- Hadoop v2.6.0
- HBase v1.0.0
*CDH (v5.8) :*
- Hadoop v2.6.0
- HBase v1.2.0
Is the latest version will be backward compatible with the older version of
HDFS/HBase data?
Also we are storing the data based on pre-split. Will this upgrade cause
any data incompatible because of different version and cluster/zk nodes.
Please help on this.
--
Regards,
Viswa.J
Re: [Urgent] - CDH upgrade v5.4.5 to v5.8 - Cluster to different
Cluster upgrade
Posted by Aman Singh <bi...@gmail.com>.
strangely, i see the question posting data as 2016, but this landed in my
inbox a few minutes ago :)
On Fri, Aug 13, 2021 at 2:11 PM Aman Singh <bi...@gmail.com>
wrote:
> There are no issues moving within the same major versions.
>
> In Hbase the challenge is only if we move from Hbase 1.x to 2.x. There we
> have to take care of MOB, coprocessors, Prefix etc.
>
> Anyway, moving/copying data across clusters does not cause issues. We only
> need to worry about in-place upgrades.
>
> When you say distcp, for Hbase do snapshot export.
>
> On Thu, Dec 8, 2016 at 9:41 PM Viswanathan J <ja...@gmail.com>
> wrote:
>
>> Hi Guys,
>>
>> Currently we are running CDH version of 5.4.5 and planning to upgrade CDH
>> v5.8 in different cluster. We are planning to migrate data to the new
>> cluster through distcp after cluster upgrade.
>>
>> *CDH (v5.4.5) :*
>>
>> - Hadoop v2.6.0
>> - HBase v1.0.0
>>
>> *CDH (v5.8) :*
>>
>>
>> - Hadoop v2.6.0
>> - HBase v1.2.0
>>
>> Is the latest version will be backward compatible with the older version
>> of HDFS/HBase data?
>>
>> Also we are storing the data based on pre-split. Will this upgrade cause
>> any data incompatible because of different version and cluster/zk nodes.
>>
>> Please help on this.
>> --
>> Regards,
>> Viswa.J
>>
>
Re: [Urgent] - CDH upgrade v5.4.5 to v5.8 - Cluster to different
Cluster upgrade
Posted by Aman Singh <bi...@gmail.com>.
strangely, i see the question posting data as 2016, but this landed in my
inbox a few minutes ago :)
On Fri, Aug 13, 2021 at 2:11 PM Aman Singh <bi...@gmail.com>
wrote:
> There are no issues moving within the same major versions.
>
> In Hbase the challenge is only if we move from Hbase 1.x to 2.x. There we
> have to take care of MOB, coprocessors, Prefix etc.
>
> Anyway, moving/copying data across clusters does not cause issues. We only
> need to worry about in-place upgrades.
>
> When you say distcp, for Hbase do snapshot export.
>
> On Thu, Dec 8, 2016 at 9:41 PM Viswanathan J <ja...@gmail.com>
> wrote:
>
>> Hi Guys,
>>
>> Currently we are running CDH version of 5.4.5 and planning to upgrade CDH
>> v5.8 in different cluster. We are planning to migrate data to the new
>> cluster through distcp after cluster upgrade.
>>
>> *CDH (v5.4.5) :*
>>
>> - Hadoop v2.6.0
>> - HBase v1.0.0
>>
>> *CDH (v5.8) :*
>>
>>
>> - Hadoop v2.6.0
>> - HBase v1.2.0
>>
>> Is the latest version will be backward compatible with the older version
>> of HDFS/HBase data?
>>
>> Also we are storing the data based on pre-split. Will this upgrade cause
>> any data incompatible because of different version and cluster/zk nodes.
>>
>> Please help on this.
>> --
>> Regards,
>> Viswa.J
>>
>
Re: [Urgent] - CDH upgrade v5.4.5 to v5.8 - Cluster to different
Cluster upgrade
Posted by Aman Singh <bi...@gmail.com>.
There are no issues moving within the same major versions.
In Hbase the challenge is only if we move from Hbase 1.x to 2.x. There we
have to take care of MOB, coprocessors, Prefix etc.
Anyway, moving/copying data across clusters does not cause issues. We only
need to worry about in-place upgrades.
When you say distcp, for Hbase do snapshot export.
On Thu, Dec 8, 2016 at 9:41 PM Viswanathan J <ja...@gmail.com>
wrote:
> Hi Guys,
>
> Currently we are running CDH version of 5.4.5 and planning to upgrade CDH
> v5.8 in different cluster. We are planning to migrate data to the new
> cluster through distcp after cluster upgrade.
>
> *CDH (v5.4.5) :*
>
> - Hadoop v2.6.0
> - HBase v1.0.0
>
> *CDH (v5.8) :*
>
>
> - Hadoop v2.6.0
> - HBase v1.2.0
>
> Is the latest version will be backward compatible with the older version
> of HDFS/HBase data?
>
> Also we are storing the data based on pre-split. Will this upgrade cause
> any data incompatible because of different version and cluster/zk nodes.
>
> Please help on this.
> --
> Regards,
> Viswa.J
>
Re: [Urgent] - CDH upgrade v5.4.5 to v5.8 - Cluster to different
Cluster upgrade
Posted by Aman Singh <bi...@gmail.com>.
There are no issues moving within the same major versions.
In Hbase the challenge is only if we move from Hbase 1.x to 2.x. There we
have to take care of MOB, coprocessors, Prefix etc.
Anyway, moving/copying data across clusters does not cause issues. We only
need to worry about in-place upgrades.
When you say distcp, for Hbase do snapshot export.
On Thu, Dec 8, 2016 at 9:41 PM Viswanathan J <ja...@gmail.com>
wrote:
> Hi Guys,
>
> Currently we are running CDH version of 5.4.5 and planning to upgrade CDH
> v5.8 in different cluster. We are planning to migrate data to the new
> cluster through distcp after cluster upgrade.
>
> *CDH (v5.4.5) :*
>
> - Hadoop v2.6.0
> - HBase v1.0.0
>
> *CDH (v5.8) :*
>
>
> - Hadoop v2.6.0
> - HBase v1.2.0
>
> Is the latest version will be backward compatible with the older version
> of HDFS/HBase data?
>
> Also we are storing the data based on pre-split. Will this upgrade cause
> any data incompatible because of different version and cluster/zk nodes.
>
> Please help on this.
> --
> Regards,
> Viswa.J
>
Re: [Urgent] - CDH upgrade v5.4.5 to v5.8 - Cluster to different
Cluster upgrade
Posted by Viswanathan J <ja...@gmail.com>.
Hi Manoj,
You mean even though destination cluster has different version no issue in
data copying and incompatible will not occur right?
On Dec 8, 2016 4:32 PM, "manoj donga" <ma...@gmail.com> wrote:
> DistCp considering backward only if your older one is v4. Anything v5 is
> same for DistCp.
>
> Manoj Donga
> On 8 Dec 2016 4:11 pm, "Viswanathan J" <ja...@gmail.com> wrote:
>
>> Hi Guys,
>>
>> Currently we are running CDH version of 5.4.5 and planning to upgrade CDH
>> v5.8 in different cluster. We are planning to migrate data to the new
>> cluster through distcp after cluster upgrade.
>>
>> *CDH (v5.4.5) :*
>>
>> - Hadoop v2.6.0
>> - HBase v1.0.0
>>
>> *CDH (v5.8) :*
>>
>>
>> - Hadoop v2.6.0
>> - HBase v1.2.0
>>
>> Is the latest version will be backward compatible with the older version
>> of HDFS/HBase data?
>>
>> Also we are storing the data based on pre-split. Will this upgrade cause
>> any data incompatible because of different version and cluster/zk nodes.
>>
>> Please help on this.
>> --
>> Regards,
>> Viswa.J
>>
>> --
>>
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "CDH Users" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to cdh-user+unsubscribe@cloudera.org.
>> For more options, visit https://groups.google.com/a/cloudera.org/d/optout
>> .
>>
> --
>
> ---
> You received this message because you are subscribed to the Google Groups
> "CDH Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to cdh-user+unsubscribe@cloudera.org.
> For more options, visit https://groups.google.com/a/cloudera.org/d/optout.
>