You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Battula, Brahma Reddy" <bb...@visa.com.INVALID> on 2021/06/10 07:43:03 UTC
Any best practices for hive upgrade from 1.2.1 to 3.1.2
Hi All,
We are planning to upgrade the hive from 1.2.1 to 3.1.2, can we get any best practices ..?
Is any chance to upgrade without down time (if we disable new features like managed tables)..?
Thanks.
Re: Any best practices for hive upgrade from 1.2.1 to 3.1.2
Posted by "Battula, Brahma Reddy" <bb...@visa.com>.
Thanks for prompt reply.
Do you’ve any reference or blogs written for this like what all issues faced during upgrade..?
If possible hive community can arrange one syncup call..?
From: Julien Tane <ju...@solute.de>
Date: Thursday, 10 June 2021 at 2:27 PM
To: user@hive.apache.org <us...@hive.apache.org>
Subject: AW: Any best practices for hive upgrade from 1.2.1 to 3.1.2
Hello,
we did an upgrade of our processes on a new cluster HDP 2.5 (more or less 1.2.1) --> HDP 3.1 (Hive 3) and a lot of things were problematic
But mainly you need to make sure you take care of the int -> String because the new version of hive expects the right data type
So I would not expect a upgrade without problem, but YMMV.
my 2c,
Julien
Julien Tane
Big Data Engineer
[Tel.]
+49 721 98993-393
[Fax]
+49 721 98993-66
[E-Mail]
juta@solute.de<ma...@solute.de>
solute GmbH
Zeppelinstraße 15
76185 Karlsruhe
Germany
[Logo Solute]
[SoluteDay]<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.solute.de%2Fger%2Fsoluteday%2F&data=04%7C01%7Cbbattula%40visa.com%7C68b0deb9f5b34ac5086308d92bed9bf5%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637589122370643729%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=UYPqg4LqUGSssrCY9m5137dKrvo7gAYngc60rAMGFrc%3D&reserved=0>
Marken der solute GmbH | brands of solute GmbH
[Marken]
Geschäftsführer | Managing Director: Dr. Thilo Gans, Bernd Vermaaten
Webseite | www.solute.de <https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.solute.de%2F&data=04%7C01%7Cbbattula%40visa.com%7C68b0deb9f5b34ac5086308d92bed9bf5%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637589122370653686%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=2h8PynRSdEwC7PDjz6yU8fWMA9JCzbSIgUkgXJ6ry%2BU%3D&reserved=0>
Sitz | Registered Office: Karlsruhe
Registergericht | Register Court: Amtsgericht Mannheim
Registernummer | Register No.: HRB 110579
USt-ID | VAT ID: DE234663798
Informationen zum Datenschutz | Information about privacy policy
https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php <https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.solute.de%2Fger%2Fdatenschutz%2Fgrundsaetze-der-datenverarbeitung.php&data=04%7C01%7Cbbattula%40visa.com%7C68b0deb9f5b34ac5086308d92bed9bf5%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C637589122370653686%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=hV2SwQCGCw%2BP9NVl6HCuXliu%2B9VGi9klJYc7H6t8P2o%3D&reserved=0>
________________________________
Von: Battula, Brahma Reddy <bb...@visa.com>
Gesendet: Donnerstag, 10. Juni 2021 09:43:03
An: dev@hive.apache.org; user@hive.apache.org
Betreff: Any best practices for hive upgrade from 1.2.1 to 3.1.2
Hi All,
We are planning to upgrade the hive from 1.2.1 to 3.1.2, can we get any best practices ..?
Is any chance to upgrade without down time (if we disable new features like managed tables)..?
Thanks.
AW: Any best practices for hive upgrade from 1.2.1 to 3.1.2
Posted by Julien Tane <ju...@solute.de>.
Hello,
we did an upgrade of our processes on a new cluster HDP 2.5 (more or less 1.2.1) --> HDP 3.1 (Hive 3) and a lot of things were problematic
But mainly you need to make sure you take care of the int -> String because the new version of hive expects the right data type
So I would not expect a upgrade without problem, but YMMV.
my 2c,
Julien
Julien Tane
Big Data Engineer
[Tel.] +49 721 98993-393
[Fax] +49 721 98993-66
[E-Mail] juta@solute.de<ma...@solute.de>
solute GmbH
Zeppelinstra?e 15
76185 Karlsruhe
Germany
[Logo Solute]
[SoluteDay]<https://www.solute.de/ger/soluteday/>
Marken der solute GmbH | brands of solute GmbH
[Marken]
Gesch?ftsf?hrer | Managing Director: Dr. Thilo Gans, Bernd Vermaaten
Webseite | www.solute.de <http://www.solute.de/>
Sitz | Registered Office: Karlsruhe
Registergericht | Register Court: Amtsgericht Mannheim
Registernummer | Register No.: HRB 110579
USt-ID | VAT ID: DE234663798
Informationen zum Datenschutz | Information about privacy policy
https://www.solute.de/ger/datenschutz/grundsaetze-der-datenverarbeitung.php
________________________________
Von: Battula, Brahma Reddy <bb...@visa.com>
Gesendet: Donnerstag, 10. Juni 2021 09:43:03
An: dev@hive.apache.org; user@hive.apache.org
Betreff: Any best practices for hive upgrade from 1.2.1 to 3.1.2
Hi All,
We are planning to upgrade the hive from 1.2.1 to 3.1.2, can we get any best practices ..?
Is any chance to upgrade without down time (if we disable new features like managed tables)..?
Thanks.
Re: Any best practices for hive upgrade from 1.2.1 to 3.1.2
Posted by eric wong <wi...@gmail.com>.
You can refer to this blog, but i'm afraid there is only a chinese version
and you cloud translate it to English
Hive升级全姿势 | Haihua's blog (ericsahit.github.io)
<https://ericsahit.github.io/2017/09/10/Hive%E5%8D%87%E7%BA%A7%E5%85%A8%E5%A7%BF%E5%8A%BF/>
Battula, Brahma Reddy <bb...@visa.com> 于2021年6月10日周四 15:43写道：
> Hi All,
>
>
>
> We are planning to upgrade the hive from 1.2.1 to 3.1.2, can we get any
> best practices ..?
>
>
>
> Is any chance to upgrade without down time (if we disable new features
> like managed tables)..?
>
>
>
>
>
> Thanks.
>
>
>
>
>
>
>
--
王海华