Hive handling of ingested data when source column changes size or new column added

[Mich Talebzadeh <mi...@gmail.com>]

Assuming we are ingesting into Hive table from an RDBMS Oracle table.

This is done through a daily mechanism.

My conclusion is this.


   1. The source column has moved from VARCHA2(50) to CARCHAR2(100). As I
   know this should not matter in Hive as every VARCHAR is stored as String in
   Hive. So moving from VARCHAR2(50) to VARCHAR2(100) at source with Hive
   column defined as Varchar(50) would not matter? Data will be ingested OK
   2. How about NUMERIC columns or DECIMAL columns at source. Will they
   have to be modified in Hive?


Also if we add another column to source table, then there is no other way
than adding that column to Hive. Also the existing Hive partitions will
stay as before but new partitions will have space reserved for additional
columns.

Thanks

Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com


*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.