[GitHub] [incubator-hudi] umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

[GitBox <gi...@apache.org>]

umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types
URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-552051388
 
 
   > Sending this PR out early to get feedback. Have not yet looked into what changes are required for tests. But in general these changes have been working for us on AWS EMR without any issues so far. This PR implements the following:
   > 
   >     * Migrates Hudi to Spark 2.4.4
   > 
   >     * Migrates Hudi to use spark-avro module instead of the deprecated databricks-avro
   > 
   >     * Adds support for Decimal/Date types correctly through Hive
   > 
   >     * Timestamp still needs to be supported as it is blocked on https://issues.apache.org/jira/browse/HUDI-83
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services