You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/05/12 01:33:32 UTC
[GitHub] [hudi] xiarixiaoyao commented on issue #5519: [SUPPORT] Schema Evolution - Error with datatype promotion
xiarixiaoyao commented on issue #5519:
URL: https://github.com/apache/hudi/issues/5519#issuecomment-1124442163
@neerajpadarthi @JoshuaZhuCN @gy19951022 pls try to use "set hoodie.schema.on.read.enable=true" to enable schem evolution.
step1: start spark-sql and set hoodie.schema.on.read.enable=true
# Spark SQL for spark 3.1.x
spark-sql --packages org.apache.hudi:hudi-spark3.1.2-bundle_2.12:0.11.1,org.apache.spark:spark-avro_2.12:3.1.2 \
--conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer' \
--conf 'spark.sql.extensions=org.apache.spark.sql.hudi.HoodieSparkSessionExtension'
step2: use alter statement to alter hoodie schema. : alter table $tableName alter column col6 type long
then your can play with the hoodie table which has a new schema.
your can learn more about schema evoultion on https://hudi.apache.org/docs/schema_evolution
more example can be find in org.apache.spark.sql.hudi.TestSpark3DDL.scala. thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org