You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/12/13 05:30:20 UTC
[GitHub] [spark] cloud-fan opened a new pull request #26876:
[SPARK-30238][SQL][2.4] hive partition pruning can only support string and
integral types
cloud-fan opened a new pull request #26876: [SPARK-30238][SQL][2.4] hive partition pruning can only support string and integral types
URL: https://github.com/apache/spark/pull/26876
backport https://github.com/apache/spark/pull/26871
-----
Check the partition column data type and only allow string and integral types in hive partition pruning.
Currently we only support string and integral types in hive partition pruning, but the check is done for literals. If the predicate is `InSet`, then there is no literal and we may pass an unsupported partition predicate to Hive and cause problems.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org