You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/09/08 09:24:16 UTC

[GitHub] [spark] hotienvu commented on pull request #29661: [SPARK-32811][SQL] optimize IN predicate against continuous range

hotienvu commented on pull request #29661:
URL: https://github.com/apache/spark/pull/29661#issuecomment-688741730


   Updated with some details. We have a job where the values in the IN clause are machine-generated hence the range can be arbitrary but dense at the  same time which is hard to look at. having a simplified range checks helps. 
   This alone may not be that useful, but if we can detect and compact the range, it would be nice
   e.g. 1,3,4,5,6,9,10,11 => 1, 3..6, 9..11


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org