You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/09/12 08:37:58 UTC
[GitHub] [hudi] Zhangshunyu opened a new issue, #6655: [SUPPORT] tryComposeIndexFilterExpr in dataskip util could support InSet expression of spark?
Zhangshunyu opened a new issue, #6655:
URL: https://github.com/apache/hudi/issues/6655
spark has a threshold spark.sql.optimizer.inSetConversionThreshold by default it is 10,
when filter is IN expression for example in ('1', '2', '3' ... '100'), when the values of in set > 10
IN will transform to InSet, but the filter expression transform doesnt check InSet, it only has In
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on issue #6655: [SUPPORT] tryComposeIndexFilterExpr in dataskip util could support InSet expression of spark?
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on issue #6655:
URL: https://github.com/apache/hudi/issues/6655#issuecomment-1248512311
@Zhangshunyu this is a great catch!
I've filed HUDI-4851 to address. @xushiyan we can close this one.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan closed issue #6655: [SUPPORT] tryComposeIndexFilterExpr in dataskip util could support InSet expression of spark?
Posted by GitBox <gi...@apache.org>.
xushiyan closed issue #6655: [SUPPORT] tryComposeIndexFilterExpr in dataskip util could support InSet expression of spark?
URL: https://github.com/apache/hudi/issues/6655
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on issue #6655: [SUPPORT] tryComposeIndexFilterExpr in dataskip util could support InSet expression of spark?
Posted by GitBox <gi...@apache.org>.
xushiyan commented on issue #6655:
URL: https://github.com/apache/hudi/issues/6655#issuecomment-1247434901
@alexeykudinkin can you take a look pls?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] alexeykudinkin commented on issue #6655: [SUPPORT] tryComposeIndexFilterExpr in dataskip util could support InSet expression of spark?
Posted by GitBox <gi...@apache.org>.
alexeykudinkin commented on issue #6655:
URL: https://github.com/apache/hudi/issues/6655#issuecomment-1248504597
@xushiyan you can assign this one to myself
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org