You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "jalpan-randeri (via GitHub)" <gi...@apache.org> on 2026/05/05 02:13:57 UTC
[I] Support Filter pushdown in Spark Structured Streaming [spark]
jalpan-randeri opened a new issue, #55680:
URL: https://github.com/apache/spark/issues/55680
Currently, Spark Structured streaming via the DSv2 api does not pushdown predicate. This results in more data being scan and filtered out at engine layer. This results in excessive I/O, driver bottlenecks and increased latency.
Relevant Iceberg issue - https://github.com/apache/iceberg/issues/15692
PR on Spark side - https://github.com/apache/spark/pull/55679
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [I] Support Filter pushdown in Spark Structured Streaming [spark]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #55680: Support Filter pushdown in Spark Structured Streaming
URL: https://github.com/apache/spark/issues/55680
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org