You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2021/09/02 06:13:00 UTC
[jira] [Commented] (SPARK-36649) Support Trigger.AvailableNow on
Kafka data source
[ https://issues.apache.org/jira/browse/SPARK-36649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408561#comment-17408561 ]
Jungtaek Lim commented on SPARK-36649:
--------------------------------------
[~saitsh@jira]
Would like to see whether you are interested to work on this one, as you have contributed related code path.
> Support Trigger.AvailableNow on Kafka data source
> -------------------------------------------------
>
> Key: SPARK-36649
> URL: https://issues.apache.org/jira/browse/SPARK-36649
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 3.3.0
> Reporter: Jungtaek Lim
> Priority: Major
>
> SPARK-36533 introduces a new trigger Trigger.AvailableNow, but only introduces the new functionality to the file stream source. Given that Kafka data source is the one of major data sources being used in streaming query, we should make Kafka data source support this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org