You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2019/10/13 23:10:00 UTC
[jira] [Resolved] (SPARK-29361) Enable DataFrame with streaming
source support on DSv1
[ https://issues.apache.org/jira/browse/SPARK-29361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jungtaek Lim resolved SPARK-29361.
----------------------------------
Resolution: Invalid
Closing this, as there was some explanation that DSv2 is the first one supporting streaming source.
https://lists.apache.org/thread.html/2684c0fd155a21ef100377a23e135feeabd0b0a7a098ca5e40f20e37@%3Cdev.spark.apache.org%3E
https://lists.apache.org/thread.html/3f0f5306b8d61a43023114bbcae7bb404ca5a0ddc3ba56f01876f8f6@<dev.spark.apache.org>
> Enable DataFrame with streaming source support on DSv1
> --------------------------------------------------------
>
> Key: SPARK-29361
> URL: https://issues.apache.org/jira/browse/SPARK-29361
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Jungtaek Lim
> Priority: Major
>
> DSv2 is heavily diverged between Spark 2.x and 3.x, and started from some times before, Spark community suggested to not deal with old DSv2 and wait for new DSv2.
> The only consistent option between Spark 2.x and 3.x is DSv1, but supporting streaming source is missed in DSv1. This issue tracks the effort to add support for streaming source on DSv1.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org