You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2017/06/30 17:38:00 UTC
[jira] [Resolved] (SPARK-17924) Consolidate streaming and batch
write path
[ https://issues.apache.org/jira/browse/SPARK-17924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Reynold Xin resolved SPARK-17924.
---------------------------------
Resolution: Fixed
Fix Version/s: 2.3.0
> Consolidate streaming and batch write path
> ------------------------------------------
>
> Key: SPARK-17924
> URL: https://issues.apache.org/jira/browse/SPARK-17924
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Reynold Xin
> Assignee: Reynold Xin
> Fix For: 2.3.0
>
>
> Structured streaming and normal SQL operation currently have two separate write path, leading to a lot of duplicated functions (that look similar) and if branches. The purpose of this ticket is to consolidate the two as much as possible to make the write path more clear.
> A side-effect of this change is that streaming will automatically support all the file formats.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org