You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2017/06/30 12:33:00 UTC

[jira] [Commented] (SPARK-17924) Consolidate streaming and batch write path

    [ https://issues.apache.org/jira/browse/SPARK-17924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16070019#comment-16070019 ] 

Wenchen Fan commented on SPARK-17924:
-------------------------------------

cc [~rxin] can we resolve this ticket? all subtasks are done.

> Consolidate streaming and batch write path
> ------------------------------------------
>
>                 Key: SPARK-17924
>                 URL: https://issues.apache.org/jira/browse/SPARK-17924
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Reynold Xin
>            Assignee: Reynold Xin
>
> Structured streaming and normal SQL operation currently have two separate write path, leading to a lot of duplicated functions (that look similar) and if branches. The purpose of this ticket is to consolidate the two as much as possible to make the write path more clear.
> A side-effect of this change is that streaming will automatically support all the file formats.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org