You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Arun Mahadevan (JIRA)" <ji...@apache.org> on 2018/08/02 14:04:00 UTC

[jira] [Created] (SPARK-25000) Identify common interfaces to reduce the code duplication between micro-batch and continuous sources

Arun Mahadevan created SPARK-25000:
--------------------------------------

             Summary: Identify common interfaces to reduce the code duplication between micro-batch and continuous sources
                 Key: SPARK-25000
                 URL: https://issues.apache.org/jira/browse/SPARK-25000
             Project: Spark
          Issue Type: Improvement
          Components: Structured Streaming
    Affects Versions: 2.4.0
            Reporter: Arun Mahadevan


Currently there are two separate implementations (micro-batch and continuous) for each type of source and and the chance of code duplication is more.

Identify and pull out some generic APIs that both micro-batch and continuous sources can implement so that such duplication can be avoided as much as possible. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org