You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Daniel Halperin (JIRA)" <ji...@apache.org> on 2016/02/25 18:07:18 UTC

[jira] [Created] (BEAM-70) More expressive UnboundedSource hierarchy and utilities

Daniel Halperin created BEAM-70:
-----------------------------------

             Summary: More expressive UnboundedSource hierarchy and utilities
                 Key: BEAM-70
                 URL: https://issues.apache.org/jira/browse/BEAM-70
             Project: Beam
          Issue Type: New Feature
          Components: sdk-java-core
            Reporter: Daniel Halperin


Right now, the UnboundedSource type hierarchy is 1 deep -- UnboundedSource and then things like CountingSource or KafkaSource directly on top.

To ease implementors, we should have more abstract classes in the "common source types". Some examples may be:

- KeyRangeUnboundedSource -- for things like PubSub, Bigtable, Kafka, Kinesis
- StreamSource -- for reading from a socket or other stream.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)