You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Mark Shields (JIRA)" <ji...@apache.org> on 2016/03/18 18:29:33 UTC
[jira] [Commented] (BEAM-129) Support pubsub IO
[ https://issues.apache.org/jira/browse/BEAM-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201816#comment-15201816 ]
Mark Shields commented on BEAM-129:
-----------------------------------
For the read side I think this boils down to https://issues.apache.org/jira/browse/BEAM-125 plus making sure the Flink runner is invoking UnboundedSource readers appropriately. I'm working on BEAM-125 right now. (Turns out to be very easy to get working, but more challenging to make fast.)
For the write side ideally we'll start with generic UnboundedSink, then implement pub/sub writes on that, then the Flink runner would invoke that generically. A shorter-term solution may be in order.
> Support pubsub IO
> -----------------
>
> Key: BEAM-129
> URL: https://issues.apache.org/jira/browse/BEAM-129
> Project: Beam
> Issue Type: New Feature
> Components: runner-flink
> Reporter: Kostas Kloudas
> Assignee: Maximilian Michels
>
> Support pubsub IO
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Re: [jira] [Commented] (BEAM-129) Support pubsub IO
Posted by Kostas Kloudas <k....@data-artisans.com>.
Hi Mark,
Thanks a lot for reporting this and for working on it!
We just migrated all the known issues of the Flink-runner
from our previous repository to the BEAM one.
Kostas
> On Mar 18, 2016, at 6:29 PM, Mark Shields (JIRA) <ji...@apache.org> wrote:
>
>
> [ https://issues.apache.org/jira/browse/BEAM-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201816#comment-15201816 ]
>
> Mark Shields commented on BEAM-129:
> -----------------------------------
>
> For the read side I think this boils down to https://issues.apache.org/jira/browse/BEAM-125 plus making sure the Flink runner is invoking UnboundedSource readers appropriately. I'm working on BEAM-125 right now. (Turns out to be very easy to get working, but more challenging to make fast.)
>
> For the write side ideally we'll start with generic UnboundedSink, then implement pub/sub writes on that, then the Flink runner would invoke that generically. A shorter-term solution may be in order.
>
>> Support pubsub IO
>> -----------------
>>
>> Key: BEAM-129
>> URL: https://issues.apache.org/jira/browse/BEAM-129
>> Project: Beam
>> Issue Type: New Feature
>> Components: runner-flink
>> Reporter: Kostas Kloudas
>> Assignee: Maximilian Michels
>>
>> Support pubsub IO
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)