You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by venturadelmonte <ve...@gmail.com> on 2016/10/28 09:59:52 UTC
Re: [DISCUSS] Add Side Input/Broadcast Set For Streaming API
Hello,
I find this feature really cool because it would allow people to tackle
scenarios requiring a more advanced "join" on multiple streams as
already stated above.
Here
<https://docs.google.com/document/d/1hqUmrLY_wPTeS5bqG36Qq9P8LeDjZ_db61ky7OQy1hw/edit?usp=sharing>
you can find my few thoughts about this feature (a.k.a. my
attempt to extend Aljoscha's initial document).
I hope you will find it interesting and a good starting point for
having a new FLIP soon ;-)
Cheers,
Ventura
--
View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Add-Side-Input-Broadcast-Set-For-Streaming-API-tp11529p14287.html
Sent from the Apache Flink Mailing List archive. mailing list archive at Nabble.com.
Re: [DISCUSS] Add Side Input/Broadcast Set For Streaming API
Posted by Gábor Gévay <gg...@gmail.com>.
Hello,
I am also interested in this feature for a paper that I'm writing.
I have the "slowly evolving side input" case with a complicated custom
"update precondition" that would be expressible by a stateful UDF that
makes its decisions from looking at the elements of the main stream.
Best,
Gábor
2016-11-09 3:19 GMT+01:00 吕文龙 <we...@gmail.com>:
> Hi, all, we are also trying to find one way to do state initialization for
> stateful job, which has some external data stored in external storage. Side
> Input is a great feature meeting the requirement. I am looking forward to a
> full proposal including runtime implementations.
>
> 2016-11-01 21:52 GMT+08:00 Aljoscha Krettek <al...@apache.org>:
>
>> Hi,
>> thanks for trying to revive the discussion! I added some comments in the
>> doc.
>>
>> Cheers,
>> Aljoscha
>>
>> On Fri, 28 Oct 2016 at 12:05 venturadelmonte <ve...@gmail.com>
>> wrote:
>>
>> > Hello,
>> >
>> > I find this feature really cool because it would allow people to tackle
>> > scenarios requiring a more advanced "join" on multiple streams as
>> > already stated above.
>> > Here
>> > <
>> > https://docs.google.com/document/d/1hqUmrLY_wPTeS5bqG36Qq9P8LeDjZ_
>> db61ky7OQy1hw/edit?usp=sharing
>> > >
>> > you can find my few thoughts about this feature (a.k.a. my
>> > attempt to extend Aljoscha's initial document).
>> > I hope you will find it interesting and a good starting point for
>> > having a new FLIP soon ;-)
>> >
>> > Cheers,
>> > Ventura
>> >
>> >
>> >
>> > --
>> > View this message in context:
>> > http://apache-flink-mailing-list-archive.1008284.n3.
>> nabble.com/DISCUSS-Add-Side-Input-Broadcast-Set-For-
>> Streaming-API-tp11529p14287.html
>> > Sent from the Apache Flink Mailing List archive. mailing list archive at
>> > Nabble.com.
>> >
>>
Re: [DISCUSS] Add Side Input/Broadcast Set For Streaming API
Posted by 吕文龙 <we...@gmail.com>.
Hi, all, we are also trying to find one way to do state initialization for
stateful job, which has some external data stored in external storage. Side
Input is a great feature meeting the requirement. I am looking forward to a
full proposal including runtime implementations.
2016-11-01 21:52 GMT+08:00 Aljoscha Krettek <al...@apache.org>:
> Hi,
> thanks for trying to revive the discussion! I added some comments in the
> doc.
>
> Cheers,
> Aljoscha
>
> On Fri, 28 Oct 2016 at 12:05 venturadelmonte <ve...@gmail.com>
> wrote:
>
> > Hello,
> >
> > I find this feature really cool because it would allow people to tackle
> > scenarios requiring a more advanced "join" on multiple streams as
> > already stated above.
> > Here
> > <
> > https://docs.google.com/document/d/1hqUmrLY_wPTeS5bqG36Qq9P8LeDjZ_
> db61ky7OQy1hw/edit?usp=sharing
> > >
> > you can find my few thoughts about this feature (a.k.a. my
> > attempt to extend Aljoscha's initial document).
> > I hope you will find it interesting and a good starting point for
> > having a new FLIP soon ;-)
> >
> > Cheers,
> > Ventura
> >
> >
> >
> > --
> > View this message in context:
> > http://apache-flink-mailing-list-archive.1008284.n3.
> nabble.com/DISCUSS-Add-Side-Input-Broadcast-Set-For-
> Streaming-API-tp11529p14287.html
> > Sent from the Apache Flink Mailing List archive. mailing list archive at
> > Nabble.com.
> >
>
Re: [DISCUSS] Add Side Input/Broadcast Set For Streaming API
Posted by Aljoscha Krettek <al...@apache.org>.
Hi,
thanks for trying to revive the discussion! I added some comments in the
doc.
Cheers,
Aljoscha
On Fri, 28 Oct 2016 at 12:05 venturadelmonte <ve...@gmail.com>
wrote:
> Hello,
>
> I find this feature really cool because it would allow people to tackle
> scenarios requiring a more advanced "join" on multiple streams as
> already stated above.
> Here
> <
> https://docs.google.com/document/d/1hqUmrLY_wPTeS5bqG36Qq9P8LeDjZ_db61ky7OQy1hw/edit?usp=sharing
> >
> you can find my few thoughts about this feature (a.k.a. my
> attempt to extend Aljoscha's initial document).
> I hope you will find it interesting and a good starting point for
> having a new FLIP soon ;-)
>
> Cheers,
> Ventura
>
>
>
> --
> View this message in context:
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Add-Side-Input-Broadcast-Set-For-Streaming-API-tp11529p14287.html
> Sent from the Apache Flink Mailing List archive. mailing list archive at
> Nabble.com.
>