You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Nancy Estrada <na...@gmail.com> on 2017/06/21 16:44:46 UTC

Re: Combining streams with static data and using REST API as a sink

Hi Josh,

I have a use-case similar to yours. I need to join a stream with data from a
database to which I have access via a REST API. Since the Side inputs API
continues begin and ongoing work. I am wondering how did you approached it,
Did you use the rich function updating it periodically?

Thank you in advance!
Nancy





--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Combining-streams-with-static-data-and-using-REST-API-as-a-sink-tp7083p13902.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Combining streams with static data and using REST API as a sink

Posted by Aljoscha Krettek <al...@apache.org>.
A quick note on this: the side-input API is still ongoing work and it turns out it’s more complicated (obviously … 😳) and we will need quite a bit more work on other parts of Flink before we can provide a good built-in solution.

In the meantime, you can check out the Async I/O operator [1]. I think this fits your use case of accessing an external system quite well because it allows firing off several request to external systems at the same time.

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/stream/asyncio.html
> On 21. Jun 2017, at 18:44, Nancy Estrada <na...@gmail.com> wrote:
> 
> Hi Josh,
> 
> I have a use-case similar to yours. I need to join a stream with data from a
> database to which I have access via a REST API. Since the Side inputs API
> continues begin and ongoing work. I am wondering how did you approached it,
> Did you use the rich function updating it periodically?
> 
> Thank you in advance!
> Nancy
> 
> 
> 
> 
> 
> --
> View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Combining-streams-with-static-data-and-using-REST-API-as-a-sink-tp7083p13902.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.