Flink sql joined with dimtable from mysql

[yelun <98...@qq.com>]

hi,

I want to use flink sql to left join static dimension table from mysql currently, so I converted the mysql table into data stream to join with  DataStream which has converted to flink table. While I found that the real-time stream data is not joined correctly with mysql data  at the beginning, but the latter stream can be joined correctly. So I want to ask that is there any good way to make real-time stream can join with mysql data which has loaded and supporting dynamicly loading mysql data into memory once each hour. Thanks a lot.

Re: Flink sql joined with dimtable from mysql

[yelun <98...@qq.com>]

Thanks for your guidance.

> 在 2018年11月13日，下午9:49，Xiaowei Jiang <xi...@gmail.com> 写道：
> 
> It was not super clean on what you did. But from your description, the join
> was not correct initially because existing MySQL data was not seen by Flink
> yet. Later when updates are seen by Flink, the result will be correct. A
> better place for such question is probably on the user mailing list.
> 
> Xiaowei
> 
> On Tue, Nov 13, 2018 at 6:08 PM yelun <98...@qq.com> wrote:
> 
>> hi,
>> 
>> I want to use flink sql to left join static dimension table from mysql
>> currently, so I converted the mysql table into data stream to join with
>> DataStream which has converted to flink table. While I found that the
>> real-time stream data is not joined correctly with mysql data  at the
>> beginning, but the latter stream can be joined correctly. So I want to ask
>> that is there any good way to make real-time stream can join with mysql
>> data which has loaded and supporting dynamicly loading mysql data into
>> memory once each hour. Thanks a lot.

Re: Flink sql joined with dimtable from mysql

[Xiaowei Jiang <xi...@gmail.com>]

It was not super clean on what you did. But from your description, the join
was not correct initially because existing MySQL data was not seen by Flink
yet. Later when updates are seen by Flink, the result will be correct. A
better place for such question is probably on the user mailing list.

Xiaowei

On Tue, Nov 13, 2018 at 6:08 PM yelun <98...@qq.com> wrote:

> hi,
>
> I want to use flink sql to left join static dimension table from mysql
> currently, so I converted the mysql table into data stream to join with
> DataStream which has converted to flink table. While I found that the
> real-time stream data is not joined correctly with mysql data  at the
> beginning, but the latter stream can be joined correctly. So I want to ask
> that is there any good way to make real-time stream can join with mysql
> data which has loaded and supporting dynamicly loading mysql data into
> memory once each hour. Thanks a lot.