static table in flink

[Jaqie Chan <ja...@gmail.com>]

Hello,

I have questions about static table in flink.

Join the stream table with static table. I'm looking at temporal table,
while the time based table would grow exponentially over period. Any
suggestions?

Stream tables checks the contains in static table(updates once everyday
with new set of data). Trying to approach this with views.

Thanks for any suggestions.

Regards
嘉琪

Re: static table in flink

[Jingsong Li <ji...@gmail.com>]

Hi Jaqie:

I think you can take a look to temporal table in blink planner. (Using
LookupableTableSource). [1]
Use processing time: Its processing is to query from external table(storage
like HBase, JDBC) by per record in real time.

[1]
https://ci.apache.org/projects/flink/flink-docs-master/dev/table/streaming/joins.html#join-with-a-temporal-table

Best,
Jingsong Lee

On Sun, Nov 10, 2019 at 11:00 AM vino yang <ya...@gmail.com> wrote:

> Hi Jaqie,
>
> If I understand your question correctly, it seems you are finding a
> solution about the Stream table and Dim table(you called static table) join.
>
> There were many users who asked this question. Linked some reply
> here[1][2] to let you consider.
>
> Best,
> Vino
>
> [1]:
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/How-to-Join-a-dimension-table-in-flink-sql-td20729.html
> [2]: http://www.codeha.us/apache-flink-users/msg12421.html
>
> Jaqie Chan <ja...@gmail.com> 于2019年11月9日周六 下午3:04写道：
>
>> Hello,
>>
>> I have questions about static table in flink.
>>
>> Join the stream table with static table. I'm looking at temporal table,
>> while the time based table would grow exponentially over period. Any
>> suggestions?
>>
>> Stream tables checks the contains in static table(updates once everyday
>> with new set of data). Trying to approach this with views.
>>
>> Thanks for any suggestions.
>>
>> Regards
>> 嘉琪
>>
>>

-- 
Best, Jingsong Lee

Re: static table in flink

[vino yang <ya...@gmail.com>]

Hi Jaqie,

If I understand your question correctly, it seems you are finding a
solution about the Stream table and Dim table(you called static table) join.

There were many users who asked this question. Linked some reply here[1][2]
to let you consider.

Best,
Vino

[1]:
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/How-to-Join-a-dimension-table-in-flink-sql-td20729.html
[2]: http://www.codeha.us/apache-flink-users/msg12421.html

Jaqie Chan <ja...@gmail.com> 于2019年11月9日周六 下午3:04写道：

> Hello,
>
> I have questions about static table in flink.
>
> Join the stream table with static table. I'm looking at temporal table,
> while the time based table would grow exponentially over period. Any
> suggestions?
>
> Stream tables checks the contains in static table(updates once everyday
> with new set of data). Trying to approach this with views.
>
> Thanks for any suggestions.
>
> Regards
> 嘉琪
>
>