Joining a flink materialised view table with a streaming table

[Francis Conroy <fr...@switchdin.com>]

Hi all,
I recently put up a question about a deduplication query related to a join
and realised that I was probably asking the wrong question. I'm using Flink
1.15-SNAPSHOT (97ddc39945cda9bf1f52ab159852fdb606201cf2) as we're using the
RabbitMQ connector with pyflink. We won't go to prod until 1.15 is released.

I've got a materialised view based on some CDC tables, I've also run a
deduplication query on this to ensure that the primary key is unique, I
just want to join this with a table created from a dataStream and don't
care about it being deterministic or having a temporal join on a versioned
table, I just want to join with the corresponding value in the table at
that time (wall clock time).

I think I want something like a lookup join(
https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sql/queries/joins/#lookup-join)
but where I'm joining with a dynamic deduplicated view instead of a JDBC
table.

I tried doing a temporal join against a versioned table but the join is
always empty for some reason.
Thanks for your help.

-- 
This email and any attachments are proprietary and confidential and are 
intended solely for the use of the individual to whom it is addressed. Any 
views or opinions expressed are solely those of the author and do not 
necessarily reflect or represent those of SwitchDin Pty Ltd. If you have 
received this email in error, please let us know immediately by reply email 
and delete it from your system. You may not use, disseminate, distribute or 
copy this message nor disclose its contents to anyone. 
SwitchDin Pty Ltd 
(ABN 29 154893857) PO Box 1165, Newcastle NSW 2300 Australia