You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@storm.apache.org by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2016/11/17 15:08:58 UTC

[jira] [Closed] (STORM-2146) Storm SQL - Support JOIN between Streaming data source and State data source in Trident mode

     [ https://issues.apache.org/jira/browse/STORM-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jungtaek Lim closed STORM-2146.
-------------------------------
    Resolution: Invalid

We decided to postpone 'join' until we can use 'Streaming SQL'. So this is invalid for now.

> Storm SQL - Support JOIN between Streaming data source and State data source in Trident mode
> --------------------------------------------------------------------------------------------
>
>                 Key: STORM-2146
>                 URL: https://issues.apache.org/jira/browse/STORM-2146
>             Project: Apache Storm
>          Issue Type: New Feature
>          Components: storm-sql
>            Reporter: Jungtaek Lim
>
> This issue is only targeted to Trident mode.
> This issue also handles drop supporting join between Streaming data source and Streaming data source since the join is based on micro-batch so result is non-deterministic which doesn't make sense.
> This issue tracks supporting join between Streaming data source and State data source. 
> Following works should be done:
> - create interface for State Table which is able to query value based on key
> - define DDL for State data source
> - modify visitTableScan in TridentLogicalPlanCompiler to handle State data source
> - modify visitJoin in TridentLogicalPlanCompiler
> -- check join condition: first one is Streaming and next one is State
> --- table order can be reversible
> --- only simple equi-join is supported (support compose key?)
> -- query to State via join key and join Streaming row and the value
> - address unit tests
> - update document 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)