[jira] [Commented] (FLINK-6968) Store streaming, updating tables with unique key in queryable state

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396822#comment-16396822 ] 

ASF GitHub Bot commented on FLINK-6968:
---------------------------------------

GitHub user liurenjie1024 opened a pull request:

    https://github.com/apache/flink/pull/5688

    [FLINK-6968][Table API & SQL] Add Queryable table sink.

    ## What is the purpose of the change
    
    Streaming tables with unique key are continuously updated. For example queries with a non-windowed aggregation generate such tables. Commonly, such updating tables are emitted via an upsert table sink to an external datastore (k-v store, database) to make it accessible to applications.
    
    ## Brief change log
    
      - *Add a QueryableStateTableSink.*
      - *States are queryable.*
    
    ## Verifying this change
    
    This change added tests and can be verified as follows:
      - *Added test that validates that states will be stored.*
      - *Manually verified the change by running a 4 node cluser with 2 JobManagers and 4 TaskManagers, a stateful streaming program, and use QueryableStateClient to test that.*
    
    
    ## Documentation
    
      - Does this pull request introduce a new feature? yes
      - If yes, how is the feature documented? docs


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/liurenjie1024/flink QueryableTableSink

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/5688.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #5688
    
----
commit 0663e550216dfef8bf205f90d5ac8a0e7e77a42b
Author: liurenjie1024 <li...@...>
Date:   2018-03-12T07:32:44Z

    Code complete

commit 6d62d53f0bae65249ab69bddf7932e62ae1e7897
Author: liurenjie1024 <li...@...>
Date:   2018-03-13T09:44:30Z

    Add test

commit c9ffa6ecdd638a497b60f3f063b2d352b1b98059
Author: liurenjie1024 <li...@...>
Date:   2018-03-13T10:43:19Z

    Fix test style

----


> Store streaming, updating tables with unique key in queryable state
> -------------------------------------------------------------------
>
>                 Key: FLINK-6968
>                 URL: https://issues.apache.org/jira/browse/FLINK-6968
>             Project: Flink
>          Issue Type: New Feature
>          Components: Table API &amp; SQL
>            Reporter: Fabian Hueske
>            Assignee: Renjie Liu
>            Priority: Major
>
> Streaming tables with unique key are continuously updated. For example queries with a non-windowed aggregation generate such tables. Commonly, such updating tables are emitted via an upsert table sink to an external datastore (k-v store, database) to make it accessible to applications.
> This issue is about adding a feature to store and maintain such a table as queryable state in Flink. By storing the table in Flnk's queryable state, we do not need an external data store to access the results of the query but can query the results directly from Flink.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)