[jira] [Commented] (SAMZA-1938) Support use cases to run multiple sql statements in one Samza job

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SAMZA-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640514#comment-16640514 ] 

ASF GitHub Bot commented on SAMZA-1938:
---------------------------------------

GitHub user weiqingy opened a pull request:

    https://github.com/apache/samza/pull/697

    SAMZA-1938: Support use cases to run multiple sql statements in one Samza job

    ## What changes were proposed in this pull request?
    
    This PR is to support the following user scenarios:
    1. support users to run multiple Sql statements in the same job.
    - sql1 = "Insert into testavro.simpleOutputTopic select * from testavro.SIMPLE1";
    -  sql2 = "Insert into testavro.SIMPLE3 select * from testavro.SIMPLE2";
    
    2. Support fan-out use case. For example, 
    - sql1 = "Insert into testavro.SIMPLE2 select * from testavro.SIMPLE1";
    - sql2 = "Insert into testavro.SIMPLE3 select * from testavro.SIMPLE1";
    
    3. Support fan-in use case. For example,
    - sql1 = "Insert into testavro.simpleOutputTopic select * from testavro.SIMPLE2";
    - sql2 = "Insert into testavro.simpleOutputTopic select * from testavro.SIMPLE1";
    
    This PR make the information about SystemDescriptors,  MessageStream of input sources and OutputStreams stored in QueryTranslator because those information belongs to the job, and each job has only one QueryTranslator object.
    
    ## How was this patch tested?
    1. Add unit tests
    2. Testing in Samza SQL shell.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/weiqingy/samza apa-SAMZA-1938

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/samza/pull/697.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #697
    
----
commit 99468e92a693f449384a0bf61538e1a4723b6076
Author: Weiqing Yang <ya...@...>
Date:   2018-10-06T00:42:23Z

    SAMZA-1938: Support use cases to run multiple sql statements in one Samza job

----


> Support use cases to run multiple sql statements in one Samza job 
> ------------------------------------------------------------------
>
>                 Key: SAMZA-1938
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1938
>             Project: Samza
>          Issue Type: Bug
>          Components: sql
>            Reporter: Weiqing Yang
>            Priority: Major
>             Fix For: 0.15.0
>
>
> This Jira is to track the following tasks:
>  * Support users to run multiple Sql statements in the same job.
>  ** sql1 = "Insert into testavro.simpleOutputTopic select * from testavro.SIMPLE1";
>  sql2 = "Insert into testavro.SIMPLE3 select * from testavro.SIMPLE2";
>  * Support fan-out use case. For example, 
>  ** sql1 = "Insert into testavro.SIMPLE2 select * from testavro.SIMPLE1";
>  sql2 = "Insert into testavro.SIMPLE3 select * from testavro.SIMPLE1";
>  * Support fan-in use case. For example,
>  ** sql1 = "Insert into testavro.simpleOutputTopic select * from testavro.SIMPLE2";
> sql2 = "Insert into testavro.simpleOutputTopic select * from testavro.SIMPLE1";



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)