[jira] [Commented] (SAMZA-1889) Extend ExecutionPlanner to support Stream-Table Joins

["Rayman (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SAMZA-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978788#comment-16978788 ] 

Rayman commented on SAMZA-1889:
-------------------------------

This causes a problem when using 
withSideInputs("system.stream-name") 


Exception in thread "main" org.apache.samza.SamzaException: Failed to run applicationException in thread "main" org.apache.samza.SamzaException: Failed to run application at org.apache.samza.runtime.RemoteApplicationRunner.run(RemoteApplicationRunner.java:79) at org.apache.samza.runtime.ApplicationRunnerUtil.invoke(ApplicationRunnerUtil.java:57) at org.apache.samza.runtime.ApplicationRunnerMain.main(ApplicationRunnerMain.java:53)Caused by: java.lang.IllegalArgumentException: Identifier 'streamId' is 'queuing.data-PVE-64-1M'. It must match the expression [A-Za-z0-9_-]+ at org.apache.samza.system.StreamSpec.validateLogicalIdentifier(StreamSpec.java:235) at org.apache.samza.system.StreamSpec.<init>(StreamSpec.java:153) at org.apache.samza.system.StreamSpec.<init>(StreamSpec.java:133) at org.apache.samza.util.StreamUtil.getStreamSpec(StreamUtil.java:90) at org.apache.samza.execution.ExecutionPlanner.createJobGraph(ExecutionPlanner.java:154) at org.apache.samza.execution.ExecutionPlanner.plan(ExecutionPlanner.java:83) at org.apache.samza.execution.JobPlanner.getExecutionPlan(JobPlanner.java:101) at org.apache.samza.execution.RemoteJobPlanner.prepareJobs(RemoteJobPlanner.java:57) at org.apache.samza.runtime.RemoteApplicationRunner.run(RemoteApplicationRunner.java:67) ... 2 more

> Extend ExecutionPlanner to support Stream-Table Joins
> -----------------------------------------------------
>
>                 Key: SAMZA-1889
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1889
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Ahmed Abdul Hamid
>            Assignee: Ahmed Abdul Hamid
>            Priority: Major
>             Fix For: 1.0
>
>         Attachments: Extending Samza’s Execution Planner to Support Stream-Table Joins.pdf, Modularizing Join Validation in Samza’s Execution Planner.pdf
>
>
> We need to extend ExecutionPlanner to support Tables. In particular, we need it to verify agreement in partition count between stream(s) behind the table and all other streams participating in Stream-Table Joins with said stream(s).
> All the details are documented in the following documents:
>  * [^Extending Samza’s Execution Planner to Support Stream-Table Joins.pdf]
>  * [^Modularizing Join Validation in Samza’s Execution Planner.pdf]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)