You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Aditya (JIRA)" <ji...@apache.org> on 2018/03/11 15:45:00 UTC

[jira] [Commented] (SAMZA-1612) Stream-table join: Number of partitions deduced for partitionBy for the stream to be joined does not take into account the partitions in the table

    [ https://issues.apache.org/jira/browse/SAMZA-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16394543#comment-16394543 ] 

Aditya commented on SAMZA-1612:
-------------------------------

[~weisong44] is aware of this bug and is planning to fix it.

> Stream-table join: Number of partitions deduced for partitionBy for the stream to be joined does not take into account the partitions in the table
> --------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: SAMZA-1612
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1612
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Aditya
>            Priority: Major
>
> While creating intermediate streams via partitionBy operator, ExecutionPlanner deduces the number of partitions for the intermediate partitions by looking at the sources, sinks and any reachable joins in the DAG. For stream-table join (local table) with the stream being partitioned and then joined with the table, the stream behind the table is not reachable in the DAG from the stream that needs to be joined and hence the number of partitions in the table are incorrectly not taken into account.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)