You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Jake Maes (JIRA)" <ji...@apache.org> on 2018/01/31 00:22:00 UTC

[jira] [Commented] (SAMZA-1580) Optimizer for High-level API

    [ https://issues.apache.org/jira/browse/SAMZA-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346039#comment-16346039 ] 

Jake Maes commented on SAMZA-1580:
----------------------------------

Doesn't a planner usually *contain* a sequence of optimizers and transformers?

Why would this need to happen before the planner?

Or, am I just mincing words? :-)

> Optimizer for High-level API
> ----------------------------
>
>                 Key: SAMZA-1580
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1580
>             Project: Samza
>          Issue Type: Bug
>            Reporter: Xinyu Liu
>            Assignee: Xinyu Liu
>            Priority: Major
>
> Need an optimizer before the planning, which does the following:
> 1) Replace partitionBy() with a map(keyFn, ValueFn) if task count = 1
> 2) Remove broadcast() if task count = 1.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)