You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Xianda Ke (JIRA)" <ji...@apache.org> on 2016/12/07 08:41:58 UTC

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

    [ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728138#comment-15728138 ] 

Xianda Ke commented on PIG-4952:
--------------------------------

max parallelism value from parent RDDs seems OK.

LGTM
+1

> Calculate the value of parallism for spark mode
> -----------------------------------------------
>
>                 Key: PIG-4952
>                 URL: https://issues.apache.org/jira/browse/PIG-4952
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: liyunzhang_intel
>            Assignee: liyunzhang_intel
>             Fix For: spark-branch
>
>         Attachments: PIG-4952.patch, PIG-4952_1.patch
>
>
> Calculate the value of parallism for spark mode like what org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer.ParallelismSetter does.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)