You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "liyunzhang (JIRA)" <ji...@apache.org> on 2018/03/15 01:21:00 UTC

[jira] [Updated] (PIG-5332) Implement auto parallelism for pig on spark

     [ https://issues.apache.org/jira/browse/PIG-5332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

liyunzhang updated PIG-5332:
----------------------------
    Issue Type: Sub-task  (was: Bug)
        Parent: PIG-4059

> Implement auto parallelism for pig on spark
> -------------------------------------------
>
>                 Key: PIG-5332
>                 URL: https://issues.apache.org/jira/browse/PIG-5332
>             Project: Pig
>          Issue Type: Sub-task
>            Reporter: liyunzhang
>            Priority: Major
>
> Currently, pig on spark use {{pig.exec.reducers.max}} as reduce number. It is better to have auto parallelism and not let end-users to calculate the reduce number.  Pig on tez implementation is in PIG-4434



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)