You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Zhiyuan Yang (JIRA)" <ji...@apache.org> on 2017/08/14 21:14:00 UTC

[jira] [Commented] (TEZ-3819) Round robin partitioner make fair cartesian product not fault tolerant

    [ https://issues.apache.org/jira/browse/TEZ-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126411#comment-16126411 ] 

Zhiyuan Yang commented on TEZ-3819:
-----------------------------------

Using hash partitioner can be a short term resolution, although skew caused by repeated key inevitable.

> Round robin partitioner make fair cartesian product not fault tolerant
> ----------------------------------------------------------------------
>
>                 Key: TEZ-3819
>                 URL: https://issues.apache.org/jira/browse/TEZ-3819
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Zhiyuan Yang
>            Assignee: Zhiyuan Yang
>
> In case of task failure and retry, round robin partitioner cannot give consistent partitioning, which can cause wrong output of fair cartesian product.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)