You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "liuzhixin (JIRA)" <ji...@apache.org> on 2018/11/02 06:37:00 UTC
[jira] [Commented] (KYLIN-3388) Data may become not correct if
mappers fail during the redistribute step, "distribute by rand()"
[ https://issues.apache.org/jira/browse/KYLIN-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672628#comment-16672628 ]
liuzhixin commented on KYLIN-3388:
----------------------------------
[~Shaofengshi]
Step1: Create Intermediate Flat Hive Table
Step2: Redistribute intermediate table
#
Perhaps, Kylin can insert one rand column in the intermediate hive table for the next shard, (as default).
At the same time, Kylin should support the custom column for shard. (has provided)
#
> Data may become not correct if mappers fail during the redistribute step, "distribute by rand()"
> ------------------------------------------------------------------------------------------------
>
> Key: KYLIN-3388
> URL: https://issues.apache.org/jira/browse/KYLIN-3388
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
> Reporter: Zhong Yanghong
> Assignee: Chao Long
> Priority: Critical
> Fix For: v2.4.0, v2.3.2
>
> Attachments: Hive Issue - distribute by rand().png
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)