You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2017/08/09 05:06:01 UTC
[jira] [Closed] (KYLIN-2365) multi FactDistinctColumnsReducer task
write the same output file
[ https://issues.apache.org/jira/browse/KYLIN-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shaofeng SHI closed KYLIN-2365.
-------------------------------
> multi FactDistinctColumnsReducer task write the same output file
> ----------------------------------------------------------------
>
> Key: KYLIN-2365
> URL: https://issues.apache.org/jira/browse/KYLIN-2365
> Project: Kylin
> Issue Type: Bug
> Components: streaming
> Affects Versions: v1.6.0
> Reporter: zheng zhifeng
>
> Multi FactDistinctColumnsReducer task will write the
> distinct columns to the same output file if the mapreduce
> property mapreduce.reduce.speculative is true. This will
> make the mapreduce job failed or the output file is redundancy.
> I think it shoud set mapreduce.reduce.speculative to false on
> Extract Fact Table Distinct Columns step.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)