You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "kangkaisen (JIRA)" <ji...@apache.org> on 2017/01/08 09:47:58 UTC
[jira] [Closed] (KYLIN-2366) multi FactDistinctColumnsReducer task
write the same output file
[ https://issues.apache.org/jira/browse/KYLIN-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
kangkaisen closed KYLIN-2366.
-----------------------------
Resolution: Duplicate
Fix Version/s: (was: Future)
> multi FactDistinctColumnsReducer task write the same output file
> ----------------------------------------------------------------
>
> Key: KYLIN-2366
> URL: https://issues.apache.org/jira/browse/KYLIN-2366
> Project: Kylin
> Issue Type: Bug
> Components: streaming
> Affects Versions: v1.6.0
> Reporter: zheng zhifeng
>
> Multi FactDistinctColumnsReducer task will write the
> distinct column to the same output file if the mapreduce
> property mapreduce.reduce.speculative is true. This will
> make the mapreduce job failed or the output file is redundancy.
> I think it shoud set mapreduce.reduce.speculative to false on
> Extract Fact Table Distinct Columns step.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)