You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "liyang (JIRA)" <ji...@apache.org> on 2017/01/17 05:50:26 UTC
[jira] [Resolved] (KYLIN-2365) multi FactDistinctColumnsReducer
task write the same output file
[ https://issues.apache.org/jira/browse/KYLIN-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
liyang resolved KYLIN-2365.
---------------------------
Resolution: Duplicate
Fix Version/s: (was: Future)
> multi FactDistinctColumnsReducer task write the same output file
> ----------------------------------------------------------------
>
> Key: KYLIN-2365
> URL: https://issues.apache.org/jira/browse/KYLIN-2365
> Project: Kylin
> Issue Type: Bug
> Components: streaming
> Affects Versions: v1.6.0
> Reporter: zheng zhifeng
>
> Multi FactDistinctColumnsReducer task will write the
> distinct columns to the same output file if the mapreduce
> property mapreduce.reduce.speculative is true. This will
> make the mapreduce job failed or the output file is redundancy.
> I think it shoud set mapreduce.reduce.speculative to false on
> Extract Fact Table Distinct Columns step.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)