You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "zheng zhifeng (JIRA)" <ji...@apache.org> on 2017/01/08 07:01:58 UTC
[jira] [Created] (KYLIN-2366) multi FactDistinctColumnsReducer task
write the same output file
zheng zhifeng created KYLIN-2366:
------------------------------------
Summary: multi FactDistinctColumnsReducer task write the same output file
Key: KYLIN-2366
URL: https://issues.apache.org/jira/browse/KYLIN-2366
Project: Kylin
Issue Type: Bug
Components: streaming
Affects Versions: v1.6.0
Reporter: zheng zhifeng
Fix For: Future
Multi FactDistinctColumnsReducer task will write the
distinct columns to the same output file if the mapreduce
property mapreduce.reduce.speculative is true. This will
make the mapreduce job failed or the output file is redundancy.
I think it shoud set mapreduce.reduce.speculative to false on
Extract Fact Table Distinct Columns step.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)