You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by xx...@apache.org on 2021/01/24 03:53:07 UTC
[kylin] branch 2.6.x updated: KYLIN-4882
config["kylin.engine.spark-fact-distinct"] overwrite in the Cube-level is
invalid
This is an automated email from the ASF dual-hosted git repository.
xxyu pushed a commit to branch 2.6.x
in repository https://gitbox.apache.org/repos/asf/kylin.git
The following commit(s) were added to refs/heads/2.6.x by this push:
new bf39e03 KYLIN-4882 config["kylin.engine.spark-fact-distinct"] overwrite in the Cube-level is invalid
bf39e03 is described below
commit bf39e03939b34e6faf2ce88e6b362c808636107a
Author: ITzhangqiang <IT...@163.com>
AuthorDate: Fri Jan 22 10:22:35 2021 +0800
KYLIN-4882 config["kylin.engine.spark-fact-distinct"] overwrite in the Cube-level is invalid
---
.../org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java | 3 +--
1 file changed, 1 insertion(+), 2 deletions(-)
diff --git a/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java b/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java
index e0c6eee..6d55d17 100644
--- a/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java
+++ b/engine-spark/src/main/java/org/apache/kylin/engine/spark/SparkBatchCubingJobBuilder2.java
@@ -65,8 +65,7 @@ public class SparkBatchCubingJobBuilder2 extends JobBuilderSupport {
inputSide.addStepPhase1_CreateFlatTable(result);
// Phase 2: Build Dictionary
- KylinConfig config = KylinConfig.getInstanceFromEnv();
- if (config.isSparkFactDistinctEnable()) {
+ if (seg.getConfig().isSparkFactDistinctEnable()) {
result.addTask(createFactDistinctColumnsSparkStep(jobId));
} else {
result.addTask(createFactDistinctColumnsStep(jobId));