You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by la...@apache.org on 2025/08/21 13:27:29 UTC
(impala) 01/02: IMPALA-14061: Calcite Planner: added Calcite rules
This is an automated email from the ASF dual-hosted git repository.
laszlog pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git
commit 5244f6169e0529a4b40defca26b3aed266b0fee3
Author: Steve Carlin <sc...@cloudera.com>
AuthorDate: Thu May 8 15:50:18 2025 -0700
IMPALA-14061: Calcite Planner: added Calcite rules
This commit adds Calcite optimization rules to create more efficient
plans. These rules should be considered a work in progress. These
were tested against a 3TB tpcds database so they are fairly efficient
as/is, but we can make improvements as we see them along the way.
Most of the changes have been added to the CalciteOptimizer file. There
are several phases of rules that are applied, which are as follows:
- expand nodes: These rules change the plan to a plan that can be
handled by Impala. For instance, there are RelNodes such as
"LogicalIntersect" which are not directly applicable to the Impala
physical nodes so they need to be expanded.
- coerce nodes: This module changes the nodes so they have the
correct datatype values (e.g. literal strings in Calcite are char
but need to be varchar for Impala)
- optimize nodes: first pass on reordering the logical RelNode ordering.
- join: Squishes the join RelNodes together, pushes them into one
"multiJoin" and then lets Calcite's join optimizer reorder the joins
into a more optimal plan. A note on this: with this iteration,
statistics are still not being applied. This will come in with later
commits to make better plans.
- post join optimize nodes: Reruns the optimize nodes since the
join ordering may present new optimization opportunities
- pre Impala commit: Extra massaging after optimization that is
done at the end
- conversion to Impala RelNodes: Maps Calcite RelNodes into Impala
RelNodes which will then be mapped to Impala PlanNodes
In addition to this general change, there is also a change with
removing the "toCNF" rule. Calcite has multiple places where it
creates a SEARCH operator via "simplifying" the RexNodes within
various rules. This operator is not supported directly in Impala
and we need to call "expandSearch" to handle this. Because Impala
does this under the covers in the rules, this has been fixed
by overriding the RexBuilder (with ImpalaRexBuilder) and expanding
the SEARCH operator whenever it is called (sidenote: we could have
changed the rules that called simplify, but that would have resulted
in too much code duplication).
The toCNF rule was removed and placed as a call within the
CoerceOperandShuttle, which already manipulates all the RexNodes, so
all that code is now in one place.
Change-Id: I6671f7ed298a18965ef0b7a5fc10f4912333a52b
Reviewed-on: http://gerrit.cloudera.org:8080/22870
Reviewed-by: Aman Sinha <am...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
.../impala/calcite/coercenodes/CoerceNodes.java | 12 +-
.../impala/calcite/operators/ImpalaRexBuilder.java | 56 +
.../impala/calcite/rules/ConvertToCNFRules.java | 137 -
.../impala/calcite/service/CalciteJniFrontend.java | 3 +-
.../impala/calcite/service/CalciteOptimizer.java | 169 +-
.../calcite/service/CalciteRelNodeConverter.java | 20 +-
.../calcite/service/CalciteSingleNodePlanner.java | 3 +-
.../org/apache/impala/calcite/util/LogUtil.java | 49 +
.../PlannerTest/calcite_tpcds/tpcds-q01.test | 331 +-
.../PlannerTest/calcite_tpcds/tpcds-q02.test | 747 +-
.../PlannerTest/calcite_tpcds/tpcds-q03.test | 106 +-
.../PlannerTest/calcite_tpcds/tpcds-q04.test | 6964 +++++-------------
.../PlannerTest/calcite_tpcds/tpcds-q05.test | 372 +-
.../PlannerTest/calcite_tpcds/tpcds-q06.test | 1332 ++--
.../PlannerTest/calcite_tpcds/tpcds-q07.test | 178 +-
.../PlannerTest/calcite_tpcds/tpcds-q08.test | 809 +--
.../PlannerTest/calcite_tpcds/tpcds-q09.test | 206 +-
.../PlannerTest/calcite_tpcds/tpcds-q10a.test | 1269 ++--
.../PlannerTest/calcite_tpcds/tpcds-q11.test | 3364 +++------
.../PlannerTest/calcite_tpcds/tpcds-q12.test | 116 +-
.../PlannerTest/calcite_tpcds/tpcds-q13.test | 764 +-
.../PlannerTest/calcite_tpcds/tpcds-q14a.test | 7602 ++++++++++----------
.../PlannerTest/calcite_tpcds/tpcds-q14b.test | 5637 +++++++--------
.../PlannerTest/calcite_tpcds/tpcds-q15.test | 348 +-
.../PlannerTest/calcite_tpcds/tpcds-q16.test | 1782 ++---
.../PlannerTest/calcite_tpcds/tpcds-q17.test | 472 +-
.../PlannerTest/calcite_tpcds/tpcds-q18.test | 926 ++-
.../PlannerTest/calcite_tpcds/tpcds-q19.test | 798 +-
.../PlannerTest/calcite_tpcds/tpcds-q20.test | 106 +-
.../PlannerTest/calcite_tpcds/tpcds-q21.test | 272 +-
.../PlannerTest/calcite_tpcds/tpcds-q22.test | 108 +-
.../PlannerTest/calcite_tpcds/tpcds-q23a.test | 3538 +++++----
.../PlannerTest/calcite_tpcds/tpcds-q23b.test | 4186 ++++++-----
.../PlannerTest/calcite_tpcds/tpcds-q24a.test | 1420 ++--
.../PlannerTest/calcite_tpcds/tpcds-q24b.test | 1420 ++--
.../PlannerTest/calcite_tpcds/tpcds-q25.test | 460 +-
.../PlannerTest/calcite_tpcds/tpcds-q26.test | 178 +-
.../PlannerTest/calcite_tpcds/tpcds-q27.test | 326 +-
.../PlannerTest/calcite_tpcds/tpcds-q29.test | 480 +-
.../PlannerTest/calcite_tpcds/tpcds-q30.test | 1145 ++-
.../PlannerTest/calcite_tpcds/tpcds-q31.test | 2224 +++---
.../PlannerTest/calcite_tpcds/tpcds-q32.test | 747 +-
.../PlannerTest/calcite_tpcds/tpcds-q33.test | 1953 +++--
.../PlannerTest/calcite_tpcds/tpcds-q34.test | 195 +-
.../PlannerTest/calcite_tpcds/tpcds-q35a.test | 1430 ++--
.../PlannerTest/calcite_tpcds/tpcds-q36.test | 278 +-
.../PlannerTest/calcite_tpcds/tpcds-q37.test | 180 +-
.../PlannerTest/calcite_tpcds/tpcds-q38.test | 1536 ++--
.../PlannerTest/calcite_tpcds/tpcds-q39a.test | 910 +--
.../PlannerTest/calcite_tpcds/tpcds-q39b.test | 910 +--
.../PlannerTest/calcite_tpcds/tpcds-q40.test | 378 +-
.../PlannerTest/calcite_tpcds/tpcds-q41.test | 256 +-
.../PlannerTest/calcite_tpcds/tpcds-q42.test | 198 +-
.../calcite_tpcds/tpcds-q43-verbose.test | 60 +-
.../PlannerTest/calcite_tpcds/tpcds-q43.test | 100 +-
.../PlannerTest/calcite_tpcds/tpcds-q44.test | 146 +-
.../PlannerTest/calcite_tpcds/tpcds-q45.test | 737 +-
.../PlannerTest/calcite_tpcds/tpcds-q46.test | 1290 ++--
.../PlannerTest/calcite_tpcds/tpcds-q47.test | 1478 ++--
.../PlannerTest/calcite_tpcds/tpcds-q48.test | 582 +-
.../PlannerTest/calcite_tpcds/tpcds-q49.test | 408 +-
.../PlannerTest/calcite_tpcds/tpcds-q50.test | 200 +-
.../PlannerTest/calcite_tpcds/tpcds-q51.test | 140 +-
.../PlannerTest/calcite_tpcds/tpcds-q52.test | 202 +-
.../PlannerTest/calcite_tpcds/tpcds-q53.test | 168 +-
.../PlannerTest/calcite_tpcds/tpcds-q54.test | 1100 +--
.../PlannerTest/calcite_tpcds/tpcds-q55.test | 138 +-
.../PlannerTest/calcite_tpcds/tpcds-q56.test | 2103 +++---
.../PlannerTest/calcite_tpcds/tpcds-q57.test | 1472 ++--
.../PlannerTest/calcite_tpcds/tpcds-q58.test | 2486 +++----
.../PlannerTest/calcite_tpcds/tpcds-q59.test | 779 +-
.../PlannerTest/calcite_tpcds/tpcds-q60.test | 1987 +++--
.../PlannerTest/calcite_tpcds/tpcds-q61.test | 698 +-
.../PlannerTest/calcite_tpcds/tpcds-q62.test | 372 +-
.../PlannerTest/calcite_tpcds/tpcds-q63.test | 168 +-
.../PlannerTest/calcite_tpcds/tpcds-q64.test | 3300 ++++-----
.../PlannerTest/calcite_tpcds/tpcds-q65.test | 1072 ++-
.../PlannerTest/calcite_tpcds/tpcds-q66.test | 565 +-
.../PlannerTest/calcite_tpcds/tpcds-q67.test | 144 +-
.../PlannerTest/calcite_tpcds/tpcds-q68.test | 1220 ++--
.../PlannerTest/calcite_tpcds/tpcds-q69.test | 1851 ++---
.../PlannerTest/calcite_tpcds/tpcds-q70.test | 238 +-
.../PlannerTest/calcite_tpcds/tpcds-q71.test | 258 +-
.../PlannerTest/calcite_tpcds/tpcds-q72.test | 564 +-
.../PlannerTest/calcite_tpcds/tpcds-q73.test | 180 +-
.../PlannerTest/calcite_tpcds/tpcds-q74.test | 3620 ++++------
.../PlannerTest/calcite_tpcds/tpcds-q75.test | 4044 ++++++-----
.../PlannerTest/calcite_tpcds/tpcds-q76.test | 290 +-
.../PlannerTest/calcite_tpcds/tpcds-q77.test | 582 +-
.../PlannerTest/calcite_tpcds/tpcds-q78.test | 1384 ++--
.../PlannerTest/calcite_tpcds/tpcds-q79.test | 903 ++-
.../PlannerTest/calcite_tpcds/tpcds-q80.test | 949 ++-
.../PlannerTest/calcite_tpcds/tpcds-q81.test | 683 +-
.../PlannerTest/calcite_tpcds/tpcds-q82.test | 192 +-
.../PlannerTest/calcite_tpcds/tpcds-q83.test | 2497 +++----
.../PlannerTest/calcite_tpcds/tpcds-q84.test | 206 +-
.../PlannerTest/calcite_tpcds/tpcds-q85.test | 1375 ++--
.../PlannerTest/calcite_tpcds/tpcds-q86.test | 118 +-
.../PlannerTest/calcite_tpcds/tpcds-q87.test | 398 +-
.../PlannerTest/calcite_tpcds/tpcds-q88.test | 958 +--
.../PlannerTest/calcite_tpcds/tpcds-q89.test | 182 +-
.../PlannerTest/calcite_tpcds/tpcds-q90.test | 636 +-
.../PlannerTest/calcite_tpcds/tpcds-q91.test | 1041 ++-
.../PlannerTest/calcite_tpcds/tpcds-q92.test | 771 +-
.../PlannerTest/calcite_tpcds/tpcds-q93.test | 152 +-
.../PlannerTest/calcite_tpcds/tpcds-q94.test | 1804 ++---
.../PlannerTest/calcite_tpcds/tpcds-q95.test | 1433 ++--
.../PlannerTest/calcite_tpcds/tpcds-q96.test | 132 +-
.../PlannerTest/calcite_tpcds/tpcds-q97.test | 146 +-
.../PlannerTest/calcite_tpcds/tpcds-q98.test | 106 +-
.../PlannerTest/calcite_tpcds/tpcds-q99.test | 362 +-
111 files changed, 51725 insertions(+), 58851 deletions(-)
diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/coercenodes/CoerceNodes.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/coercenodes/CoerceNodes.java
index 01dcb1f1d..0f6846943 100644
--- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/coercenodes/CoerceNodes.java
+++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/coercenodes/CoerceNodes.java
@@ -35,6 +35,7 @@ import org.apache.calcite.rex.RexBuilder;
import org.apache.calcite.rex.RexInputRef;
import org.apache.calcite.rex.RexLiteral;
import org.apache.calcite.rex.RexNode;
+import org.apache.calcite.rex.RexUtil;
import org.apache.calcite.sql.SqlKind;
import org.apache.calcite.sql.type.SqlTypeName;
import org.apache.calcite.util.Util;
@@ -371,13 +372,20 @@ public class CoerceNodes{
*/
private static List<RexNode> processRexNodes(RelNode relNode, List<RelNode> inputs,
List<RexNode> rexNodes) {
+ RexBuilder rexBuilder = relNode.getCluster().getRexBuilder();
CoerceOperandShuttle shuttle = new CoerceOperandShuttle(
- relNode.getCluster().getTypeFactory(),
- relNode.getCluster().getRexBuilder(), inputs);
+ relNode.getCluster().getTypeFactory(), rexBuilder, inputs);
List<RexNode> changedRexNodes = new ArrayList<>();
boolean rexNodeChanged = false;
for (RexNode rexNode : rexNodes) {
RexNode changedRexNode = shuttle.apply(rexNode);
+
+ changedRexNode = RexUtil.pullFactors(rexBuilder, changedRexNode);
+ // TODO: IMPALA-13436: use max_cnf_exprs query option instead of hardcoded 100.
+ // The default for max_cnf_exprs is 200, but we use 100 here because tpcds
+ // q41 is super slow when the value is at 200.
+ changedRexNode = RexUtil.toCnf(rexBuilder, 100, changedRexNode);
+
changedRexNodes.add(changedRexNode);
rexNodeChanged |= (changedRexNode != rexNode);
}
diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/operators/ImpalaRexBuilder.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/operators/ImpalaRexBuilder.java
new file mode 100644
index 000000000..2f374d136
--- /dev/null
+++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/operators/ImpalaRexBuilder.java
@@ -0,0 +1,56 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to you under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.impala.calcite.operators;
+
+import org.apache.calcite.rel.type.RelDataType;
+import org.apache.calcite.rel.type.RelDataTypeFactory;
+import org.apache.calcite.rex.RexBuilder;
+import org.apache.calcite.rex.RexCall;
+import org.apache.calcite.rex.RexNode;
+import org.apache.calcite.rex.RexUtil;
+import org.apache.calcite.sql.SqlKind;
+import org.apache.calcite.sql.SqlOperator;
+
+import java.util.List;
+
+/**
+ * Factory for row expressions.
+ *
+ * See the base class in Calcite for the details about RexBuilder. This extension
+ * allows Impala to override functions that need extra work to make RexBuilder
+ * Impala compatible.
+ */
+public class ImpalaRexBuilder extends RexBuilder {
+
+ public ImpalaRexBuilder(RelDataTypeFactory typeFactory) {
+ super(typeFactory);
+ }
+
+ /**
+ * Only override the makeCall. The SEARCH operator is not supported at this time,
+ * so we "expand" it to something Impala can understand.
+ */
+ @Override
+ public RexNode makeCall(
+ SqlOperator op,
+ List<? extends RexNode> exprs) {
+ RexNode retNode = super.makeCall(op, exprs);
+ return op.getKind() == SqlKind.SEARCH
+ ? RexUtil.expandSearch(this, null, retNode)
+ : retNode;
+ }
+}
diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ConvertToCNFRules.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ConvertToCNFRules.java
deleted file mode 100644
index 5d9582ed3..000000000
--- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ConvertToCNFRules.java
+++ /dev/null
@@ -1,137 +0,0 @@
-// Licensed to the Apache Software Foundation (ASF) under one
-// or more contributor license agreements. See the NOTICE file
-// distributed with this work for additional information
-// regarding copyright ownership. The ASF licenses this file
-// to you under the Apache License, Version 2.0 (the
-// "License"); you may not use this file except in compliance
-// with the License. You may obtain a copy of the License at
-//
-// http://www.apache.org/licenses/LICENSE-2.0
-//
-// Unless required by applicable law or agreed to in writing,
-// software distributed under the License is distributed on an
-// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
-// KIND, either express or implied. See the License for the
-// specific language governing permissions and limitations
-// under the License.
-
-package org.apache.impala.calcite.rules;
-
-import com.google.common.base.Preconditions;
-import com.google.common.collect.ImmutableList;
-import org.apache.calcite.plan.RelOptRule;
-import org.apache.calcite.plan.RelOptRuleCall;
-import org.apache.calcite.rel.logical.LogicalFilter;
-import org.apache.calcite.rel.logical.LogicalJoin;
-import org.apache.calcite.rel.logical.LogicalProject;
-import org.apache.calcite.rex.RexBuilder;
-import org.apache.calcite.rex.RexCall;
-import org.apache.calcite.rex.RexLiteral;
-import org.apache.calcite.rex.RexNode;
-import org.apache.calcite.rex.RexShuttle;
-import org.apache.calcite.rex.RexUtil;
-
-import java.util.ArrayList;
-import java.util.HashSet;
-import java.util.List;
-
-/**
- * Rules to convert RexNode expressions into conjunctive normal form. These
- * are required rules for tpcds queries. Without these rules, the performance for
- * tpcds slows down drastically.
- */
-public class ConvertToCNFRules {
-
- public static class FilterConvertToCNFRule extends RelOptRule {
- public FilterConvertToCNFRule() {
- super(operand(LogicalFilter.class, none()));
- }
-
- @Override
- public void onMatch(RelOptRuleCall call) {
- final LogicalFilter filter = call.rel(0);
-
- RexBuilder rexBuilder = filter.getCluster().getRexBuilder();
- RexNode condition = filter.getCondition();
- RexNode newCondition = toCnf(rexBuilder, condition);
- if (!newCondition.equals(condition)) {
- LogicalFilter newFilter = LogicalFilter.create(filter.getInput(0), newCondition);
- call.transformTo(newFilter);
- }
- }
- }
-
- public static class ProjectConvertToCNFRule extends RelOptRule {
- public ProjectConvertToCNFRule() {
- super(operand(LogicalProject.class, none()));
- }
-
- @Override
- public void onMatch(RelOptRuleCall call) {
- final LogicalProject project = call.rel(0);
-
- List<RexNode> newProjects = new ArrayList<>();
- boolean projectChanged = false;
- RexBuilder rexBuilder = project.getCluster().getRexBuilder();
- for (RexNode rexNode : project.getProjects()) {
- RexNode newProject = toCnf(rexBuilder, rexNode);
- newProjects.add(newProject);
- projectChanged |= (!newProject.equals(rexNode));
- }
- if (projectChanged) {
- LogicalProject newProject = LogicalProject.create(project.getInput(0),
- project.getHints(), newProjects,
- project.getRowType().getFieldNames(), project.getVariablesSet());
- call.transformTo(newProject);
- }
- }
- }
-
- public static class JoinConvertToCNFRule extends RelOptRule {
-
- public JoinConvertToCNFRule() {
- super(operand(LogicalJoin.class, none()));
- }
-
- @Override
- public void onMatch(RelOptRuleCall call) {
- final LogicalJoin join = call.rel(0);
- RexBuilder rexBuilder = join.getCluster().getRexBuilder();
- RexNode condition = join.getCondition();
- RexNode newCondition = toCnf(rexBuilder, condition);
- if (!newCondition.equals(condition)) {
- LogicalJoin newJoin = LogicalJoin.create(join.getInput(0), join.getInput(1),
- join.getHints(), newCondition, new HashSet<>(), join.getJoinType(),
- join.isSemiJoinDone(), ImmutableList.copyOf(join.getSystemFieldList()));
- call.transformTo(newJoin);
- }
- }
- }
-
- private static class ConvertToCNFShuttle extends RexShuttle {
- private final RexBuilder rexBuilder;
- public boolean fixedOperator = false;
-
- public ConvertToCNFShuttle (RexBuilder rexBuilder) {
- this.rexBuilder = rexBuilder;
- }
-
- @Override
- public RexNode visitCall(RexCall call) {
- RexCall cnfCall = (RexCall) RexUtil.toCnf(rexBuilder, call);
- return super.visitCall(cnfCall);
- }
- }
-
- private static RexNode toCnf(RexBuilder rexBuilder, RexNode rexNode) {
- if (rexNode instanceof RexLiteral) {
- return rexNode;
- }
- RexNode expandedCondition = RexUtil.expandSearch(rexBuilder, null, rexNode);
- RexNode newCondition = RexUtil.pullFactors(rexBuilder, expandedCondition);
- // TODO: IMPALA-13436: use max_cnf_exprs query option instead of hardcoded 100.
- // The default for max_cnf_exprs is 200, but we use 100 here because tpcds
- // q41 is super slow when the value is at 200.
- return RexUtil.toCnf(rexBuilder, 100, newCondition);
- }
-}
diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteJniFrontend.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteJniFrontend.java
index a28bedbf5..152c36d00 100644
--- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteJniFrontend.java
+++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteJniFrontend.java
@@ -144,7 +144,8 @@ public class CalciteJniFrontend extends JniFrontend {
markEvent(mdHandler, logicalPlan, queryCtx, "Created initial logical plan");
// Optimize the query
- CalciteOptimizer optimizer = new CalciteOptimizer(validator);
+ CalciteOptimizer optimizer = new CalciteOptimizer(validator,
+ queryCtx.getTimeline());
ImpalaPlanRel optimizedPlan = optimizer.optimize(logicalPlan);
markEvent(mdHandler, optimizedPlan, queryCtx, "Optimized logical plan");
diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteOptimizer.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteOptimizer.java
index 47130c674..4cb88557a 100644
--- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteOptimizer.java
+++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteOptimizer.java
@@ -19,6 +19,7 @@ package org.apache.impala.calcite.service;
import com.google.common.collect.ImmutableList;
import org.apache.calcite.plan.RelOptCostImpl;
+import org.apache.calcite.plan.RelOptRule;
import org.apache.calcite.plan.RelOptUtil;
import org.apache.calcite.plan.hep.HepMatchOrder;
import org.apache.calcite.plan.hep.HepPlanner;
@@ -28,18 +29,25 @@ import org.apache.calcite.prepare.CalciteCatalogReader;
import org.apache.calcite.rel.RelNode;
import org.apache.calcite.rel.core.RelFactories;
import org.apache.calcite.rel.rules.CoreRules;
+import org.apache.calcite.rel.rules.PruneEmptyRules;
+import org.apache.calcite.rex.RexBuilder;
import org.apache.calcite.sql.SqlExplainFormat;
import org.apache.calcite.sql.SqlExplainLevel;
+import org.apache.calcite.sql.validate.SqlValidator;
+import org.apache.calcite.sql2rel.RelFieldTrimmer;
import org.apache.calcite.tools.RelBuilder;
import org.apache.impala.calcite.coercenodes.CoerceNodes;
import org.apache.impala.calcite.rel.node.ConvertToImpalaRelRules;
import org.apache.impala.calcite.rel.node.ImpalaPlanRel;
import org.apache.impala.calcite.rules.CombineValuesNodesRule;
-import org.apache.impala.calcite.rules.ConvertToCNFRules;
import org.apache.impala.calcite.rules.ExtractLiteralAgg;
import org.apache.impala.calcite.rules.ImpalaMinusToDistinctRule;
import org.apache.impala.calcite.rules.RewriteRexOverRule;
+import org.apache.impala.calcite.util.LogUtil;
import org.apache.impala.common.ImpalaException;
+import org.apache.impala.util.EventSequence;
+
+import java.util.List;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
@@ -55,41 +63,83 @@ public class CalciteOptimizer implements CompilerStep {
private final CalciteCatalogReader reader_;
- public CalciteOptimizer(CalciteAnalysisResult analysisResult) {
+ private final SqlValidator validator_;
+
+ private final EventSequence timeline_;
+
+ public CalciteOptimizer(CalciteAnalysisResult analysisResult,
+ EventSequence timeline) {
this.reader_ = analysisResult.getCatalogReader();
+ this.validator_ = analysisResult.getSqlValidator();
+ this.timeline_ = timeline;
}
- public CalciteOptimizer(CalciteValidator validator) {
+ public CalciteOptimizer(CalciteValidator validator, EventSequence timeline) {
this.reader_ = validator.getCatalogReader();
+ this.validator_ = validator.getSqlValidator();
+ this.timeline_ = timeline;
}
public ImpalaPlanRel optimize(RelNode logPlan) throws ImpalaException {
RelBuilder relBuilder = RelFactories.LOGICAL_BUILDER.create(logPlan.getCluster(),
reader_);
+ RexBuilder rexBuilder = logPlan.getCluster().getRexBuilder();
+
// Run some essential rules needed to create working RelNodes before doing
// optimization
- RelNode expandedNodesPlan = runExpandNodesProgram(relBuilder, logPlan);
-
- // Run essential Join Node rules
- RelNode optimizedPlan = runJoinProgram(relBuilder, expandedNodesPlan);
-
- logDebug(optimizedPlan);
+ timeline_.markEvent("Starting optimization");
+ RelNode expandedNodesPlan = runExpandNodesProgram(logPlan);
+ timeline_.markEvent("Expanded plan");
+ LogUtil.logDebug(expandedNodesPlan, "Plan after expanded plan phase.");
+
+ // The initial parse and validate steps have some issues finding the correct
+ // Impala datatypes for various functions and expressions. For instance,
+ // string literals are treated as 'char' by Calcite and 'string' as Impala.
+ // The coerceNodes step changes all the expressions and types to something that
+ // is compatible with Impala.
+ RelNode coercedNodesPlan =
+ CoerceNodes.coerceNodes(expandedNodesPlan, rexBuilder);
+ timeline_.markEvent("Coerced plan");
+ LogUtil.logDebug(coercedNodesPlan, "Plan after it has been coerced.");
+
+ // Run rules that swap RelNodes and optimize the expressions within a RelNode
+ RelNode preJoinOptimizedPlan = runOptimizeNodesProgram(relBuilder, coercedNodesPlan);
+ timeline_.markEvent("Created optimized plan pre join");
+ LogUtil.logDebug(preJoinOptimizedPlan, "Optimized plan before join rules " +
+ "have been applied.");
+
+ // Run join optimization
+ RelNode optimizedJoinPlan = runJoinProgram(preJoinOptimizedPlan);
+ timeline_.markEvent("Created optimized join plan");
+ LogUtil.logDebug(optimizedJoinPlan, "Optimized plan after join optimization.");
+
+ // rerun rules that swap RelNodes and optimize the expressions within a RelNode,
+ // since the join optimization may have enabled some more rules that can be applied.
+ RelNode postOptimizedJoinPlan =
+ runOptimizeNodesProgram(relBuilder, optimizedJoinPlan);
+ timeline_.markEvent("Created optimized plan post join");
+ LogUtil.logDebug(postOptimizedJoinPlan, "Optimized plan after a second pass of "
+ + "rules applied after join optimization.");
// Run some essential rules needed to create working RelNodes after
// optimization
- optimizedPlan = runPreImpalaConvertProgram(relBuilder, optimizedPlan);
-
- logDebug(optimizedPlan);
+ RelNode preImpalaConvertPlan =
+ runPreImpalaConvertProgram(postOptimizedJoinPlan);
+ LogUtil.logDebug(preImpalaConvertPlan, "Optimized plan after final "
+ + "preparation done before conversion to physical nodes.");
+ // Change the Calcite RelNodes into ImpalaPlanRel RelNodes, all of which
+ // contain a method that converts the RelNodes into Impala PlanNodes.
ImpalaPlanRel finalOptimizedPlan =
- runImpalaConvertProgram(relBuilder, optimizedPlan);
+ runImpalaConvertProgram(preImpalaConvertPlan);
+ timeline_.markEvent("Created final Impala convert plan");
+ LogUtil.logDebug(finalOptimizedPlan, "Final Impala optimized plan");
return finalOptimizedPlan;
}
- public RelNode runExpandNodesProgram(RelBuilder relBuilder,
- RelNode plan) throws ImpalaException {
+ private RelNode runExpandNodesProgram(RelNode plan) throws ImpalaException {
HepProgramBuilder builder = new HepProgramBuilder();
@@ -97,11 +147,9 @@ public class CalciteOptimizer implements CompilerStep {
builder.addRuleCollection(ImmutableList.of(
CoreRules.INTERSECT_TO_DISTINCT,
CoreRules.UNION_TO_DISTINCT,
- new ConvertToCNFRules.FilterConvertToCNFRule(),
- new ConvertToCNFRules.JoinConvertToCNFRule(),
- new ConvertToCNFRules.ProjectConvertToCNFRule(),
ImpalaMinusToDistinctRule.Config.DEFAULT.toRule(),
new CombineValuesNodesRule(),
+ new ExtractLiteralAgg(),
CoreRules.SORT_REMOVE_CONSTANT_KEYS
));
@@ -110,17 +158,62 @@ public class CalciteOptimizer implements CompilerStep {
return runProgram(plan, builder.build());
}
+ private RelNode runOptimizeNodesProgram(RelBuilder relBuilder,
+ RelNode plan) throws ImpalaException {
+
+ RelFieldTrimmer trimmer =
+ new RelFieldTrimmer(validator_, relBuilder);
+ RelNode trimmedPlan = trimmer.trim(plan);
+
+ HepProgramBuilder builder = new HepProgramBuilder();
+
+ List<RelOptRule> interRules = ImmutableList.of(
+ CoreRules.UNION_PULL_UP_CONSTANTS,
+ CoreRules.AGGREGATE_ANY_PULL_UP_CONSTANTS,
+ CoreRules.FILTER_PROJECT_TRANSPOSE,
+ CoreRules.FILTER_SET_OP_TRANSPOSE,
+ CoreRules.JOIN_CONDITION_PUSH,
+ CoreRules.FILTER_INTO_JOIN,
+ CoreRules.FILTER_AGGREGATE_TRANSPOSE,
+ CoreRules.PROJECT_JOIN_TRANSPOSE,
+ CoreRules.UNION_REMOVE,
+ CoreRules.PROJECT_TO_SEMI_JOIN,
+ CoreRules.FILTER_VALUES_MERGE,
+ CoreRules.FILTER_MERGE,
+ CoreRules.PROJECT_MERGE,
+ PruneEmptyRules.PROJECT_INSTANCE,
+ PruneEmptyRules.AGGREGATE_INSTANCE,
+ PruneEmptyRules.SORT_INSTANCE,
+ PruneEmptyRules.FILTER_INSTANCE,
+ PruneEmptyRules.UNION_INSTANCE,
+ PruneEmptyRules.JOIN_LEFT_INSTANCE,
+ PruneEmptyRules.JOIN_RIGHT_INSTANCE
+ );
+ builder.addMatchOrder(HepMatchOrder.TOP_DOWN);
+ builder.addRuleCollection(interRules);
+
+ return trimmer.trim(runProgram(plan, builder.build()));
+ }
+
/**
* Run the rules specifically for join ordering.
*
*/
- public RelNode runJoinProgram(RelBuilder relBuilder,
- RelNode plan) throws ImpalaException {
+ private RelNode runJoinProgram(RelNode plan) throws ImpalaException {
HepProgramBuilder builder = new HepProgramBuilder();
builder.addMatchOrder(HepMatchOrder.BOTTOM_UP);
+ builder.addRuleCollection(ImmutableList.of(
+ CoreRules.SEMI_JOIN_PROJECT_TRANSPOSE,
+ CoreRules.JOIN_PROJECT_BOTH_TRANSPOSE_INCLUDE_OUTER,
+ CoreRules.PROJECT_MERGE
+ ));
+
+ // has to be in a separate program or else there is an infinite loop
+ builder.addRuleInstance(CoreRules.JOIN_PUSH_TRANSITIVE_PREDICATES);
+
// Merge the filter nodes into the Join. Also include
// The filter/project transpose in case the Filter
// exists above the Project in the RelNode so it can
@@ -141,13 +234,22 @@ public class CalciteOptimizer implements CompilerStep {
builder.addRuleInstance(CoreRules.JOIN_CONDITION_PUSH);
builder.addRuleInstance(CoreRules.JOIN_TO_MULTI_JOIN);
builder.addRuleInstance(CoreRules.MULTI_JOIN_OPTIMIZE);
- builder.addRuleInstance(CoreRules.FILTER_PROJECT_TRANSPOSE);
return runProgram(plan, builder.build());
}
- public RelNode runPreImpalaConvertProgram(RelBuilder relBuilder,
- RelNode plan) throws ImpalaException {
+ /**
+ * Run the convert program that does one last step to prepare the Logical
+ * plan to conversion into the Physical plan. The two current rules in
+ * this method are:
+ *
+ * RewriteRexOverRule: This rule changes analytic expressions similar to
+ * the changes made in the "AnalyticExpr.rewrite" method
+ *
+ * FILTER_PROJECT_TRANSPOSE: One last transpose is done since the physical
+ * conversion needs the Logical RelNodes ordered in this way.
+ */
+ private RelNode runPreImpalaConvertProgram(RelNode plan) throws ImpalaException {
HepProgramBuilder builder = new HepProgramBuilder();
@@ -155,21 +257,14 @@ public class CalciteOptimizer implements CompilerStep {
builder.addMatchOrder(HepMatchOrder.BOTTOM_UP);
builder.addRuleCollection(ImmutableList.of(
RewriteRexOverRule.INSTANCE,
- new ExtractLiteralAgg(),
CoreRules.FILTER_PROJECT_TRANSPOSE
));
- retRelNode = runProgram(retRelNode, builder.build());
-
- // Fix up the operands for the nodes which may also change some return types that
- // propagate upwards in the plan.
- return CoerceNodes.coerceNodes(retRelNode, plan.getCluster().getRexBuilder());
-
+ return runProgram(retRelNode, builder.build());
}
- public ImpalaPlanRel runImpalaConvertProgram(RelBuilder relBuilder,
- RelNode plan) throws ImpalaException {
+ private ImpalaPlanRel runImpalaConvertProgram(RelNode plan) throws ImpalaException {
HepProgramBuilder builder = new HepProgramBuilder();
builder.addRuleCollection(ImmutableList.of(
@@ -195,17 +290,13 @@ public class CalciteOptimizer implements CompilerStep {
return planner.findBestExp();
}
- public String getDebugString(Object optimizedPlan) {
- return RelOptUtil.dumpPlan("[Impala plan]", (RelNode) optimizedPlan,
+ public String getDebugString(Object optimizedPlan, String planString) {
+ return RelOptUtil.dumpPlan("[" + planString + "]", (RelNode) optimizedPlan,
SqlExplainFormat.TEXT, SqlExplainLevel.NON_COST_ATTRIBUTES);
}
@Override
public void logDebug(Object resultObject) {
- if (!(resultObject instanceof RelNode)) {
- LOG.debug("Finished optimizer step, but unknown result: " + resultObject);
- return;
- }
- LOG.info(getDebugString(resultObject));
+ LogUtil.logDebug(resultObject, "Optimized Plan");
}
}
diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteRelNodeConverter.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteRelNodeConverter.java
index 038bfa0cc..e8fde8bee 100644
--- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteRelNodeConverter.java
+++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteRelNodeConverter.java
@@ -51,7 +51,9 @@ import org.apache.calcite.tools.FrameworkConfig;
import org.apache.calcite.tools.Frameworks;
import org.apache.calcite.tools.RelBuilder;
import org.apache.impala.calcite.operators.ImpalaConvertletTable;
+import org.apache.impala.calcite.operators.ImpalaRexBuilder;
import org.apache.impala.calcite.schema.ImpalaRelMetadataProvider;
+import org.apache.impala.calcite.util.LogUtil;
import java.util.List;
@@ -85,7 +87,7 @@ public class CalciteRelNodeConverter implements CompilerStep {
this.planner_ = new VolcanoPlanner();
planner_.addRelTraitDef(ConventionTraitDef.INSTANCE);
cluster_ =
- RelOptCluster.create(planner_, new RexBuilder(typeFactory_));
+ RelOptCluster.create(planner_, new ImpalaRexBuilder(typeFactory_));
viewExpander_ = createViewExpander(
analysisResult.getSqlValidator().getCatalogReader().getRootSchema().plus());
cluster_.setMetadataProvider(ImpalaRelMetadataProvider.DEFAULT);
@@ -98,7 +100,7 @@ public class CalciteRelNodeConverter implements CompilerStep {
this.planner_ = new VolcanoPlanner();
planner_.addRelTraitDef(ConventionTraitDef.INSTANCE);
cluster_ =
- RelOptCluster.create(planner_, new RexBuilder(typeFactory_));
+ RelOptCluster.create(planner_, new ImpalaRexBuilder(typeFactory_));
viewExpander_ = createViewExpander(validator.getCatalogReader()
.getRootSchema().plus());
cluster_.setMetadataProvider(ImpalaRelMetadataProvider.DEFAULT);
@@ -136,7 +138,7 @@ public class CalciteRelNodeConverter implements CompilerStep {
// Convert the valid AST into a logical plan
RelRoot root = relConverter.convertQuery(validatedNode, false, true);
RelNode relNode = root.project();
- logDebug(relNode);
+ LogUtil.logDebug(relNode, "Plan after conversion from Abstract Syntax Tree");
RelNode subQueryRemovedPlan =
runProgram(
@@ -146,14 +148,14 @@ public class CalciteRelNodeConverter implements CompilerStep {
CoreRules.FILTER_SUB_QUERY_TO_CORRELATE
),
relNode);
- logDebug(subQueryRemovedPlan);
+ LogUtil.logDebug(subQueryRemovedPlan, "Plan after subquery removal phase");
RelBuilder relBuilder = RelFactories.LOGICAL_BUILDER.create(cluster_,
reader_);
RelNode decorrelatedPlan =
RelDecorrelator.decorrelateQuery(subQueryRemovedPlan, relBuilder);
- logDebug(decorrelatedPlan);
+ LogUtil.logDebug(decorrelatedPlan, "Plan after subquery decorrelation phase");
return decorrelatedPlan;
}
@@ -163,17 +165,11 @@ public class CalciteRelNodeConverter implements CompilerStep {
@Override
public void logDebug(Object resultObject) {
- if (!(resultObject instanceof RelNode)) {
- LOG.debug("RelNodeConverter produced an unknown output: " + resultObject);
- return;
- }
- LOG.info(RelOptUtil.dumpPlan("[Logical plan]", (RelNode) resultObject,
- SqlExplainFormat.TEXT, SqlExplainLevel.NON_COST_ATTRIBUTES));
+ LogUtil.logDebug(resultObject, "RelNodeConverter plan");
}
private RelNode runProgram(List<RelOptRule> rules, RelNode currentNode) {
HepProgramBuilder builder = new HepProgramBuilder();
- // rules to convert Calcite nodes into ImpalaPlanRel nodes
builder.addRuleCollection(rules);
builder.addMatchOrder(HepMatchOrder.BOTTOM_UP);
diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteSingleNodePlanner.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteSingleNodePlanner.java
index 3a26dd457..97ea69669 100644
--- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteSingleNodePlanner.java
+++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteSingleNodePlanner.java
@@ -65,7 +65,8 @@ public class CalciteSingleNodePlanner implements SingleNodePlannerIntf {
RelNode logicalPlan = relNodeConverter.convert(analysisResult_.getValidatedNode());
// Optimize the query
- CalciteOptimizer optimizer = new CalciteOptimizer(analysisResult_);
+ CalciteOptimizer optimizer =
+ new CalciteOptimizer(analysisResult_, ctx_.getTimeline());
ImpalaPlanRel optimizedPlan = optimizer.optimize(logicalPlan);
// Create Physical Impala PlanNodes
diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/util/LogUtil.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/util/LogUtil.java
new file mode 100644
index 000000000..88b3c8830
--- /dev/null
+++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/util/LogUtil.java
@@ -0,0 +1,49 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements. See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership. The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License. You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied. See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+package org.apache.impala.calcite.util;
+
+import org.apache.calcite.plan.RelOptUtil;
+import org.apache.calcite.rel.RelNode;
+import org.apache.calcite.sql.SqlExplainFormat;
+import org.apache.calcite.sql.SqlExplainLevel;
+
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+public class LogUtil {
+
+ protected static final Logger LOG =
+ LoggerFactory.getLogger(LogUtil.class.getName());
+
+ public static void logDebug(Object resultObject, String planString) {
+ if (!LOG.isDebugEnabled()) {
+ return;
+ }
+
+ if (!(resultObject instanceof RelNode)) {
+ LOG.debug("Unknown object passed, RelNode needed.");
+ return;
+ }
+
+ String debugString = RelOptUtil.dumpPlan("[" + planString + "]",
+ (RelNode) resultObject,
+ SqlExplainFormat.TEXT, SqlExplainLevel.NON_COST_ATTRIBUTES);
+
+ LOG.debug(debugString);
+ }
+}
diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q01.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q01.test
index f0fdce12e..985e1a980 100644
--- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q01.test
+++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q01.test
@@ -25,11 +25,11 @@ limit 100
# end query 1 in stream 0 using template query1.tpl
---- PLAN
-Max Per-Host Resource Reservation: Memory=130.04MB Threads=1
-Per-Host Resource Estimates: Memory=13.04GB
+Max Per-Host Resource Reservation: Memory=129.83MB Threads=1
+Per-Host Resource Estimates: Memory=2.81GB
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=13.04GB mem-reservation=130.04MB thread-reservation=1 runtime-filters-memory=20.00MB
-| max-parallelism=1 segment-costs=[1214229476, 1214229476, 4705461, 13864191355, 100]
+| Per-Instance Resources: mem-estimate=2.81GB mem-reservation=129.83MB thread-reservation=1 runtime-filters-memory=20.00MB
+| max-parallelism=1 segment-costs=[143540604, 143540604, 4705461, 12482450363, 100]
PLAN-ROOT SINK
| output exprs: c_customer_id
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=100
@@ -37,15 +37,15 @@ PLAN-ROOT SINK
14:TOP-N [LIMIT=100]
| order by: c_customer_id ASC NULLS LAST
| mem-estimate=2.73KB mem-reservation=0B thread-reservation=0
-| tuple-ids=16 row-size=28B cardinality=100 cost=13219387793
+| tuple-ids=16 row-size=28B cardinality=100 cost=11991890128
| in pipelines: 14(GETNEXT), 04(OPEN)
|
13:HASH JOIN [INNER JOIN]
| hash predicates: tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| fk/pk conjuncts: none
| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6,7,15,0 row-size=707B cardinality=793.12M cost=395326499
+| mem-estimate=1.64GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=6,7,15,0 row-size=94B cardinality=722.75M cost=346347760
| in pipelines: 04(GETNEXT), 00(OPEN)
|
|--00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
@@ -55,7 +55,7 @@ PLAN-ROOT SINK
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.10M
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=0 row-size=204B cardinality=30.00M cost=46823813
+| tuple-ids=0 row-size=32B cardinality=30.00M cost=8640000
| in pipelines: 00(GETNEXT)
|
12:HASH JOIN [INNER JOIN]
@@ -64,7 +64,7 @@ PLAN-ROOT SINK
| other join predicates: sum(tpcds_partitioned_parquet_snap.store_returns.sr_fee) > multiply(avg(sum(tpcds_partitioned_parquet_snap.store_returns_0.sr_fee)), CAST(1.2 AS DECIMAL(2,1)))
| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=6,7,15 row-size=503B cardinality=863.99M cost=159394557
+| tuple-ids=6,7,15 row-size=62B cardinality=722.75M cost=131246886
| in pipelines: 04(GETNEXT), 11(OPEN)
|
|--11:AGGREGATE [FINALIZE]
@@ -77,9 +77,8 @@ PLAN-ROOT SINK
| 10:AGGREGATE [FINALIZE]
| | output: sum(tpcds_partitioned_parquet_snap.store_returns_0.sr_fee)
| | group by: tpcds_partitioned_parquet_snap.store_returns_0.sr_customer_sk, tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk
-| | having: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)
-| | mem-estimate=3.24GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=24B cardinality=16.08M cost=949210422
+| | mem-estimate=552.11MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=24B cardinality=16.08M cost=94921044
| | in pipelines: 10(GETNEXT), 07(OPEN)
| |
| 09:HASH JOIN [INNER JOIN]
@@ -87,7 +86,7 @@ PLAN-ROOT SINK
| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns_0.sr_returned_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=9,11 row-size=321B cardinality=160.81M cost=70387897
+| | tuple-ids=9,11 row-size=24B cardinality=16.08M cost=7039125
| | in pipelines: 07(GETNEXT), 08(OPEN)
| |
| |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
@@ -99,20 +98,22 @@ PLAN-ROOT SINK
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=11 row-size=237B cardinality=373 cost=112653
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=11 row-size=8B cardinality=373 cost=10467
| | in pipelines: 08(GETNEXT)
| |
| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns]
| HDFS partitions=2004/2004 files=2004 size=48.14GB
+| predicates: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)
| runtime filters: RF008[bloom] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_returned_date_sk
| stored statistics:
| table: rows=863.99M size=48.14GB
| partitions: 2004/2004 rows=863.99M
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=30.09M est-scan-range=373(filtered from 2004)
+| parquet dictionary predicates: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=9 row-size=84B cardinality=160.81M(filtered from 863.99M) cost=194518504
+| tuple-ids=9 row-size=16B cardinality=16.08M(filtered from 86.40M) cost=41569968
| in pipelines: 07(GETNEXT)
|
06:HASH JOIN [INNER JOIN]
@@ -120,7 +121,7 @@ PLAN-ROOT SINK
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns.sr_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk
| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=6,7 row-size=483B cardinality=11.07M cost=43253937
+| tuple-ids=6,7 row-size=42B cardinality=1.11M cost=4325435
| in pipelines: 04(GETNEXT), 05(OPEN)
|
|--05:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
@@ -133,15 +134,15 @@ PLAN-ROOT SINK
| extrapolated-rows=disabled max-scan-range-rows=1.35K
| parquet statistics predicates: tpcds_partitioned_parquet_snap.store.s_state = 'TN'
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store.s_state = 'TN'
-| mem-estimate=16.00MB mem-reservation=232.00KB thread-reservation=0
-| tuple-ids=7 row-size=459B cardinality=46 cost=4756
+| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
+| tuple-ids=7 row-size=18B cardinality=46 cost=154
| in pipelines: 05(GETNEXT)
|
04:AGGREGATE [FINALIZE]
| output: sum(tpcds_partitioned_parquet_snap.store_returns.sr_fee)
| group by: tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_returns.sr_store_sk
-| mem-estimate=3.24GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=24B cardinality=160.81M cost=949210422
+| mem-estimate=552.11MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=6 row-size=24B cardinality=16.08M cost=94921044
| in pipelines: 04(GETNEXT), 01(OPEN)
|
03:HASH JOIN [INNER JOIN]
@@ -149,7 +150,7 @@ PLAN-ROOT SINK
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns.sr_returned_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=2,4 row-size=321B cardinality=160.81M cost=70387897
+| tuple-ids=2,4 row-size=24B cardinality=16.08M cost=7039125
| in pipelines: 01(GETNEXT), 02(OPEN)
|
|--02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
@@ -161,27 +162,29 @@ PLAN-ROOT SINK
| extrapolated-rows=disabled max-scan-range-rows=73.05K
| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT)
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=4 row-size=237B cardinality=373 cost=112653
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=4 row-size=8B cardinality=373 cost=10467
| in pipelines: 02(GETNEXT)
|
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns]
HDFS partitions=2004/2004 files=2004 size=48.14GB
+ predicates: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)
runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF006[bloom] -> [...]
stored statistics:
table: rows=863.99M size=48.14GB
partitions: 2004/2004 rows=863.99M
columns: all
extrapolated-rows=disabled max-scan-range-rows=30.09M est-scan-range=373(filtered from 2004)
+ parquet dictionary predicates: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=2 row-size=84B cardinality=160.81M(filtered from 863.99M) cost=194518504
+ tuple-ids=2 row-size=16B cardinality=16.08M(filtered from 86.40M) cost=41569968
in pipelines: 01(GETNEXT)
---- DISTRIBUTEDPLAN
-Max Per-Host Resource Reservation: Memory=2.10GB Threads=57
-Per-Host Resource Estimates: Memory=9.61GB
+Max Per-Host Resource Reservation: Memory=787.20MB Threads=28
+Per-Host Resource Estimates: Memory=2.36GB
F09:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=4.37MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[130] cpu-comparison-result=271 [max(1 (self) vs 271 (sum children))]
+| max-parallelism=1 segment-costs=[130] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
PLAN-ROOT SINK
| output exprs: c_customer_id
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=100
@@ -194,12 +197,12 @@ PLAN-ROOT SINK
| in pipelines: 14(GETNEXT)
|
F02:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)] hosts=10 instances=120
-Per-Instance Resources: mem-estimate=59.29MB mem-reservation=34.00MB thread-reservation=1
-max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-result=271 [max(120 (self) vs 271 (sum children))]
+Per-Instance Resources: mem-estimate=20.55MB mem-reservation=8.50MB thread-reservation=1
+max-parallelism=1250 segment-costs=[98483035, 12443809510, 104] cpu-comparison-result=120 [max(120 (self) vs 71 (sum children))]
14:TOP-N [LIMIT=100]
| order by: c_customer_id ASC NULLS LAST
| mem-estimate=2.73KB mem-reservation=0B thread-reservation=0
-| tuple-ids=16 row-size=28B cardinality=100 cost=13219387793
+| tuple-ids=16 row-size=28B cardinality=100 cost=11991890128
| in pipelines: 14(GETNEXT), 17(OPEN)
|
13:HASH JOIN [INNER JOIN, BROADCAST]
@@ -207,26 +210,26 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| hash predicates: tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| fk/pk conjuncts: none
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6,7,15,0 row-size=707B cardinality=793.12M cost=365326499
+| tuple-ids=6,7,15,0 row-size=94B cardinality=722.75M cost=316347760
| in pipelines: 17(GETNEXT), 00(OPEN)
|
|--F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | Per-Instance Resources: mem-estimate=1.67GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
| | max-parallelism=10 segment-costs=[69869990]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | mem-estimate=1.64GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
| 25:EXCHANGE [BROADCAST]
-| | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=0 row-size=204B cardinality=30.00M cost=39869990
+| | mem-estimate=10.35MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=0 row-size=32B cardinality=30.00M cost=39869990
| | in pipelines: 00(GETNEXT)
| |
| F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| max-parallelism=10 segment-costs=[64027278]
+| Per-Instance Resources: mem-estimate=16.14MB mem-reservation=1.00MB thread-reservation=1
+| max-parallelism=10 segment-costs=[11880000]
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| HDFS partitions=1/1 files=1 size=1.55GB
| stored statistics:
@@ -234,7 +237,7 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.10M
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=0 row-size=204B cardinality=30.00M cost=46823813
+| tuple-ids=0 row-size=32B cardinality=30.00M cost=8640000
| in pipelines: 00(GETNEXT)
|
12:HASH JOIN [INNER JOIN, BROADCAST]
@@ -243,12 +246,12 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| fk/pk conjuncts: none
| other join predicates: sum(tpcds_partitioned_parquet_snap.store_returns.sr_fee) > multiply(avg(sum(tpcds_partitioned_parquet_snap.store_returns_0.sr_fee)), CAST(1.2 AS DECIMAL(2,1)))
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=6,7,15 row-size=503B cardinality=863.99M cost=159393904
+| tuple-ids=6,7,15 row-size=62B cardinality=722.75M cost=131246233
| in pipelines: 17(GETNEXT), 23(OPEN)
|
|--F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=24.41MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[1513] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
+| | max-parallelism=10 segment-costs=[1513] cpu-comparison-result=20 [max(10 (self) vs 20 (sum children))]
| JOIN BUILD
| | join-table-id=01 plan-id=02 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk
@@ -261,8 +264,8 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| | in pipelines: 23(GETNEXT)
| |
| F07:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)] hosts=10 instances=10 (adjusted from 120)
-| Per-Instance Resources: mem-estimate=12.49MB mem-reservation=1.94MB thread-reservation=1
-| max-parallelism=10 segment-costs=[40536, 49] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
+| Per-Instance Resources: mem-estimate=10.38MB mem-reservation=1.94MB thread-reservation=1
+| max-parallelism=10 segment-costs=[40536, 49] cpu-comparison-result=20 [max(10 (self) vs 20 (sum children))]
| 23:AGGREGATE [FINALIZE]
| | output: avg:merge(sum(tpcds_partitioned_parquet_snap.store_returns_0.sr_fee))
| | group by: tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk
@@ -271,13 +274,13 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| | in pipelines: 23(GETNEXT), 21(OPEN)
| |
| 22:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)]
-| | mem-estimate=2.49MB mem-reservation=0B thread-reservation=0
+| | mem-estimate=393.05KB mem-reservation=0B thread-reservation=0
| | tuple-ids=14 row-size=20B cardinality=78.36K cost=15914
| | in pipelines: 21(GETNEXT)
| |
-| F06:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)] hosts=10 instances=100 (adjusted from 120)
-| Per-Instance Resources: mem-estimate=78.49MB mem-reservation=36.00MB thread-reservation=1
-| max-parallelism=100 segment-costs=[984830336, 4908058, 141298] cpu-comparison-result=120 [max(100 (self) vs 120 (sum children))]
+| F06:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)] hosts=10 instances=10 (adjusted from 120)
+| Per-Instance Resources: mem-estimate=75.76MB mem-reservation=36.00MB thread-reservation=1
+| max-parallelism=10 segment-costs=[98483035, 4908058, 141298] cpu-comparison-result=20 [max(10 (self) vs 20 (sum children))]
| 11:AGGREGATE [STREAMING]
| | output: avg(sum(tpcds_partitioned_parquet_snap.store_returns_0.sr_fee))
| | group by: tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk
@@ -288,25 +291,24 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| 21:AGGREGATE [FINALIZE]
| | output: sum:merge(tpcds_partitioned_parquet_snap.store_returns_0.sr_fee)
| | group by: tpcds_partitioned_parquet_snap.store_returns_0.sr_customer_sk, tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk
-| | having: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)
| | mem-estimate=55.21MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=24B cardinality=16.08M cost=949210422
+| | tuple-ids=13 row-size=24B cardinality=16.08M cost=94921044
| | in pipelines: 21(GETNEXT), 07(OPEN)
| |
| 20:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)]
-| | mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=13 row-size=24B cardinality=160.81M cost=35619914
+| | mem-estimate=10.55MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=13 row-size=24B cardinality=16.08M cost=3561991
| | in pipelines: 07(GETNEXT)
| |
-| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| Per-Instance Resources: mem-estimate=61.44MB mem-reservation=34.50MB thread-reservation=1
-| max-parallelism=130 segment-costs=[1214116450, 331401897] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
+| Per-Instance Resources: mem-estimate=51.09MB mem-reservation=34.50MB thread-reservation=1
+| max-parallelism=20 segment-costs=[143529764, 33140190] cpu-comparison-result=20 [max(20 (self) vs 11 (sum children))]
| 10:AGGREGATE [STREAMING]
| | output: sum(tpcds_partitioned_parquet_snap.store_returns_0.sr_fee)
| | group by: tpcds_partitioned_parquet_snap.store_returns_0.sr_customer_sk, tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk
-| | mem-estimate=34.51MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=24B cardinality=160.81M cost=949210422
+| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=24B cardinality=16.08M cost=94921044
| | in pipelines: 07(GETNEXT)
| |
| 09:HASH JOIN [INNER JOIN, BROADCAST]
@@ -314,26 +316,26 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| | hash predicates: tpcds_partitioned_parquet_snap.store_returns_0.sr_returned_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns_0.sr_returned_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=9,11 row-size=321B cardinality=160.81M cost=70387524
+| | tuple-ids=9,11 row-size=24B cardinality=16.08M cost=7038752
| | in pipelines: 07(GETNEXT), 08(OPEN)
| |
| |--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=24.42MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=02 plan-id=03 cohort-id=02
| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| | | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 19:EXCHANGE [BROADCAST]
-| | | mem-estimate=174.22KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=11 row-size=237B cardinality=373 cost=490
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=11 row-size=8B cardinality=373 cost=490
| | | in pipelines: 08(GETNEXT)
| | |
| | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[112899]
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10483]
| | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
@@ -343,20 +345,22 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=11 row-size=237B cardinality=373 cost=112653
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=11 row-size=8B cardinality=373 cost=10467
| | in pipelines: 08(GETNEXT)
| |
| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM]
| HDFS partitions=2004/2004 files=2004 size=48.14GB
+| predicates: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)
| runtime filters: RF008[bloom] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_returned_date_sk
| stored statistics:
| table: rows=863.99M size=48.14GB
| partitions: 2004/2004 rows=863.99M
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=30.09M est-scan-range=373(filtered from 2004)
+| parquet dictionary predicates: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=9 row-size=84B cardinality=160.81M(filtered from 863.99M) cost=194518504
+| tuple-ids=9 row-size=16B cardinality=16.08M(filtered from 86.40M) cost=41569968
| in pipelines: 07(GETNEXT)
|
06:HASH JOIN [INNER JOIN, BROADCAST]
@@ -364,11 +368,11 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| hash predicates: tpcds_partitioned_parquet_snap.store_returns.sr_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns.sr_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=6,7 row-size=483B cardinality=11.07M cost=43253891
+| tuple-ids=6,7 row-size=42B cardinality=1.11M cost=4325389
| in pipelines: 17(GETNEXT), 05(OPEN)
|
|--F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=24.29MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[106]
| JOIN BUILD
| | join-table-id=03 plan-id=04 cohort-id=01
@@ -377,14 +381,14 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=46
| |
| 18:EXCHANGE [BROADCAST]
-| | mem-estimate=41.39KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=7 row-size=459B cardinality=46 cost=60
+| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=7 row-size=18B cardinality=46 cost=60
| | in pipelines: 05(GETNEXT)
| |
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| Per-Instance Resources: mem-estimate=17.81MB mem-reservation=232.00KB thread-reservation=1
-| max-parallelism=1 segment-costs=[4813]
+| Per-Instance Resources: mem-estimate=16.09MB mem-reservation=16.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[157]
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
| HDFS partitions=1/1 files=1 size=119.76KB
| predicates: tpcds_partitioned_parquet_snap.store.s_state = 'TN'
@@ -395,31 +399,31 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| extrapolated-rows=disabled max-scan-range-rows=1.35K
| parquet statistics predicates: tpcds_partitioned_parquet_snap.store.s_state = 'TN'
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store.s_state = 'TN'
-| mem-estimate=16.00MB mem-reservation=232.00KB thread-reservation=0
-| tuple-ids=7 row-size=459B cardinality=46 cost=4756
+| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
+| tuple-ids=7 row-size=18B cardinality=46 cost=154
| in pipelines: 05(GETNEXT)
|
17:AGGREGATE [FINALIZE]
| output: sum:merge(tpcds_partitioned_parquet_snap.store_returns.sr_fee)
| group by: tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_returns.sr_store_sk
-| mem-estimate=46.01MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=24B cardinality=160.81M cost=949210422
+| mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
+| tuple-ids=6 row-size=24B cardinality=16.08M cost=94921044
| in pipelines: 17(GETNEXT), 01(OPEN)
|
16:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)]
-| mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
-| tuple-ids=6 row-size=24B cardinality=160.81M cost=35619914
+| mem-estimate=10.55MB mem-reservation=0B thread-reservation=0
+| tuple-ids=6 row-size=24B cardinality=16.08M cost=3561991
| in pipelines: 01(GETNEXT)
|
-F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
Per-Host Shared Resources: mem-estimate=19.00MB mem-reservation=19.00MB thread-reservation=0 runtime-filters-memory=19.00MB
-Per-Instance Resources: mem-estimate=63.63MB mem-reservation=34.50MB thread-reservation=1
-max-parallelism=130 segment-costs=[1214116450, 331401897] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
+Per-Instance Resources: mem-estimate=63.12MB mem-reservation=34.50MB thread-reservation=1
+max-parallelism=20 segment-costs=[143529764, 33140190] cpu-comparison-result=20 [max(20 (self) vs 11 (sum children))]
04:AGGREGATE [STREAMING]
| output: sum(tpcds_partitioned_parquet_snap.store_returns.sr_fee)
| group by: tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_returns.sr_store_sk
-| mem-estimate=34.51MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=24B cardinality=160.81M cost=949210422
+| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=6 row-size=24B cardinality=16.08M cost=94921044
| in pipelines: 01(GETNEXT)
|
03:HASH JOIN [INNER JOIN, BROADCAST]
@@ -427,26 +431,26 @@ max-parallelism=130 segment-costs=[1214116450, 331401897] cpu-comparison-result=
| hash predicates: tpcds_partitioned_parquet_snap.store_returns.sr_returned_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns.sr_returned_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=2,4 row-size=321B cardinality=160.81M cost=70387524
+| tuple-ids=2,4 row-size=24B cardinality=16.08M cost=7038752
| in pipelines: 01(GETNEXT), 02(OPEN)
|
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=24.42MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[863]
| JOIN BUILD
| | join-table-id=04 plan-id=05 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=373
| |
| 15:EXCHANGE [BROADCAST]
-| | mem-estimate=174.22KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=237B cardinality=373 cost=490
+| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=4 row-size=8B cardinality=373 cost=490
| | in pipelines: 02(GETNEXT)
| |
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[112899]
+| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[10483]
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| HDFS partitions=1/1 files=1 size=2.17MB
| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT)
@@ -456,27 +460,29 @@ max-parallelism=130 segment-costs=[1214116450, 331401897] cpu-comparison-result=
| extrapolated-rows=disabled max-scan-range-rows=73.05K
| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT)
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=4 row-size=237B cardinality=373 cost=112653
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=4 row-size=8B cardinality=373 cost=10467
| in pipelines: 02(GETNEXT)
|
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM]
HDFS partitions=2004/2004 files=2004 size=48.14GB
+ predicates: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)
runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF006[bloom] -> [...]
stored statistics:
table: rows=863.99M size=48.14GB
partitions: 2004/2004 rows=863.99M
columns: all
extrapolated-rows=disabled max-scan-range-rows=30.09M est-scan-range=373(filtered from 2004)
+ parquet dictionary predicates: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=2 row-size=84B cardinality=160.81M(filtered from 863.99M) cost=194518504
+ tuple-ids=2 row-size=16B cardinality=16.08M(filtered from 86.40M) cost=41569968
in pipelines: 01(GETNEXT)
---- PARALLELPLANS
-Max Per-Host Resource Reservation: Memory=2.10GB Threads=57
-Per-Host Resource Estimates: Memory=9.61GB
+Max Per-Host Resource Reservation: Memory=787.20MB Threads=28
+Per-Host Resource Estimates: Memory=2.36GB
F09:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=4.37MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[130] cpu-comparison-result=271 [max(1 (self) vs 271 (sum children))]
+| max-parallelism=1 segment-costs=[130] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
PLAN-ROOT SINK
| output exprs: c_customer_id
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=100
@@ -489,12 +495,12 @@ PLAN-ROOT SINK
| in pipelines: 14(GETNEXT)
|
F02:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)] hosts=10 instances=120
-Per-Instance Resources: mem-estimate=59.29MB mem-reservation=34.00MB thread-reservation=1
-max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-result=271 [max(120 (self) vs 271 (sum children))]
+Per-Instance Resources: mem-estimate=20.55MB mem-reservation=8.50MB thread-reservation=1
+max-parallelism=1250 segment-costs=[98483035, 12443809510, 104] cpu-comparison-result=120 [max(120 (self) vs 71 (sum children))]
14:TOP-N [LIMIT=100]
| order by: c_customer_id ASC NULLS LAST
| mem-estimate=2.73KB mem-reservation=0B thread-reservation=0
-| tuple-ids=16 row-size=28B cardinality=100 cost=13219387793
+| tuple-ids=16 row-size=28B cardinality=100 cost=11991890128
| in pipelines: 14(GETNEXT), 17(OPEN)
|
13:HASH JOIN [INNER JOIN, BROADCAST]
@@ -502,26 +508,26 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| hash predicates: tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| fk/pk conjuncts: none
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6,7,15,0 row-size=707B cardinality=793.12M cost=365326499
+| tuple-ids=6,7,15,0 row-size=94B cardinality=722.75M cost=316347760
| in pipelines: 17(GETNEXT), 00(OPEN)
|
|--F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | Per-Instance Resources: mem-estimate=1.67GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
| | max-parallelism=10 segment-costs=[69869990]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | mem-estimate=1.64GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
| 25:EXCHANGE [BROADCAST]
-| | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=0 row-size=204B cardinality=30.00M cost=39869990
+| | mem-estimate=10.35MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=0 row-size=32B cardinality=30.00M cost=39869990
| | in pipelines: 00(GETNEXT)
| |
| F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| max-parallelism=10 segment-costs=[64027278]
+| Per-Instance Resources: mem-estimate=16.14MB mem-reservation=1.00MB thread-reservation=1
+| max-parallelism=10 segment-costs=[11880000]
| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| HDFS partitions=1/1 files=1 size=1.55GB
| stored statistics:
@@ -529,7 +535,7 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.10M
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=0 row-size=204B cardinality=30.00M cost=46823813
+| tuple-ids=0 row-size=32B cardinality=30.00M cost=8640000
| in pipelines: 00(GETNEXT)
|
12:HASH JOIN [INNER JOIN, BROADCAST]
@@ -538,12 +544,12 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| fk/pk conjuncts: none
| other join predicates: sum(tpcds_partitioned_parquet_snap.store_returns.sr_fee) > multiply(avg(sum(tpcds_partitioned_parquet_snap.store_returns_0.sr_fee)), CAST(1.2 AS DECIMAL(2,1)))
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=6,7,15 row-size=503B cardinality=863.99M cost=159393904
+| tuple-ids=6,7,15 row-size=62B cardinality=722.75M cost=131246233
| in pipelines: 17(GETNEXT), 23(OPEN)
|
|--F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=24.41MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[1513] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
+| | max-parallelism=10 segment-costs=[1513] cpu-comparison-result=20 [max(10 (self) vs 20 (sum children))]
| JOIN BUILD
| | join-table-id=01 plan-id=02 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk
@@ -556,8 +562,8 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| | in pipelines: 23(GETNEXT)
| |
| F07:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)] hosts=10 instances=10 (adjusted from 120)
-| Per-Instance Resources: mem-estimate=12.49MB mem-reservation=1.94MB thread-reservation=1
-| max-parallelism=10 segment-costs=[40536, 49] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
+| Per-Instance Resources: mem-estimate=10.38MB mem-reservation=1.94MB thread-reservation=1
+| max-parallelism=10 segment-costs=[40536, 49] cpu-comparison-result=20 [max(10 (self) vs 20 (sum children))]
| 23:AGGREGATE [FINALIZE]
| | output: avg:merge(sum(tpcds_partitioned_parquet_snap.store_returns_0.sr_fee))
| | group by: tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk
@@ -566,13 +572,13 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| | in pipelines: 23(GETNEXT), 21(OPEN)
| |
| 22:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)]
-| | mem-estimate=2.49MB mem-reservation=0B thread-reservation=0
+| | mem-estimate=393.05KB mem-reservation=0B thread-reservation=0
| | tuple-ids=14 row-size=20B cardinality=78.36K cost=15914
| | in pipelines: 21(GETNEXT)
| |
-| F06:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)] hosts=10 instances=100 (adjusted from 120)
-| Per-Instance Resources: mem-estimate=78.49MB mem-reservation=36.00MB thread-reservation=1
-| max-parallelism=100 segment-costs=[984830336, 4908058, 141298] cpu-comparison-result=120 [max(100 (self) vs 120 (sum children))]
+| F06:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)] hosts=10 instances=10 (adjusted from 120)
+| Per-Instance Resources: mem-estimate=75.76MB mem-reservation=36.00MB thread-reservation=1
+| max-parallelism=10 segment-costs=[98483035, 4908058, 141298] cpu-comparison-result=20 [max(10 (self) vs 20 (sum children))]
| 11:AGGREGATE [STREAMING]
| | output: avg(sum(tpcds_partitioned_parquet_snap.store_returns_0.sr_fee))
| | group by: tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk
@@ -583,25 +589,24 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| 21:AGGREGATE [FINALIZE]
| | output: sum:merge(tpcds_partitioned_parquet_snap.store_returns_0.sr_fee)
| | group by: tpcds_partitioned_parquet_snap.store_returns_0.sr_customer_sk, tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk
-| | having: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)
| | mem-estimate=55.21MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=24B cardinality=16.08M cost=949210422
+| | tuple-ids=13 row-size=24B cardinality=16.08M cost=94921044
| | in pipelines: 21(GETNEXT), 07(OPEN)
| |
| 20:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_returns_0.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)]
-| | mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=13 row-size=24B cardinality=160.81M cost=35619914
+| | mem-estimate=10.55MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=13 row-size=24B cardinality=16.08M cost=3561991
| | in pipelines: 07(GETNEXT)
| |
-| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| Per-Instance Resources: mem-estimate=61.44MB mem-reservation=34.50MB thread-reservation=1
-| max-parallelism=130 segment-costs=[1214116450, 331401897] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
+| Per-Instance Resources: mem-estimate=51.09MB mem-reservation=34.50MB thread-reservation=1
+| max-parallelism=20 segment-costs=[143529764, 33140190] cpu-comparison-result=20 [max(20 (self) vs 11 (sum children))]
| 10:AGGREGATE [STREAMING]
| | output: sum(tpcds_partitioned_parquet_snap.store_returns_0.sr_fee)
| | group by: tpcds_partitioned_parquet_snap.store_returns_0.sr_customer_sk, tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk
-| | mem-estimate=34.51MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=24B cardinality=160.81M cost=949210422
+| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=24B cardinality=16.08M cost=94921044
| | in pipelines: 07(GETNEXT)
| |
| 09:HASH JOIN [INNER JOIN, BROADCAST]
@@ -609,26 +614,26 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| | hash predicates: tpcds_partitioned_parquet_snap.store_returns_0.sr_returned_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns_0.sr_returned_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=9,11 row-size=321B cardinality=160.81M cost=70387524
+| | tuple-ids=9,11 row-size=24B cardinality=16.08M cost=7038752
| | in pipelines: 07(GETNEXT), 08(OPEN)
| |
| |--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=24.42MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=02 plan-id=03 cohort-id=02
| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| | | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 19:EXCHANGE [BROADCAST]
-| | | mem-estimate=174.22KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=11 row-size=237B cardinality=373 cost=490
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=11 row-size=8B cardinality=373 cost=490
| | | in pipelines: 08(GETNEXT)
| | |
| | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[112899]
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10483]
| | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
@@ -638,20 +643,22 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=11 row-size=237B cardinality=373 cost=112653
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=11 row-size=8B cardinality=373 cost=10467
| | in pipelines: 08(GETNEXT)
| |
| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM]
| HDFS partitions=2004/2004 files=2004 size=48.14GB
+| predicates: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)
| runtime filters: RF008[bloom] -> tpcds_partitioned_parquet_snap.store_returns_0.sr_returned_date_sk
| stored statistics:
| table: rows=863.99M size=48.14GB
| partitions: 2004/2004 rows=863.99M
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=30.09M est-scan-range=373(filtered from 2004)
+| parquet dictionary predicates: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns_0.sr_store_sk)
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=9 row-size=84B cardinality=160.81M(filtered from 863.99M) cost=194518504
+| tuple-ids=9 row-size=16B cardinality=16.08M(filtered from 86.40M) cost=41569968
| in pipelines: 07(GETNEXT)
|
06:HASH JOIN [INNER JOIN, BROADCAST]
@@ -659,11 +666,11 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| hash predicates: tpcds_partitioned_parquet_snap.store_returns.sr_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns.sr_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=6,7 row-size=483B cardinality=11.07M cost=43253891
+| tuple-ids=6,7 row-size=42B cardinality=1.11M cost=4325389
| in pipelines: 17(GETNEXT), 05(OPEN)
|
|--F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=24.29MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[106]
| JOIN BUILD
| | join-table-id=03 plan-id=04 cohort-id=01
@@ -672,14 +679,14 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=46
| |
| 18:EXCHANGE [BROADCAST]
-| | mem-estimate=41.39KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=7 row-size=459B cardinality=46 cost=60
+| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=7 row-size=18B cardinality=46 cost=60
| | in pipelines: 05(GETNEXT)
| |
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| Per-Instance Resources: mem-estimate=17.81MB mem-reservation=232.00KB thread-reservation=1
-| max-parallelism=1 segment-costs=[4813]
+| Per-Instance Resources: mem-estimate=16.09MB mem-reservation=16.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[157]
| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
| HDFS partitions=1/1 files=1 size=119.76KB
| predicates: tpcds_partitioned_parquet_snap.store.s_state = 'TN'
@@ -690,31 +697,31 @@ max-parallelism=1380 segment-costs=[984830336, 13787362087, 104] cpu-comparison-
| extrapolated-rows=disabled max-scan-range-rows=1.35K
| parquet statistics predicates: tpcds_partitioned_parquet_snap.store.s_state = 'TN'
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store.s_state = 'TN'
-| mem-estimate=16.00MB mem-reservation=232.00KB thread-reservation=0
-| tuple-ids=7 row-size=459B cardinality=46 cost=4756
+| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
+| tuple-ids=7 row-size=18B cardinality=46 cost=154
| in pipelines: 05(GETNEXT)
|
17:AGGREGATE [FINALIZE]
| output: sum:merge(tpcds_partitioned_parquet_snap.store_returns.sr_fee)
| group by: tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_returns.sr_store_sk
-| mem-estimate=46.01MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=24B cardinality=160.81M cost=949210422
+| mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
+| tuple-ids=6 row-size=24B cardinality=16.08M cost=94921044
| in pipelines: 17(GETNEXT), 01(OPEN)
|
16:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk,tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)]
-| mem-estimate=13.28MB mem-reservation=0B thread-reservation=0
-| tuple-ids=6 row-size=24B cardinality=160.81M cost=35619914
+| mem-estimate=10.55MB mem-reservation=0B thread-reservation=0
+| tuple-ids=6 row-size=24B cardinality=16.08M cost=3561991
| in pipelines: 01(GETNEXT)
|
-F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=20 (adjusted from 120)
Per-Host Shared Resources: mem-estimate=19.00MB mem-reservation=19.00MB thread-reservation=0 runtime-filters-memory=19.00MB
-Per-Instance Resources: mem-estimate=63.63MB mem-reservation=34.50MB thread-reservation=1
-max-parallelism=130 segment-costs=[1214116450, 331401897] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
+Per-Instance Resources: mem-estimate=63.12MB mem-reservation=34.50MB thread-reservation=1
+max-parallelism=20 segment-costs=[143529764, 33140190] cpu-comparison-result=20 [max(20 (self) vs 11 (sum children))]
04:AGGREGATE [STREAMING]
| output: sum(tpcds_partitioned_parquet_snap.store_returns.sr_fee)
| group by: tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, tpcds_partitioned_parquet_snap.store_returns.sr_store_sk
-| mem-estimate=34.51MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=24B cardinality=160.81M cost=949210422
+| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=6 row-size=24B cardinality=16.08M cost=94921044
| in pipelines: 01(GETNEXT)
|
03:HASH JOIN [INNER JOIN, BROADCAST]
@@ -722,26 +729,26 @@ max-parallelism=130 segment-costs=[1214116450, 331401897] cpu-comparison-result=
| hash predicates: tpcds_partitioned_parquet_snap.store_returns.sr_returned_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_returns.sr_returned_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=2,4 row-size=321B cardinality=160.81M cost=70387524
+| tuple-ids=2,4 row-size=24B cardinality=16.08M cost=7038752
| in pipelines: 01(GETNEXT), 02(OPEN)
|
|--F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=24.42MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | Per-Instance Resources: mem-estimate=4.89MB mem-reservation=4.88MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[863]
| JOIN BUILD
| | join-table-id=04 plan-id=05 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| | mem-estimate=3.88MB mem-reservation=3.88MB spill-buffer=64.00KB thread-reservation=0 cost=373
| |
| 15:EXCHANGE [BROADCAST]
-| | mem-estimate=174.22KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=237B cardinality=373 cost=490
+| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=4 row-size=8B cardinality=373 cost=490
| | in pipelines: 02(GETNEXT)
| |
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[112899]
+| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[10483]
| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| HDFS partitions=1/1 files=1 size=2.17MB
| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT)
@@ -751,19 +758,21 @@ max-parallelism=130 segment-costs=[1214116450, 331401897] cpu-comparison-result=
| extrapolated-rows=disabled max-scan-range-rows=73.05K
| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT)
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=4 row-size=237B cardinality=373 cost=112653
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=4 row-size=8B cardinality=373 cost=10467
| in pipelines: 02(GETNEXT)
|
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_returns, RANDOM]
HDFS partitions=2004/2004 files=2004 size=48.14GB
+ predicates: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)
runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_returns.sr_store_sk, RF006[bloom] -> [...]
stored statistics:
table: rows=863.99M size=48.14GB
partitions: 2004/2004 rows=863.99M
columns: all
extrapolated-rows=disabled max-scan-range-rows=30.09M est-scan-range=373(filtered from 2004)
+ parquet dictionary predicates: is_not_null_pred(tpcds_partitioned_parquet_snap.store_returns.sr_store_sk)
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=2 row-size=84B cardinality=160.81M(filtered from 863.99M) cost=194518504
+ tuple-ids=2 row-size=16B cardinality=16.08M(filtered from 86.40M) cost=41569968
in pipelines: 01(GETNEXT)
====
diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q02.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q02.test
index bb6e7a7af..287161b3a 100644
--- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q02.test
+++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q02.test
@@ -60,81 +60,102 @@ with wscs as
# end query 2 in stream 0 using template query2.tpl
---- PLAN
-Max Per-Host Resource Reservation: Memory=92.88MB Threads=1
-Per-Host Resource Estimates: Memory=171MB
+Max Per-Host Resource Reservation: Memory=24.62MB Threads=1
+Per-Host Resource Estimates: Memory=112MB
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=170.88MB mem-reservation=92.88MB thread-reservation=1 runtime-filters-memory=3.00MB
-| max-parallelism=1 segment-costs=[8530932679, 8530932679, 262550, 20480]
+| Per-Instance Resources: mem-estimate=112.38MB mem-reservation=24.62MB thread-reservation=1 runtime-filters-memory=3.00MB
+| max-parallelism=1 segment-costs=[8530838007, 8530838007, 61716, 20480]
PLAN-ROOT SINK
-| output exprs: tpcds_partitioned_parquet_snap.date_dim.d_week_seq, round(divide(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END)), CAST(2 AS TINYINT)), round(divide(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.d [...]
+| output exprs: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq, round(divide(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END)), CAST(2 AS TINYINT)), round(divide(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_sn [...]
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=20480
|
17:SORT
-| order by: tpcds_partitioned_parquet_snap.date_dim.d_week_seq ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq ASC NULLS LAST
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
| tuple-ids=20 row-size=228B cardinality=2.56K cost=26432
| in pipelines: 17(GETNEXT), 05(OPEN)
|
16:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_week_seq = subtract(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, 53)
+| hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_week_seq = tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| fk/pk conjuncts: none
+| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq, RF001[min_max] <- tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=7,15,16,18 row-size=248B cardinality=2.56K cost=3566
+| in pipelines: 05(GETNEXT), 15(OPEN)
+|
+|--15:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| HDFS partitions=1/1 files=1 size=2.17MB
+| predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
+| stored statistics:
+| table: rows=73.05K size=2.17MB
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=73.05K
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
+| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| tuple-ids=18 row-size=8B cardinality=373 cost=10467
+| in pipelines: 15(GETNEXT)
+|
+14:HASH JOIN [INNER JOIN]
+| hash predicates: subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53) = tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
| fk/pk conjuncts: assumed fk/pk
-| runtime filters: RF000[bloom] <- subtract(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, 53)
+| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=7,8,17,18 row-size=706B cardinality=2.56K cost=3680
-| in pipelines: 05(GETNEXT), 13(OPEN)
+| tuple-ids=7,15,16 row-size=240B cardinality=10.64K cost=7218
+| in pipelines: 05(GETNEXT), 11(OPEN)
|
-|--15:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq = tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+|--13:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq = tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
| | fk/pk conjuncts: none
-| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq, RF007[min_max] <- tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, RF007[min_max] <- tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=17,18 row-size=353B cardinality=2.56K cost=3566
-| | in pipelines: 13(GETNEXT), 14(OPEN)
+| | tuple-ids=15,16 row-size=124B cardinality=2.56K cost=3566
+| | in pipelines: 11(GETNEXT), 12(OPEN)
| |
-| |--14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| |--12:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=18 row-size=237B cardinality=373 cost=112653
-| | in pipelines: 14(GETNEXT)
-| |
-| 13:AGGREGATE [FINALIZE]
-| | output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitione [...]
-| | group by: tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
+| | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| | tuple-ids=16 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 12(GETNEXT)
+| |
+| 11:AGGREGATE [FINALIZE]
+| | output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitione [...]
+| | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
| | mem-estimate=10.00MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
-| | tuple-ids=17 row-size=116B cardinality=10.64K cost=4617060482
-| | in pipelines: 13(GETNEXT), 09(OPEN), 10(OPEN)
+| | tuple-ids=15 row-size=116B cardinality=10.64K cost=4617060482
+| | in pipelines: 11(GETNEXT), 07(OPEN), 08(OPEN)
| |
-| 12:HASH JOIN [INNER JOIN]
-| | hash predicates: SOLD_DATE_SK = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| 10:HASH JOIN [INNER JOIN]
+| | hash predicates: SOLD_DATE_SK = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | fk/pk conjuncts: assumed fk/pk
-| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=14,15 row-size=245B cardinality=6.48G cost=2836389159
-| | in pipelines: 09(GETNEXT), 10(GETNEXT), 11(OPEN)
+| | mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
+| | tuple-ids=12,13 row-size=35B cardinality=6.48G cost=2836389159
+| | in pipelines: 07(GETNEXT), 08(GETNEXT), 09(OPEN)
| |
-| |--11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, RF006[bloom] -> tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
+| | runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq, RF006[bloom] -> tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=15 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 11(GETNEXT)
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=13 row-size=27B cardinality=73.05K cost=15928
+| | in pipelines: 09(GETNEXT)
| |
-| 08:UNION
+| 06:UNION
| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=14 row-size=8B cardinality=6.48G cost=330871146
-| | in pipelines: 09(GETNEXT), 10(GETNEXT)
+| | tuple-ids=12 row-size=8B cardinality=6.48G cost=330871146
+| | in pipelines: 07(GETNEXT), 08(GETNEXT)
| |
-| |--10:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
+| |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
| | HDFS partitions=1831/1831 files=1831 size=280.96GB
| | stored statistics:
| | table: rows=4.32G size=280.96GB
@@ -142,10 +163,10 @@ PLAN-ROOT SINK
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=21.52M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=12 row-size=8B cardinality=4.32G cost=497672983
-| | in pipelines: 10(GETNEXT)
+| | tuple-ids=10 row-size=8B cardinality=4.32G cost=497672983
+| | in pipelines: 08(GETNEXT)
| |
-| 09:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
+| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
| HDFS partitions=1824/1824 files=1824 size=145.75GB
| stored statistics:
| table: rows=2.16G size=145.75GB
@@ -153,30 +174,8 @@ PLAN-ROOT SINK
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.37M
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=10 row-size=8B cardinality=2.16G cost=248828309
-| in pipelines: 09(GETNEXT)
-|
-07:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_week_seq = tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
-| fk/pk conjuncts: none
-| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq, RF003[min_max] <- tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
-| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=7,8 row-size=353B cardinality=2.56K cost=3566
-| in pipelines: 05(GETNEXT), 06(OPEN)
-|
-|--06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT)
-| runtime filters: RF000[bloom] -> tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
-| stored statistics:
-| table: rows=73.05K size=2.17MB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT)
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=8 row-size=237B cardinality=373 cost=112653
-| in pipelines: 06(GETNEXT)
+| tuple-ids=8 row-size=8B cardinality=2.16G cost=248828309
+| in pipelines: 07(GETNEXT)
|
05:AGGREGATE [FINALIZE]
| output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_s [...]
@@ -188,19 +187,19 @@ PLAN-ROOT SINK
04:HASH JOIN [INNER JOIN]
| hash predicates: SOLD_DATE_SK = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| fk/pk conjuncts: assumed fk/pk
-| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=4,5 row-size=245B cardinality=6.48G cost=2836389159
+| mem-estimate=4.75MB mem-reservation=4.75MB spill-buffer=256.00KB thread-reservation=0
+| tuple-ids=4,5 row-size=35B cardinality=6.48G cost=2836389159
| in pipelines: 01(GETNEXT), 02(GETNEXT), 03(OPEN)
|
|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| HDFS partitions=1/1 files=1 size=2.17MB
-| runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF000[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF002[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq
+| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF000[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF002[bloom] -> subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53)
| stored statistics:
| table: rows=73.05K size=2.17MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=5 row-size=237B cardinality=73.05K cost=110600
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=5 row-size=27B cardinality=73.05K cost=15928
| in pipelines: 03(GETNEXT)
|
00:UNION
@@ -230,157 +229,195 @@ PLAN-ROOT SINK
tuple-ids=0 row-size=8B cardinality=2.16G cost=248828309
in pipelines: 01(GETNEXT)
---- DISTRIBUTEDPLAN
-Max Per-Host Resource Reservation: Memory=954.69MB Threads=37
-Per-Host Resource Estimates: Memory=1.72GB
+Max Per-Host Resource Reservation: Memory=237.19MB Threads=37
+Per-Host Resource Estimates: Memory=1014MB
F13:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=6.32MB mem-reservation=4.00MB thread-reservation=1
| max-parallelism=1 segment-costs=[22294] cpu-comparison-result=262 [max(1 (self) vs 262 (sum children))]
PLAN-ROOT SINK
-| output exprs: tpcds_partitioned_parquet_snap.date_dim.d_week_seq, round(divide(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END)), CAST(2 AS TINYINT)), round(divide(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.d [...]
+| output exprs: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq, round(divide(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END)), CAST(2 AS TINYINT)), round(divide(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_sn [...]
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=20480
|
28:MERGING-EXCHANGE [UNPARTITIONED]
-| order by: tpcds_partitioned_parquet_snap.date_dim.d_week_seq ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq ASC NULLS LAST
| mem-estimate=2.32MB mem-reservation=0B thread-reservation=0
| tuple-ids=20 row-size=228B cardinality=2.56K cost=1814
| in pipelines: 17(GETNEXT)
|
-F12:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
-Per-Instance Resources: mem-estimate=9.61MB mem-reservation=6.00MB thread-reservation=1
-max-parallelism=10 segment-costs=[32089, 16097] cpu-comparison-result=262 [max(10 (self) vs 262 (sum children))]
+F11:PLAN FRAGMENT [HASH(subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53))] hosts=10 instances=10 (adjusted from 120)
+Per-Instance Resources: mem-estimate=7.29MB mem-reservation=6.00MB thread-reservation=1
+max-parallelism=10 segment-costs=[41143, 16097] cpu-comparison-result=262 [max(10 (self) vs 262 (sum children))]
17:SORT
-| order by: tpcds_partitioned_parquet_snap.date_dim.d_week_seq ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq ASC NULLS LAST
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
| tuple-ids=20 row-size=228B cardinality=2.56K cost=26432
| in pipelines: 17(GETNEXT), 20(OPEN)
|
-16:HASH JOIN [INNER JOIN, PARTITIONED]
+16:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=00
-| hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_week_seq = subtract(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, 53)
-| fk/pk conjuncts: assumed fk/pk
+| hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_week_seq = tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| fk/pk conjuncts: none
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=7,8,17,18 row-size=706B cardinality=2.56K cost=1120
-| in pipelines: 20(GETNEXT), 24(OPEN)
+| tuple-ids=7,15,16,18 row-size=248B cardinality=2.56K cost=3193
+| in pipelines: 20(GETNEXT), 15(OPEN)
|
-|--F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=6.55MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[7097] cpu-comparison-result=131 [max(10 (self) vs 131 (sum children))]
+|--F14:PLAN FRAGMENT [HASH(subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53))] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | max-parallelism=10 segment-costs=[863]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
-| | build expressions: subtract(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, 53)
-| | runtime filters: RF000[bloom] <- subtract(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, 53)
+| | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq, RF001[min_max] <- tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| |
+| 27:EXCHANGE [BROADCAST]
+| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=18 row-size=8B cardinality=373 cost=490
+| | in pipelines: 15(GETNEXT)
+| |
+| F12:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=256.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[10483]
+| 15:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| HDFS partitions=1/1 files=1 size=2.17MB
+| predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
+| stored statistics:
+| table: rows=73.05K size=2.17MB
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=73.05K
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
+| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| tuple-ids=18 row-size=8B cardinality=373 cost=10467
+| in pipelines: 15(GETNEXT)
+|
+14:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=01
+| hash predicates: subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53) = tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
+| fk/pk conjuncts: assumed fk/pk
+| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=7,15,16 row-size=240B cardinality=10.64K cost=4658
+| in pipelines: 20(GETNEXT), 23(OPEN)
+|
+|--F15:PLAN FRAGMENT [HASH(subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53))] hosts=10 instances=10 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=4.26MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | max-parallelism=10 segment-costs=[4398] cpu-comparison-result=131 [max(10 (self) vs 131 (sum children))]
+| JOIN BUILD
+| | join-table-id=01 plan-id=02 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
+| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=2560
| |
-| 27:EXCHANGE [HASH(subtract(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, 53))]
-| | mem-estimate=3.61MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=17,18 row-size=353B cardinality=2.56K cost=4537
-| | in pipelines: 24(GETNEXT)
+| 26:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq)]
+| | mem-estimate=1.32MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=15,16 row-size=124B cardinality=2.56K cost=1838
+| | in pipelines: 23(GETNEXT)
| |
-| F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
+| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
| Per-Instance Resources: mem-estimate=34.06MB mem-reservation=1.94MB thread-reservation=1
-| max-parallelism=10 segment-costs=[1760943, 64051] cpu-comparison-result=131 [max(10 (self) vs 131 (sum children))]
-| 15:HASH JOIN [INNER JOIN, PARTITIONED]
-| | hash-table-id=01
-| | hash predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq = tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| max-parallelism=10 segment-costs=[1760943, 26273] cpu-comparison-result=131 [max(10 (self) vs 131 (sum children))]
+| 13:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=02
+| | hash predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq = tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
| | fk/pk conjuncts: none
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=17,18 row-size=353B cardinality=2.56K cost=3193
-| | in pipelines: 24(GETNEXT), 14(OPEN)
+| | tuple-ids=15,16 row-size=124B cardinality=2.56K cost=3193
+| | in pipelines: 23(GETNEXT), 12(OPEN)
| |
-| |--F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
-| | | Per-Instance Resources: mem-estimate=3.11MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | | max-parallelism=10 segment-costs=[821]
+| |--F16:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
+| | | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[428]
| | JOIN BUILD
-| | | join-table-id=01 plan-id=02 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
-| | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq, RF007[min_max] <- tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| | | join-table-id=02 plan-id=03 cohort-id=02
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
+| | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, RF007[min_max] <- tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
-| | 25:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq)]
-| | | mem-estimate=174.22KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=18 row-size=237B cardinality=373 cost=448
-| | | in pipelines: 14(GETNEXT)
+| | 24:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq)]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=16 row-size=8B cardinality=373 cost=55
+| | | in pipelines: 12(GETNEXT)
| | |
-| | F11:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=25.42MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[118541]
-| | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | F10:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.47MB mem-reservation=256.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10851]
+| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=18 row-size=237B cardinality=373 cost=112653
-| | in pipelines: 14(GETNEXT)
-| |
-| 24:AGGREGATE [FINALIZE]
-| | output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum:me [...]
-| | group by: tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
+| | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| | tuple-ids=16 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 12(GETNEXT)
+| |
+| 23:AGGREGATE [FINALIZE]
+| | output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum:me [...]
+| | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=17 row-size=116B cardinality=10.64K cost=937636
-| | in pipelines: 24(GETNEXT), 09(OPEN), 10(OPEN)
+| | tuple-ids=15 row-size=116B cardinality=10.64K cost=937636
+| | in pipelines: 23(GETNEXT), 07(OPEN), 08(OPEN)
| |
-| 23:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq)]
+| 22:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq)]
| | mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=17 row-size=116B cardinality=1.28M cost=823307
-| | in pipelines: 09(GETNEXT), 10(GETNEXT)
+| | tuple-ids=15 row-size=116B cardinality=1.28M cost=823307
+| | in pipelines: 07(GETNEXT), 08(GETNEXT)
| |
-| F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
| Per-Instance Resources: mem-estimate=30.69MB mem-reservation=4.00MB thread-reservation=1
| max-parallelism=120 segment-costs=[8534050783, 10197930] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
-| 13:AGGREGATE [STREAMING]
-| | output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitione [...]
-| | group by: tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
+| 11:AGGREGATE [STREAMING]
+| | output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitione [...]
+| | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
| | mem-estimate=10.00MB mem-reservation=3.00MB spill-buffer=128.00KB thread-reservation=0
-| | tuple-ids=17 row-size=116B cardinality=1.28M cost=4620362235
-| | in pipelines: 09(GETNEXT), 10(GETNEXT)
+| | tuple-ids=15 row-size=116B cardinality=1.28M cost=4620362235
+| | in pipelines: 07(GETNEXT), 08(GETNEXT)
| |
-| 12:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=02
-| | hash predicates: SOLD_DATE_SK = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| 10:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=03
+| | hash predicates: SOLD_DATE_SK = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | fk/pk conjuncts: assumed fk/pk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=14,15 row-size=245B cardinality=6.48G cost=2836316110
-| | in pipelines: 09(GETNEXT), 10(GETNEXT), 11(OPEN)
+| | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
+| | tuple-ids=12,13 row-size=35B cardinality=6.48G cost=2836316110
+| | in pipelines: 07(GETNEXT), 08(GETNEXT), 09(OPEN)
| |
-| |--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
+| |--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=58.92MB mem-reservation=57.00MB thread-reservation=1
| | | max-parallelism=10 segment-costs=[170129]
| | JOIN BUILD
-| | | join-table-id=02 plan-id=03 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
+| | | join-table-id=03 plan-id=04 cohort-id=02
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
| | |
-| | 22:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=15 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 11(GETNEXT)
+| | 21:EXCHANGE [BROADCAST]
+| | | mem-estimate=1.92MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=13 row-size=27B cardinality=73.05K cost=97080
+| | | in pipelines: 09(GETNEXT)
| | |
-| | F09:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | F08:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | Per-Instance Resources: mem-estimate=16.12MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[22859]
+| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, RF006[bloom] -> tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
+| | runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq, RF006[bloom] -> tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=15 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 11(GETNEXT)
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=13 row-size=27B cardinality=73.05K cost=15928
+| | in pipelines: 09(GETNEXT)
| |
-| 08:UNION
+| 06:UNION
| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=14 row-size=8B cardinality=6.48G cost=330871146
-| | in pipelines: 09(GETNEXT), 10(GETNEXT)
+| | tuple-ids=12 row-size=8B cardinality=6.48G cost=330871146
+| | in pipelines: 07(GETNEXT), 08(GETNEXT)
| |
-| |--10:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
+| |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
| | HDFS partitions=1831/1831 files=1831 size=280.96GB
| | stored statistics:
| | table: rows=4.32G size=280.96GB
@@ -388,10 +425,10 @@ max-parallelism=10 segment-costs=[32089, 16097] cpu-comparison-result=262 [max(1
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=21.52M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=12 row-size=8B cardinality=4.32G cost=497672983
-| | in pipelines: 10(GETNEXT)
+| | tuple-ids=10 row-size=8B cardinality=4.32G cost=497672983
+| | in pipelines: 08(GETNEXT)
| |
-| 09:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
| HDFS partitions=1824/1824 files=1824 size=145.75GB
| stored statistics:
| table: rows=2.16G size=145.75GB
@@ -399,57 +436,17 @@ max-parallelism=10 segment-costs=[32089, 16097] cpu-comparison-result=262 [max(1
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.37M
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=10 row-size=8B cardinality=2.16G cost=248828309
-| in pipelines: 09(GETNEXT)
+| tuple-ids=8 row-size=8B cardinality=2.16G cost=248828309
+| in pipelines: 07(GETNEXT)
|
-26:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim.d_week_seq)]
-| mem-estimate=3.61MB mem-reservation=0B thread-reservation=0
-| tuple-ids=7,8 row-size=353B cardinality=2.56K cost=4537
+25:EXCHANGE [HASH(subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53))]
+| mem-estimate=1.29MB mem-reservation=0B thread-reservation=0
+| tuple-ids=7 row-size=116B cardinality=10.64K cost=6860
| in pipelines: 20(GETNEXT)
|
F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
Per-Instance Resources: mem-estimate=34.06MB mem-reservation=1.94MB thread-reservation=1
-max-parallelism=10 segment-costs=[1760943, 64051] cpu-comparison-result=131 [max(10 (self) vs 131 (sum children))]
-07:HASH JOIN [INNER JOIN, PARTITIONED]
-| hash-table-id=03
-| hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_week_seq = tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
-| fk/pk conjuncts: none
-| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=7,8 row-size=353B cardinality=2.56K cost=3193
-| in pipelines: 20(GETNEXT), 06(OPEN)
-|
-|--F17:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=3.11MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[821]
-| JOIN BUILD
-| | join-table-id=03 plan-id=04 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
-| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq, RF003[min_max] <- tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
-| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=373
-| |
-| 21:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq)]
-| | mem-estimate=174.22KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=8 row-size=237B cardinality=373 cost=448
-| | in pipelines: 06(GETNEXT)
-| |
-| F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| Per-Instance Resources: mem-estimate=25.42MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[118541]
-| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT)
-| runtime filters: RF000[bloom] -> tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
-| stored statistics:
-| table: rows=73.05K size=2.17MB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT)
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=8 row-size=237B cardinality=373 cost=112653
-| in pipelines: 06(GETNEXT)
-|
+max-parallelism=10 segment-costs=[1760943, 84982] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
20:AGGREGATE [FINALIZE]
| output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WH [...]
| group by: tpcds_partitioned_parquet_snap.date_dim.d_week_seq
@@ -476,36 +473,36 @@ max-parallelism=120 segment-costs=[8534050783, 10197930] cpu-comparison-result=1
| hash-table-id=04
| hash predicates: SOLD_DATE_SK = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| fk/pk conjuncts: assumed fk/pk
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=4,5 row-size=245B cardinality=6.48G cost=2836316110
+| mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
+| tuple-ids=4,5 row-size=35B cardinality=6.48G cost=2836316110
| in pipelines: 01(GETNEXT), 02(GETNEXT), 03(OPEN)
|
|--F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
+| | Per-Instance Resources: mem-estimate=58.92MB mem-reservation=57.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[170129]
| JOIN BUILD
| | join-table-id=04 plan-id=05 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
+| | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
| |
| 18:EXCHANGE [BROADCAST]
-| | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=5 row-size=237B cardinality=73.05K cost=97080
+| | mem-estimate=1.92MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=5 row-size=27B cardinality=73.05K cost=97080
| | in pipelines: 03(GETNEXT)
| |
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
-| Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[158950]
+| Per-Instance Resources: mem-estimate=16.12MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[22859]
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| HDFS partitions=1/1 files=1 size=2.17MB
-| runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF000[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF002[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq
+| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF000[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF002[bloom] -> subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53)
| stored statistics:
| table: rows=73.05K size=2.17MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=5 row-size=237B cardinality=73.05K cost=110600
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=5 row-size=27B cardinality=73.05K cost=15928
| in pipelines: 03(GETNEXT)
|
00:UNION
@@ -535,157 +532,195 @@ max-parallelism=120 segment-costs=[8534050783, 10197930] cpu-comparison-result=1
tuple-ids=0 row-size=8B cardinality=2.16G cost=248828309
in pipelines: 01(GETNEXT)
---- PARALLELPLANS
-Max Per-Host Resource Reservation: Memory=954.69MB Threads=37
-Per-Host Resource Estimates: Memory=1.72GB
+Max Per-Host Resource Reservation: Memory=237.19MB Threads=37
+Per-Host Resource Estimates: Memory=1014MB
F13:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=6.32MB mem-reservation=4.00MB thread-reservation=1
| max-parallelism=1 segment-costs=[22294] cpu-comparison-result=262 [max(1 (self) vs 262 (sum children))]
PLAN-ROOT SINK
-| output exprs: tpcds_partitioned_parquet_snap.date_dim.d_week_seq, round(divide(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END)), CAST(2 AS TINYINT)), round(divide(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.d [...]
+| output exprs: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq, round(divide(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END)), CAST(2 AS TINYINT)), round(divide(sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_sn [...]
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=20480
|
28:MERGING-EXCHANGE [UNPARTITIONED]
-| order by: tpcds_partitioned_parquet_snap.date_dim.d_week_seq ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq ASC NULLS LAST
| mem-estimate=2.32MB mem-reservation=0B thread-reservation=0
| tuple-ids=20 row-size=228B cardinality=2.56K cost=1814
| in pipelines: 17(GETNEXT)
|
-F12:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
-Per-Instance Resources: mem-estimate=9.61MB mem-reservation=6.00MB thread-reservation=1
-max-parallelism=10 segment-costs=[32089, 16097] cpu-comparison-result=262 [max(10 (self) vs 262 (sum children))]
+F11:PLAN FRAGMENT [HASH(subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53))] hosts=10 instances=10 (adjusted from 120)
+Per-Instance Resources: mem-estimate=7.29MB mem-reservation=6.00MB thread-reservation=1
+max-parallelism=10 segment-costs=[41143, 16097] cpu-comparison-result=262 [max(10 (self) vs 262 (sum children))]
17:SORT
-| order by: tpcds_partitioned_parquet_snap.date_dim.d_week_seq ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq ASC NULLS LAST
| mem-estimate=6.00MB mem-reservation=6.00MB spill-buffer=2.00MB thread-reservation=0
| tuple-ids=20 row-size=228B cardinality=2.56K cost=26432
| in pipelines: 17(GETNEXT), 20(OPEN)
|
-16:HASH JOIN [INNER JOIN, PARTITIONED]
+16:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=00
-| hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_week_seq = subtract(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, 53)
-| fk/pk conjuncts: assumed fk/pk
+| hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_week_seq = tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| fk/pk conjuncts: none
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=7,8,17,18 row-size=706B cardinality=2.56K cost=1120
-| in pipelines: 20(GETNEXT), 24(OPEN)
+| tuple-ids=7,15,16,18 row-size=248B cardinality=2.56K cost=3193
+| in pipelines: 20(GETNEXT), 15(OPEN)
|
-|--F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=6.55MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[7097] cpu-comparison-result=131 [max(10 (self) vs 131 (sum children))]
+|--F14:PLAN FRAGMENT [HASH(subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53))] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | max-parallelism=10 segment-costs=[863]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
-| | build expressions: subtract(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, 53)
-| | runtime filters: RF000[bloom] <- subtract(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, 53)
+| | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq, RF001[min_max] <- tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| |
+| 27:EXCHANGE [BROADCAST]
+| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=18 row-size=8B cardinality=373 cost=490
+| | in pipelines: 15(GETNEXT)
+| |
+| F12:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=256.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[10483]
+| 15:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| HDFS partitions=1/1 files=1 size=2.17MB
+| predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
+| stored statistics:
+| table: rows=73.05K size=2.17MB
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=73.05K
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
+| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| tuple-ids=18 row-size=8B cardinality=373 cost=10467
+| in pipelines: 15(GETNEXT)
+|
+14:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=01
+| hash predicates: subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53) = tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
+| fk/pk conjuncts: assumed fk/pk
+| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=7,15,16 row-size=240B cardinality=10.64K cost=4658
+| in pipelines: 20(GETNEXT), 23(OPEN)
+|
+|--F15:PLAN FRAGMENT [HASH(subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53))] hosts=10 instances=10 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=4.26MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | max-parallelism=10 segment-costs=[4398] cpu-comparison-result=131 [max(10 (self) vs 131 (sum children))]
+| JOIN BUILD
+| | join-table-id=01 plan-id=02 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
+| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=2560
| |
-| 27:EXCHANGE [HASH(subtract(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, 53))]
-| | mem-estimate=3.61MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=17,18 row-size=353B cardinality=2.56K cost=4537
-| | in pipelines: 24(GETNEXT)
+| 26:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq)]
+| | mem-estimate=1.32MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=15,16 row-size=124B cardinality=2.56K cost=1838
+| | in pipelines: 23(GETNEXT)
| |
-| F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
+| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
| Per-Instance Resources: mem-estimate=34.06MB mem-reservation=1.94MB thread-reservation=1
-| max-parallelism=10 segment-costs=[1760943, 64051] cpu-comparison-result=131 [max(10 (self) vs 131 (sum children))]
-| 15:HASH JOIN [INNER JOIN, PARTITIONED]
-| | hash-table-id=01
-| | hash predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq = tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| max-parallelism=10 segment-costs=[1760943, 26273] cpu-comparison-result=131 [max(10 (self) vs 131 (sum children))]
+| 13:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=02
+| | hash predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq = tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
| | fk/pk conjuncts: none
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=17,18 row-size=353B cardinality=2.56K cost=3193
-| | in pipelines: 24(GETNEXT), 14(OPEN)
+| | tuple-ids=15,16 row-size=124B cardinality=2.56K cost=3193
+| | in pipelines: 23(GETNEXT), 12(OPEN)
| |
-| |--F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
-| | | Per-Instance Resources: mem-estimate=3.11MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | | max-parallelism=10 segment-costs=[821]
+| |--F16:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
+| | | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[428]
| | JOIN BUILD
-| | | join-table-id=01 plan-id=02 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
-| | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq, RF007[min_max] <- tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq
+| | | join-table-id=02 plan-id=03 cohort-id=02
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
+| | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, RF007[min_max] <- tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
-| | 25:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_2.d_week_seq)]
-| | | mem-estimate=174.22KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=18 row-size=237B cardinality=373 cost=448
-| | | in pipelines: 14(GETNEXT)
+| | 24:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq)]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=16 row-size=8B cardinality=373 cost=55
+| | | in pipelines: 12(GETNEXT)
| | |
-| | F11:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=25.42MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[118541]
-| | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | F10:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.47MB mem-reservation=256.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10851]
+| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1998 AS INT), CAST(1 AS INT))
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=18 row-size=237B cardinality=373 cost=112653
-| | in pipelines: 14(GETNEXT)
-| |
-| 24:AGGREGATE [FINALIZE]
-| | output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum:me [...]
-| | group by: tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
+| | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| | tuple-ids=16 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 12(GETNEXT)
+| |
+| 23:AGGREGATE [FINALIZE]
+| | output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum:me [...]
+| | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
| | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=17 row-size=116B cardinality=10.64K cost=937636
-| | in pipelines: 24(GETNEXT), 09(OPEN), 10(OPEN)
+| | tuple-ids=15 row-size=116B cardinality=10.64K cost=937636
+| | in pipelines: 23(GETNEXT), 07(OPEN), 08(OPEN)
| |
-| 23:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq)]
+| 22:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq)]
| | mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=17 row-size=116B cardinality=1.28M cost=823307
-| | in pipelines: 09(GETNEXT), 10(GETNEXT)
+| | tuple-ids=15 row-size=116B cardinality=1.28M cost=823307
+| | in pipelines: 07(GETNEXT), 08(GETNEXT)
| |
-| F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
| Per-Instance Resources: mem-estimate=30.69MB mem-reservation=4.00MB thread-reservation=1
| max-parallelism=120 segment-costs=[8534050783, 10197930] cpu-comparison-result=120 [max(120 (self) vs 11 (sum children))]
-| 13:AGGREGATE [STREAMING]
-| | output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_1.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitione [...]
-| | group by: tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
+| 11:AGGREGATE [STREAMING]
+| | output: sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitioned_parquet_snap.date_dim_0.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum(CASE WHEN tpcds_partitione [...]
+| | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
| | mem-estimate=10.00MB mem-reservation=3.00MB spill-buffer=128.00KB thread-reservation=0
-| | tuple-ids=17 row-size=116B cardinality=1.28M cost=4620362235
-| | in pipelines: 09(GETNEXT), 10(GETNEXT)
+| | tuple-ids=15 row-size=116B cardinality=1.28M cost=4620362235
+| | in pipelines: 07(GETNEXT), 08(GETNEXT)
| |
-| 12:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=02
-| | hash predicates: SOLD_DATE_SK = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| 10:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=03
+| | hash predicates: SOLD_DATE_SK = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | fk/pk conjuncts: assumed fk/pk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=14,15 row-size=245B cardinality=6.48G cost=2836316110
-| | in pipelines: 09(GETNEXT), 10(GETNEXT), 11(OPEN)
+| | mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
+| | tuple-ids=12,13 row-size=35B cardinality=6.48G cost=2836316110
+| | in pipelines: 07(GETNEXT), 08(GETNEXT), 09(OPEN)
| |
-| |--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
+| |--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=58.92MB mem-reservation=57.00MB thread-reservation=1
| | | max-parallelism=10 segment-costs=[170129]
| | JOIN BUILD
-| | | join-table-id=02 plan-id=03 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
+| | | join-table-id=03 plan-id=04 cohort-id=02
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
| | |
-| | 22:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=15 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 11(GETNEXT)
+| | 21:EXCHANGE [BROADCAST]
+| | | mem-estimate=1.92MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=13 row-size=27B cardinality=73.05K cost=97080
+| | | in pipelines: 09(GETNEXT)
| | |
-| | F09:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | F08:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | Per-Instance Resources: mem-estimate=16.12MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[22859]
+| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq, RF006[bloom] -> tpcds_partitioned_parquet_snap.date_dim_1.d_week_seq
+| | runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq, RF006[bloom] -> tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=15 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 11(GETNEXT)
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=13 row-size=27B cardinality=73.05K cost=15928
+| | in pipelines: 09(GETNEXT)
| |
-| 08:UNION
+| 06:UNION
| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=14 row-size=8B cardinality=6.48G cost=330871146
-| | in pipelines: 09(GETNEXT), 10(GETNEXT)
+| | tuple-ids=12 row-size=8B cardinality=6.48G cost=330871146
+| | in pipelines: 07(GETNEXT), 08(GETNEXT)
| |
-| |--10:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
+| |--08:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
| | HDFS partitions=1831/1831 files=1831 size=280.96GB
| | stored statistics:
| | table: rows=4.32G size=280.96GB
@@ -693,10 +728,10 @@ max-parallelism=10 segment-costs=[32089, 16097] cpu-comparison-result=262 [max(1
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=21.52M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=12 row-size=8B cardinality=4.32G cost=497672983
-| | in pipelines: 10(GETNEXT)
+| | tuple-ids=10 row-size=8B cardinality=4.32G cost=497672983
+| | in pipelines: 08(GETNEXT)
| |
-| 09:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
| HDFS partitions=1824/1824 files=1824 size=145.75GB
| stored statistics:
| table: rows=2.16G size=145.75GB
@@ -704,57 +739,17 @@ max-parallelism=10 segment-costs=[32089, 16097] cpu-comparison-result=262 [max(1
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.37M
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=10 row-size=8B cardinality=2.16G cost=248828309
-| in pipelines: 09(GETNEXT)
+| tuple-ids=8 row-size=8B cardinality=2.16G cost=248828309
+| in pipelines: 07(GETNEXT)
|
-26:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim.d_week_seq)]
-| mem-estimate=3.61MB mem-reservation=0B thread-reservation=0
-| tuple-ids=7,8 row-size=353B cardinality=2.56K cost=4537
+25:EXCHANGE [HASH(subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53))]
+| mem-estimate=1.29MB mem-reservation=0B thread-reservation=0
+| tuple-ids=7 row-size=116B cardinality=10.64K cost=6860
| in pipelines: 20(GETNEXT)
|
F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
Per-Instance Resources: mem-estimate=34.06MB mem-reservation=1.94MB thread-reservation=1
-max-parallelism=10 segment-costs=[1760943, 64051] cpu-comparison-result=131 [max(10 (self) vs 131 (sum children))]
-07:HASH JOIN [INNER JOIN, PARTITIONED]
-| hash-table-id=03
-| hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_week_seq = tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
-| fk/pk conjuncts: none
-| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=7,8 row-size=353B cardinality=2.56K cost=3193
-| in pipelines: 20(GETNEXT), 06(OPEN)
-|
-|--F17:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim.d_week_seq)] hosts=10 instances=10 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=3.11MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[821]
-| JOIN BUILD
-| | join-table-id=03 plan-id=04 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
-| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq, RF003[min_max] <- tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
-| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=373
-| |
-| 21:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq)]
-| | mem-estimate=174.22KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=8 row-size=237B cardinality=373 cost=448
-| | in pipelines: 06(GETNEXT)
-| |
-| F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| Per-Instance Resources: mem-estimate=25.42MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[118541]
-| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT)
-| runtime filters: RF000[bloom] -> tpcds_partitioned_parquet_snap.date_dim_0.d_week_seq
-| stored statistics:
-| table: rows=73.05K size=2.17MB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1998 AS INT)
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=8 row-size=237B cardinality=373 cost=112653
-| in pipelines: 06(GETNEXT)
-|
+max-parallelism=10 segment-costs=[1760943, 84982] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
20:AGGREGATE [FINALIZE]
| output: sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Sunday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Monday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Tuesday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WHEN tpcds_partitioned_parquet_snap.date_dim.d_day_name = 'Wednesday' THEN SALES_PRICE ELSE NULL END), sum:merge(CASE WH [...]
| group by: tpcds_partitioned_parquet_snap.date_dim.d_week_seq
@@ -781,36 +776,36 @@ max-parallelism=120 segment-costs=[8534050783, 10197930] cpu-comparison-result=1
| hash-table-id=04
| hash predicates: SOLD_DATE_SK = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| fk/pk conjuncts: assumed fk/pk
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=4,5 row-size=245B cardinality=6.48G cost=2836316110
+| mem-estimate=0B mem-reservation=0B spill-buffer=256.00KB thread-reservation=0
+| tuple-ids=4,5 row-size=35B cardinality=6.48G cost=2836316110
| in pipelines: 01(GETNEXT), 02(GETNEXT), 03(OPEN)
|
|--F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
+| | Per-Instance Resources: mem-estimate=58.92MB mem-reservation=57.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[170129]
| JOIN BUILD
| | join-table-id=04 plan-id=05 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
+| | mem-estimate=57.00MB mem-reservation=57.00MB spill-buffer=256.00KB thread-reservation=0 cost=73049
| |
| 18:EXCHANGE [BROADCAST]
-| | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=5 row-size=237B cardinality=73.05K cost=97080
+| | mem-estimate=1.92MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=5 row-size=27B cardinality=73.05K cost=97080
| | in pipelines: 03(GETNEXT)
| |
| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
-| Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[158950]
+| Per-Instance Resources: mem-estimate=16.12MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[22859]
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| HDFS partitions=1/1 files=1 size=2.17MB
-| runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF000[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF002[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq
+| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF000[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_week_seq, RF002[bloom] -> subtract(tpcds_partitioned_parquet_snap.date_dim.d_week_seq, 53)
| stored statistics:
| table: rows=73.05K size=2.17MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=5 row-size=237B cardinality=73.05K cost=110600
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=5 row-size=27B cardinality=73.05K cost=15928
| in pipelines: 03(GETNEXT)
|
00:UNION
diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q03.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q03.test
index b2f2a91e6..4ed582a5f 100644
--- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q03.test
+++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q03.test
@@ -21,11 +21,11 @@ select dt.d_year
# end query 3 in stream 0 using template query3.tpl
---- PLAN
-Max Per-Host Resource Reservation: Memory=48.81MB Threads=1
-Per-Host Resource Estimates: Memory=544MB
+Max Per-Host Resource Reservation: Memory=47.88MB Threads=1
+Per-Host Resource Estimates: Memory=543MB
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=544.41MB mem-reservation=48.81MB thread-reservation=1 runtime-filters-memory=2.00MB
-| max-parallelism=1 segment-costs=[12006302306, 117158429, 400]
+| Per-Instance Resources: mem-estimate=543.48MB mem-reservation=47.88MB thread-reservation=1 runtime-filters-memory=2.00MB
+| max-parallelism=1 segment-costs=[1554129087, 117158429, 400]
PLAN-ROOT SINK
| output exprs: tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.item.i_brand_id, tpcds_partitioned_parquet_snap.item.i_brand, sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
@@ -47,8 +47,8 @@ PLAN-ROOT SINK
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| mem-estimate=2.88MB mem-reservation=2.88MB spill-buffer=128.00KB thread-reservation=0
-| tuple-ids=0,2,4 row-size=739B cardinality=9.00M cost=3943388
+| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=0,2,4 row-size=64B cardinality=9.00M cost=3943388
| in pipelines: 00(GETNEXT), 03(OPEN)
|
|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
@@ -60,8 +60,8 @@ PLAN-ROOT SINK
| extrapolated-rows=disabled max-scan-range-rows=73.05K
| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT)
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=4 row-size=237B cardinality=6.09K cost=112653
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=4 row-size=12B cardinality=6.09K cost=14675
| in pipelines: 03(GETNEXT)
|
02:HASH JOIN [INNER JOIN]
@@ -69,7 +69,7 @@ PLAN-ROOT SINK
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk
| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.item.i_item_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.item.i_item_sk
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2 row-size=501B cardinality=9.00M cost=3937676
+| tuple-ids=0,2 row-size=52B cardinality=9.00M cost=3937676
| in pipelines: 00(GETNEXT), 01(OPEN)
|
|--01:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
@@ -82,7 +82,7 @@ PLAN-ROOT SINK
| parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id = CAST(816 AS INT)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id = CAST(816 AS INT)
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=2 row-size=405B cardinality=375 cost=1365725
+| tuple-ids=2 row-size=40B cardinality=375 cost=156093
| in pipelines: 01(GETNEXT)
|
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
@@ -94,11 +94,11 @@ PLAN-ROOT SINK
columns: all
extrapolated-rows=disabled max-scan-range-rows=390.22M
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
- tuple-ids=0 row-size=96B cardinality=9.00M(filtered from 8.64G) cost=11943846410
+ tuple-ids=0 row-size=12B cardinality=9.00M(filtered from 8.64G) cost=1492980801
in pipelines: 00(GETNEXT)
---- DISTRIBUTEDPLAN
-Max Per-Host Resource Reservation: Memory=294.25MB Threads=19
-Per-Host Resource Estimates: Memory=569MB
+Max Per-Host Resource Reservation: Memory=279.50MB Threads=19
+Per-Host Resource Estimates: Memory=553MB
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=4.11MB mem-reservation=4.00MB thread-reservation=1
| max-parallelism=1 segment-costs=[435] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
@@ -137,7 +137,7 @@ max-parallelism=20 segment-costs=[56254141, 117158429, 168] cpu-comparison-resul
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
Per-Instance Resources: mem-estimate=30.39MB mem-reservation=13.00MB thread-reservation=1
-max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))]
+max-parallelism=160 segment-costs=[1553951857, 34850578] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))]
05:AGGREGATE [STREAMING]
| output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)
| group by: tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.item.i_brand, tpcds_partitioned_parquet_snap.item.i_brand_id
@@ -149,27 +149,27 @@ max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result
| hash-table-id=00
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0
-| tuple-ids=0,2,4 row-size=739B cardinality=9.00M cost=3937301
+| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=0,2,4 row-size=64B cardinality=9.00M cost=3937301
| in pipelines: 00(GETNEXT), 03(OPEN)
|
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=37.11MB mem-reservation=35.50MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | Per-Instance Resources: mem-estimate=24.34MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[14167]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | mem-estimate=34.50MB mem-reservation=34.50MB spill-buffer=128.00KB thread-reservation=0 cost=6087
+| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=6087
| |
| 08:EXCHANGE [BROADCAST]
-| | mem-estimate=1.61MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=237B cardinality=6.09K cost=8080
+| | mem-estimate=87.33KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=4 row-size=12B cardinality=6.09K cost=8080
| | in pipelines: 03(GETNEXT)
| |
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[116681]
+| Per-Instance Resources: mem-estimate=16.06MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[15003]
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| HDFS partitions=1/1 files=1 size=2.17MB
| predicates: tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT)
@@ -179,8 +179,8 @@ max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result
| extrapolated-rows=disabled max-scan-range-rows=73.05K
| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT)
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=4 row-size=237B cardinality=6.09K cost=112653
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=4 row-size=12B cardinality=6.09K cost=14675
| in pipelines: 03(GETNEXT)
|
02:HASH JOIN [INNER JOIN, BROADCAST]
@@ -188,11 +188,11 @@ max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2 row-size=501B cardinality=9.00M cost=3937301
+| tuple-ids=0,2 row-size=52B cardinality=9.00M cost=3937301
| in pipelines: 00(GETNEXT), 01(OPEN)
|
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=24.98MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[865]
| JOIN BUILD
| | join-table-id=01 plan-id=02 cohort-id=01
@@ -201,13 +201,13 @@ max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=375
| |
| 07:EXCHANGE [BROADCAST]
-| | mem-estimate=748.35KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=2 row-size=405B cardinality=375 cost=490
+| | mem-estimate=79.39KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=2 row-size=40B cardinality=375 cost=490
| | in pipelines: 01(GETNEXT)
| |
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
-| Per-Instance Resources: mem-estimate=17.60MB mem-reservation=512.00KB thread-reservation=1
-| max-parallelism=4 segment-costs=[1366143]
+| Per-Instance Resources: mem-estimate=16.17MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=4 segment-costs=[156141]
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
| HDFS partitions=1/1 files=1 size=33.54MB
| predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id = CAST(816 AS INT)
@@ -218,7 +218,7 @@ max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result
| parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id = CAST(816 AS INT)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id = CAST(816 AS INT)
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=2 row-size=405B cardinality=375 cost=1365725
+| tuple-ids=2 row-size=40B cardinality=375 cost=156093
| in pipelines: 01(GETNEXT)
|
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
@@ -230,11 +230,11 @@ max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result
columns: all
extrapolated-rows=disabled max-scan-range-rows=390.22M
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
- tuple-ids=0 row-size=96B cardinality=9.00M(filtered from 8.64G) cost=11943846410
+ tuple-ids=0 row-size=12B cardinality=9.00M(filtered from 8.64G) cost=1492980801
in pipelines: 00(GETNEXT)
---- PARALLELPLANS
-Max Per-Host Resource Reservation: Memory=294.25MB Threads=19
-Per-Host Resource Estimates: Memory=569MB
+Max Per-Host Resource Reservation: Memory=279.50MB Threads=19
+Per-Host Resource Estimates: Memory=553MB
F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=4.11MB mem-reservation=4.00MB thread-reservation=1
| max-parallelism=1 segment-costs=[435] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
@@ -273,7 +273,7 @@ max-parallelism=20 segment-costs=[56254141, 117158429, 168] cpu-comparison-resul
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
Per-Host Shared Resources: mem-estimate=2.00MB mem-reservation=2.00MB thread-reservation=0 runtime-filters-memory=2.00MB
Per-Instance Resources: mem-estimate=30.39MB mem-reservation=13.00MB thread-reservation=1
-max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))]
+max-parallelism=160 segment-costs=[1553951857, 34850578] cpu-comparison-result=120 [max(120 (self) vs 25 (sum children))]
05:AGGREGATE [STREAMING]
| output: sum(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)
| group by: tpcds_partitioned_parquet_snap.date_dim.d_year, tpcds_partitioned_parquet_snap.item.i_brand, tpcds_partitioned_parquet_snap.item.i_brand_id
@@ -285,27 +285,27 @@ max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result
| hash-table-id=00
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=128.00KB thread-reservation=0
-| tuple-ids=0,2,4 row-size=739B cardinality=9.00M cost=3937301
+| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=0,2,4 row-size=64B cardinality=9.00M cost=3937301
| in pipelines: 00(GETNEXT), 03(OPEN)
|
|--F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=37.11MB mem-reservation=35.50MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | Per-Instance Resources: mem-estimate=24.34MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[14167]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | mem-estimate=34.50MB mem-reservation=34.50MB spill-buffer=128.00KB thread-reservation=0 cost=6087
+| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=6087
| |
| 08:EXCHANGE [BROADCAST]
-| | mem-estimate=1.61MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=237B cardinality=6.09K cost=8080
+| | mem-estimate=87.33KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=4 row-size=12B cardinality=6.09K cost=8080
| | in pipelines: 03(GETNEXT)
| |
| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[116681]
+| Per-Instance Resources: mem-estimate=16.06MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[15003]
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| HDFS partitions=1/1 files=1 size=2.17MB
| predicates: tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT)
@@ -315,8 +315,8 @@ max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result
| extrapolated-rows=disabled max-scan-range-rows=73.05K
| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_moy = CAST(11 AS INT)
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=4 row-size=237B cardinality=6.09K cost=112653
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=4 row-size=12B cardinality=6.09K cost=14675
| in pipelines: 03(GETNEXT)
|
02:HASH JOIN [INNER JOIN, BROADCAST]
@@ -324,11 +324,11 @@ max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2 row-size=501B cardinality=9.00M cost=3937301
+| tuple-ids=0,2 row-size=52B cardinality=9.00M cost=3937301
| in pipelines: 00(GETNEXT), 01(OPEN)
|
|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=24.98MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[865]
| JOIN BUILD
| | join-table-id=01 plan-id=02 cohort-id=01
@@ -337,13 +337,13 @@ max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=375
| |
| 07:EXCHANGE [BROADCAST]
-| | mem-estimate=748.35KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=2 row-size=405B cardinality=375 cost=490
+| | mem-estimate=79.39KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=2 row-size=40B cardinality=375 cost=490
| | in pipelines: 01(GETNEXT)
| |
| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
-| Per-Instance Resources: mem-estimate=17.60MB mem-reservation=512.00KB thread-reservation=1
-| max-parallelism=4 segment-costs=[1366143]
+| Per-Instance Resources: mem-estimate=16.17MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=4 segment-costs=[156141]
| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
| HDFS partitions=1/1 files=1 size=33.54MB
| predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id = CAST(816 AS INT)
@@ -354,7 +354,7 @@ max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result
| parquet statistics predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id = CAST(816 AS INT)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_manufact_id = CAST(816 AS INT)
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=2 row-size=405B cardinality=375 cost=1365725
+| tuple-ids=2 row-size=40B cardinality=375 cost=156093
| in pipelines: 01(GETNEXT)
|
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
@@ -366,6 +366,6 @@ max-parallelism=1210 segment-costs=[12004817466, 34850578] cpu-comparison-result
columns: all
extrapolated-rows=disabled max-scan-range-rows=390.22M
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
- tuple-ids=0 row-size=96B cardinality=9.00M(filtered from 8.64G) cost=11943846410
+ tuple-ids=0 row-size=12B cardinality=9.00M(filtered from 8.64G) cost=1492980801
in pipelines: 00(GETNEXT)
====
diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q04.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q04.test
index 16414a8e6..294273cb5 100644
--- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q04.test
+++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q04.test
@@ -116,5371 +116,2145 @@ limit 100
# end query 4 in stream 0 using template query4.tpl
---- PLAN
-Max Per-Host Resource Reservation: Memory=990.00MB Threads=1
-Per-Host Resource Estimates: Memory=382.06GB
+Max Per-Host Resource Reservation: Memory=507.88MB Threads=1
+Per-Host Resource Estimates: Memory=86.90GB
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=382.06GB mem-reservation=990.00MB thread-reservation=1 runtime-filters-memory=160.00MB
-| max-parallelism=1 segment-costs=[56489724478, 35665892950, 17904128344, 56489724478, 35665892950, 17904128344, 56489724478, 35665892950, 17904128344, 56489724478, 35665892950, 17904128344, 56489724478, 35665892950, 17904128344, 56489724478, 35665892950, 17904128344, 234049227739, 400]
+| Per-Instance Resources: mem-estimate=86.90GB mem-reservation=507.88MB thread-reservation=1 runtime-filters-memory=70.00MB
+| max-parallelism=1 segment-costs=[11764350338, 2992083199, 4555427905, 2367304320, 1287212638, 5889891799, 1574489651, 400]
PLAN-ROOT SINK
-| output exprs: CUSTOMER_ID, CUSTOMER_FIRST_NAME, CUSTOMER_LAST_NAME, CUSTOMER_BIRTH_COUNTRY
+| output exprs: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_birth_country
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
-131:TOP-N [LIMIT=100]
-| order by: CUSTOMER_ID ASC NULLS LAST, CUSTOMER_FIRST_NAME ASC NULLS LAST, CUSTOMER_LAST_NAME ASC NULLS LAST, CUSTOMER_BIRTH_COUNTRY ASC NULLS LAST
-| mem-estimate=4.69KB mem-reservation=0B thread-reservation=0
-| tuple-ids=138 row-size=48B cardinality=100 cost=20108584520
-| in pipelines: 131(GETNEXT), 07(OPEN), 13(OPEN), 19(OPEN)
-|
-130:HASH JOIN [INNER JOIN]
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| other join predicates: CASE WHEN YEAR_TOTAL > CAST(0 AS DECIMAL(3,0)) THEN divide(YEAR_TOTAL, YEAR_TOTAL) ELSE NULL END > CASE WHEN YEAR_TOTAL > CAST(0 AS DECIMAL(3,0)) THEN divide(YEAR_TOTAL, YEAR_TOTAL) ELSE NULL END
-| mem-estimate=50.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45,68,91,114,137 row-size=696B cardinality=1.18G cost=1701289795
-| in pipelines: 07(GETNEXT), 13(GETNEXT), 19(GETNEXT), 116(OPEN), 122(OPEN), 128(OPEN)
-|
-|--129:SELECT
-| | predicates: DYEAR = CAST(1999 AS INT), SALE_TYPE = 'w', YEAR_TOTAL > CAST(0 AS DECIMAL(3,0))
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=137 row-size=116B cardinality=1.18G cost=35500236800
-| | in pipelines: 116(GETNEXT), 122(GETNEXT), 128(GETNEXT)
-| |
-| 109:UNION
-| | pass-through-operands: 110
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=137 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 116(GETNEXT), 122(GETNEXT), 128(GETNEXT)
-| |
-| |--128:AGGREGATE [FINALIZE]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_16.c_customer_id, tpcds_partitioned_parquet_snap.customer_16.c_first_name, tpcds_partitioned_parquet_snap.customer_16.c_last_name, tpcds_partitioned_parquet_snap.customer_16.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_16.c_birth_country, tpcds_partitioned_parquet_snap.customer_16.c_login, tpcds_partitioned_parquet_snap.customer_16.c_email_address, tpcds_partitioned_parquet_snap.date_dim_16.d_year
-| | | mem-estimate=7.64GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=136 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 128(GETNEXT), 123(OPEN)
-| | |
-| | 127:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_4.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_4.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk
-| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=130,132,134 row-size=582B cardinality=1.99G cost=870089007
-| | | in pipelines: 123(GETNEXT), 126(OPEN)
-| | |
-| | |--126:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=134 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 126(GETNEXT)
-| | |
-| | 125:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_4.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_16.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_4.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_16.c_customer_sk
-| | | runtime filters: RF071[min_max] <- tpcds_partitioned_parquet_snap.customer_16.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=130,132 row-size=344B cardinality=1.99G cost=900015958
-| | | in pipelines: 123(GETNEXT), 124(OPEN)
-| | |
-| | |--124:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=132 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 124(GETNEXT)
-| | |
-| | 123:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF071[min_max] -> tpcds_partitioned_parquet_snap.web_sales_4.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=130 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 123(GETNEXT)
-| |
-| 110:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=129 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 116(GETNEXT), 122(GETNEXT)
-| |
-| |--122:AGGREGATE [FINALIZE]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_15.c_customer_id, tpcds_partitioned_parquet_snap.customer_15.c_first_name, tpcds_partitioned_parquet_snap.customer_15.c_last_name, tpcds_partitioned_parquet_snap.customer_15.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_15.c_birth_country, tpcds_partitioned_parquet_snap.customer_15.c_login, tpcds_partitioned_parquet_snap.customer_15.c_email_address, tpcds_partitioned_parquet_snap.date_dim_15.d_year
-| | | mem-estimate=10.25GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=128 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 122(GETNEXT), 117(OPEN)
-| | |
-| | 121:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_4.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_4.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk
-| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=122,124,126 row-size=582B cardinality=3.97G cost=1735865988
-| | | in pipelines: 117(GETNEXT), 120(OPEN)
-| | |
-| | |--120:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=126 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 120(GETNEXT)
-| | |
-| | 119:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_4.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_15.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_4.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_15.c_customer_sk
-| | | runtime filters: RF067[min_max] <- tpcds_partitioned_parquet_snap.customer_15.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=122,124 row-size=344B cardinality=3.97G cost=1765792939
-| | | in pipelines: 117(GETNEXT), 118(OPEN)
-| | |
-| | |--118:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=124 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 118(GETNEXT)
-| | |
-| | 117:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF067[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_4.cs_bill_customer_sk
+41:TOP-N [LIMIT=100]
+| order by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_birth_country ASC NULLS LAST
+| mem-estimate=8.27KB mem-reservation=0B thread-reservation=0
+| tuple-ids=42 row-size=85B cardinality=100 cost=1196431039
+| in pipelines: 41(GETNEXT), 29(OPEN)
+|
+40:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| other join predicates: CASE WHEN sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(3,0)) THEN divide(sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitione [...]
+| runtime filters: RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id
+| mem-estimate=14.68GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34,41,27,20,13,6 row-size=991B cardinality=80.79M cost=103120687
+| in pipelines: 29(GETNEXT), 05(OPEN)
+|
+|--05:AGGREGATE [FINALIZE]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(3,0))
+| | mem-estimate=6.95GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=80.79M cost=4768537611
+| | in pipelines: 05(GETNEXT), 00(OPEN)
+| |
+| 04:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | runtime filters: RF030[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF031[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=0,2,4 row-size=185B cardinality=807.87M cost=402121453
+| | in pipelines: 00(GETNEXT), 03(OPEN)
+| |
+| |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| | HDFS partitions=1/1 files=1 size=1.55GB
| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
+| | table: rows=30.00M size=1.55GB
| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=122 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 117(GETNEXT)
-| |
-| 116:AGGREGATE [FINALIZE]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_14.c_customer_id, tpcds_partitioned_parquet_snap.customer_14.c_first_name, tpcds_partitioned_parquet_snap.customer_14.c_last_name, tpcds_partitioned_parquet_snap.customer_14.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_14.c_birth_country, tpcds_partitioned_parquet_snap.customer_14.c_login, tpcds_partitioned_parquet_snap.customer_14.c_email_address, tpcds_partitioned_parquet_snap.date_dim_14.d_year
-| | mem-estimate=15.48GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=121 row-size=169B cardinality=5.88G cost=37525876254
-| | in pipelines: 116(GETNEXT), 111(OPEN)
-| |
-| 115:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk
-| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=115,117,119 row-size=538B cardinality=7.93G cost=3471570225
-| | in pipelines: 111(GETNEXT), 114(OPEN)
-| |
-| |--114:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| | tuple-ids=4 row-size=153B cardinality=30.00M cost=29871228
+| | in pipelines: 03(GETNEXT)
+| |
+| 02:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | runtime filters: RF032[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=0,2 row-size=32B cardinality=880.06M cost=385202450
+| | in pipelines: 00(GETNEXT), 01(OPEN)
+| |
+| |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=119 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 114(GETNEXT)
-| |
-| 113:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_14.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_14.c_customer_sk
-| | runtime filters: RF062[bloom] <- tpcds_partitioned_parquet_snap.customer_14.c_customer_sk, RF063[min_max] <- tpcds_partitioned_parquet_snap.customer_14.c_customer_sk
-| | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=115,117 row-size=300B cardinality=7.93G cost=3501497176
-| | in pipelines: 111(GETNEXT), 112(OPEN)
-| |
-| |--112:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=2 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 01(GETNEXT)
+| |
+| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
+| HDFS partitions=1831/1831 files=1831 size=280.96GB
+| runtime filters: RF031[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF032[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk, RF030[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk
+| stored statistics:
+| table: rows=4.32G size=280.96GB
+| partitions: 1831/1831 rows=4.32G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=374(filtered from 1831)
+| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| tuple-ids=0 row-size=24B cardinality=880.06M(filtered from 4.32G) cost=304148590
+| in pipelines: 00(GETNEXT)
+|
+39:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| mem-estimate=5.36GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34,41,27,20,13 row-size=826B cardinality=30.00M cost=43131000
+| in pipelines: 29(GETNEXT), 11(OPEN)
+|
+|--11:AGGREGATE [FINALIZE]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
+| | mem-estimate=5.92GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=30.00M cost=694393366
+| | in pipelines: 11(GETNEXT), 06(OPEN)
+| |
+| 10:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | runtime filters: RF027[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=7,9,11 row-size=185B cardinality=406.48M cost=216950480
+| | in pipelines: 06(GETNEXT), 09(OPEN)
+| |
+| |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
| | HDFS partitions=1/1 files=1 size=1.55GB
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=117 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 112(GETNEXT)
+| | tuple-ids=11 row-size=153B cardinality=30.00M cost=29871228
+| | in pipelines: 09(GETNEXT)
| |
-| 111:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF063[min_max] -> tpcds_partitioned_parquet_snap.store_sales_4.ss_customer_sk, RF062[bloom] -> tpcds_partitioned_parquet_snap.store_sales_4.ss_customer_sk
-| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=115 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 111(GETNEXT)
-|
-108:HASH JOIN [INNER JOIN]
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| mem-estimate=50.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45,68,91,114 row-size=580B cardinality=1.18G cost=1701289795
-| in pipelines: 07(GETNEXT), 13(GETNEXT), 19(GETNEXT), 94(OPEN), 100(OPEN), 106(OPEN)
-|
-|--107:SELECT
-| | predicates: DYEAR = add(CAST(1999 AS INT), CAST(1 AS INT)), SALE_TYPE = 'w'
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=114 row-size=116B cardinality=1.18G cost=23666825216
-| | in pipelines: 94(GETNEXT), 100(GETNEXT), 106(GETNEXT)
-| |
-| 87:UNION
-| | pass-through-operands: 88
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=114 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 94(GETNEXT), 100(GETNEXT), 106(GETNEXT)
-| |
-| |--106:AGGREGATE [FINALIZE]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_13.c_customer_id, tpcds_partitioned_parquet_snap.customer_13.c_first_name, tpcds_partitioned_parquet_snap.customer_13.c_last_name, tpcds_partitioned_parquet_snap.customer_13.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_13.c_birth_country, tpcds_partitioned_parquet_snap.customer_13.c_login, tpcds_partitioned_parquet_snap.customer_13.c_email_address, tpcds_partitioned_parquet_snap.date_dim_13.d_year
-| | | mem-estimate=7.64GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=113 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 106(GETNEXT), 101(OPEN)
-| | |
-| | 105:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_3.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_3.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk
-| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=107,109,111 row-size=582B cardinality=1.99G cost=870089007
-| | | in pipelines: 101(GETNEXT), 104(OPEN)
-| | |
-| | |--104:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=111 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 104(GETNEXT)
-| | |
-| | 103:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_3.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_13.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_3.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_13.c_customer_sk
-| | | runtime filters: RF059[min_max] <- tpcds_partitioned_parquet_snap.customer_13.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=107,109 row-size=344B cardinality=1.99G cost=900015958
-| | | in pipelines: 101(GETNEXT), 102(OPEN)
-| | |
-| | |--102:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=109 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 102(GETNEXT)
-| | |
-| | 101:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF059[min_max] -> tpcds_partitioned_parquet_snap.web_sales_3.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=107 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 101(GETNEXT)
-| |
-| 88:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=106 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 94(GETNEXT), 100(GETNEXT)
-| |
-| |--100:AGGREGATE [FINALIZE]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_12.c_customer_id, tpcds_partitioned_parquet_snap.customer_12.c_first_name, tpcds_partitioned_parquet_snap.customer_12.c_last_name, tpcds_partitioned_parquet_snap.customer_12.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_12.c_birth_country, tpcds_partitioned_parquet_snap.customer_12.c_login, tpcds_partitioned_parquet_snap.customer_12.c_email_address, tpcds_partitioned_parquet_snap.date_dim_12.d_year
-| | | mem-estimate=10.25GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=105 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 100(GETNEXT), 95(OPEN)
-| | |
-| | 99:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_3.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_3.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk
-| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=99,101,103 row-size=582B cardinality=3.97G cost=1735865988
-| | | in pipelines: 95(GETNEXT), 98(OPEN)
-| | |
-| | |--98:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=103 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 98(GETNEXT)
-| | |
-| | 97:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_3.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_12.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_3.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_12.c_customer_sk
-| | | runtime filters: RF055[min_max] <- tpcds_partitioned_parquet_snap.customer_12.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=99,101 row-size=344B cardinality=3.97G cost=1765792939
-| | | in pipelines: 95(GETNEXT), 96(OPEN)
-| | |
-| | |--96:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=101 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 96(GETNEXT)
-| | |
-| | 95:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF055[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_3.cs_bill_customer_sk
-| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=99 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 95(GETNEXT)
-| |
-| 94:AGGREGATE [FINALIZE]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_11.c_customer_id, tpcds_partitioned_parquet_snap.customer_11.c_first_name, tpcds_partitioned_parquet_snap.customer_11.c_last_name, tpcds_partitioned_parquet_snap.customer_11.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_11.c_birth_country, tpcds_partitioned_parquet_snap.customer_11.c_login, tpcds_partitioned_parquet_snap.customer_11.c_email_address, tpcds_partitioned_parquet_snap.date_dim_11.d_year
-| | mem-estimate=15.48GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=98 row-size=169B cardinality=5.88G cost=37525876254
-| | in pipelines: 94(GETNEXT), 89(OPEN)
-| |
-| 93:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk
-| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=92,94,96 row-size=538B cardinality=7.93G cost=3471570225
-| | in pipelines: 89(GETNEXT), 92(OPEN)
-| |
-| |--92:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| 08:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=7,9 row-size=32B cardinality=441.70M cost=193334203
+| | in pipelines: 06(GETNEXT), 07(OPEN)
+| |
+| |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=96 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 92(GETNEXT)
-| |
-| 91:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_11.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_11.c_customer_sk
-| | runtime filters: RF050[bloom] <- tpcds_partitioned_parquet_snap.customer_11.c_customer_sk, RF051[min_max] <- tpcds_partitioned_parquet_snap.customer_11.c_customer_sk
-| | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=92,94 row-size=300B cardinality=7.93G cost=3501497176
-| | in pipelines: 89(GETNEXT), 90(OPEN)
-| |
-| |--90:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=9 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 07(GETNEXT)
+| |
+| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
+| HDFS partitions=1824/1824 files=1824 size=145.75GB
+| runtime filters: RF027[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF028[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk
+| stored statistics:
+| table: rows=2.16G size=145.75GB
+| partitions: 1824/1824 rows=2.16G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=374(filtered from 1824)
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=7 row-size=24B cardinality=441.70M(filtered from 2.16G) cost=152652894
+| in pipelines: 06(GETNEXT)
+|
+38:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| runtime filters: RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| mem-estimate=5.36GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34,41,27,20 row-size=661B cardinality=30.00M cost=43131000
+| in pipelines: 29(GETNEXT), 17(OPEN)
+|
+|--17:AGGREGATE [FINALIZE]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | mem-estimate=6.95GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=30.00M cost=1245950132
+| | in pipelines: 17(GETNEXT), 12(OPEN)
+| |
+| 16:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | runtime filters: RF022[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF023[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=14,16,18 row-size=185B cardinality=807.87M cost=402121453
+| | in pipelines: 12(GETNEXT), 15(OPEN)
+| |
+| |--15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
| | HDFS partitions=1/1 files=1 size=1.55GB
+| | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=94 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 90(GETNEXT)
+| | tuple-ids=18 row-size=153B cardinality=30.00M cost=29871228
+| | in pipelines: 15(GETNEXT)
| |
-| 89:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF051[min_max] -> tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk, RF050[bloom] -> tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk
-| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=92 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 89(GETNEXT)
-|
-86:HASH JOIN [INNER JOIN]
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| other join predicates: CASE WHEN YEAR_TOTAL > CAST(0 AS DECIMAL(3,0)) THEN divide(YEAR_TOTAL, YEAR_TOTAL) ELSE NULL END > CASE WHEN YEAR_TOTAL > CAST(0 AS DECIMAL(3,0)) THEN divide(YEAR_TOTAL, YEAR_TOTAL) ELSE NULL END
-| mem-estimate=50.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45,68,91 row-size=464B cardinality=1.18G cost=1701289795
-| in pipelines: 07(GETNEXT), 13(GETNEXT), 19(GETNEXT), 72(OPEN), 78(OPEN), 84(OPEN)
-|
-|--85:SELECT
-| | predicates: DYEAR = CAST(1999 AS INT), SALE_TYPE = 'c', YEAR_TOTAL > CAST(0 AS DECIMAL(3,0))
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=91 row-size=116B cardinality=1.18G cost=35500236800
-| | in pipelines: 72(GETNEXT), 78(GETNEXT), 84(GETNEXT)
-| |
-| 65:UNION
-| | pass-through-operands: 66
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=91 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 72(GETNEXT), 78(GETNEXT), 84(GETNEXT)
-| |
-| |--84:AGGREGATE [FINALIZE]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_10.c_customer_id, tpcds_partitioned_parquet_snap.customer_10.c_first_name, tpcds_partitioned_parquet_snap.customer_10.c_last_name, tpcds_partitioned_parquet_snap.customer_10.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_10.c_birth_country, tpcds_partitioned_parquet_snap.customer_10.c_login, tpcds_partitioned_parquet_snap.customer_10.c_email_address, tpcds_partitioned_parquet_snap.date_dim_10.d_year
-| | | mem-estimate=7.64GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=90 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 84(GETNEXT), 79(OPEN)
-| | |
-| | 83:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_2.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_2.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk
-| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=84,86,88 row-size=582B cardinality=1.99G cost=870089007
-| | | in pipelines: 79(GETNEXT), 82(OPEN)
-| | |
-| | |--82:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=88 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 82(GETNEXT)
-| | |
-| | 81:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_2.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_10.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_2.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_10.c_customer_sk
-| | | runtime filters: RF047[min_max] <- tpcds_partitioned_parquet_snap.customer_10.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=84,86 row-size=344B cardinality=1.99G cost=900015958
-| | | in pipelines: 79(GETNEXT), 80(OPEN)
-| | |
-| | |--80:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=86 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 80(GETNEXT)
-| | |
-| | 79:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF047[min_max] -> tpcds_partitioned_parquet_snap.web_sales_2.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=84 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 79(GETNEXT)
-| |
-| 66:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=83 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 72(GETNEXT), 78(GETNEXT)
-| |
-| |--78:AGGREGATE [FINALIZE]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_9.c_customer_id, tpcds_partitioned_parquet_snap.customer_9.c_first_name, tpcds_partitioned_parquet_snap.customer_9.c_last_name, tpcds_partitioned_parquet_snap.customer_9.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_9.c_birth_country, tpcds_partitioned_parquet_snap.customer_9.c_login, tpcds_partitioned_parquet_snap.customer_9.c_email_address, tpcds_partitioned_parquet_snap.date_dim_9.d_year
-| | | mem-estimate=10.25GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=82 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 78(GETNEXT), 73(OPEN)
-| | |
-| | 77:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_2.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_2.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk
-| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=76,78,80 row-size=582B cardinality=3.97G cost=1735865988
-| | | in pipelines: 73(GETNEXT), 76(OPEN)
-| | |
-| | |--76:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=80 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 76(GETNEXT)
-| | |
-| | 75:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_2.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_9.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_2.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_9.c_customer_sk
-| | | runtime filters: RF042[bloom] <- tpcds_partitioned_parquet_snap.customer_9.c_customer_sk, RF043[min_max] <- tpcds_partitioned_parquet_snap.customer_9.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=76,78 row-size=344B cardinality=3.97G cost=1765792939
-| | | in pipelines: 73(GETNEXT), 74(OPEN)
-| | |
-| | |--74:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=78 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 74(GETNEXT)
-| | |
-| | 73:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF043[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_2.cs_bill_customer_sk, RF042[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_2.cs_bill_customer_sk
-| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=76 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 73(GETNEXT)
-| |
-| 72:AGGREGATE [FINALIZE]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_8.c_customer_id, tpcds_partitioned_parquet_snap.customer_8.c_first_name, tpcds_partitioned_parquet_snap.customer_8.c_last_name, tpcds_partitioned_parquet_snap.customer_8.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_8.c_birth_country, tpcds_partitioned_parquet_snap.customer_8.c_login, tpcds_partitioned_parquet_snap.customer_8.c_email_address, tpcds_partitioned_parquet_snap.date_dim_8.d_year
-| | mem-estimate=15.48GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=75 row-size=169B cardinality=5.88G cost=37525876254
-| | in pipelines: 72(GETNEXT), 67(OPEN)
-| |
-| 71:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_2.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk
-| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=69,71,73 row-size=538B cardinality=7.93G cost=3471570225
-| | in pipelines: 67(GETNEXT), 70(OPEN)
-| |
-| |--70:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| 14:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=14,16 row-size=32B cardinality=880.06M cost=385202450
+| | in pipelines: 12(GETNEXT), 13(OPEN)
+| |
+| |--13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=73 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 70(GETNEXT)
-| |
-| 69:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_8.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_2.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_8.c_customer_sk
-| | runtime filters: RF038[bloom] <- tpcds_partitioned_parquet_snap.customer_8.c_customer_sk, RF039[min_max] <- tpcds_partitioned_parquet_snap.customer_8.c_customer_sk
-| | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=69,71 row-size=300B cardinality=7.93G cost=3501497176
-| | in pipelines: 67(GETNEXT), 68(OPEN)
-| |
-| |--68:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=71 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 68(GETNEXT)
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=16 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 13(GETNEXT)
| |
-| 67:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF039[min_max] -> tpcds_partitioned_parquet_snap.store_sales_2.ss_customer_sk, RF038[bloom] -> tpcds_partitioned_parquet_snap.store_sales_2.ss_customer_sk
+| 12:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
+| HDFS partitions=1831/1831 files=1831 size=280.96GB
+| runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk, RF022[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk
| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
+| table: rows=4.32G size=280.96GB
+| partitions: 1831/1831 rows=4.32G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=69 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 67(GETNEXT)
-|
-64:HASH JOIN [INNER JOIN]
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| mem-estimate=50.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45,68 row-size=348B cardinality=1.18G cost=1701289795
-| in pipelines: 07(GETNEXT), 13(GETNEXT), 19(GETNEXT), 50(OPEN), 56(OPEN), 62(OPEN)
-|
-|--63:SELECT
-| | predicates: DYEAR = add(CAST(1999 AS INT), CAST(1 AS INT)), SALE_TYPE = 'c'
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=68 row-size=116B cardinality=1.18G cost=23666825216
-| | in pipelines: 50(GETNEXT), 56(GETNEXT), 62(GETNEXT)
-| |
-| 43:UNION
-| | pass-through-operands: 44
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=68 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 50(GETNEXT), 56(GETNEXT), 62(GETNEXT)
-| |
-| |--62:AGGREGATE [FINALIZE]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_7.c_customer_id, tpcds_partitioned_parquet_snap.customer_7.c_first_name, tpcds_partitioned_parquet_snap.customer_7.c_last_name, tpcds_partitioned_parquet_snap.customer_7.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_7.c_birth_country, tpcds_partitioned_parquet_snap.customer_7.c_login, tpcds_partitioned_parquet_snap.customer_7.c_email_address, tpcds_partitioned_parquet_snap.date_dim_7.d_year
-| | | mem-estimate=7.64GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=67 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 62(GETNEXT), 57(OPEN)
-| | |
-| | 61:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_1.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_1.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk
-| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=61,63,65 row-size=582B cardinality=1.99G cost=870089007
-| | | in pipelines: 57(GETNEXT), 60(OPEN)
-| | |
-| | |--60:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=65 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 60(GETNEXT)
-| | |
-| | 59:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_1.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_7.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_1.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_7.c_customer_sk
-| | | runtime filters: RF035[min_max] <- tpcds_partitioned_parquet_snap.customer_7.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=61,63 row-size=344B cardinality=1.99G cost=900015958
-| | | in pipelines: 57(GETNEXT), 58(OPEN)
-| | |
-| | |--58:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=63 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 58(GETNEXT)
-| | |
-| | 57:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF035[min_max] -> tpcds_partitioned_parquet_snap.web_sales_1.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=61 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 57(GETNEXT)
-| |
-| 44:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=60 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 50(GETNEXT), 56(GETNEXT)
-| |
-| |--56:AGGREGATE [FINALIZE]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_6.c_customer_id, tpcds_partitioned_parquet_snap.customer_6.c_first_name, tpcds_partitioned_parquet_snap.customer_6.c_last_name, tpcds_partitioned_parquet_snap.customer_6.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_6.c_birth_country, tpcds_partitioned_parquet_snap.customer_6.c_login, tpcds_partitioned_parquet_snap.customer_6.c_email_address, tpcds_partitioned_parquet_snap.date_dim_6.d_year
-| | | mem-estimate=10.25GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=59 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 56(GETNEXT), 51(OPEN)
-| | |
-| | 55:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk
-| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=53,55,57 row-size=582B cardinality=3.97G cost=1735865988
-| | | in pipelines: 51(GETNEXT), 54(OPEN)
-| | |
-| | |--54:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=57 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 54(GETNEXT)
-| | |
-| | 53:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_6.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_6.c_customer_sk
-| | | runtime filters: RF030[bloom] <- tpcds_partitioned_parquet_snap.customer_6.c_customer_sk, RF031[min_max] <- tpcds_partitioned_parquet_snap.customer_6.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=53,55 row-size=344B cardinality=3.97G cost=1765792939
-| | | in pipelines: 51(GETNEXT), 52(OPEN)
-| | |
-| | |--52:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=55 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 52(GETNEXT)
-| | |
-| | 51:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF031[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_1.cs_bill_customer_sk, RF030[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_1.cs_bill_customer_sk
+| extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=374(filtered from 1831)
+| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| tuple-ids=14 row-size=24B cardinality=880.06M(filtered from 4.32G) cost=304148590
+| in pipelines: 12(GETNEXT)
+|
+37:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| mem-estimate=5.36GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34,41,27 row-size=495B cardinality=30.00M cost=77037753
+| in pipelines: 29(GETNEXT), 23(OPEN)
+|
+|--23:AGGREGATE [FINALIZE]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
+| | mem-estimate=9.05GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=30.00M cost=2364508786
+| | in pipelines: 23(GETNEXT), 18(OPEN)
+| |
+| 22:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | runtime filters: RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=21,23,25 row-size=185B cardinality=1.62G cost=777080012
+| | in pipelines: 18(GETNEXT), 21(OPEN)
+| |
+| |--21:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id
| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
+| | table: rows=30.00M size=1.55GB
| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=53 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 51(GETNEXT)
-| |
-| 50:AGGREGATE [FINALIZE]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_5.c_customer_id, tpcds_partitioned_parquet_snap.customer_5.c_first_name, tpcds_partitioned_parquet_snap.customer_5.c_last_name, tpcds_partitioned_parquet_snap.customer_5.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_5.c_birth_country, tpcds_partitioned_parquet_snap.customer_5.c_login, tpcds_partitioned_parquet_snap.customer_5.c_email_address, tpcds_partitioned_parquet_snap.date_dim_5.d_year
-| | mem-estimate=15.48GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=52 row-size=169B cardinality=5.88G cost=37525876254
-| | in pipelines: 50(GETNEXT), 45(OPEN)
-| |
-| 49:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk
-| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=46,48,50 row-size=538B cardinality=7.93G cost=3471570225
-| | in pipelines: 45(GETNEXT), 48(OPEN)
-| |
-| |--48:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| | tuple-ids=25 row-size=153B cardinality=30.00M cost=29871228
+| | in pipelines: 21(GETNEXT)
+| |
+| 20:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=21,23 row-size=32B cardinality=1.77G cost=773341361
+| | in pipelines: 18(GETNEXT), 19(OPEN)
+| |
+| |--19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=50 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 48(GETNEXT)
-| |
-| 47:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_5.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_5.c_customer_sk
-| | runtime filters: RF026[bloom] <- tpcds_partitioned_parquet_snap.customer_5.c_customer_sk, RF027[min_max] <- tpcds_partitioned_parquet_snap.customer_5.c_customer_sk
-| | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=46,48 row-size=300B cardinality=7.93G cost=3501497176
-| | in pipelines: 45(GETNEXT), 46(OPEN)
-| |
-| |--46:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=48 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 46(GETNEXT)
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=23 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 19(GETNEXT)
| |
-| 45:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
+| 18:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF027[min_max] -> tpcds_partitioned_parquet_snap.store_sales_1.ss_customer_sk, RF026[bloom] -> tpcds_partitioned_parquet_snap.store_sales_1.ss_customer_sk
+| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
| stored statistics:
| table: rows=8.64G size=389.90GB
| partitions: 1824/1824 rows=8.64G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
+| extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=46 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 45(GETNEXT)
-|
-42:HASH JOIN [INNER JOIN]
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| mem-estimate=50.00GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45 row-size=232B cardinality=1.18G cost=1701289795
-| in pipelines: 07(GETNEXT), 13(GETNEXT), 19(GETNEXT), 28(OPEN), 34(OPEN), 40(OPEN)
-|
-|--41:SELECT
-| | predicates: DYEAR = CAST(1999 AS INT), SALE_TYPE = 's', YEAR_TOTAL > CAST(0 AS DECIMAL(3,0))
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=45 row-size=116B cardinality=1.18G cost=35500236800
-| | in pipelines: 28(GETNEXT), 34(GETNEXT), 40(GETNEXT)
-| |
-| 21:UNION
-| | pass-through-operands: 22
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=45 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 28(GETNEXT), 34(GETNEXT), 40(GETNEXT)
-| |
-| |--40:AGGREGATE [FINALIZE]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address, tpcds_partitioned_parquet_snap.date_dim_4.d_year
-| | | mem-estimate=7.64GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=44 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 40(GETNEXT), 35(OPEN)
-| | |
-| | 39:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=38,40,42 row-size=582B cardinality=1.99G cost=870089007
-| | | in pipelines: 35(GETNEXT), 38(OPEN)
-| | |
-| | |--38:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=42 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 38(GETNEXT)
-| | |
-| | 37:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | runtime filters: RF023[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=38,40 row-size=344B cardinality=1.99G cost=900015958
-| | | in pipelines: 35(GETNEXT), 36(OPEN)
-| | |
-| | |--36:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=40 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 36(GETNEXT)
-| | |
-| | 35:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=38 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 35(GETNEXT)
-| |
-| 22:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=37 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 28(GETNEXT), 34(GETNEXT)
-| |
-| |--34:AGGREGATE [FINALIZE]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address, tpcds_partitioned_parquet_snap.date_dim_3.d_year
-| | | mem-estimate=10.25GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=36 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 34(GETNEXT), 29(OPEN)
-| | |
-| | 33:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=30,32,34 row-size=582B cardinality=3.97G cost=1735865988
-| | | in pipelines: 29(GETNEXT), 32(OPEN)
-| | |
-| | |--32:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=34 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 32(GETNEXT)
-| | |
-| | 31:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk, RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=30,32 row-size=344B cardinality=3.97G cost=1765792939
-| | | in pipelines: 29(GETNEXT), 30(OPEN)
-| | |
-| | |--30:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=32 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 30(GETNEXT)
-| | |
-| | 29:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk
-| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=30 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 29(GETNEXT)
-| |
-| 28:AGGREGATE [FINALIZE]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address, tpcds_partitioned_parquet_snap.date_dim_2.d_year
-| | mem-estimate=15.48GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=29 row-size=169B cardinality=5.88G cost=37525876254
-| | in pipelines: 28(GETNEXT), 23(OPEN)
-| |
-| 27:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=23,25,27 row-size=538B cardinality=7.93G cost=3471570225
-| | in pipelines: 23(GETNEXT), 26(OPEN)
-| |
-| |--26:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=27 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 26(GETNEXT)
-| |
-| 25:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=23,25 row-size=300B cardinality=7.93G cost=3501497176
-| | in pipelines: 23(GETNEXT), 24(OPEN)
-| |
-| |--24:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| tuple-ids=21 row-size=24B cardinality=1.77G(filtered from 8.64G) cost=610616051
+| in pipelines: 18(GETNEXT)
+|
+36:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_4.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_4.c_customer_id
+| runtime filters: RF009[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_id
+| mem-estimate=7.16GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34,41 row-size=330B cardinality=162.19M cost=111638172
+| in pipelines: 29(GETNEXT), 35(OPEN)
+|
+|--35:AGGREGATE [FINALIZE]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2)) > CAST(0 AS DECIMAL(3,0))
+| | mem-estimate=5.92GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=41 row-size=165B cardinality=40.65M cost=2399263927
+| | in pipelines: 35(GETNEXT), 30(OPEN)
+| |
+| 34:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | runtime filters: RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=35,37,39 row-size=185B cardinality=406.48M cost=216950480
+| | in pipelines: 30(GETNEXT), 33(OPEN)
+| |
+| |--33:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
| | HDFS partitions=1/1 files=1 size=1.55GB
+| | runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF006[bloom] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=25 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 24(GETNEXT)
-| |
-| 23:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF014[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk
-| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=23 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 23(GETNEXT)
-|
-20:SELECT
-| predicates: DYEAR = add(CAST(1999 AS INT), CAST(1 AS INT)), SALE_TYPE = 's'
-| mem-estimate=0B mem-reservation=0B thread-reservation=0
-| tuple-ids=22 row-size=116B cardinality=1.18G cost=23666825216
-| in pipelines: 07(GETNEXT), 13(GETNEXT), 19(GETNEXT)
-|
-00:UNION
-| pass-through-operands: 01
-| mem-estimate=0B mem-reservation=0B thread-reservation=0
-| tuple-ids=22 row-size=116B cardinality=11.83G cost=782000635
-| in pipelines: 07(GETNEXT), 13(GETNEXT), 19(GETNEXT)
-|
-|--19:AGGREGATE [FINALIZE]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address, tpcds_partitioned_parquet_snap.date_dim_1.d_year
-| | mem-estimate=7.64GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=21 row-size=169B cardinality=1.99G cost=11732593545
-| | in pipelines: 19(GETNEXT), 14(OPEN)
-| |
-| 18:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=15,17,19 row-size=582B cardinality=1.99G cost=870089007
-| | in pipelines: 14(GETNEXT), 17(OPEN)
-| |
-| |--17:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| | tuple-ids=39 row-size=153B cardinality=30.00M cost=29871228
+| | in pipelines: 33(GETNEXT)
+| |
+| 32:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=35,37 row-size=32B cardinality=441.70M cost=193334203
+| | in pipelines: 30(GETNEXT), 31(OPEN)
+| |
+| |--31:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT)
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=19 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 17(GETNEXT)
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT)
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=37 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 31(GETNEXT)
| |
-| 16:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | runtime filters: RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=15,17 row-size=344B cardinality=1.99G cost=900015958
-| | in pipelines: 14(GETNEXT), 15(OPEN)
-| |
-| |--15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=17 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 15(GETNEXT)
-| |
-| 14:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
+| 30:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
| HDFS partitions=1824/1824 files=1824 size=145.75GB
-| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk
+| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk
| stored statistics:
| table: rows=2.16G size=145.75GB
| partitions: 1824/1824 rows=2.16G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=3.37M
-| mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| tuple-ids=15 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| in pipelines: 14(GETNEXT)
-|
-01:UNION
-| mem-estimate=0B mem-reservation=0B thread-reservation=0
-| tuple-ids=14 row-size=116B cardinality=9.85G cost=3873500731
-| in pipelines: 07(GETNEXT), 13(GETNEXT)
-|
-|--13:AGGREGATE [FINALIZE]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address, tpcds_partitioned_parquet_snap.date_dim_0.d_year
-| | mem-estimate=10.25GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=169B cardinality=3.97G cost=23408022405
-| | in pipelines: 13(GETNEXT), 08(OPEN)
-| |
-| 12:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=7,9,11 row-size=582B cardinality=3.97G cost=1735865988
-| | in pipelines: 08(GETNEXT), 11(OPEN)
-| |
-| |--11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=11 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 11(GETNEXT)
-| |
-| 10:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=7,9 row-size=344B cardinality=3.97G cost=1765792939
-| | in pipelines: 08(GETNEXT), 09(OPEN)
-| |
-| |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=9 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 09(GETNEXT)
-| |
-| 08:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
-| HDFS partitions=1831/1831 files=1831 size=280.96GB
-| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF006[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk
+| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=374(filtered from 1824)
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=35 row-size=24B cardinality=441.70M(filtered from 2.16G) cost=152652894
+| in pipelines: 30(GETNEXT)
+|
+29:AGGREGATE [FINALIZE]
+| output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address
+| having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2)) > CAST(0 AS DECIMAL(3,0))
+| mem-estimate=9.05GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34 row-size=165B cardinality=162.19M cost=9573431219
+| in pipelines: 29(GETNEXT), 24(OPEN)
+|
+28:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=28,30,32 row-size=185B cardinality=1.62G cost=777080012
+| in pipelines: 24(GETNEXT), 27(OPEN)
+|
+|--27:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| HDFS partitions=1/1 files=1 size=1.55GB
+| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF009[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF006[bloom] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id
| stored statistics:
-| table: rows=4.32G size=280.96GB
-| partitions: 1831/1831 rows=4.32G
+| table: rows=30.00M size=1.55GB
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=21.52M
+| extrapolated-rows=disabled max-scan-range-rows=3.10M
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=7 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| in pipelines: 08(GETNEXT)
-|
-07:AGGREGATE [FINALIZE]
-| output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address, tpcds_partitioned_parquet_snap.date_dim.d_year
-| mem-estimate=15.48GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=169B cardinality=5.88G cost=37525876254
-| in pipelines: 07(GETNEXT), 02(OPEN)
-|
-06:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4 row-size=538B cardinality=7.93G cost=3471570225
-| in pipelines: 02(GETNEXT), 05(OPEN)
-|
-|--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| tuple-ids=32 row-size=153B cardinality=30.00M cost=29871228
+| in pipelines: 27(GETNEXT)
+|
+26:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=28,30 row-size=32B cardinality=1.77G cost=773341361
+| in pipelines: 24(GETNEXT), 25(OPEN)
+|
+|--25:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| HDFS partitions=1/1 files=1 size=2.17MB
+| predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT)
| stored statistics:
| table: rows=73.05K size=2.17MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=4 row-size=237B cardinality=73.05K cost=110600
-| in pipelines: 05(GETNEXT)
-|
-04:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| mem-estimate=6.46GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2 row-size=300B cardinality=7.93G cost=3501497176
-| in pipelines: 02(GETNEXT), 03(OPEN)
-|
-|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| HDFS partitions=1/1 files=1 size=1.55GB
-| stored statistics:
-| table: rows=30.00M size=1.55GB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=3.10M
-| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=2 row-size=204B cardinality=30.00M cost=46823813
-| in pipelines: 03(GETNEXT)
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT)
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=30 row-size=8B cardinality=373 cost=10467
+| in pipelines: 25(GETNEXT)
|
-02:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
+24:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
HDFS partitions=1824/1824 files=1824 size=389.90GB
- runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk
+ runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk
stored statistics:
table: rows=8.64G size=389.90GB
partitions: 1824/1824 rows=8.64G
columns: all
- extrapolated-rows=disabled max-scan-range-rows=390.22M
+ extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
- tuple-ids=0 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
- in pipelines: 02(GETNEXT)
+ tuple-ids=28 row-size=24B cardinality=1.77G(filtered from 8.64G) cost=610616051
+ in pipelines: 24(GETNEXT)
---- DISTRIBUTEDPLAN
-Max Per-Host Resource Reservation: Memory=26.29GB Threads=409
-Per-Host Resource Estimates: Memory=1.25TB
-F85:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=4.40MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[434] cpu-comparison-result=2160 [max(1 (self) vs 2160 (sum children))]
+Max Per-Host Resource Reservation: Memory=9.94GB Threads=365
+Per-Host Resource Estimates: Memory=181.12GB
+F31:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
+| Per-Instance Resources: mem-estimate=4.85MB mem-reservation=4.00MB thread-reservation=1
+| max-parallelism=1 segment-costs=[442] cpu-comparison-result=1440 [max(1 (self) vs 1440 (sum children))]
PLAN-ROOT SINK
-| output exprs: CUSTOMER_ID, CUSTOMER_FIRST_NAME, CUSTOMER_LAST_NAME, CUSTOMER_BIRTH_COUNTRY
+| output exprs: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_birth_country
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
-210:MERGING-EXCHANGE [UNPARTITIONED]
-| order by: CUSTOMER_ID ASC NULLS LAST, CUSTOMER_FIRST_NAME ASC NULLS LAST, CUSTOMER_LAST_NAME ASC NULLS LAST, CUSTOMER_BIRTH_COUNTRY ASC NULLS LAST
+78:MERGING-EXCHANGE [UNPARTITIONED]
+| order by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_birth_country ASC NULLS LAST
| limit: 100
-| mem-estimate=406.72KB mem-reservation=0B thread-reservation=0
-| tuple-ids=138 row-size=48B cardinality=100 cost=34
-| in pipelines: 131(GETNEXT)
-|
-F28:PLAN FRAGMENT [HASH(CUSTOMER_ID)] hosts=10 instances=80 (adjusted from 120)
-Per-Instance Resources: mem-estimate=24.07MB mem-reservation=0B thread-reservation=1
-max-parallelism=2350 segment-costs=[23461227104, 157] cpu-comparison-result=2160 [max(80 (self) vs 2160 (sum children))]
-131:TOP-N [LIMIT=100]
-| order by: CUSTOMER_ID ASC NULLS LAST, CUSTOMER_FIRST_NAME ASC NULLS LAST, CUSTOMER_LAST_NAME ASC NULLS LAST, CUSTOMER_BIRTH_COUNTRY ASC NULLS LAST
-| mem-estimate=4.69KB mem-reservation=0B thread-reservation=0
-| tuple-ids=138 row-size=48B cardinality=100 cost=20108584520
-| in pipelines: 131(GETNEXT), 135(OPEN), 139(OPEN), 143(OPEN)
-|
-130:HASH JOIN [INNER JOIN, PARTITIONED]
+| mem-estimate=866.84KB mem-reservation=0B thread-reservation=0
+| tuple-ids=42 row-size=85B cardinality=100 cost=42
+| in pipelines: 41(GETNEXT)
+|
+F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)] hosts=10 instances=100 (adjusted from 120)
+Per-Instance Resources: mem-estimate=29.83MB mem-reservation=0B thread-reservation=1
+max-parallelism=160 segment-costs=[1504285782, 253] cpu-comparison-result=1440 [max(100 (self) vs 1440 (sum children))]
+41:TOP-N [LIMIT=100]
+| order by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_birth_country ASC NULLS LAST
+| mem-estimate=8.27KB mem-reservation=0B thread-reservation=0
+| tuple-ids=42 row-size=85B cardinality=100 cost=1196431039
+| in pipelines: 41(GETNEXT), 46(OPEN)
+|
+40:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=00
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| other join predicates: CASE WHEN YEAR_TOTAL > CAST(0 AS DECIMAL(3,0)) THEN divide(YEAR_TOTAL, YEAR_TOTAL) ELSE NULL END > CASE WHEN YEAR_TOTAL > CAST(0 AS DECIMAL(3,0)) THEN divide(YEAR_TOTAL, YEAR_TOTAL) ELSE NULL END
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| other join predicates: CASE WHEN sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(3,0)) THEN divide(sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitione [...]
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45,68,91,114,137 row-size=696B cardinality=1.18G cost=517948489
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT), 200(OPEN), 204(OPEN), 208(OPEN)
+| tuple-ids=34,41,27,20,13,6 row-size=991B cardinality=80.79M cost=22333617
+| in pipelines: 46(GETNEXT), 76(OPEN)
|
-|--F86:PLAN FRAGMENT [HASH(CUSTOMER_ID)] hosts=10 instances=80 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=1.92GB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=2350 segment-costs=[1946241445] cpu-comparison-result=360 [max(80 (self) vs 360 (sum children))]
+|--F32:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)] hosts=10 instances=100 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=180.17MB mem-reservation=34.00MB thread-reservation=1
+| | max-parallelism=160 segment-costs=[151134290] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
-| | build expressions: CUSTOMER_ID
-| | mem-estimate=1.90GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1183341306
-| |
-| 209:EXCHANGE [HASH(CUSTOMER_ID)]
-| | mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=137 row-size=116B cardinality=1.18G cost=762900139
-| | in pipelines: 200(GETNEXT), 204(GETNEXT), 208(GETNEXT)
-| |
-| F84:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=4.23GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=120 segment-costs=[44477605605, 26934229118, 13500002573, 49605428499] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))]
-| 129:SELECT
-| | predicates: DYEAR = CAST(1999 AS INT), SALE_TYPE = 'w', YEAR_TOTAL > CAST(0 AS DECIMAL(3,0))
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=137 row-size=116B cardinality=1.18G cost=35500236800
-| | in pipelines: 200(GETNEXT), 204(GETNEXT), 208(GETNEXT)
-| |
-| 109:UNION
-| | pass-through-operands: 110
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=137 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 200(GETNEXT), 204(GETNEXT), 208(GETNEXT)
-| |
-| |--208:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_16.c_customer_id, tpcds_partitioned_parquet_snap.customer_16.c_first_name, tpcds_partitioned_parquet_snap.customer_16.c_last_name, tpcds_partitioned_parquet_snap.customer_16.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_16.c_birth_country, tpcds_partitioned_parquet_snap.customer_16.c_login, tpcds_partitioned_parquet_snap.customer_16.c_email_address, tpcds_partitioned_parquet_snap.date_dim_16.d_year
-| | | mem-estimate=2.79GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=136 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 208(GETNEXT), 123(OPEN)
-| | |
-| | 207:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_16.c_customer_id,tpcds_partitioned_parquet_snap.customer_16.c_first_name,tpcds_partitioned_parquet_snap.customer_16.c_last_name,tpcds_partitioned_parquet_snap.customer_16.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_16.c_birth_country,tpcds_partitioned_parquet_snap.customer_16.c_login,tpcds_partitioned_parquet_snap.customer_16.c_email_address,tpcds_partitioned_parquet_snap.date_dim_16.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=136 row-size=169B cardinality=1.99G cost=1767409028
-| | | in pipelines: 123(GETNEXT)
-| | |
-| | F80:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=2.19GB mem-reservation=34.26MB thread-reservation=1
-| | max-parallelism=1824 segment-costs=[17827120882, 22676121640] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 128:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_16.c_customer_id, tpcds_partitioned_parquet_snap.customer_16.c_first_name, tpcds_partitioned_parquet_snap.customer_16.c_last_name, tpcds_partitioned_parquet_snap.customer_16.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_16.c_birth_country, tpcds_partitioned_parquet_snap.customer_16.c_login, tpcds_partitioned_parquet_snap.customer_16.c_email_address, tpcds_partitioned_parquet_snap.date_dim_16.d_year
-| | | mem-estimate=2.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=136 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 123(GETNEXT)
-| | |
-| | 127:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=05
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_4.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_4.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=130,132,134 row-size=582B cardinality=1.99G cost=870015958
-| | | in pipelines: 123(GETNEXT), 126(OPEN)
-| | |
-| | |--F91:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=05 plan-id=06 cohort-id=04
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 206:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=134 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 126(GETNEXT)
-| | | |
-| | | F82:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 126:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=134 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 126(GETNEXT)
-| | |
-| | 125:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=06
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_4.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_16.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_4.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_16.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=130,132 row-size=344B cardinality=1.99G cost=870015958
-| | | in pipelines: 123(GETNEXT), 124(OPEN)
-| | |
-| | |--F92:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=06 plan-id=07 cohort-id=04
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_16.c_customer_sk
-| | | | runtime filters: RF071[min_max] <- tpcds_partitioned_parquet_snap.customer_16.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 205:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=132 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 124(GETNEXT)
-| | | |
-| | | F81:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 124:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=132 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 124(GETNEXT)
-| | |
-| | 123:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF071[min_max] -> tpcds_partitioned_parquet_snap.web_sales_4.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=130 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 123(GETNEXT)
-| |
-| 110:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=129 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 200(GETNEXT), 204(GETNEXT)
-| |
-| |--204:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_15.c_customer_id, tpcds_partitioned_parquet_snap.customer_15.c_first_name, tpcds_partitioned_parquet_snap.customer_15.c_last_name, tpcds_partitioned_parquet_snap.customer_15.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_15.c_birth_country, tpcds_partitioned_parquet_snap.customer_15.c_login, tpcds_partitioned_parquet_snap.customer_15.c_email_address, tpcds_partitioned_parquet_snap.date_dim_15.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=128 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 204(GETNEXT), 117(OPEN)
-| | |
-| | 203:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_15.c_customer_id,tpcds_partitioned_parquet_snap.customer_15.c_first_name,tpcds_partitioned_parquet_snap.customer_15.c_last_name,tpcds_partitioned_parquet_snap.customer_15.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_15.c_birth_country,tpcds_partitioned_parquet_snap.customer_15.c_login,tpcds_partitioned_parquet_snap.customer_15.c_email_address,tpcds_partitioned_parquet_snap.date_dim_15.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=128 row-size=169B cardinality=3.97G cost=3526206713
-| | | in pipelines: 117(GETNEXT)
-| | |
-| | F75:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=4.26GB mem-reservation=35.00MB thread-reservation=1
-| | max-parallelism=1831 segment-costs=[35588885488, 45241758471] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 122:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_15.c_customer_id, tpcds_partitioned_parquet_snap.customer_15.c_first_name, tpcds_partitioned_parquet_snap.customer_15.c_last_name, tpcds_partitioned_parquet_snap.customer_15.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_15.c_birth_country, tpcds_partitioned_parquet_snap.customer_15.c_login, tpcds_partitioned_parquet_snap.customer_15.c_email_address, tpcds_partitioned_parquet_snap.date_dim_15.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=128 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 117(GETNEXT)
-| | |
-| | 121:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=03
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_4.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_4.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=122,124,126 row-size=582B cardinality=3.97G cost=1735792939
-| | | in pipelines: 117(GETNEXT), 120(OPEN)
-| | |
-| | |--F89:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=03 plan-id=04 cohort-id=03
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 202:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=126 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 120(GETNEXT)
-| | | |
-| | | F77:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 120:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=126 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 120(GETNEXT)
-| | |
-| | 119:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=04
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_4.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_15.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_4.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_15.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=122,124 row-size=344B cardinality=3.97G cost=1735792939
-| | | in pipelines: 117(GETNEXT), 118(OPEN)
-| | |
-| | |--F90:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=04 plan-id=05 cohort-id=03
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_15.c_customer_sk
-| | | | runtime filters: RF067[min_max] <- tpcds_partitioned_parquet_snap.customer_15.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 201:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=124 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 118(GETNEXT)
-| | | |
-| | | F76:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 118:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=124 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 118(GETNEXT)
-| | |
-| | 117:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF067[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_4.cs_bill_customer_sk
-| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=122 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 117(GETNEXT)
-| |
-| 200:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_14.c_customer_id, tpcds_partitioned_parquet_snap.customer_14.c_first_name, tpcds_partitioned_parquet_snap.customer_14.c_last_name, tpcds_partitioned_parquet_snap.customer_14.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_14.c_birth_country, tpcds_partitioned_parquet_snap.customer_14.c_login, tpcds_partitioned_parquet_snap.customer_14.c_email_address, tpcds_partitioned_parquet_snap.date_dim_14.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=121 row-size=169B cardinality=5.88G cost=37464857383
-| | in pipelines: 200(GETNEXT), 111(OPEN)
-| |
-| 199:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_14.c_customer_id,tpcds_partitioned_parquet_snap.customer_14.c_first_name,tpcds_partitioned_parquet_snap.customer_14.c_last_name,tpcds_partitioned_parquet_snap.customer_14.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_14.c_birth_country,tpcds_partitioned_parquet_snap.customer_14.c_login,tpcds_partitioned_parquet_snap.customer_14.c_email_address,tpcds_partitioned_parquet_snap.date_dim_14.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=121 row-size=169B cardinality=7.89G cost=7012748222
-| | in pipelines: 111(GETNEXT)
-| |
-| F71:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=4.26GB mem-reservation=42.00MB thread-reservation=1
-| max-parallelism=1824 segment-costs=[65500594865, 89974606443] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 116:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_14.c_customer_id, tpcds_partitioned_parquet_snap.customer_14.c_first_name, tpcds_partitioned_parquet_snap.customer_14.c_last_name, tpcds_partitioned_parquet_snap.customer_14.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_14.c_birth_country, tpcds_partitioned_parquet_snap.customer_14.c_login, tpcds_partitioned_parquet_snap.customer_14.c_email_address, tpcds_partitioned_parquet_snap.date_dim_14.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=121 row-size=169B cardinality=7.89G cost=46613754103
-| | in pipelines: 111(GETNEXT)
-| |
-| 115:HASH JOIN [INNER JOIN, BROADCAST]
+| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | runtime filters: RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | mem-estimate=150.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=80787070
+| |
+| 77:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=80.79M cost=70347220
+| | in pipelines: 76(GETNEXT)
+| |
+| F30:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.18GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=550 segment-costs=[5472009822, 900826381] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| 76:AGGREGATE [FINALIZE]
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(3,0))
+| | mem-estimate=1.11GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=80.79M cost=4768537611
+| | in pipelines: 76(GETNEXT), 00(OPEN)
+| |
+| 75:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=807.87M cost=703472211
+| | in pipelines: 00(GETNEXT)
+| |
+| F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=946.99MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=910 segment-costs=[5400364645, 9008263849] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 05:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | mem-estimate=853.01MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=807.87M cost=4768537611
+| | in pipelines: 00(GETNEXT)
+| |
+| 04:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=01
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=115,117,119 row-size=538B cardinality=7.93G cost=3471497176
-| | in pipelines: 111(GETNEXT), 114(OPEN)
+| | tuple-ids=0,2,4 row-size=185B cardinality=807.87M cost=372121453
+| | in pipelines: 00(GETNEXT), 03(OPEN)
| |
-| |--F87:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
+| |--F33:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | | max-parallelism=910 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=01 plan-id=02 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | |
-| | 198:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=119 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 114(GETNEXT)
-| | |
-| | F73:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 114:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | HDFS partitions=1/1 files=1 size=2.17MB
+| | | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | | runtime filters: RF030[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF031[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | |
+| | 74:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=4 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 03(GETNEXT)
+| | |
+| | F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[341205999]
+| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | HDFS partitions=1/1 files=1 size=1.55GB
| | stored statistics:
-| | table: rows=73.05K size=2.17MB
+| | table: rows=30.00M size=1.55GB
| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=119 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 114(GETNEXT)
-| |
-| 113:HASH JOIN [INNER JOIN, BROADCAST]
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=4 row-size=153B cardinality=30.00M cost=29871228
+| | in pipelines: 03(GETNEXT)
+| |
+| 73:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=0,2 row-size=32B cardinality=880.06M cost=259705581
+| | in pipelines: 00(GETNEXT)
+| |
+| F26:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=1.00MB thread-reservation=1
+| max-parallelism=350 segment-costs=[3409790834]
+| 02:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=02
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_14.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_14.c_customer_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=115,117 row-size=300B cardinality=7.93G cost=3471497176
-| | in pipelines: 111(GETNEXT), 112(OPEN)
-| |
-| |--F88:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=10 segment-costs=[69869990]
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=0,2 row-size=32B cardinality=880.06M cost=385202077
+| | in pipelines: 00(GETNEXT), 01(OPEN)
+| |
+| |--F34:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=02 plan-id=03 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_14.c_customer_sk
-| | | runtime filters: RF062[bloom] <- tpcds_partitioned_parquet_snap.customer_14.c_customer_sk, RF063[min_max] <- tpcds_partitioned_parquet_snap.customer_14.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | |
-| | 197:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=117 row-size=204B cardinality=30.00M cost=39869990
-| | | in pipelines: 112(GETNEXT)
-| | |
-| | F72:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
-| | 112:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | HDFS partitions=1/1 files=1 size=1.55GB
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | | runtime filters: RF032[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| | |
+| | 72:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=2 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 01(GETNEXT)
+| | |
+| | F27:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10483]
+| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
| | stored statistics:
-| | table: rows=30.00M size=1.55GB
+| | table: rows=73.05K size=2.17MB
| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=117 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 112(GETNEXT)
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=2 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 01(GETNEXT)
| |
-| 111:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF063[min_max] -> tpcds_partitioned_parquet_snap.store_sales_4.ss_customer_sk, RF062[bloom] -> tpcds_partitioned_parquet_snap.store_sales_4.ss_customer_sk
+| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
+| HDFS partitions=1831/1831 files=1831 size=280.96GB
+| runtime filters: RF031[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF032[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk, RF030[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk
| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=115 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 111(GETNEXT)
-|
-108:HASH JOIN [INNER JOIN, PARTITIONED]
-| hash-table-id=07
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45,68,91,114 row-size=580B cardinality=1.18G cost=517948489
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT), 187(OPEN), 191(OPEN), 195(OPEN)
-|
-|--F93:PLAN FRAGMENT [HASH(CUSTOMER_ID)] hosts=10 instances=80 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=1.92GB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=2350 segment-costs=[1946241445] cpu-comparison-result=360 [max(80 (self) vs 360 (sum children))]
-| JOIN BUILD
-| | join-table-id=07 plan-id=08 cohort-id=01
-| | build expressions: CUSTOMER_ID
-| | mem-estimate=1.90GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1183341306
-| |
-| 196:EXCHANGE [HASH(CUSTOMER_ID)]
-| | mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=114 row-size=116B cardinality=1.18G cost=762900139
-| | in pipelines: 187(GETNEXT), 191(GETNEXT), 195(GETNEXT)
-| |
-| F70:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=4.23GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=120 segment-costs=[44477605605, 26934229118, 13500002573, 37772016915] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))]
-| 107:SELECT
-| | predicates: DYEAR = add(CAST(1999 AS INT), CAST(1 AS INT)), SALE_TYPE = 'w'
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=114 row-size=116B cardinality=1.18G cost=23666825216
-| | in pipelines: 187(GETNEXT), 191(GETNEXT), 195(GETNEXT)
-| |
-| 87:UNION
-| | pass-through-operands: 88
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=114 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 187(GETNEXT), 191(GETNEXT), 195(GETNEXT)
-| |
-| |--195:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_13.c_customer_id, tpcds_partitioned_parquet_snap.customer_13.c_first_name, tpcds_partitioned_parquet_snap.customer_13.c_last_name, tpcds_partitioned_parquet_snap.customer_13.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_13.c_birth_country, tpcds_partitioned_parquet_snap.customer_13.c_login, tpcds_partitioned_parquet_snap.customer_13.c_email_address, tpcds_partitioned_parquet_snap.date_dim_13.d_year
-| | | mem-estimate=2.79GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=113 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 195(GETNEXT), 101(OPEN)
-| | |
-| | 194:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_13.c_customer_id,tpcds_partitioned_parquet_snap.customer_13.c_first_name,tpcds_partitioned_parquet_snap.customer_13.c_last_name,tpcds_partitioned_parquet_snap.customer_13.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_13.c_birth_country,tpcds_partitioned_parquet_snap.customer_13.c_login,tpcds_partitioned_parquet_snap.customer_13.c_email_address,tpcds_partitioned_parquet_snap.date_dim_13.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=113 row-size=169B cardinality=1.99G cost=1767409028
-| | | in pipelines: 101(GETNEXT)
-| | |
-| | F66:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=2.19GB mem-reservation=34.26MB thread-reservation=1
-| | max-parallelism=1824 segment-costs=[17827120882, 22676121640] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 106:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_13.c_customer_id, tpcds_partitioned_parquet_snap.customer_13.c_first_name, tpcds_partitioned_parquet_snap.customer_13.c_last_name, tpcds_partitioned_parquet_snap.customer_13.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_13.c_birth_country, tpcds_partitioned_parquet_snap.customer_13.c_login, tpcds_partitioned_parquet_snap.customer_13.c_email_address, tpcds_partitioned_parquet_snap.date_dim_13.d_year
-| | | mem-estimate=2.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=113 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 101(GETNEXT)
-| | |
-| | 105:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=12
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_3.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_3.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=107,109,111 row-size=582B cardinality=1.99G cost=870015958
-| | | in pipelines: 101(GETNEXT), 104(OPEN)
-| | |
-| | |--F98:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=12 plan-id=13 cohort-id=07
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 193:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=111 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 104(GETNEXT)
-| | | |
-| | | F68:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 104:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=111 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 104(GETNEXT)
-| | |
-| | 103:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=13
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_3.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_13.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_3.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_13.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=107,109 row-size=344B cardinality=1.99G cost=870015958
-| | | in pipelines: 101(GETNEXT), 102(OPEN)
-| | |
-| | |--F99:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=13 plan-id=14 cohort-id=07
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_13.c_customer_sk
-| | | | runtime filters: RF059[min_max] <- tpcds_partitioned_parquet_snap.customer_13.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 192:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=109 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 102(GETNEXT)
-| | | |
-| | | F67:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 102:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=109 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 102(GETNEXT)
-| | |
-| | 101:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF059[min_max] -> tpcds_partitioned_parquet_snap.web_sales_3.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=107 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 101(GETNEXT)
-| |
-| 88:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=106 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 187(GETNEXT), 191(GETNEXT)
-| |
-| |--191:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_12.c_customer_id, tpcds_partitioned_parquet_snap.customer_12.c_first_name, tpcds_partitioned_parquet_snap.customer_12.c_last_name, tpcds_partitioned_parquet_snap.customer_12.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_12.c_birth_country, tpcds_partitioned_parquet_snap.customer_12.c_login, tpcds_partitioned_parquet_snap.customer_12.c_email_address, tpcds_partitioned_parquet_snap.date_dim_12.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=105 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 191(GETNEXT), 95(OPEN)
-| | |
-| | 190:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_12.c_customer_id,tpcds_partitioned_parquet_snap.customer_12.c_first_name,tpcds_partitioned_parquet_snap.customer_12.c_last_name,tpcds_partitioned_parquet_snap.customer_12.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_12.c_birth_country,tpcds_partitioned_parquet_snap.customer_12.c_login,tpcds_partitioned_parquet_snap.customer_12.c_email_address,tpcds_partitioned_parquet_snap.date_dim_12.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=105 row-size=169B cardinality=3.97G cost=3526206713
-| | | in pipelines: 95(GETNEXT)
-| | |
-| | F61:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=4.26GB mem-reservation=35.00MB thread-reservation=1
-| | max-parallelism=1831 segment-costs=[35588885488, 45241758471] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 100:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_12.c_customer_id, tpcds_partitioned_parquet_snap.customer_12.c_first_name, tpcds_partitioned_parquet_snap.customer_12.c_last_name, tpcds_partitioned_parquet_snap.customer_12.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_12.c_birth_country, tpcds_partitioned_parquet_snap.customer_12.c_login, tpcds_partitioned_parquet_snap.customer_12.c_email_address, tpcds_partitioned_parquet_snap.date_dim_12.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=105 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 95(GETNEXT)
-| | |
-| | 99:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=10
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_3.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_3.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=99,101,103 row-size=582B cardinality=3.97G cost=1735792939
-| | | in pipelines: 95(GETNEXT), 98(OPEN)
-| | |
-| | |--F96:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=10 plan-id=11 cohort-id=06
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 189:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=103 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 98(GETNEXT)
-| | | |
-| | | F63:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 98:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=103 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 98(GETNEXT)
-| | |
-| | 97:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=11
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_3.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_12.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_3.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_12.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=99,101 row-size=344B cardinality=3.97G cost=1735792939
-| | | in pipelines: 95(GETNEXT), 96(OPEN)
-| | |
-| | |--F97:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=11 plan-id=12 cohort-id=06
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_12.c_customer_sk
-| | | | runtime filters: RF055[min_max] <- tpcds_partitioned_parquet_snap.customer_12.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 188:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=101 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 96(GETNEXT)
-| | | |
-| | | F62:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 96:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=101 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 96(GETNEXT)
-| | |
-| | 95:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF055[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_3.cs_bill_customer_sk
-| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=99 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 95(GETNEXT)
-| |
-| 187:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_11.c_customer_id, tpcds_partitioned_parquet_snap.customer_11.c_first_name, tpcds_partitioned_parquet_snap.customer_11.c_last_name, tpcds_partitioned_parquet_snap.customer_11.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_11.c_birth_country, tpcds_partitioned_parquet_snap.customer_11.c_login, tpcds_partitioned_parquet_snap.customer_11.c_email_address, tpcds_partitioned_parquet_snap.date_dim_11.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=98 row-size=169B cardinality=5.88G cost=37464857383
-| | in pipelines: 187(GETNEXT), 89(OPEN)
-| |
-| 186:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_11.c_customer_id,tpcds_partitioned_parquet_snap.customer_11.c_first_name,tpcds_partitioned_parquet_snap.customer_11.c_last_name,tpcds_partitioned_parquet_snap.customer_11.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_11.c_birth_country,tpcds_partitioned_parquet_snap.customer_11.c_login,tpcds_partitioned_parquet_snap.customer_11.c_email_address,tpcds_partitioned_parquet_snap.date_dim_11.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=98 row-size=169B cardinality=7.89G cost=7012748222
-| | in pipelines: 89(GETNEXT)
-| |
-| F57:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=4.26GB mem-reservation=42.00MB thread-reservation=1
-| max-parallelism=1824 segment-costs=[65500594865, 89974606443] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 94:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_11.c_customer_id, tpcds_partitioned_parquet_snap.customer_11.c_first_name, tpcds_partitioned_parquet_snap.customer_11.c_last_name, tpcds_partitioned_parquet_snap.customer_11.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_11.c_birth_country, tpcds_partitioned_parquet_snap.customer_11.c_login, tpcds_partitioned_parquet_snap.customer_11.c_email_address, tpcds_partitioned_parquet_snap.date_dim_11.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=98 row-size=169B cardinality=7.89G cost=46613754103
-| | in pipelines: 89(GETNEXT)
-| |
-| 93:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=08
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=92,94,96 row-size=538B cardinality=7.93G cost=3471497176
-| | in pipelines: 89(GETNEXT), 92(OPEN)
-| |
-| |--F94:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
-| | JOIN BUILD
-| | | join-table-id=08 plan-id=09 cohort-id=05
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | |
-| | 185:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=96 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 92(GETNEXT)
-| | |
-| | F59:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 92:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=96 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 92(GETNEXT)
-| |
-| 91:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=09
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_11.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_11.c_customer_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=92,94 row-size=300B cardinality=7.93G cost=3471497176
-| | in pipelines: 89(GETNEXT), 90(OPEN)
-| |
-| |--F95:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=10 segment-costs=[69869990]
-| | JOIN BUILD
-| | | join-table-id=09 plan-id=10 cohort-id=05
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_11.c_customer_sk
-| | | runtime filters: RF050[bloom] <- tpcds_partitioned_parquet_snap.customer_11.c_customer_sk, RF051[min_max] <- tpcds_partitioned_parquet_snap.customer_11.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | |
-| | 184:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=94 row-size=204B cardinality=30.00M cost=39869990
-| | | in pipelines: 90(GETNEXT)
-| | |
-| | F58:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
-| | 90:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=94 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 90(GETNEXT)
-| |
-| 89:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF051[min_max] -> tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk, RF050[bloom] -> tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk
-| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=92 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 89(GETNEXT)
-|
-86:HASH JOIN [INNER JOIN, PARTITIONED]
-| hash-table-id=14
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| other join predicates: CASE WHEN YEAR_TOTAL > CAST(0 AS DECIMAL(3,0)) THEN divide(YEAR_TOTAL, YEAR_TOTAL) ELSE NULL END > CASE WHEN YEAR_TOTAL > CAST(0 AS DECIMAL(3,0)) THEN divide(YEAR_TOTAL, YEAR_TOTAL) ELSE NULL END
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45,68,91 row-size=464B cardinality=1.18G cost=517948489
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT), 174(OPEN), 178(OPEN), 182(OPEN)
-|
-|--F100:PLAN FRAGMENT [HASH(CUSTOMER_ID)] hosts=10 instances=80 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=1.92GB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=2350 segment-costs=[1946241445] cpu-comparison-result=360 [max(80 (self) vs 360 (sum children))]
-| JOIN BUILD
-| | join-table-id=14 plan-id=15 cohort-id=01
-| | build expressions: CUSTOMER_ID
-| | mem-estimate=1.90GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1183341306
-| |
-| 183:EXCHANGE [HASH(CUSTOMER_ID)]
-| | mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=91 row-size=116B cardinality=1.18G cost=762900139
-| | in pipelines: 174(GETNEXT), 178(GETNEXT), 182(GETNEXT)
-| |
-| F56:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=4.23GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=120 segment-costs=[44477605605, 26934229118, 13500002573, 49605428499] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))]
-| 85:SELECT
-| | predicates: DYEAR = CAST(1999 AS INT), SALE_TYPE = 'c', YEAR_TOTAL > CAST(0 AS DECIMAL(3,0))
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=91 row-size=116B cardinality=1.18G cost=35500236800
-| | in pipelines: 174(GETNEXT), 178(GETNEXT), 182(GETNEXT)
-| |
-| 65:UNION
-| | pass-through-operands: 66
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=91 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 174(GETNEXT), 178(GETNEXT), 182(GETNEXT)
-| |
-| |--182:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_10.c_customer_id, tpcds_partitioned_parquet_snap.customer_10.c_first_name, tpcds_partitioned_parquet_snap.customer_10.c_last_name, tpcds_partitioned_parquet_snap.customer_10.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_10.c_birth_country, tpcds_partitioned_parquet_snap.customer_10.c_login, tpcds_partitioned_parquet_snap.customer_10.c_email_address, tpcds_partitioned_parquet_snap.date_dim_10.d_year
-| | | mem-estimate=2.79GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=90 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 182(GETNEXT), 79(OPEN)
-| | |
-| | 181:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_10.c_customer_id,tpcds_partitioned_parquet_snap.customer_10.c_first_name,tpcds_partitioned_parquet_snap.customer_10.c_last_name,tpcds_partitioned_parquet_snap.customer_10.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_10.c_birth_country,tpcds_partitioned_parquet_snap.customer_10.c_login,tpcds_partitioned_parquet_snap.customer_10.c_email_address,tpcds_partitioned_parquet_snap.date_dim_10.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=90 row-size=169B cardinality=1.99G cost=1767409028
-| | | in pipelines: 79(GETNEXT)
-| | |
-| | F52:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=2.19GB mem-reservation=34.26MB thread-reservation=1
-| | max-parallelism=1824 segment-costs=[17827120882, 22676121640] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 84:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_10.c_customer_id, tpcds_partitioned_parquet_snap.customer_10.c_first_name, tpcds_partitioned_parquet_snap.customer_10.c_last_name, tpcds_partitioned_parquet_snap.customer_10.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_10.c_birth_country, tpcds_partitioned_parquet_snap.customer_10.c_login, tpcds_partitioned_parquet_snap.customer_10.c_email_address, tpcds_partitioned_parquet_snap.date_dim_10.d_year
-| | | mem-estimate=2.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=90 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 79(GETNEXT)
-| | |
-| | 83:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=19
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_2.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_2.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=84,86,88 row-size=582B cardinality=1.99G cost=870015958
-| | | in pipelines: 79(GETNEXT), 82(OPEN)
-| | |
-| | |--F105:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=19 plan-id=20 cohort-id=10
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 180:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=88 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 82(GETNEXT)
-| | | |
-| | | F54:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 82:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=88 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 82(GETNEXT)
-| | |
-| | 81:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=20
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_2.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_10.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_2.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_10.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=84,86 row-size=344B cardinality=1.99G cost=870015958
-| | | in pipelines: 79(GETNEXT), 80(OPEN)
-| | |
-| | |--F106:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=20 plan-id=21 cohort-id=10
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_10.c_customer_sk
-| | | | runtime filters: RF047[min_max] <- tpcds_partitioned_parquet_snap.customer_10.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 179:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=86 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 80(GETNEXT)
-| | | |
-| | | F53:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 80:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=86 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 80(GETNEXT)
-| | |
-| | 79:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF047[min_max] -> tpcds_partitioned_parquet_snap.web_sales_2.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=84 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 79(GETNEXT)
-| |
-| 66:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=83 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 174(GETNEXT), 178(GETNEXT)
-| |
-| |--178:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_9.c_customer_id, tpcds_partitioned_parquet_snap.customer_9.c_first_name, tpcds_partitioned_parquet_snap.customer_9.c_last_name, tpcds_partitioned_parquet_snap.customer_9.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_9.c_birth_country, tpcds_partitioned_parquet_snap.customer_9.c_login, tpcds_partitioned_parquet_snap.customer_9.c_email_address, tpcds_partitioned_parquet_snap.date_dim_9.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=82 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 178(GETNEXT), 73(OPEN)
-| | |
-| | 177:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_9.c_customer_id,tpcds_partitioned_parquet_snap.customer_9.c_first_name,tpcds_partitioned_parquet_snap.customer_9.c_last_name,tpcds_partitioned_parquet_snap.customer_9.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_9.c_birth_country,tpcds_partitioned_parquet_snap.customer_9.c_login,tpcds_partitioned_parquet_snap.customer_9.c_email_address,tpcds_partitioned_parquet_snap.date_dim_9.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=82 row-size=169B cardinality=3.97G cost=3526206713
-| | | in pipelines: 73(GETNEXT)
-| | |
-| | F47:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| | Per-Instance Resources: mem-estimate=4.26GB mem-reservation=35.00MB thread-reservation=1
-| | max-parallelism=1831 segment-costs=[35588885488, 45241758471] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 78:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_9.c_customer_id, tpcds_partitioned_parquet_snap.customer_9.c_first_name, tpcds_partitioned_parquet_snap.customer_9.c_last_name, tpcds_partitioned_parquet_snap.customer_9.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_9.c_birth_country, tpcds_partitioned_parquet_snap.customer_9.c_login, tpcds_partitioned_parquet_snap.customer_9.c_email_address, tpcds_partitioned_parquet_snap.date_dim_9.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=82 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 73(GETNEXT)
-| | |
-| | 77:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=17
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_2.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_2.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=76,78,80 row-size=582B cardinality=3.97G cost=1735792939
-| | | in pipelines: 73(GETNEXT), 76(OPEN)
-| | |
-| | |--F103:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=17 plan-id=18 cohort-id=09
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 176:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=80 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 76(GETNEXT)
-| | | |
-| | | F49:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 76:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=80 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 76(GETNEXT)
-| | |
-| | 75:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=18
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_2.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_9.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_2.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_9.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=76,78 row-size=344B cardinality=3.97G cost=1735792939
-| | | in pipelines: 73(GETNEXT), 74(OPEN)
-| | |
-| | |--F104:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=18 plan-id=19 cohort-id=09
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_9.c_customer_sk
-| | | | runtime filters: RF042[bloom] <- tpcds_partitioned_parquet_snap.customer_9.c_customer_sk, RF043[min_max] <- tpcds_partitioned_parquet_snap.customer_9.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 175:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=78 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 74(GETNEXT)
-| | | |
-| | | F48:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 74:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=78 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 74(GETNEXT)
-| | |
-| | 73:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF043[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_2.cs_bill_customer_sk, RF042[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_2.cs_bill_customer_sk
-| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=76 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 73(GETNEXT)
-| |
-| 174:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_8.c_customer_id, tpcds_partitioned_parquet_snap.customer_8.c_first_name, tpcds_partitioned_parquet_snap.customer_8.c_last_name, tpcds_partitioned_parquet_snap.customer_8.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_8.c_birth_country, tpcds_partitioned_parquet_snap.customer_8.c_login, tpcds_partitioned_parquet_snap.customer_8.c_email_address, tpcds_partitioned_parquet_snap.date_dim_8.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=75 row-size=169B cardinality=5.88G cost=37464857383
-| | in pipelines: 174(GETNEXT), 67(OPEN)
-| |
-| 173:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_8.c_customer_id,tpcds_partitioned_parquet_snap.customer_8.c_first_name,tpcds_partitioned_parquet_snap.customer_8.c_last_name,tpcds_partitioned_parquet_snap.customer_8.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_8.c_birth_country,tpcds_partitioned_parquet_snap.customer_8.c_login,tpcds_partitioned_parquet_snap.customer_8.c_email_address,tpcds_partitioned_parquet_snap.date_dim_8.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=75 row-size=169B cardinality=7.89G cost=7012748222
-| | in pipelines: 67(GETNEXT)
-| |
-| F43:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=4.26GB mem-reservation=42.00MB thread-reservation=1
-| max-parallelism=1824 segment-costs=[65500594865, 89974606443] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 72:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_8.c_customer_id, tpcds_partitioned_parquet_snap.customer_8.c_first_name, tpcds_partitioned_parquet_snap.customer_8.c_last_name, tpcds_partitioned_parquet_snap.customer_8.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_8.c_birth_country, tpcds_partitioned_parquet_snap.customer_8.c_login, tpcds_partitioned_parquet_snap.customer_8.c_email_address, tpcds_partitioned_parquet_snap.date_dim_8.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=75 row-size=169B cardinality=7.89G cost=46613754103
-| | in pipelines: 67(GETNEXT)
-| |
-| 71:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=15
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_2.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=69,71,73 row-size=538B cardinality=7.93G cost=3471497176
-| | in pipelines: 67(GETNEXT), 70(OPEN)
-| |
-| |--F101:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
-| | JOIN BUILD
-| | | join-table-id=15 plan-id=16 cohort-id=08
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | |
-| | 172:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=73 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 70(GETNEXT)
-| | |
-| | F45:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 70:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=73 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 70(GETNEXT)
-| |
-| 69:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=16
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_8.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_2.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_8.c_customer_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=69,71 row-size=300B cardinality=7.93G cost=3471497176
-| | in pipelines: 67(GETNEXT), 68(OPEN)
-| |
-| |--F102:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=10 segment-costs=[69869990]
-| | JOIN BUILD
-| | | join-table-id=16 plan-id=17 cohort-id=08
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_8.c_customer_sk
-| | | runtime filters: RF038[bloom] <- tpcds_partitioned_parquet_snap.customer_8.c_customer_sk, RF039[min_max] <- tpcds_partitioned_parquet_snap.customer_8.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | |
-| | 171:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=71 row-size=204B cardinality=30.00M cost=39869990
-| | | in pipelines: 68(GETNEXT)
-| | |
-| | F44:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
-| | 68:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=71 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 68(GETNEXT)
-| |
-| 67:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF039[min_max] -> tpcds_partitioned_parquet_snap.store_sales_2.ss_customer_sk, RF038[bloom] -> tpcds_partitioned_parquet_snap.store_sales_2.ss_customer_sk
-| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=69 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 67(GETNEXT)
-|
-64:HASH JOIN [INNER JOIN, PARTITIONED]
-| hash-table-id=21
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45,68 row-size=348B cardinality=1.18G cost=517948489
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT), 161(OPEN), 165(OPEN), 169(OPEN)
-|
-|--F107:PLAN FRAGMENT [HASH(CUSTOMER_ID)] hosts=10 instances=80 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=1.92GB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=2350 segment-costs=[1946241445] cpu-comparison-result=360 [max(80 (self) vs 360 (sum children))]
-| JOIN BUILD
-| | join-table-id=21 plan-id=22 cohort-id=01
-| | build expressions: CUSTOMER_ID
-| | mem-estimate=1.90GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1183341306
-| |
-| 170:EXCHANGE [HASH(CUSTOMER_ID)]
-| | mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=68 row-size=116B cardinality=1.18G cost=762900139
-| | in pipelines: 161(GETNEXT), 165(GETNEXT), 169(GETNEXT)
-| |
-| F42:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=4.23GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=120 segment-costs=[44477605605, 26934229118, 13500002573, 37772016915] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))]
-| 63:SELECT
-| | predicates: DYEAR = add(CAST(1999 AS INT), CAST(1 AS INT)), SALE_TYPE = 'c'
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=68 row-size=116B cardinality=1.18G cost=23666825216
-| | in pipelines: 161(GETNEXT), 165(GETNEXT), 169(GETNEXT)
-| |
-| 43:UNION
-| | pass-through-operands: 44
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=68 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 161(GETNEXT), 165(GETNEXT), 169(GETNEXT)
-| |
-| |--169:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_7.c_customer_id, tpcds_partitioned_parquet_snap.customer_7.c_first_name, tpcds_partitioned_parquet_snap.customer_7.c_last_name, tpcds_partitioned_parquet_snap.customer_7.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_7.c_birth_country, tpcds_partitioned_parquet_snap.customer_7.c_login, tpcds_partitioned_parquet_snap.customer_7.c_email_address, tpcds_partitioned_parquet_snap.date_dim_7.d_year
-| | | mem-estimate=2.79GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=67 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 169(GETNEXT), 57(OPEN)
-| | |
-| | 168:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_7.c_customer_id,tpcds_partitioned_parquet_snap.customer_7.c_first_name,tpcds_partitioned_parquet_snap.customer_7.c_last_name,tpcds_partitioned_parquet_snap.customer_7.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_7.c_birth_country,tpcds_partitioned_parquet_snap.customer_7.c_login,tpcds_partitioned_parquet_snap.customer_7.c_email_address,tpcds_partitioned_parquet_snap.date_dim_7.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=67 row-size=169B cardinality=1.99G cost=1767409028
-| | | in pipelines: 57(GETNEXT)
-| | |
-| | F38:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=2.19GB mem-reservation=34.26MB thread-reservation=1
-| | max-parallelism=1824 segment-costs=[17827120882, 22676121640] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 62:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_7.c_customer_id, tpcds_partitioned_parquet_snap.customer_7.c_first_name, tpcds_partitioned_parquet_snap.customer_7.c_last_name, tpcds_partitioned_parquet_snap.customer_7.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_7.c_birth_country, tpcds_partitioned_parquet_snap.customer_7.c_login, tpcds_partitioned_parquet_snap.customer_7.c_email_address, tpcds_partitioned_parquet_snap.date_dim_7.d_year
-| | | mem-estimate=2.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=67 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 57(GETNEXT)
-| | |
-| | 61:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=26
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_1.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_1.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=61,63,65 row-size=582B cardinality=1.99G cost=870015958
-| | | in pipelines: 57(GETNEXT), 60(OPEN)
-| | |
-| | |--F112:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=26 plan-id=27 cohort-id=13
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 167:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=65 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 60(GETNEXT)
-| | | |
-| | | F40:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 60:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=65 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 60(GETNEXT)
-| | |
-| | 59:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=27
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_1.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_7.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_1.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_7.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=61,63 row-size=344B cardinality=1.99G cost=870015958
-| | | in pipelines: 57(GETNEXT), 58(OPEN)
-| | |
-| | |--F113:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=27 plan-id=28 cohort-id=13
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_7.c_customer_sk
-| | | | runtime filters: RF035[min_max] <- tpcds_partitioned_parquet_snap.customer_7.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 166:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=63 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 58(GETNEXT)
-| | | |
-| | | F39:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 58:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=63 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 58(GETNEXT)
-| | |
-| | 57:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF035[min_max] -> tpcds_partitioned_parquet_snap.web_sales_1.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=61 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 57(GETNEXT)
-| |
-| 44:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=60 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 161(GETNEXT), 165(GETNEXT)
-| |
-| |--165:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_6.c_customer_id, tpcds_partitioned_parquet_snap.customer_6.c_first_name, tpcds_partitioned_parquet_snap.customer_6.c_last_name, tpcds_partitioned_parquet_snap.customer_6.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_6.c_birth_country, tpcds_partitioned_parquet_snap.customer_6.c_login, tpcds_partitioned_parquet_snap.customer_6.c_email_address, tpcds_partitioned_parquet_snap.date_dim_6.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=59 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 165(GETNEXT), 51(OPEN)
-| | |
-| | 164:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_6.c_customer_id,tpcds_partitioned_parquet_snap.customer_6.c_first_name,tpcds_partitioned_parquet_snap.customer_6.c_last_name,tpcds_partitioned_parquet_snap.customer_6.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_6.c_birth_country,tpcds_partitioned_parquet_snap.customer_6.c_login,tpcds_partitioned_parquet_snap.customer_6.c_email_address,tpcds_partitioned_parquet_snap.date_dim_6.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=59 row-size=169B cardinality=3.97G cost=3526206713
-| | | in pipelines: 51(GETNEXT)
-| | |
-| | F33:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| | Per-Instance Resources: mem-estimate=4.26GB mem-reservation=35.00MB thread-reservation=1
-| | max-parallelism=1831 segment-costs=[35588885488, 45241758471] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 56:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_6.c_customer_id, tpcds_partitioned_parquet_snap.customer_6.c_first_name, tpcds_partitioned_parquet_snap.customer_6.c_last_name, tpcds_partitioned_parquet_snap.customer_6.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_6.c_birth_country, tpcds_partitioned_parquet_snap.customer_6.c_login, tpcds_partitioned_parquet_snap.customer_6.c_email_address, tpcds_partitioned_parquet_snap.date_dim_6.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=59 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 51(GETNEXT)
-| | |
-| | 55:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=24
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=53,55,57 row-size=582B cardinality=3.97G cost=1735792939
-| | | in pipelines: 51(GETNEXT), 54(OPEN)
-| | |
-| | |--F110:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=24 plan-id=25 cohort-id=12
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 163:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=57 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 54(GETNEXT)
-| | | |
-| | | F35:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 54:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=57 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 54(GETNEXT)
-| | |
-| | 53:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=25
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_6.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_6.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=53,55 row-size=344B cardinality=3.97G cost=1735792939
-| | | in pipelines: 51(GETNEXT), 52(OPEN)
-| | |
-| | |--F111:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=25 plan-id=26 cohort-id=12
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_6.c_customer_sk
-| | | | runtime filters: RF030[bloom] <- tpcds_partitioned_parquet_snap.customer_6.c_customer_sk, RF031[min_max] <- tpcds_partitioned_parquet_snap.customer_6.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 162:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=55 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 52(GETNEXT)
-| | | |
-| | | F34:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 52:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=55 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 52(GETNEXT)
-| | |
-| | 51:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF031[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_1.cs_bill_customer_sk, RF030[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_1.cs_bill_customer_sk
-| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=53 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 51(GETNEXT)
-| |
-| 161:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_5.c_customer_id, tpcds_partitioned_parquet_snap.customer_5.c_first_name, tpcds_partitioned_parquet_snap.customer_5.c_last_name, tpcds_partitioned_parquet_snap.customer_5.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_5.c_birth_country, tpcds_partitioned_parquet_snap.customer_5.c_login, tpcds_partitioned_parquet_snap.customer_5.c_email_address, tpcds_partitioned_parquet_snap.date_dim_5.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=52 row-size=169B cardinality=5.88G cost=37464857383
-| | in pipelines: 161(GETNEXT), 45(OPEN)
-| |
-| 160:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_5.c_customer_id,tpcds_partitioned_parquet_snap.customer_5.c_first_name,tpcds_partitioned_parquet_snap.customer_5.c_last_name,tpcds_partitioned_parquet_snap.customer_5.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_5.c_birth_country,tpcds_partitioned_parquet_snap.customer_5.c_login,tpcds_partitioned_parquet_snap.customer_5.c_email_address,tpcds_partitioned_parquet_snap.date_dim_5.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=52 row-size=169B cardinality=7.89G cost=7012748222
-| | in pipelines: 45(GETNEXT)
-| |
-| F29:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=4.26GB mem-reservation=42.00MB thread-reservation=1
-| max-parallelism=1824 segment-costs=[65500594865, 89974606443] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 50:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_5.c_customer_id, tpcds_partitioned_parquet_snap.customer_5.c_first_name, tpcds_partitioned_parquet_snap.customer_5.c_last_name, tpcds_partitioned_parquet_snap.customer_5.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_5.c_birth_country, tpcds_partitioned_parquet_snap.customer_5.c_login, tpcds_partitioned_parquet_snap.customer_5.c_email_address, tpcds_partitioned_parquet_snap.date_dim_5.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=52 row-size=169B cardinality=7.89G cost=46613754103
-| | in pipelines: 45(GETNEXT)
-| |
-| 49:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=22
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=46,48,50 row-size=538B cardinality=7.93G cost=3471497176
-| | in pipelines: 45(GETNEXT), 48(OPEN)
-| |
-| |--F108:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
-| | JOIN BUILD
-| | | join-table-id=22 plan-id=23 cohort-id=11
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | |
-| | 159:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=50 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 48(GETNEXT)
-| | |
-| | F31:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 48:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=50 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 48(GETNEXT)
-| |
-| 47:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=23
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_5.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_5.c_customer_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=46,48 row-size=300B cardinality=7.93G cost=3471497176
-| | in pipelines: 45(GETNEXT), 46(OPEN)
-| |
-| |--F109:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=10 segment-costs=[69869990]
-| | JOIN BUILD
-| | | join-table-id=23 plan-id=24 cohort-id=11
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_5.c_customer_sk
-| | | runtime filters: RF026[bloom] <- tpcds_partitioned_parquet_snap.customer_5.c_customer_sk, RF027[min_max] <- tpcds_partitioned_parquet_snap.customer_5.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | |
-| | 158:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=48 row-size=204B cardinality=30.00M cost=39869990
-| | | in pipelines: 46(GETNEXT)
-| | |
-| | F30:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
-| | 46:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=48 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 46(GETNEXT)
-| |
-| 45:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF027[min_max] -> tpcds_partitioned_parquet_snap.store_sales_1.ss_customer_sk, RF026[bloom] -> tpcds_partitioned_parquet_snap.store_sales_1.ss_customer_sk
-| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
+| table: rows=4.32G size=280.96GB
+| partitions: 1831/1831 rows=4.32G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=46 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 45(GETNEXT)
+| extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=374(filtered from 1831)
+| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| tuple-ids=0 row-size=24B cardinality=880.06M(filtered from 4.32G) cost=304148590
+| in pipelines: 00(GETNEXT)
|
-42:HASH JOIN [INNER JOIN, PARTITIONED]
-| hash-table-id=28
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
+39:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=03
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45 row-size=232B cardinality=1.18G cost=517948489
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT), 147(OPEN), 151(OPEN), 155(OPEN)
+| tuple-ids=34,41,27,20,13 row-size=826B cardinality=30.00M cost=13131000
+| in pipelines: 46(GETNEXT), 70(OPEN)
|
-|--F114:PLAN FRAGMENT [HASH(CUSTOMER_ID)] hosts=10 instances=80 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=1.92GB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=2350 segment-costs=[1946241445] cpu-comparison-result=360 [max(80 (self) vs 360 (sum children))]
+|--F35:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)] hosts=10 instances=100 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=81.45MB mem-reservation=34.00MB thread-reservation=1
+| | max-parallelism=160 segment-costs=[56123197] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
| JOIN BUILD
-| | join-table-id=28 plan-id=29 cohort-id=01
-| | build expressions: CUSTOMER_ID
-| | mem-estimate=1.90GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1183341306
-| |
-| 157:EXCHANGE [HASH(CUSTOMER_ID)]
-| | mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=45 row-size=116B cardinality=1.18G cost=762900139
-| | in pipelines: 147(GETNEXT), 151(GETNEXT), 155(GETNEXT)
-| |
-| F27:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=4.23GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=120 segment-costs=[44477605605, 26934229118, 13500002573, 49605428499] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))]
-| 41:SELECT
-| | predicates: DYEAR = CAST(1999 AS INT), SALE_TYPE = 's', YEAR_TOTAL > CAST(0 AS DECIMAL(3,0))
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=45 row-size=116B cardinality=1.18G cost=35500236800
-| | in pipelines: 147(GETNEXT), 151(GETNEXT), 155(GETNEXT)
-| |
-| 21:UNION
-| | pass-through-operands: 22
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=45 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 147(GETNEXT), 151(GETNEXT), 155(GETNEXT)
-| |
-| |--155:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address, tpcds_partitioned_parquet_snap.date_dim_4.d_year
-| | | mem-estimate=2.79GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=44 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 155(GETNEXT), 35(OPEN)
-| | |
-| | 154:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address,tpcds_partitioned_parquet_snap.date_dim_4.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=44 row-size=169B cardinality=1.99G cost=1767409028
-| | | in pipelines: 35(GETNEXT)
-| | |
-| | F23:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=2.19GB mem-reservation=34.26MB thread-reservation=1
-| | max-parallelism=1824 segment-costs=[17827120882, 22676121640] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 40:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address, tpcds_partitioned_parquet_snap.date_dim_4.d_year
-| | | mem-estimate=2.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=44 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 35(GETNEXT)
-| | |
-| | 39:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=33
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=38,40,42 row-size=582B cardinality=1.99G cost=870015958
-| | | in pipelines: 35(GETNEXT), 38(OPEN)
-| | |
-| | |--F119:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=33 plan-id=34 cohort-id=16
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 153:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=42 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 38(GETNEXT)
-| | | |
-| | | F25:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 38:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=42 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 38(GETNEXT)
-| | |
-| | 37:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=34
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=38,40 row-size=344B cardinality=1.99G cost=870015958
-| | | in pipelines: 35(GETNEXT), 36(OPEN)
-| | |
-| | |--F120:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=34 plan-id=35 cohort-id=16
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | | runtime filters: RF023[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 152:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=40 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 36(GETNEXT)
-| | | |
-| | | F24:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 36:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=40 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 36(GETNEXT)
-| | |
-| | 35:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=38 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 35(GETNEXT)
-| |
-| 22:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=37 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 147(GETNEXT), 151(GETNEXT)
-| |
-| |--151:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address, tpcds_partitioned_parquet_snap.date_dim_3.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=36 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 151(GETNEXT), 29(OPEN)
-| | |
-| | 150:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id,tpcds_partitioned_parquet_snap.customer_3.c_first_name,tpcds_partitioned_parquet_snap.customer_3.c_last_name,tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_3.c_birth_country,tpcds_partitioned_parquet_snap.customer_3.c_login,tpcds_partitioned_parquet_snap.customer_3.c_email_address,tpcds_partitioned_parquet_snap.date_dim_3.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=36 row-size=169B cardinality=3.97G cost=3526206713
-| | | in pipelines: 29(GETNEXT)
-| | |
-| | F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| | Per-Instance Resources: mem-estimate=4.26GB mem-reservation=35.00MB thread-reservation=1
-| | max-parallelism=1831 segment-costs=[35588885488, 45241758471] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 34:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address, tpcds_partitioned_parquet_snap.date_dim_3.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=36 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 29(GETNEXT)
-| | |
-| | 33:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=31
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=30,32,34 row-size=582B cardinality=3.97G cost=1735792939
-| | | in pipelines: 29(GETNEXT), 32(OPEN)
-| | |
-| | |--F117:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=31 plan-id=32 cohort-id=15
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 149:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=34 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 32(GETNEXT)
-| | | |
-| | | F20:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 32:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=34 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 32(GETNEXT)
-| | |
-| | 31:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=32
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=30,32 row-size=344B cardinality=3.97G cost=1735792939
-| | | in pipelines: 29(GETNEXT), 30(OPEN)
-| | |
-| | |--F118:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=32 plan-id=33 cohort-id=15
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk, RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 148:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=32 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 30(GETNEXT)
-| | | |
-| | | F19:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 30:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=32 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 30(GETNEXT)
-| | |
-| | 29:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk
-| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=30 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 29(GETNEXT)
-| |
-| 147:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address, tpcds_partitioned_parquet_snap.date_dim_2.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=29 row-size=169B cardinality=5.88G cost=37464857383
-| | in pipelines: 147(GETNEXT), 23(OPEN)
-| |
-| 146:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address,tpcds_partitioned_parquet_snap.date_dim_2.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=29 row-size=169B cardinality=7.89G cost=7012748222
-| | in pipelines: 23(GETNEXT)
-| |
-| F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=4.26GB mem-reservation=42.00MB thread-reservation=1
-| max-parallelism=1824 segment-costs=[65500594865, 89974606443] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 28:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address, tpcds_partitioned_parquet_snap.date_dim_2.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=29 row-size=169B cardinality=7.89G cost=46613754103
-| | in pipelines: 23(GETNEXT)
-| |
-| 27:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=29
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=23,25,27 row-size=538B cardinality=7.93G cost=3471497176
-| | in pipelines: 23(GETNEXT), 26(OPEN)
-| |
-| |--F115:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
-| | JOIN BUILD
-| | | join-table-id=29 plan-id=30 cohort-id=14
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | |
-| | 145:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=27 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 26(GETNEXT)
-| | |
-| | F16:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 26:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=27 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 26(GETNEXT)
-| |
-| 25:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=30
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=23,25 row-size=300B cardinality=7.93G cost=3471497176
-| | in pipelines: 23(GETNEXT), 24(OPEN)
-| |
-| |--F116:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=10 segment-costs=[69869990]
-| | JOIN BUILD
-| | | join-table-id=30 plan-id=31 cohort-id=14
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | |
-| | 144:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=25 row-size=204B cardinality=30.00M cost=39869990
-| | | in pipelines: 24(GETNEXT)
-| | |
-| | F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
-| | 24:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=25 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 24(GETNEXT)
-| |
-| 23:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF014[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk
-| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=23 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 23(GETNEXT)
-|
-156:EXCHANGE [HASH(CUSTOMER_ID)]
-| mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| tuple-ids=22 row-size=116B cardinality=1.18G cost=762900139
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT)
-|
-F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-Per-Instance Resources: mem-estimate=4.23GB mem-reservation=34.00MB thread-reservation=1
-max-parallelism=120 segment-costs=[44477605605, 26934229118, 13500002573, 37772016915] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))]
-20:SELECT
-| predicates: DYEAR = add(CAST(1999 AS INT), CAST(1 AS INT)), SALE_TYPE = 's'
-| mem-estimate=0B mem-reservation=0B thread-reservation=0
-| tuple-ids=22 row-size=116B cardinality=1.18G cost=23666825216
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT)
-|
-00:UNION
-| pass-through-operands: 01
-| mem-estimate=0B mem-reservation=0B thread-reservation=0
-| tuple-ids=22 row-size=116B cardinality=11.83G cost=782000635
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT)
-|
-|--143:AGGREGATE [FINALIZE]
+| | join-table-id=03 plan-id=04 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | mem-estimate=54.93MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| |
+| 71:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)]
+| | mem-estimate=26.52MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=30.00M cost=26123197
+| | in pipelines: 70(GETNEXT)
+| |
+| F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)] hosts=10 instances=100 (adjusted from 120)
+| Per-Instance Resources: mem-estimate=715.42MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=100 segment-costs=[998712806, 334518771] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
+| 70:AGGREGATE [FINALIZE]
| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address, tpcds_partitioned_parquet_snap.date_dim_1.d_year
-| | mem-estimate=2.79GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=21 row-size=169B cardinality=1.99G cost=11732593545
-| | in pipelines: 143(GETNEXT), 14(OPEN)
-| |
-| 142:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address,tpcds_partitioned_parquet_snap.date_dim_1.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=21 row-size=169B cardinality=1.99G cost=1767409028
-| | in pipelines: 14(GETNEXT)
-| |
-| F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=2.19GB mem-reservation=34.26MB thread-reservation=1
-| max-parallelism=1824 segment-costs=[17827120882, 22676121640] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 19:AGGREGATE [STREAMING]
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
+| | mem-estimate=649.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=30.00M cost=664015288
+| | in pipelines: 70(GETNEXT), 06(OPEN)
+| |
+| 69:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=384.37M cost=334697518
+| | in pipelines: 06(GETNEXT)
+| |
+| F24:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=509.95MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=430 segment-costs=[2616446902, 4285945495] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 11:AGGREGATE [STREAMING]
| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address, tpcds_partitioned_parquet_snap.date_dim_1.d_year
-| | mem-estimate=2.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=21 row-size=169B cardinality=1.99G cost=11732593545
-| | in pipelines: 14(GETNEXT)
-| |
-| 18:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=39
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=15,17,19 row-size=582B cardinality=1.99G cost=870015958
-| | in pipelines: 14(GETNEXT), 17(OPEN)
-| |
-| |--F125:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
-| | JOIN BUILD
-| | | join-table-id=39 plan-id=40 cohort-id=01
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | |
-| | 141:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=19 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 17(GETNEXT)
-| | |
-| | F11:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 17:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=19 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 17(GETNEXT)
-| |
-| 16:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=40
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=15,17 row-size=344B cardinality=1.99G cost=870015958
-| | in pipelines: 14(GETNEXT), 15(OPEN)
-| |
-| |--F126:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[69869990]
-| | JOIN BUILD
-| | | join-table-id=40 plan-id=41 cohort-id=01
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | runtime filters: RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | |
-| | 140:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=17 row-size=204B cardinality=30.00M cost=39869990
-| | | in pipelines: 15(GETNEXT)
-| | |
-| | F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
-| | 15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=17 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 15(GETNEXT)
-| |
-| 14:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| HDFS partitions=1824/1824 files=1824 size=145.75GB
-| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk
-| stored statistics:
-| table: rows=2.16G size=145.75GB
-| partitions: 1824/1824 rows=2.16G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=3.37M
-| mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| tuple-ids=15 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| in pipelines: 14(GETNEXT)
-|
-01:UNION
-| mem-estimate=0B mem-reservation=0B thread-reservation=0
-| tuple-ids=14 row-size=116B cardinality=9.85G cost=3873500731
-| in pipelines: 135(GETNEXT), 139(GETNEXT)
-|
-|--139:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address, tpcds_partitioned_parquet_snap.date_dim_0.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=169B cardinality=3.97G cost=23408022405
-| | in pipelines: 139(GETNEXT), 08(OPEN)
-| |
-| 138:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address,tpcds_partitioned_parquet_snap.date_dim_0.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=13 row-size=169B cardinality=3.97G cost=3526206713
-| | in pipelines: 08(GETNEXT)
-| |
-| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=4.26GB mem-reservation=35.00MB thread-reservation=1
-| max-parallelism=1831 segment-costs=[35588885488, 45241758471] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 13:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address, tpcds_partitioned_parquet_snap.date_dim_0.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=169B cardinality=3.97G cost=23408022405
-| | in pipelines: 08(GETNEXT)
-| |
-| 12:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=37
-| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
+| | mem-estimate=429.19MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=384.37M cost=2299149579
+| | in pipelines: 06(GETNEXT)
+| |
+| 10:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=04
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=7,9,11 row-size=582B cardinality=3.97G cost=1735792939
-| | in pipelines: 08(GETNEXT), 11(OPEN)
+| | tuple-ids=7,9,11 row-size=185B cardinality=406.48M cost=186950480
+| | in pipelines: 06(GETNEXT), 09(OPEN)
| |
-| |--F123:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
+| |--F36:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=430 segment-costs=[54467197]
| | JOIN BUILD
-| | | join-table-id=37 plan-id=38 cohort-id=01
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | |
-| | 137:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=11 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 11(GETNEXT)
-| | |
-| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=11 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 11(GETNEXT)
-| |
-| 10:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=38
-| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=7,9 row-size=344B cardinality=3.97G cost=1735792939
-| | in pipelines: 08(GETNEXT), 09(OPEN)
-| |
-| |--F124:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=10 segment-costs=[69869990]
-| | JOIN BUILD
-| | | join-table-id=38 plan-id=39 cohort-id=01
+| | | join-table-id=04 plan-id=05 cohort-id=03
| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | | runtime filters: RF027[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 136:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=9 row-size=204B cardinality=30.00M cost=39869990
+| | 68:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=11 row-size=153B cardinality=30.00M cost=24467197
| | | in pipelines: 09(GETNEXT)
| | |
-| | F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
+| | F23:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[341205999]
| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=9 row-size=204B cardinality=30.00M cost=46823813
+| | tuple-ids=11 row-size=153B cardinality=30.00M cost=29871228
| | in pipelines: 09(GETNEXT)
| |
-| 08:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| HDFS partitions=1831/1831 files=1831 size=280.96GB
-| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF006[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk
-| stored statistics:
-| table: rows=4.32G size=280.96GB
-| partitions: 1831/1831 rows=4.32G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=21.52M
-| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=7 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| in pipelines: 08(GETNEXT)
-|
-135:AGGREGATE [FINALIZE]
-| output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2))
-| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address, tpcds_partitioned_parquet_snap.date_dim.d_year
-| mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=169B cardinality=5.88G cost=37464857383
-| in pipelines: 135(GETNEXT), 02(OPEN)
-|
-134:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address,tpcds_partitioned_parquet_snap.date_dim.d_year)]
-| mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| tuple-ids=6 row-size=169B cardinality=7.89G cost=7012748222
-| in pipelines: 02(GETNEXT)
-|
-F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-Per-Instance Resources: mem-estimate=4.26GB mem-reservation=42.00MB thread-reservation=1
-max-parallelism=1824 segment-costs=[65500594865, 89974606443] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-07:AGGREGATE [STREAMING]
-| output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address, tpcds_partitioned_parquet_snap.date_dim.d_year
-| mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=169B cardinality=7.89G cost=46613754103
-| in pipelines: 02(GETNEXT)
-|
-06:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=35
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4 row-size=538B cardinality=7.93G cost=3471497176
-| in pipelines: 02(GETNEXT), 05(OPEN)
-|
-|--F121:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[170129]
-| JOIN BUILD
-| | join-table-id=35 plan-id=36 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| |
-| 133:EXCHANGE [BROADCAST]
-| | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=237B cardinality=73.05K cost=97080
-| | in pipelines: 05(GETNEXT)
-| |
-| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[158950]
-| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| HDFS partitions=1/1 files=1 size=2.17MB
-| stored statistics:
-| table: rows=73.05K size=2.17MB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| tuple-ids=4 row-size=237B cardinality=73.05K cost=110600
-| in pipelines: 05(GETNEXT)
-|
-04:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=36
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2 row-size=300B cardinality=7.93G cost=3471497176
-| in pipelines: 02(GETNEXT), 03(OPEN)
-|
-|--F122:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | max-parallelism=10 segment-costs=[69869990]
-| JOIN BUILD
-| | join-table-id=36 plan-id=37 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| |
-| 132:EXCHANGE [BROADCAST]
-| | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=2 row-size=204B cardinality=30.00M cost=39869990
-| | in pipelines: 03(GETNEXT)
-| |
-| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| max-parallelism=10 segment-costs=[64027278]
-| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| HDFS partitions=1/1 files=1 size=1.55GB
-| stored statistics:
-| table: rows=30.00M size=1.55GB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=3.10M
-| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=2 row-size=204B cardinality=30.00M cost=46823813
-| in pipelines: 03(GETNEXT)
-|
-02:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
- HDFS partitions=1824/1824 files=1824 size=389.90GB
- runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk
- stored statistics:
- table: rows=8.64G size=389.90GB
- partitions: 1824/1824 rows=8.64G
- columns: all
- extrapolated-rows=disabled max-scan-range-rows=390.22M
- mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
- tuple-ids=0 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
- in pipelines: 02(GETNEXT)
----- PARALLELPLANS
-Max Per-Host Resource Reservation: Memory=26.29GB Threads=409
-Per-Host Resource Estimates: Memory=1.25TB
-F85:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=4.40MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[434] cpu-comparison-result=2160 [max(1 (self) vs 2160 (sum children))]
-PLAN-ROOT SINK
-| output exprs: CUSTOMER_ID, CUSTOMER_FIRST_NAME, CUSTOMER_LAST_NAME, CUSTOMER_BIRTH_COUNTRY
-| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
-|
-210:MERGING-EXCHANGE [UNPARTITIONED]
-| order by: CUSTOMER_ID ASC NULLS LAST, CUSTOMER_FIRST_NAME ASC NULLS LAST, CUSTOMER_LAST_NAME ASC NULLS LAST, CUSTOMER_BIRTH_COUNTRY ASC NULLS LAST
-| limit: 100
-| mem-estimate=406.72KB mem-reservation=0B thread-reservation=0
-| tuple-ids=138 row-size=48B cardinality=100 cost=34
-| in pipelines: 131(GETNEXT)
-|
-F28:PLAN FRAGMENT [HASH(CUSTOMER_ID)] hosts=10 instances=80 (adjusted from 120)
-Per-Instance Resources: mem-estimate=24.07MB mem-reservation=0B thread-reservation=1
-max-parallelism=2350 segment-costs=[23461227104, 157] cpu-comparison-result=2160 [max(80 (self) vs 2160 (sum children))]
-131:TOP-N [LIMIT=100]
-| order by: CUSTOMER_ID ASC NULLS LAST, CUSTOMER_FIRST_NAME ASC NULLS LAST, CUSTOMER_LAST_NAME ASC NULLS LAST, CUSTOMER_BIRTH_COUNTRY ASC NULLS LAST
-| mem-estimate=4.69KB mem-reservation=0B thread-reservation=0
-| tuple-ids=138 row-size=48B cardinality=100 cost=20108584520
-| in pipelines: 131(GETNEXT), 135(OPEN), 139(OPEN), 143(OPEN)
-|
-130:HASH JOIN [INNER JOIN, PARTITIONED]
-| hash-table-id=00
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| other join predicates: CASE WHEN YEAR_TOTAL > CAST(0 AS DECIMAL(3,0)) THEN divide(YEAR_TOTAL, YEAR_TOTAL) ELSE NULL END > CASE WHEN YEAR_TOTAL > CAST(0 AS DECIMAL(3,0)) THEN divide(YEAR_TOTAL, YEAR_TOTAL) ELSE NULL END
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45,68,91,114,137 row-size=696B cardinality=1.18G cost=517948489
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT), 200(OPEN), 204(OPEN), 208(OPEN)
-|
-|--F86:PLAN FRAGMENT [HASH(CUSTOMER_ID)] hosts=10 instances=80 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=1.92GB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=2350 segment-costs=[1946241445] cpu-comparison-result=360 [max(80 (self) vs 360 (sum children))]
-| JOIN BUILD
-| | join-table-id=00 plan-id=01 cohort-id=01
-| | build expressions: CUSTOMER_ID
-| | mem-estimate=1.90GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1183341306
-| |
-| 209:EXCHANGE [HASH(CUSTOMER_ID)]
-| | mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=137 row-size=116B cardinality=1.18G cost=762900139
-| | in pipelines: 200(GETNEXT), 204(GETNEXT), 208(GETNEXT)
-| |
-| F84:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=4.23GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=120 segment-costs=[44477605605, 26934229118, 13500002573, 49605428499] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))]
-| 129:SELECT
-| | predicates: DYEAR = CAST(1999 AS INT), SALE_TYPE = 'w', YEAR_TOTAL > CAST(0 AS DECIMAL(3,0))
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=137 row-size=116B cardinality=1.18G cost=35500236800
-| | in pipelines: 200(GETNEXT), 204(GETNEXT), 208(GETNEXT)
-| |
-| 109:UNION
-| | pass-through-operands: 110
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=137 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 200(GETNEXT), 204(GETNEXT), 208(GETNEXT)
-| |
-| |--208:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_16.c_customer_id, tpcds_partitioned_parquet_snap.customer_16.c_first_name, tpcds_partitioned_parquet_snap.customer_16.c_last_name, tpcds_partitioned_parquet_snap.customer_16.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_16.c_birth_country, tpcds_partitioned_parquet_snap.customer_16.c_login, tpcds_partitioned_parquet_snap.customer_16.c_email_address, tpcds_partitioned_parquet_snap.date_dim_16.d_year
-| | | mem-estimate=2.79GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=136 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 208(GETNEXT), 123(OPEN)
-| | |
-| | 207:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_16.c_customer_id,tpcds_partitioned_parquet_snap.customer_16.c_first_name,tpcds_partitioned_parquet_snap.customer_16.c_last_name,tpcds_partitioned_parquet_snap.customer_16.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_16.c_birth_country,tpcds_partitioned_parquet_snap.customer_16.c_login,tpcds_partitioned_parquet_snap.customer_16.c_email_address,tpcds_partitioned_parquet_snap.date_dim_16.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=136 row-size=169B cardinality=1.99G cost=1767409028
-| | | in pipelines: 123(GETNEXT)
-| | |
-| | F80:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=2.19GB mem-reservation=34.26MB thread-reservation=1
-| | max-parallelism=1824 segment-costs=[17827120882, 22676121640] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 128:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_4.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_16.c_customer_id, tpcds_partitioned_parquet_snap.customer_16.c_first_name, tpcds_partitioned_parquet_snap.customer_16.c_last_name, tpcds_partitioned_parquet_snap.customer_16.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_16.c_birth_country, tpcds_partitioned_parquet_snap.customer_16.c_login, tpcds_partitioned_parquet_snap.customer_16.c_email_address, tpcds_partitioned_parquet_snap.date_dim_16.d_year
-| | | mem-estimate=2.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=136 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 123(GETNEXT)
-| | |
-| | 127:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=05
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_4.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_4.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=130,132,134 row-size=582B cardinality=1.99G cost=870015958
-| | | in pipelines: 123(GETNEXT), 126(OPEN)
-| | |
-| | |--F91:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=05 plan-id=06 cohort-id=04
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_16.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 206:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=134 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 126(GETNEXT)
-| | | |
-| | | F82:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 126:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=134 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 126(GETNEXT)
-| | |
-| | 125:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=06
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_4.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_16.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_4.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_16.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=130,132 row-size=344B cardinality=1.99G cost=870015958
-| | | in pipelines: 123(GETNEXT), 124(OPEN)
-| | |
-| | |--F92:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=06 plan-id=07 cohort-id=04
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_16.c_customer_sk
-| | | | runtime filters: RF071[min_max] <- tpcds_partitioned_parquet_snap.customer_16.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 205:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=132 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 124(GETNEXT)
-| | | |
-| | | F81:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 124:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=132 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 124(GETNEXT)
-| | |
-| | 123:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF071[min_max] -> tpcds_partitioned_parquet_snap.web_sales_4.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=130 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 123(GETNEXT)
-| |
-| 110:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=129 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 200(GETNEXT), 204(GETNEXT)
-| |
-| |--204:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_15.c_customer_id, tpcds_partitioned_parquet_snap.customer_15.c_first_name, tpcds_partitioned_parquet_snap.customer_15.c_last_name, tpcds_partitioned_parquet_snap.customer_15.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_15.c_birth_country, tpcds_partitioned_parquet_snap.customer_15.c_login, tpcds_partitioned_parquet_snap.customer_15.c_email_address, tpcds_partitioned_parquet_snap.date_dim_15.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=128 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 204(GETNEXT), 117(OPEN)
-| | |
-| | 203:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_15.c_customer_id,tpcds_partitioned_parquet_snap.customer_15.c_first_name,tpcds_partitioned_parquet_snap.customer_15.c_last_name,tpcds_partitioned_parquet_snap.customer_15.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_15.c_birth_country,tpcds_partitioned_parquet_snap.customer_15.c_login,tpcds_partitioned_parquet_snap.customer_15.c_email_address,tpcds_partitioned_parquet_snap.date_dim_15.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=128 row-size=169B cardinality=3.97G cost=3526206713
-| | | in pipelines: 117(GETNEXT)
-| | |
-| | F75:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=4.26GB mem-reservation=35.00MB thread-reservation=1
-| | max-parallelism=1831 segment-costs=[35588885488, 45241758471] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 122:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_4.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_15.c_customer_id, tpcds_partitioned_parquet_snap.customer_15.c_first_name, tpcds_partitioned_parquet_snap.customer_15.c_last_name, tpcds_partitioned_parquet_snap.customer_15.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_15.c_birth_country, tpcds_partitioned_parquet_snap.customer_15.c_login, tpcds_partitioned_parquet_snap.customer_15.c_email_address, tpcds_partitioned_parquet_snap.date_dim_15.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=128 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 117(GETNEXT)
-| | |
-| | 121:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=03
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_4.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_4.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=122,124,126 row-size=582B cardinality=3.97G cost=1735792939
-| | | in pipelines: 117(GETNEXT), 120(OPEN)
-| | |
-| | |--F89:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=03 plan-id=04 cohort-id=03
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_15.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 202:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=126 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 120(GETNEXT)
-| | | |
-| | | F77:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 120:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=126 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 120(GETNEXT)
-| | |
-| | 119:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=04
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_4.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_15.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_4.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_15.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=122,124 row-size=344B cardinality=3.97G cost=1735792939
-| | | in pipelines: 117(GETNEXT), 118(OPEN)
-| | |
-| | |--F90:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=04 plan-id=05 cohort-id=03
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_15.c_customer_sk
-| | | | runtime filters: RF067[min_max] <- tpcds_partitioned_parquet_snap.customer_15.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 201:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=124 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 118(GETNEXT)
-| | | |
-| | | F76:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 118:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=124 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 118(GETNEXT)
-| | |
-| | 117:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF067[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_4.cs_bill_customer_sk
-| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=122 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 117(GETNEXT)
-| |
-| 200:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_14.c_customer_id, tpcds_partitioned_parquet_snap.customer_14.c_first_name, tpcds_partitioned_parquet_snap.customer_14.c_last_name, tpcds_partitioned_parquet_snap.customer_14.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_14.c_birth_country, tpcds_partitioned_parquet_snap.customer_14.c_login, tpcds_partitioned_parquet_snap.customer_14.c_email_address, tpcds_partitioned_parquet_snap.date_dim_14.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=121 row-size=169B cardinality=5.88G cost=37464857383
-| | in pipelines: 200(GETNEXT), 111(OPEN)
-| |
-| 199:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_14.c_customer_id,tpcds_partitioned_parquet_snap.customer_14.c_first_name,tpcds_partitioned_parquet_snap.customer_14.c_last_name,tpcds_partitioned_parquet_snap.customer_14.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_14.c_birth_country,tpcds_partitioned_parquet_snap.customer_14.c_login,tpcds_partitioned_parquet_snap.customer_14.c_email_address,tpcds_partitioned_parquet_snap.date_dim_14.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=121 row-size=169B cardinality=7.89G cost=7012748222
-| | in pipelines: 111(GETNEXT)
-| |
-| F71:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=4.26GB mem-reservation=42.00MB thread-reservation=1
-| max-parallelism=1824 segment-costs=[65500594865, 89974606443] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 116:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_4.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_14.c_customer_id, tpcds_partitioned_parquet_snap.customer_14.c_first_name, tpcds_partitioned_parquet_snap.customer_14.c_last_name, tpcds_partitioned_parquet_snap.customer_14.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_14.c_birth_country, tpcds_partitioned_parquet_snap.customer_14.c_login, tpcds_partitioned_parquet_snap.customer_14.c_email_address, tpcds_partitioned_parquet_snap.date_dim_14.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=121 row-size=169B cardinality=7.89G cost=46613754103
-| | in pipelines: 111(GETNEXT)
-| |
-| 115:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=01
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=115,117,119 row-size=538B cardinality=7.93G cost=3471497176
-| | in pipelines: 111(GETNEXT), 114(OPEN)
-| |
-| |--F87:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
-| | JOIN BUILD
-| | | join-table-id=01 plan-id=02 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_14.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | |
-| | 198:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=119 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 114(GETNEXT)
-| | |
-| | F73:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 114:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=119 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 114(GETNEXT)
-| |
-| 113:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=02
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_4.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_14.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_4.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_14.c_customer_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=115,117 row-size=300B cardinality=7.93G cost=3471497176
-| | in pipelines: 111(GETNEXT), 112(OPEN)
-| |
-| |--F88:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=10 segment-costs=[69869990]
-| | JOIN BUILD
-| | | join-table-id=02 plan-id=03 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_14.c_customer_sk
-| | | runtime filters: RF062[bloom] <- tpcds_partitioned_parquet_snap.customer_14.c_customer_sk, RF063[min_max] <- tpcds_partitioned_parquet_snap.customer_14.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | |
-| | 197:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=117 row-size=204B cardinality=30.00M cost=39869990
-| | | in pipelines: 112(GETNEXT)
-| | |
-| | F72:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
-| | 112:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=117 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 112(GETNEXT)
-| |
-| 111:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF063[min_max] -> tpcds_partitioned_parquet_snap.store_sales_4.ss_customer_sk, RF062[bloom] -> tpcds_partitioned_parquet_snap.store_sales_4.ss_customer_sk
-| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=115 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 111(GETNEXT)
-|
-108:HASH JOIN [INNER JOIN, PARTITIONED]
-| hash-table-id=07
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45,68,91,114 row-size=580B cardinality=1.18G cost=517948489
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT), 187(OPEN), 191(OPEN), 195(OPEN)
-|
-|--F93:PLAN FRAGMENT [HASH(CUSTOMER_ID)] hosts=10 instances=80 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=1.92GB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=2350 segment-costs=[1946241445] cpu-comparison-result=360 [max(80 (self) vs 360 (sum children))]
-| JOIN BUILD
-| | join-table-id=07 plan-id=08 cohort-id=01
-| | build expressions: CUSTOMER_ID
-| | mem-estimate=1.90GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1183341306
-| |
-| 196:EXCHANGE [HASH(CUSTOMER_ID)]
-| | mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=114 row-size=116B cardinality=1.18G cost=762900139
-| | in pipelines: 187(GETNEXT), 191(GETNEXT), 195(GETNEXT)
-| |
-| F70:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=4.23GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=120 segment-costs=[44477605605, 26934229118, 13500002573, 37772016915] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))]
-| 107:SELECT
-| | predicates: DYEAR = add(CAST(1999 AS INT), CAST(1 AS INT)), SALE_TYPE = 'w'
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=114 row-size=116B cardinality=1.18G cost=23666825216
-| | in pipelines: 187(GETNEXT), 191(GETNEXT), 195(GETNEXT)
-| |
-| 87:UNION
-| | pass-through-operands: 88
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=114 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 187(GETNEXT), 191(GETNEXT), 195(GETNEXT)
-| |
-| |--195:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_13.c_customer_id, tpcds_partitioned_parquet_snap.customer_13.c_first_name, tpcds_partitioned_parquet_snap.customer_13.c_last_name, tpcds_partitioned_parquet_snap.customer_13.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_13.c_birth_country, tpcds_partitioned_parquet_snap.customer_13.c_login, tpcds_partitioned_parquet_snap.customer_13.c_email_address, tpcds_partitioned_parquet_snap.date_dim_13.d_year
-| | | mem-estimate=2.79GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=113 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 195(GETNEXT), 101(OPEN)
-| | |
-| | 194:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_13.c_customer_id,tpcds_partitioned_parquet_snap.customer_13.c_first_name,tpcds_partitioned_parquet_snap.customer_13.c_last_name,tpcds_partitioned_parquet_snap.customer_13.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_13.c_birth_country,tpcds_partitioned_parquet_snap.customer_13.c_login,tpcds_partitioned_parquet_snap.customer_13.c_email_address,tpcds_partitioned_parquet_snap.date_dim_13.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=113 row-size=169B cardinality=1.99G cost=1767409028
-| | | in pipelines: 101(GETNEXT)
-| | |
-| | F66:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=2.19GB mem-reservation=34.26MB thread-reservation=1
-| | max-parallelism=1824 segment-costs=[17827120882, 22676121640] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 106:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_3.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_13.c_customer_id, tpcds_partitioned_parquet_snap.customer_13.c_first_name, tpcds_partitioned_parquet_snap.customer_13.c_last_name, tpcds_partitioned_parquet_snap.customer_13.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_13.c_birth_country, tpcds_partitioned_parquet_snap.customer_13.c_login, tpcds_partitioned_parquet_snap.customer_13.c_email_address, tpcds_partitioned_parquet_snap.date_dim_13.d_year
-| | | mem-estimate=2.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=113 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 101(GETNEXT)
-| | |
-| | 105:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=12
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_3.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_3.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=107,109,111 row-size=582B cardinality=1.99G cost=870015958
-| | | in pipelines: 101(GETNEXT), 104(OPEN)
-| | |
-| | |--F98:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=12 plan-id=13 cohort-id=07
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_13.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 193:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=111 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 104(GETNEXT)
-| | | |
-| | | F68:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 104:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=111 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 104(GETNEXT)
-| | |
-| | 103:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=13
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_3.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_13.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_3.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_13.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=107,109 row-size=344B cardinality=1.99G cost=870015958
-| | | in pipelines: 101(GETNEXT), 102(OPEN)
-| | |
-| | |--F99:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=13 plan-id=14 cohort-id=07
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_13.c_customer_sk
-| | | | runtime filters: RF059[min_max] <- tpcds_partitioned_parquet_snap.customer_13.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 192:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=109 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 102(GETNEXT)
-| | | |
-| | | F67:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 102:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=109 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 102(GETNEXT)
-| | |
-| | 101:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF059[min_max] -> tpcds_partitioned_parquet_snap.web_sales_3.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=107 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 101(GETNEXT)
-| |
-| 88:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=106 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 187(GETNEXT), 191(GETNEXT)
-| |
-| |--191:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_12.c_customer_id, tpcds_partitioned_parquet_snap.customer_12.c_first_name, tpcds_partitioned_parquet_snap.customer_12.c_last_name, tpcds_partitioned_parquet_snap.customer_12.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_12.c_birth_country, tpcds_partitioned_parquet_snap.customer_12.c_login, tpcds_partitioned_parquet_snap.customer_12.c_email_address, tpcds_partitioned_parquet_snap.date_dim_12.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=105 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 191(GETNEXT), 95(OPEN)
-| | |
-| | 190:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_12.c_customer_id,tpcds_partitioned_parquet_snap.customer_12.c_first_name,tpcds_partitioned_parquet_snap.customer_12.c_last_name,tpcds_partitioned_parquet_snap.customer_12.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_12.c_birth_country,tpcds_partitioned_parquet_snap.customer_12.c_login,tpcds_partitioned_parquet_snap.customer_12.c_email_address,tpcds_partitioned_parquet_snap.date_dim_12.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=105 row-size=169B cardinality=3.97G cost=3526206713
-| | | in pipelines: 95(GETNEXT)
-| | |
-| | F61:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=4.26GB mem-reservation=35.00MB thread-reservation=1
-| | max-parallelism=1831 segment-costs=[35588885488, 45241758471] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 100:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_3.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_12.c_customer_id, tpcds_partitioned_parquet_snap.customer_12.c_first_name, tpcds_partitioned_parquet_snap.customer_12.c_last_name, tpcds_partitioned_parquet_snap.customer_12.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_12.c_birth_country, tpcds_partitioned_parquet_snap.customer_12.c_login, tpcds_partitioned_parquet_snap.customer_12.c_email_address, tpcds_partitioned_parquet_snap.date_dim_12.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=105 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 95(GETNEXT)
-| | |
-| | 99:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=10
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_3.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_3.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=99,101,103 row-size=582B cardinality=3.97G cost=1735792939
-| | | in pipelines: 95(GETNEXT), 98(OPEN)
-| | |
-| | |--F96:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=10 plan-id=11 cohort-id=06
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_12.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 189:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=103 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 98(GETNEXT)
-| | | |
-| | | F63:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 98:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=103 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 98(GETNEXT)
-| | |
-| | 97:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=11
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_3.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_12.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_3.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_12.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=99,101 row-size=344B cardinality=3.97G cost=1735792939
-| | | in pipelines: 95(GETNEXT), 96(OPEN)
-| | |
-| | |--F97:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=11 plan-id=12 cohort-id=06
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_12.c_customer_sk
-| | | | runtime filters: RF055[min_max] <- tpcds_partitioned_parquet_snap.customer_12.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 188:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=101 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 96(GETNEXT)
-| | | |
-| | | F62:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 96:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=101 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 96(GETNEXT)
-| | |
-| | 95:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF055[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_3.cs_bill_customer_sk
-| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=99 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 95(GETNEXT)
-| |
-| 187:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_11.c_customer_id, tpcds_partitioned_parquet_snap.customer_11.c_first_name, tpcds_partitioned_parquet_snap.customer_11.c_last_name, tpcds_partitioned_parquet_snap.customer_11.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_11.c_birth_country, tpcds_partitioned_parquet_snap.customer_11.c_login, tpcds_partitioned_parquet_snap.customer_11.c_email_address, tpcds_partitioned_parquet_snap.date_dim_11.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=98 row-size=169B cardinality=5.88G cost=37464857383
-| | in pipelines: 187(GETNEXT), 89(OPEN)
-| |
-| 186:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_11.c_customer_id,tpcds_partitioned_parquet_snap.customer_11.c_first_name,tpcds_partitioned_parquet_snap.customer_11.c_last_name,tpcds_partitioned_parquet_snap.customer_11.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_11.c_birth_country,tpcds_partitioned_parquet_snap.customer_11.c_login,tpcds_partitioned_parquet_snap.customer_11.c_email_address,tpcds_partitioned_parquet_snap.date_dim_11.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=98 row-size=169B cardinality=7.89G cost=7012748222
-| | in pipelines: 89(GETNEXT)
-| |
-| F57:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=4.26GB mem-reservation=42.00MB thread-reservation=1
-| max-parallelism=1824 segment-costs=[65500594865, 89974606443] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 94:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_3.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_11.c_customer_id, tpcds_partitioned_parquet_snap.customer_11.c_first_name, tpcds_partitioned_parquet_snap.customer_11.c_last_name, tpcds_partitioned_parquet_snap.customer_11.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_11.c_birth_country, tpcds_partitioned_parquet_snap.customer_11.c_login, tpcds_partitioned_parquet_snap.customer_11.c_email_address, tpcds_partitioned_parquet_snap.date_dim_11.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=98 row-size=169B cardinality=7.89G cost=46613754103
-| | in pipelines: 89(GETNEXT)
-| |
-| 93:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=08
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=92,94,96 row-size=538B cardinality=7.93G cost=3471497176
-| | in pipelines: 89(GETNEXT), 92(OPEN)
-| |
-| |--F94:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
-| | JOIN BUILD
-| | | join-table-id=08 plan-id=09 cohort-id=05
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_11.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | |
-| | 185:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=96 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 92(GETNEXT)
-| | |
-| | F59:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 92:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=96 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 92(GETNEXT)
-| |
-| 91:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=09
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_11.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_11.c_customer_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=92,94 row-size=300B cardinality=7.93G cost=3471497176
-| | in pipelines: 89(GETNEXT), 90(OPEN)
-| |
-| |--F95:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=10 segment-costs=[69869990]
+| 67:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=7,9 row-size=32B cardinality=441.70M cost=130346843
+| | in pipelines: 06(GETNEXT)
+| |
+| F21:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=128.00KB thread-reservation=1
+| max-parallelism=180 segment-costs=[1711382054]
+| 08:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=05
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=7,9 row-size=32B cardinality=441.70M cost=193333830
+| | in pipelines: 06(GETNEXT), 07(OPEN)
+| |
+| |--F37:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
-| | | join-table-id=09 plan-id=10 cohort-id=05
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_11.c_customer_sk
-| | | runtime filters: RF050[bloom] <- tpcds_partitioned_parquet_snap.customer_11.c_customer_sk, RF051[min_max] <- tpcds_partitioned_parquet_snap.customer_11.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | |
-| | 184:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=94 row-size=204B cardinality=30.00M cost=39869990
-| | | in pipelines: 90(GETNEXT)
-| | |
-| | F58:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
-| | 90:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=94 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 90(GETNEXT)
-| |
-| 89:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF051[min_max] -> tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk, RF050[bloom] -> tpcds_partitioned_parquet_snap.store_sales_3.ss_customer_sk
-| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=92 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 89(GETNEXT)
-|
-86:HASH JOIN [INNER JOIN, PARTITIONED]
-| hash-table-id=14
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| other join predicates: CASE WHEN YEAR_TOTAL > CAST(0 AS DECIMAL(3,0)) THEN divide(YEAR_TOTAL, YEAR_TOTAL) ELSE NULL END > CASE WHEN YEAR_TOTAL > CAST(0 AS DECIMAL(3,0)) THEN divide(YEAR_TOTAL, YEAR_TOTAL) ELSE NULL END
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45,68,91 row-size=464B cardinality=1.18G cost=517948489
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT), 174(OPEN), 178(OPEN), 182(OPEN)
-|
-|--F100:PLAN FRAGMENT [HASH(CUSTOMER_ID)] hosts=10 instances=80 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=1.92GB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=2350 segment-costs=[1946241445] cpu-comparison-result=360 [max(80 (self) vs 360 (sum children))]
-| JOIN BUILD
-| | join-table-id=14 plan-id=15 cohort-id=01
-| | build expressions: CUSTOMER_ID
-| | mem-estimate=1.90GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1183341306
-| |
-| 183:EXCHANGE [HASH(CUSTOMER_ID)]
-| | mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=91 row-size=116B cardinality=1.18G cost=762900139
-| | in pipelines: 174(GETNEXT), 178(GETNEXT), 182(GETNEXT)
-| |
-| F56:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=4.23GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=120 segment-costs=[44477605605, 26934229118, 13500002573, 49605428499] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))]
-| 85:SELECT
-| | predicates: DYEAR = CAST(1999 AS INT), SALE_TYPE = 'c', YEAR_TOTAL > CAST(0 AS DECIMAL(3,0))
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=91 row-size=116B cardinality=1.18G cost=35500236800
-| | in pipelines: 174(GETNEXT), 178(GETNEXT), 182(GETNEXT)
-| |
-| 65:UNION
-| | pass-through-operands: 66
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=91 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 174(GETNEXT), 178(GETNEXT), 182(GETNEXT)
-| |
-| |--182:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_10.c_customer_id, tpcds_partitioned_parquet_snap.customer_10.c_first_name, tpcds_partitioned_parquet_snap.customer_10.c_last_name, tpcds_partitioned_parquet_snap.customer_10.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_10.c_birth_country, tpcds_partitioned_parquet_snap.customer_10.c_login, tpcds_partitioned_parquet_snap.customer_10.c_email_address, tpcds_partitioned_parquet_snap.date_dim_10.d_year
-| | | mem-estimate=2.79GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=90 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 182(GETNEXT), 79(OPEN)
-| | |
-| | 181:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_10.c_customer_id,tpcds_partitioned_parquet_snap.customer_10.c_first_name,tpcds_partitioned_parquet_snap.customer_10.c_last_name,tpcds_partitioned_parquet_snap.customer_10.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_10.c_birth_country,tpcds_partitioned_parquet_snap.customer_10.c_login,tpcds_partitioned_parquet_snap.customer_10.c_email_address,tpcds_partitioned_parquet_snap.date_dim_10.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=90 row-size=169B cardinality=1.99G cost=1767409028
-| | | in pipelines: 79(GETNEXT)
-| | |
-| | F52:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=2.19GB mem-reservation=34.26MB thread-reservation=1
-| | max-parallelism=1824 segment-costs=[17827120882, 22676121640] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 84:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_2.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_10.c_customer_id, tpcds_partitioned_parquet_snap.customer_10.c_first_name, tpcds_partitioned_parquet_snap.customer_10.c_last_name, tpcds_partitioned_parquet_snap.customer_10.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_10.c_birth_country, tpcds_partitioned_parquet_snap.customer_10.c_login, tpcds_partitioned_parquet_snap.customer_10.c_email_address, tpcds_partitioned_parquet_snap.date_dim_10.d_year
-| | | mem-estimate=2.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=90 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 79(GETNEXT)
-| | |
-| | 83:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=19
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_2.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_2.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=84,86,88 row-size=582B cardinality=1.99G cost=870015958
-| | | in pipelines: 79(GETNEXT), 82(OPEN)
-| | |
-| | |--F105:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=19 plan-id=20 cohort-id=10
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_10.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 180:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=88 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 82(GETNEXT)
-| | | |
-| | | F54:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 82:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=88 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 82(GETNEXT)
-| | |
-| | 81:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=20
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_2.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_10.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_2.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_10.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=84,86 row-size=344B cardinality=1.99G cost=870015958
-| | | in pipelines: 79(GETNEXT), 80(OPEN)
-| | |
-| | |--F106:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=20 plan-id=21 cohort-id=10
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_10.c_customer_sk
-| | | | runtime filters: RF047[min_max] <- tpcds_partitioned_parquet_snap.customer_10.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 179:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=86 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 80(GETNEXT)
-| | | |
-| | | F53:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 80:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=86 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 80(GETNEXT)
-| | |
-| | 79:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF047[min_max] -> tpcds_partitioned_parquet_snap.web_sales_2.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=84 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 79(GETNEXT)
-| |
-| 66:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=83 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 174(GETNEXT), 178(GETNEXT)
-| |
-| |--178:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_9.c_customer_id, tpcds_partitioned_parquet_snap.customer_9.c_first_name, tpcds_partitioned_parquet_snap.customer_9.c_last_name, tpcds_partitioned_parquet_snap.customer_9.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_9.c_birth_country, tpcds_partitioned_parquet_snap.customer_9.c_login, tpcds_partitioned_parquet_snap.customer_9.c_email_address, tpcds_partitioned_parquet_snap.date_dim_9.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=82 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 178(GETNEXT), 73(OPEN)
-| | |
-| | 177:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_9.c_customer_id,tpcds_partitioned_parquet_snap.customer_9.c_first_name,tpcds_partitioned_parquet_snap.customer_9.c_last_name,tpcds_partitioned_parquet_snap.customer_9.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_9.c_birth_country,tpcds_partitioned_parquet_snap.customer_9.c_login,tpcds_partitioned_parquet_snap.customer_9.c_email_address,tpcds_partitioned_parquet_snap.date_dim_9.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=82 row-size=169B cardinality=3.97G cost=3526206713
-| | | in pipelines: 73(GETNEXT)
-| | |
-| | F47:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| | Per-Instance Resources: mem-estimate=4.26GB mem-reservation=35.00MB thread-reservation=1
-| | max-parallelism=1831 segment-costs=[35588885488, 45241758471] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 78:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_2.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_9.c_customer_id, tpcds_partitioned_parquet_snap.customer_9.c_first_name, tpcds_partitioned_parquet_snap.customer_9.c_last_name, tpcds_partitioned_parquet_snap.customer_9.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_9.c_birth_country, tpcds_partitioned_parquet_snap.customer_9.c_login, tpcds_partitioned_parquet_snap.customer_9.c_email_address, tpcds_partitioned_parquet_snap.date_dim_9.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=82 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 73(GETNEXT)
-| | |
-| | 77:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=17
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_2.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_2.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=76,78,80 row-size=582B cardinality=3.97G cost=1735792939
-| | | in pipelines: 73(GETNEXT), 76(OPEN)
-| | |
-| | |--F103:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=17 plan-id=18 cohort-id=09
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_9.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 176:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=80 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 76(GETNEXT)
-| | | |
-| | | F49:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 76:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=80 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 76(GETNEXT)
-| | |
-| | 75:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=18
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_2.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_9.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_2.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_9.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=76,78 row-size=344B cardinality=3.97G cost=1735792939
-| | | in pipelines: 73(GETNEXT), 74(OPEN)
-| | |
-| | |--F104:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=18 plan-id=19 cohort-id=09
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_9.c_customer_sk
-| | | | runtime filters: RF042[bloom] <- tpcds_partitioned_parquet_snap.customer_9.c_customer_sk, RF043[min_max] <- tpcds_partitioned_parquet_snap.customer_9.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 175:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=78 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 74(GETNEXT)
-| | | |
-| | | F48:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 74:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=78 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 74(GETNEXT)
-| | |
-| | 73:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF043[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_2.cs_bill_customer_sk, RF042[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_2.cs_bill_customer_sk
-| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=76 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 73(GETNEXT)
-| |
-| 174:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_8.c_customer_id, tpcds_partitioned_parquet_snap.customer_8.c_first_name, tpcds_partitioned_parquet_snap.customer_8.c_last_name, tpcds_partitioned_parquet_snap.customer_8.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_8.c_birth_country, tpcds_partitioned_parquet_snap.customer_8.c_login, tpcds_partitioned_parquet_snap.customer_8.c_email_address, tpcds_partitioned_parquet_snap.date_dim_8.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=75 row-size=169B cardinality=5.88G cost=37464857383
-| | in pipelines: 174(GETNEXT), 67(OPEN)
-| |
-| 173:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_8.c_customer_id,tpcds_partitioned_parquet_snap.customer_8.c_first_name,tpcds_partitioned_parquet_snap.customer_8.c_last_name,tpcds_partitioned_parquet_snap.customer_8.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_8.c_birth_country,tpcds_partitioned_parquet_snap.customer_8.c_login,tpcds_partitioned_parquet_snap.customer_8.c_email_address,tpcds_partitioned_parquet_snap.date_dim_8.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=75 row-size=169B cardinality=7.89G cost=7012748222
-| | in pipelines: 67(GETNEXT)
-| |
-| F43:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=4.26GB mem-reservation=42.00MB thread-reservation=1
-| max-parallelism=1824 segment-costs=[65500594865, 89974606443] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 72:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_2.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_8.c_customer_id, tpcds_partitioned_parquet_snap.customer_8.c_first_name, tpcds_partitioned_parquet_snap.customer_8.c_last_name, tpcds_partitioned_parquet_snap.customer_8.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_8.c_birth_country, tpcds_partitioned_parquet_snap.customer_8.c_login, tpcds_partitioned_parquet_snap.customer_8.c_email_address, tpcds_partitioned_parquet_snap.date_dim_8.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=75 row-size=169B cardinality=7.89G cost=46613754103
-| | in pipelines: 67(GETNEXT)
-| |
-| 71:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=15
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_2.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=69,71,73 row-size=538B cardinality=7.93G cost=3471497176
-| | in pipelines: 67(GETNEXT), 70(OPEN)
-| |
-| |--F101:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
-| | JOIN BUILD
-| | | join-table-id=15 plan-id=16 cohort-id=08
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_8.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | |
-| | 172:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=73 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 70(GETNEXT)
-| | |
-| | F45:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 70:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | | join-table-id=05 plan-id=06 cohort-id=03
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| | |
+| | 66:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=9 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 07(GETNEXT)
+| | |
+| | F22:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10483]
+| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=73 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 70(GETNEXT)
-| |
-| 69:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=16
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_2.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_8.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_2.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_8.c_customer_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=69,71 row-size=300B cardinality=7.93G cost=3471497176
-| | in pipelines: 67(GETNEXT), 68(OPEN)
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=9 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 07(GETNEXT)
| |
-| |--F102:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=10 segment-costs=[69869990]
-| | JOIN BUILD
-| | | join-table-id=16 plan-id=17 cohort-id=08
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_8.c_customer_sk
-| | | runtime filters: RF038[bloom] <- tpcds_partitioned_parquet_snap.customer_8.c_customer_sk, RF039[min_max] <- tpcds_partitioned_parquet_snap.customer_8.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | |
-| | 171:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=71 row-size=204B cardinality=30.00M cost=39869990
-| | | in pipelines: 68(GETNEXT)
-| | |
-| | F44:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
-| | 68:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=71 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 68(GETNEXT)
-| |
-| 67:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF039[min_max] -> tpcds_partitioned_parquet_snap.store_sales_2.ss_customer_sk, RF038[bloom] -> tpcds_partitioned_parquet_snap.store_sales_2.ss_customer_sk
+| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| HDFS partitions=1824/1824 files=1824 size=145.75GB
+| runtime filters: RF027[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF028[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk
| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=69 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 67(GETNEXT)
-|
-64:HASH JOIN [INNER JOIN, PARTITIONED]
-| hash-table-id=21
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45,68 row-size=348B cardinality=1.18G cost=517948489
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT), 161(OPEN), 165(OPEN), 169(OPEN)
-|
-|--F107:PLAN FRAGMENT [HASH(CUSTOMER_ID)] hosts=10 instances=80 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=1.92GB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=2350 segment-costs=[1946241445] cpu-comparison-result=360 [max(80 (self) vs 360 (sum children))]
-| JOIN BUILD
-| | join-table-id=21 plan-id=22 cohort-id=01
-| | build expressions: CUSTOMER_ID
-| | mem-estimate=1.90GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1183341306
-| |
-| 170:EXCHANGE [HASH(CUSTOMER_ID)]
-| | mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=68 row-size=116B cardinality=1.18G cost=762900139
-| | in pipelines: 161(GETNEXT), 165(GETNEXT), 169(GETNEXT)
-| |
-| F42:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=4.23GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=120 segment-costs=[44477605605, 26934229118, 13500002573, 37772016915] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))]
-| 63:SELECT
-| | predicates: DYEAR = add(CAST(1999 AS INT), CAST(1 AS INT)), SALE_TYPE = 'c'
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=68 row-size=116B cardinality=1.18G cost=23666825216
-| | in pipelines: 161(GETNEXT), 165(GETNEXT), 169(GETNEXT)
-| |
-| 43:UNION
-| | pass-through-operands: 44
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=68 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 161(GETNEXT), 165(GETNEXT), 169(GETNEXT)
-| |
-| |--169:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_7.c_customer_id, tpcds_partitioned_parquet_snap.customer_7.c_first_name, tpcds_partitioned_parquet_snap.customer_7.c_last_name, tpcds_partitioned_parquet_snap.customer_7.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_7.c_birth_country, tpcds_partitioned_parquet_snap.customer_7.c_login, tpcds_partitioned_parquet_snap.customer_7.c_email_address, tpcds_partitioned_parquet_snap.date_dim_7.d_year
-| | | mem-estimate=2.79GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=67 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 169(GETNEXT), 57(OPEN)
-| | |
-| | 168:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_7.c_customer_id,tpcds_partitioned_parquet_snap.customer_7.c_first_name,tpcds_partitioned_parquet_snap.customer_7.c_last_name,tpcds_partitioned_parquet_snap.customer_7.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_7.c_birth_country,tpcds_partitioned_parquet_snap.customer_7.c_login,tpcds_partitioned_parquet_snap.customer_7.c_email_address,tpcds_partitioned_parquet_snap.date_dim_7.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=67 row-size=169B cardinality=1.99G cost=1767409028
-| | | in pipelines: 57(GETNEXT)
-| | |
-| | F38:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=2.19GB mem-reservation=34.26MB thread-reservation=1
-| | max-parallelism=1824 segment-costs=[17827120882, 22676121640] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 62:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_1.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_7.c_customer_id, tpcds_partitioned_parquet_snap.customer_7.c_first_name, tpcds_partitioned_parquet_snap.customer_7.c_last_name, tpcds_partitioned_parquet_snap.customer_7.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_7.c_birth_country, tpcds_partitioned_parquet_snap.customer_7.c_login, tpcds_partitioned_parquet_snap.customer_7.c_email_address, tpcds_partitioned_parquet_snap.date_dim_7.d_year
-| | | mem-estimate=2.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=67 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 57(GETNEXT)
-| | |
-| | 61:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=26
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_1.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_1.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=61,63,65 row-size=582B cardinality=1.99G cost=870015958
-| | | in pipelines: 57(GETNEXT), 60(OPEN)
-| | |
-| | |--F112:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=26 plan-id=27 cohort-id=13
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_7.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 167:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=65 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 60(GETNEXT)
-| | | |
-| | | F40:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 60:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=65 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 60(GETNEXT)
-| | |
-| | 59:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=27
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_1.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_7.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_1.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_7.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=61,63 row-size=344B cardinality=1.99G cost=870015958
-| | | in pipelines: 57(GETNEXT), 58(OPEN)
-| | |
-| | |--F113:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=27 plan-id=28 cohort-id=13
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_7.c_customer_sk
-| | | | runtime filters: RF035[min_max] <- tpcds_partitioned_parquet_snap.customer_7.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 166:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=63 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 58(GETNEXT)
-| | | |
-| | | F39:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 58:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=63 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 58(GETNEXT)
-| | |
-| | 57:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF035[min_max] -> tpcds_partitioned_parquet_snap.web_sales_1.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=61 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 57(GETNEXT)
-| |
-| 44:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=60 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 161(GETNEXT), 165(GETNEXT)
-| |
-| |--165:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_6.c_customer_id, tpcds_partitioned_parquet_snap.customer_6.c_first_name, tpcds_partitioned_parquet_snap.customer_6.c_last_name, tpcds_partitioned_parquet_snap.customer_6.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_6.c_birth_country, tpcds_partitioned_parquet_snap.customer_6.c_login, tpcds_partitioned_parquet_snap.customer_6.c_email_address, tpcds_partitioned_parquet_snap.date_dim_6.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=59 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 165(GETNEXT), 51(OPEN)
-| | |
-| | 164:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_6.c_customer_id,tpcds_partitioned_parquet_snap.customer_6.c_first_name,tpcds_partitioned_parquet_snap.customer_6.c_last_name,tpcds_partitioned_parquet_snap.customer_6.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_6.c_birth_country,tpcds_partitioned_parquet_snap.customer_6.c_login,tpcds_partitioned_parquet_snap.customer_6.c_email_address,tpcds_partitioned_parquet_snap.date_dim_6.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=59 row-size=169B cardinality=3.97G cost=3526206713
-| | | in pipelines: 51(GETNEXT)
-| | |
-| | F33:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| | Per-Instance Resources: mem-estimate=4.26GB mem-reservation=35.00MB thread-reservation=1
-| | max-parallelism=1831 segment-costs=[35588885488, 45241758471] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 56:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_1.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_6.c_customer_id, tpcds_partitioned_parquet_snap.customer_6.c_first_name, tpcds_partitioned_parquet_snap.customer_6.c_last_name, tpcds_partitioned_parquet_snap.customer_6.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_6.c_birth_country, tpcds_partitioned_parquet_snap.customer_6.c_login, tpcds_partitioned_parquet_snap.customer_6.c_email_address, tpcds_partitioned_parquet_snap.date_dim_6.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=59 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 51(GETNEXT)
-| | |
-| | 55:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=24
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=53,55,57 row-size=582B cardinality=3.97G cost=1735792939
-| | | in pipelines: 51(GETNEXT), 54(OPEN)
-| | |
-| | |--F110:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=24 plan-id=25 cohort-id=12
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_6.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 163:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=57 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 54(GETNEXT)
-| | | |
-| | | F35:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 54:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=57 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 54(GETNEXT)
-| | |
-| | 53:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=25
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_6.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_6.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=53,55 row-size=344B cardinality=3.97G cost=1735792939
-| | | in pipelines: 51(GETNEXT), 52(OPEN)
+| table: rows=2.16G size=145.75GB
+| partitions: 1824/1824 rows=2.16G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=374(filtered from 1824)
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=7 row-size=24B cardinality=441.70M(filtered from 2.16G) cost=152652894
+| in pipelines: 06(GETNEXT)
+|
+38:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=06
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34,41,27,20 row-size=661B cardinality=30.00M cost=13131000
+| in pipelines: 46(GETNEXT), 64(OPEN)
+|
+|--F38:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)] hosts=10 instances=100 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=84.75MB mem-reservation=34.00MB thread-reservation=1
+| | max-parallelism=160 segment-costs=[56123197] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
+| JOIN BUILD
+| | join-table-id=06 plan-id=07 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | runtime filters: RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | mem-estimate=54.93MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| |
+| 65:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=30.00M cost=26123197
+| | in pipelines: 64(GETNEXT)
+| |
+| F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.06GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=180 segment-costs=[1760337155, 334518771] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| 64:AGGREGATE [FINALIZE]
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | mem-estimate=1018.77MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=30.00M cost=1130209988
+| | in pipelines: 64(GETNEXT), 12(OPEN)
+| |
+| 63:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=723.64M cost=630127167
+| | in pipelines: 12(GETNEXT)
+| |
+| F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=946.99MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=810 segment-costs=[5018930073, 8069049063] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 17:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | mem-estimate=853.01MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=723.64M cost=4387103039
+| | in pipelines: 12(GETNEXT)
+| |
+| 16:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=07
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=14,16,18 row-size=185B cardinality=807.87M cost=372121453
+| | in pipelines: 12(GETNEXT), 15(OPEN)
+| |
+| |--F39:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | | max-parallelism=810 segment-costs=[54467197]
+| | JOIN BUILD
+| | | join-table-id=07 plan-id=08 cohort-id=04
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | | runtime filters: RF022[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF023[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | |--F111:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=25 plan-id=26 cohort-id=12
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_6.c_customer_sk
-| | | | runtime filters: RF030[bloom] <- tpcds_partitioned_parquet_snap.customer_6.c_customer_sk, RF031[min_max] <- tpcds_partitioned_parquet_snap.customer_6.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 162:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=55 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 52(GETNEXT)
-| | | |
-| | | F34:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 52:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=55 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 52(GETNEXT)
+| | 62:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=18 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 15(GETNEXT)
| | |
-| | 51:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF031[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_1.cs_bill_customer_sk, RF030[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_1.cs_bill_customer_sk
+| | F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[341205999]
+| | 15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
+| | table: rows=30.00M size=1.55GB
| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=53 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 51(GETNEXT)
-| |
-| 161:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_5.c_customer_id, tpcds_partitioned_parquet_snap.customer_5.c_first_name, tpcds_partitioned_parquet_snap.customer_5.c_last_name, tpcds_partitioned_parquet_snap.customer_5.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_5.c_birth_country, tpcds_partitioned_parquet_snap.customer_5.c_login, tpcds_partitioned_parquet_snap.customer_5.c_email_address, tpcds_partitioned_parquet_snap.date_dim_5.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=52 row-size=169B cardinality=5.88G cost=37464857383
-| | in pipelines: 161(GETNEXT), 45(OPEN)
-| |
-| 160:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_5.c_customer_id,tpcds_partitioned_parquet_snap.customer_5.c_first_name,tpcds_partitioned_parquet_snap.customer_5.c_last_name,tpcds_partitioned_parquet_snap.customer_5.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_5.c_birth_country,tpcds_partitioned_parquet_snap.customer_5.c_login,tpcds_partitioned_parquet_snap.customer_5.c_email_address,tpcds_partitioned_parquet_snap.date_dim_5.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=52 row-size=169B cardinality=7.89G cost=7012748222
-| | in pipelines: 45(GETNEXT)
-| |
-| F29:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=4.26GB mem-reservation=42.00MB thread-reservation=1
-| max-parallelism=1824 segment-costs=[65500594865, 89974606443] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 50:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_1.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_5.c_customer_id, tpcds_partitioned_parquet_snap.customer_5.c_first_name, tpcds_partitioned_parquet_snap.customer_5.c_last_name, tpcds_partitioned_parquet_snap.customer_5.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_5.c_birth_country, tpcds_partitioned_parquet_snap.customer_5.c_login, tpcds_partitioned_parquet_snap.customer_5.c_email_address, tpcds_partitioned_parquet_snap.date_dim_5.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=52 row-size=169B cardinality=7.89G cost=46613754103
-| | in pipelines: 45(GETNEXT)
-| |
-| 49:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=22
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=46,48,50 row-size=538B cardinality=7.93G cost=3471497176
-| | in pipelines: 45(GETNEXT), 48(OPEN)
+| | tuple-ids=18 row-size=153B cardinality=30.00M cost=29871228
+| | in pipelines: 15(GETNEXT)
+| |
+| 61:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=14,16 row-size=32B cardinality=880.06M cost=259705581
+| | in pipelines: 12(GETNEXT)
| |
-| |--F108:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
+| F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=1.00MB thread-reservation=1
+| max-parallelism=350 segment-costs=[3409790834]
+| 14:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=08
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=14,16 row-size=32B cardinality=880.06M cost=385202077
+| | in pipelines: 12(GETNEXT), 13(OPEN)
+| |
+| |--F40:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
-| | | join-table-id=22 plan-id=23 cohort-id=11
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_5.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | |
-| | 159:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=50 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 48(GETNEXT)
-| | |
-| | F31:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 48:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | | join-table-id=08 plan-id=09 cohort-id=04
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| | |
+| | 60:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=16 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 13(GETNEXT)
+| | |
+| | F17:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10483]
+| | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=50 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 48(GETNEXT)
-| |
-| 47:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=23
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_1.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_5.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_1.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_5.c_customer_sk
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=16 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 13(GETNEXT)
+| |
+| 12:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
+| HDFS partitions=1831/1831 files=1831 size=280.96GB
+| runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk, RF022[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk
+| stored statistics:
+| table: rows=4.32G size=280.96GB
+| partitions: 1831/1831 rows=4.32G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=374(filtered from 1831)
+| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| tuple-ids=14 row-size=24B cardinality=880.06M(filtered from 4.32G) cost=304148590
+| in pipelines: 12(GETNEXT)
+|
+37:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=09
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34,41,27 row-size=495B cardinality=30.00M cost=47037753
+| in pipelines: 46(GETNEXT), 58(OPEN)
+|
+|--F41:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)] hosts=10 instances=100 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=100.75MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=160 segment-costs=[56123197] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
+| JOIN BUILD
+| | join-table-id=09 plan-id=10 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | mem-estimate=54.93MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| |
+| 59:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=30.00M cost=26123197
+| | in pipelines: 58(GETNEXT)
+| |
+| F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.86GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=310 segment-costs=[3067099075, 334518771] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| 58:AGGREGATE [FINALIZE]
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
+| | mem-estimate=1.80GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=30.00M cost=1930086569
+| | in pipelines: 58(GETNEXT), 18(OPEN)
+| |
+| 57:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=1.31G cost=1137012506
+| | in pipelines: 18(GETNEXT)
+| |
+| F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.76GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=1460 segment-costs=[9410215497, 14559933564] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 23:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
+| | mem-estimate=1.67GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=1.31G cost=8141744291
+| | in pipelines: 18(GETNEXT)
+| |
+| 22:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=10
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=46,48 row-size=300B cardinality=7.93G cost=3471497176
-| | in pipelines: 45(GETNEXT), 46(OPEN)
+| | tuple-ids=21,23,25 row-size=185B cardinality=1.62G cost=747080012
+| | in pipelines: 18(GETNEXT), 21(OPEN)
| |
-| |--F109:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=10 segment-costs=[69869990]
+| |--F42:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=1460 segment-costs=[54467197]
| | JOIN BUILD
-| | | join-table-id=23 plan-id=24 cohort-id=11
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_5.c_customer_sk
-| | | runtime filters: RF026[bloom] <- tpcds_partitioned_parquet_snap.customer_5.c_customer_sk, RF027[min_max] <- tpcds_partitioned_parquet_snap.customer_5.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | |
-| | 158:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=48 row-size=204B cardinality=30.00M cost=39869990
-| | | in pipelines: 46(GETNEXT)
-| | |
-| | F30:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
-| | 46:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | | join-table-id=10 plan-id=11 cohort-id=05
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | | runtime filters: RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | |
+| | 56:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=25 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 21(GETNEXT)
+| | |
+| | F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[341205999]
+| | 21:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
+| | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=48 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 46(GETNEXT)
+| | tuple-ids=25 row-size=153B cardinality=30.00M cost=29871228
+| | in pipelines: 21(GETNEXT)
+| |
+| 55:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=21,23 row-size=32B cardinality=1.77G cost=521391194
+| | in pipelines: 18(GETNEXT)
+| |
+| F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=8.00MB thread-reservation=1
+| max-parallelism=374 segment-costs=[6845578389]
+| 20:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=11
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=21,23 row-size=32B cardinality=1.77G cost=773340988
+| | in pipelines: 18(GETNEXT), 19(OPEN)
+| |
+| |--F43:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
+| | JOIN BUILD
+| | | join-table-id=11 plan-id=12 cohort-id=05
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| | |
+| | 54:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=23 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 19(GETNEXT)
+| | |
+| | F12:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10483]
+| | 19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | stored statistics:
+| | table: rows=73.05K size=2.17MB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=23 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 19(GETNEXT)
| |
-| 45:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+| 18:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF027[min_max] -> tpcds_partitioned_parquet_snap.store_sales_1.ss_customer_sk, RF026[bloom] -> tpcds_partitioned_parquet_snap.store_sales_1.ss_customer_sk
+| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
| stored statistics:
| table: rows=8.64G size=389.90GB
| partitions: 1824/1824 rows=8.64G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
+| extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=46 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 45(GETNEXT)
+| tuple-ids=21 row-size=24B cardinality=1.77G(filtered from 8.64G) cost=610616051
+| in pipelines: 18(GETNEXT)
|
-42:HASH JOIN [INNER JOIN, PARTITIONED]
-| hash-table-id=28
-| hash predicates: CUSTOMER_ID = CUSTOMER_ID
-| fk/pk conjuncts: assumed fk/pk
+36:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=12
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_4.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_4.c_customer_id
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=22,45 row-size=232B cardinality=1.18G cost=517948489
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT), 147(OPEN), 151(OPEN), 155(OPEN)
+| tuple-ids=34,41 row-size=330B cardinality=162.19M cost=70990594
+| in pipelines: 46(GETNEXT), 51(OPEN)
|
-|--F114:PLAN FRAGMENT [HASH(CUSTOMER_ID)] hosts=10 instances=80 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=1.92GB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=2350 segment-costs=[1946241445] cpu-comparison-result=360 [max(80 (self) vs 360 (sum children))]
+|--F44:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)] hosts=10 instances=100 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=103.14MB mem-reservation=34.00MB thread-reservation=1
+| | max-parallelism=160 segment-costs=[76042402] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
| JOIN BUILD
-| | join-table-id=28 plan-id=29 cohort-id=01
-| | build expressions: CUSTOMER_ID
-| | mem-estimate=1.90GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=1183341306
-| |
-| 157:EXCHANGE [HASH(CUSTOMER_ID)]
-| | mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=45 row-size=116B cardinality=1.18G cost=762900139
-| | in pipelines: 147(GETNEXT), 151(GETNEXT), 155(GETNEXT)
-| |
-| F27:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=4.23GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=120 segment-costs=[44477605605, 26934229118, 13500002573, 49605428499] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))]
-| 41:SELECT
-| | predicates: DYEAR = CAST(1999 AS INT), SALE_TYPE = 's', YEAR_TOTAL > CAST(0 AS DECIMAL(3,0))
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=45 row-size=116B cardinality=1.18G cost=35500236800
-| | in pipelines: 147(GETNEXT), 151(GETNEXT), 155(GETNEXT)
-| |
-| 21:UNION
-| | pass-through-operands: 22
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=45 row-size=116B cardinality=11.83G cost=782000635
-| | in pipelines: 147(GETNEXT), 151(GETNEXT), 155(GETNEXT)
-| |
-| |--155:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address, tpcds_partitioned_parquet_snap.date_dim_4.d_year
-| | | mem-estimate=2.79GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=44 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 155(GETNEXT), 35(OPEN)
-| | |
-| | 154:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address,tpcds_partitioned_parquet_snap.date_dim_4.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=44 row-size=169B cardinality=1.99G cost=1767409028
-| | | in pipelines: 35(GETNEXT)
-| | |
-| | F23:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=2.19GB mem-reservation=34.26MB thread-reservation=1
-| | max-parallelism=1824 segment-costs=[17827120882, 22676121640] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 40:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address, tpcds_partitioned_parquet_snap.date_dim_4.d_year
-| | | mem-estimate=2.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=44 row-size=169B cardinality=1.99G cost=11732593545
-| | | in pipelines: 35(GETNEXT)
-| | |
-| | 39:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=33
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=38,40,42 row-size=582B cardinality=1.99G cost=870015958
-| | | in pipelines: 35(GETNEXT), 38(OPEN)
-| | |
-| | |--F119:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=33 plan-id=34 cohort-id=16
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 153:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=42 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 38(GETNEXT)
-| | | |
-| | | F25:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 38:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=42 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 38(GETNEXT)
-| | |
-| | 37:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=34
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=38,40 row-size=344B cardinality=1.99G cost=870015958
-| | | in pipelines: 35(GETNEXT), 36(OPEN)
-| | |
-| | |--F120:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=34 plan-id=35 cohort-id=16
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | | runtime filters: RF023[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 152:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=40 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 36(GETNEXT)
-| | | |
-| | | F24:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 36:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=40 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 36(GETNEXT)
-| | |
-| | 35:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| | HDFS partitions=1824/1824 files=1824 size=145.75GB
-| | runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1824/1824 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M
-| | mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| | tuple-ids=38 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| | in pipelines: 35(GETNEXT)
-| |
-| 22:UNION
-| | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | tuple-ids=37 row-size=116B cardinality=9.85G cost=3873500731
-| | in pipelines: 147(GETNEXT), 151(GETNEXT)
-| |
-| |--151:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address, tpcds_partitioned_parquet_snap.date_dim_3.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=36 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 151(GETNEXT), 29(OPEN)
+| | join-table-id=12 plan-id=13 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_4.c_customer_id
+| | runtime filters: RF009[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_id
+| | mem-estimate=73.32MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40647578
+| |
+| 53:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=41 row-size=165B cardinality=40.65M cost=35394824
+| | in pipelines: 51(GETNEXT)
+| |
+| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=638.32MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=280 segment-costs=[2753212168, 453245929] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| 51:AGGREGATE [FINALIZE]
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2)) > CAST(0 AS DECIMAL(3,0))
+| | mem-estimate=572.25MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=41 row-size=165B cardinality=40.65M cost=2399263927
+| | in pipelines: 51(GETNEXT), 30(OPEN)
+| |
+| 50:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=41 row-size=165B cardinality=406.48M cost=353948241
+| | in pipelines: 30(GETNEXT)
+| |
+| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=523.16MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=460 segment-costs=[2716561250, 4532459269] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 35:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
+| | mem-estimate=429.19MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=41 row-size=165B cardinality=406.48M cost=2399263927
+| | in pipelines: 30(GETNEXT)
+| |
+| 34:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=13
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=35,37,39 row-size=185B cardinality=406.48M cost=186950480
+| | in pipelines: 30(GETNEXT), 33(OPEN)
+| |
+| |--F45:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=460 segment-costs=[54467197]
+| | JOIN BUILD
+| | | join-table-id=13 plan-id=14 cohort-id=06
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | | runtime filters: RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 150:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id,tpcds_partitioned_parquet_snap.customer_3.c_first_name,tpcds_partitioned_parquet_snap.customer_3.c_last_name,tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_3.c_birth_country,tpcds_partitioned_parquet_snap.customer_3.c_login,tpcds_partitioned_parquet_snap.customer_3.c_email_address,tpcds_partitioned_parquet_snap.date_dim_3.d_year)]
-| | | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=36 row-size=169B cardinality=3.97G cost=3526206713
-| | | in pipelines: 29(GETNEXT)
+| | 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=39 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 33(GETNEXT)
| | |
-| | F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| | F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| | Per-Instance Resources: mem-estimate=4.26GB mem-reservation=35.00MB thread-reservation=1
-| | max-parallelism=1831 segment-costs=[35588885488, 45241758471] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| | 34:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address, tpcds_partitioned_parquet_snap.date_dim_3.d_year
-| | | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=36 row-size=169B cardinality=3.97G cost=23408022405
-| | | in pipelines: 29(GETNEXT)
-| | |
-| | 33:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=31
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=30,32,34 row-size=582B cardinality=3.97G cost=1735792939
-| | | in pipelines: 29(GETNEXT), 32(OPEN)
-| | |
-| | |--F117:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | | max-parallelism=10 segment-costs=[170129]
-| | | JOIN BUILD
-| | | | join-table-id=31 plan-id=32 cohort-id=15
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | | |
-| | | 149:EXCHANGE [BROADCAST]
-| | | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=34 row-size=237B cardinality=73.05K cost=97080
-| | | | in pipelines: 32(GETNEXT)
-| | | |
-| | | F20:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[158950]
-| | | 32:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | | tuple-ids=34 row-size=237B cardinality=73.05K cost=110600
-| | | in pipelines: 32(GETNEXT)
-| | |
-| | 31:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=32
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=30,32 row-size=344B cardinality=3.97G cost=1735792939
-| | | in pipelines: 29(GETNEXT), 30(OPEN)
-| | |
-| | |--F118:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | | max-parallelism=10 segment-costs=[69869990]
-| | | JOIN BUILD
-| | | | join-table-id=32 plan-id=33 cohort-id=15
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk, RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 148:EXCHANGE [BROADCAST]
-| | | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=32 row-size=204B cardinality=30.00M cost=39869990
-| | | | in pipelines: 30(GETNEXT)
-| | | |
-| | | F19:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[64027278]
-| | | 30:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=32 row-size=204B cardinality=30.00M cost=46823813
-| | | in pipelines: 30(GETNEXT)
-| | |
-| | 29:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| | HDFS partitions=1831/1831 files=1831 size=280.96GB
-| | runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[341205999]
+| | 33:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF006[bloom] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id
| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1831/1831 rows=4.32G
+| | table: rows=30.00M size=1.55GB
| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=21.52M
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=30 row-size=140B cardinality=3.97G(filtered from 4.32G) cost=8709277205
-| | in pipelines: 29(GETNEXT)
-| |
-| 147:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address, tpcds_partitioned_parquet_snap.date_dim_2.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=29 row-size=169B cardinality=5.88G cost=37464857383
-| | in pipelines: 147(GETNEXT), 23(OPEN)
-| |
-| 146:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address,tpcds_partitioned_parquet_snap.date_dim_2.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=29 row-size=169B cardinality=7.89G cost=7012748222
-| | in pipelines: 23(GETNEXT)
-| |
-| F14:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=4.26GB mem-reservation=42.00MB thread-reservation=1
-| max-parallelism=1824 segment-costs=[65500594865, 89974606443] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 28:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address, tpcds_partitioned_parquet_snap.date_dim_2.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=29 row-size=169B cardinality=7.89G cost=46613754103
-| | in pipelines: 23(GETNEXT)
-| |
-| 27:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=29
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=23,25,27 row-size=538B cardinality=7.93G cost=3471497176
-| | in pipelines: 23(GETNEXT), 26(OPEN)
-| |
-| |--F115:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
+| | tuple-ids=39 row-size=153B cardinality=30.00M cost=29871228
+| | in pipelines: 33(GETNEXT)
+| |
+| 48:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=35,37 row-size=32B cardinality=441.70M cost=130346843
+| | in pipelines: 30(GETNEXT)
+| |
+| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=128.00KB thread-reservation=1
+| max-parallelism=180 segment-costs=[1711382054]
+| 32:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=14
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=35,37 row-size=32B cardinality=441.70M cost=193333830
+| | in pipelines: 30(GETNEXT), 31(OPEN)
+| |
+| |--F46:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
-| | | join-table-id=29 plan-id=30 cohort-id=14
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
+| | | join-table-id=14 plan-id=15 cohort-id=06
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
-| | 145:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=27 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 26(GETNEXT)
+| | 47:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=37 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 31(GETNEXT)
| | |
-| | F16:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 26:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10483]
+| | 31:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT)
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=27 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 26(GETNEXT)
-| |
-| 25:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=30
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT)
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=37 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 31(GETNEXT)
+| |
+| 30:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| HDFS partitions=1824/1824 files=1824 size=145.75GB
+| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk
+| stored statistics:
+| table: rows=2.16G size=145.75GB
+| partitions: 1824/1824 rows=2.16G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=374(filtered from 1824)
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=35 row-size=24B cardinality=441.70M(filtered from 2.16G) cost=152652894
+| in pipelines: 30(GETNEXT)
+|
+52:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)]
+| mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| tuple-ids=34 row-size=165B cardinality=162.19M cost=141230779
+| in pipelines: 46(GETNEXT)
+|
+F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id,tpcds_partitioned_parquet_snap.customer_3.c_first_name,tpcds_partitioned_parquet_snap.customer_3.c_last_name,tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_3.c_birth_country,tpcds_partitioned_parquet_snap.customer_3.c_login,tpcds_partitioned_parquet_snap.customer_3.c_email_address)] hosts=10 instances=120
+Per-Instance Resources: mem-estimate=2.29GB mem-reservation=34.00MB thread-reservation=1
+max-parallelism=1100 segment-costs=[10985739011, 1808520801] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+46:AGGREGATE [FINALIZE]
+| output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2))
+| group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address
+| having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2)) > CAST(0 AS DECIMAL(3,0))
+| mem-estimate=2.23GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34 row-size=165B cardinality=162.19M cost=9573431219
+| in pipelines: 46(GETNEXT), 24(OPEN)
+|
+45:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id,tpcds_partitioned_parquet_snap.customer_3.c_first_name,tpcds_partitioned_parquet_snap.customer_3.c_last_name,tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_3.c_birth_country,tpcds_partitioned_parquet_snap.customer_3.c_login,tpcds_partitioned_parquet_snap.customer_3.c_email_address)]
+| mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| tuple-ids=34 row-size=165B cardinality=1.62G cost=1412307792
+| in pipelines: 24(GETNEXT)
+|
+F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
+Per-Instance Resources: mem-estimate=1.76GB mem-reservation=34.00MB thread-reservation=1
+max-parallelism=1810 segment-costs=[10841902425, 18085207959] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+29:AGGREGATE [STREAMING]
+| output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address
+| mem-estimate=1.67GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34 row-size=165B cardinality=1.62G cost=9573431219
+| in pipelines: 24(GETNEXT)
+|
+28:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=15
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=28,30,32 row-size=185B cardinality=1.62G cost=747080012
+| in pipelines: 24(GETNEXT), 27(OPEN)
+|
+|--F47:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
+| | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=1810 segment-costs=[54467197]
+| JOIN BUILD
+| | join-table-id=15 plan-id=16 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| |
+| 44:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_sk)]
+| | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=32 row-size=153B cardinality=30.00M cost=24467197
+| | in pipelines: 27(GETNEXT)
+| |
+| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
+| Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| max-parallelism=10 segment-costs=[341205999]
+| 27:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| HDFS partitions=1/1 files=1 size=1.55GB
+| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF009[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF006[bloom] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| stored statistics:
+| table: rows=30.00M size=1.55GB
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=3.10M
+| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| tuple-ids=32 row-size=153B cardinality=30.00M cost=29871228
+| in pipelines: 27(GETNEXT)
+|
+43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)]
+| mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| tuple-ids=28,30 row-size=32B cardinality=1.77G cost=521391194
+| in pipelines: 24(GETNEXT)
+|
+F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
+Per-Instance Resources: mem-estimate=34.75MB mem-reservation=8.00MB thread-reservation=1
+max-parallelism=374 segment-costs=[6845578389]
+26:HASH JOIN [INNER JOIN, BROADCAST]
+| hash-table-id=16
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=28,30 row-size=32B cardinality=1.77G cost=773340988
+| in pipelines: 24(GETNEXT), 25(OPEN)
+|
+|--F48:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | max-parallelism=10 segment-costs=[863]
+| JOIN BUILD
+| | join-table-id=16 plan-id=17 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| |
+| 42:EXCHANGE [BROADCAST]
+| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=30 row-size=8B cardinality=373 cost=490
+| | in pipelines: 25(GETNEXT)
+| |
+| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[10483]
+| 25:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| HDFS partitions=1/1 files=1 size=2.17MB
+| predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT)
+| stored statistics:
+| table: rows=73.05K size=2.17MB
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=73.05K
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT)
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=30 row-size=8B cardinality=373 cost=10467
+| in pipelines: 25(GETNEXT)
+|
+24:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+ HDFS partitions=1824/1824 files=1824 size=389.90GB
+ runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk
+ stored statistics:
+ table: rows=8.64G size=389.90GB
+ partitions: 1824/1824 rows=8.64G
+ columns: all
+ extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
+ mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
+ tuple-ids=28 row-size=24B cardinality=1.77G(filtered from 8.64G) cost=610616051
+ in pipelines: 24(GETNEXT)
+---- PARALLELPLANS
+Max Per-Host Resource Reservation: Memory=9.94GB Threads=365
+Per-Host Resource Estimates: Memory=181.12GB
+F31:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
+| Per-Instance Resources: mem-estimate=4.85MB mem-reservation=4.00MB thread-reservation=1
+| max-parallelism=1 segment-costs=[442] cpu-comparison-result=1440 [max(1 (self) vs 1440 (sum children))]
+PLAN-ROOT SINK
+| output exprs: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_birth_country
+| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
+|
+78:MERGING-EXCHANGE [UNPARTITIONED]
+| order by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_birth_country ASC NULLS LAST
+| limit: 100
+| mem-estimate=866.84KB mem-reservation=0B thread-reservation=0
+| tuple-ids=42 row-size=85B cardinality=100 cost=42
+| in pipelines: 41(GETNEXT)
+|
+F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)] hosts=10 instances=100 (adjusted from 120)
+Per-Instance Resources: mem-estimate=29.83MB mem-reservation=0B thread-reservation=1
+max-parallelism=160 segment-costs=[1504285782, 253] cpu-comparison-result=1440 [max(100 (self) vs 1440 (sum children))]
+41:TOP-N [LIMIT=100]
+| order by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_2.c_birth_country ASC NULLS LAST
+| mem-estimate=8.27KB mem-reservation=0B thread-reservation=0
+| tuple-ids=42 row-size=85B cardinality=100 cost=1196431039
+| in pipelines: 41(GETNEXT), 46(OPEN)
+|
+40:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=00
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| other join predicates: CASE WHEN sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(3,0)) THEN divide(sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitione [...]
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34,41,27,20,13,6 row-size=991B cardinality=80.79M cost=22333617
+| in pipelines: 46(GETNEXT), 76(OPEN)
+|
+|--F32:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)] hosts=10 instances=100 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=180.17MB mem-reservation=34.00MB thread-reservation=1
+| | max-parallelism=160 segment-costs=[151134290] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
+| JOIN BUILD
+| | join-table-id=00 plan-id=01 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | runtime filters: RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | mem-estimate=150.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=80787070
+| |
+| 77:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=80.79M cost=70347220
+| | in pipelines: 76(GETNEXT)
+| |
+| F30:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.18GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=550 segment-costs=[5472009822, 900826381] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| 76:AGGREGATE [FINALIZE]
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(3,0))
+| | mem-estimate=1.11GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=80.79M cost=4768537611
+| | in pipelines: 76(GETNEXT), 00(OPEN)
+| |
+| 75:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=807.87M cost=703472211
+| | in pipelines: 00(GETNEXT)
+| |
+| F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=946.99MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=910 segment-costs=[5400364645, 9008263849] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 05:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | mem-estimate=853.01MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=807.87M cost=4768537611
+| | in pipelines: 00(GETNEXT)
+| |
+| 04:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=01
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=23,25 row-size=300B cardinality=7.93G cost=3471497176
-| | in pipelines: 23(GETNEXT), 24(OPEN)
+| | tuple-ids=0,2,4 row-size=185B cardinality=807.87M cost=372121453
+| | in pipelines: 00(GETNEXT), 03(OPEN)
| |
-| |--F116:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=10 segment-costs=[69869990]
+| |--F33:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | | max-parallelism=910 segment-costs=[54467197]
| | JOIN BUILD
-| | | join-table-id=30 plan-id=31 cohort-id=14
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | |
-| | 144:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=25 row-size=204B cardinality=30.00M cost=39869990
-| | | in pipelines: 24(GETNEXT)
-| | |
-| | F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
-| | 24:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | | join-table-id=01 plan-id=02 cohort-id=02
+| | | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | | runtime filters: RF030[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF031[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | |
+| | 74:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=4 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 03(GETNEXT)
+| | |
+| | F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[341205999]
+| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=25 row-size=204B cardinality=30.00M cost=46823813
-| | in pipelines: 24(GETNEXT)
+| | tuple-ids=4 row-size=153B cardinality=30.00M cost=29871228
+| | in pipelines: 03(GETNEXT)
+| |
+| 73:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=0,2 row-size=32B cardinality=880.06M cost=259705581
+| | in pipelines: 00(GETNEXT)
+| |
+| F26:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=1.00MB thread-reservation=1
+| max-parallelism=350 segment-costs=[3409790834]
+| 02:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=02
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=0,2 row-size=32B cardinality=880.06M cost=385202077
+| | in pipelines: 00(GETNEXT), 01(OPEN)
+| |
+| |--F34:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
+| | JOIN BUILD
+| | | join-table-id=02 plan-id=03 cohort-id=02
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | | runtime filters: RF032[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| | |
+| | 72:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=2 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 01(GETNEXT)
+| | |
+| | F27:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10483]
+| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | stored statistics:
+| | table: rows=73.05K size=2.17MB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=2 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 01(GETNEXT)
| |
-| 23:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
-| HDFS partitions=1824/1824 files=1824 size=389.90GB
-| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF014[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk
+| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
+| HDFS partitions=1831/1831 files=1831 size=280.96GB
+| runtime filters: RF031[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF032[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk, RF030[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk
| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1824/1824 rows=8.64G
+| table: rows=4.32G size=280.96GB
+| partitions: 1831/1831 rows=4.32G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=390.22M
-| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
-| tuple-ids=23 row-size=96B cardinality=7.93G(filtered from 8.64G) cost=11943846410
-| in pipelines: 23(GETNEXT)
-|
-156:EXCHANGE [HASH(CUSTOMER_ID)]
-| mem-estimate=24.06MB mem-reservation=0B thread-reservation=0
-| tuple-ids=22 row-size=116B cardinality=1.18G cost=762900139
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT)
-|
-F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-Per-Instance Resources: mem-estimate=4.23GB mem-reservation=34.00MB thread-reservation=1
-max-parallelism=120 segment-costs=[44477605605, 26934229118, 13500002573, 37772016915] cpu-comparison-result=360 [max(120 (self) vs 360 (sum children))]
-20:SELECT
-| predicates: DYEAR = add(CAST(1999 AS INT), CAST(1 AS INT)), SALE_TYPE = 's'
-| mem-estimate=0B mem-reservation=0B thread-reservation=0
-| tuple-ids=22 row-size=116B cardinality=1.18G cost=23666825216
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT)
+| extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=374(filtered from 1831)
+| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| tuple-ids=0 row-size=24B cardinality=880.06M(filtered from 4.32G) cost=304148590
+| in pipelines: 00(GETNEXT)
|
-00:UNION
-| pass-through-operands: 01
-| mem-estimate=0B mem-reservation=0B thread-reservation=0
-| tuple-ids=22 row-size=116B cardinality=11.83G cost=782000635
-| in pipelines: 135(GETNEXT), 139(GETNEXT), 143(GETNEXT)
+39:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=03
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34,41,27,20,13 row-size=826B cardinality=30.00M cost=13131000
+| in pipelines: 46(GETNEXT), 70(OPEN)
|
-|--143:AGGREGATE [FINALIZE]
+|--F35:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)] hosts=10 instances=100 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=81.45MB mem-reservation=34.00MB thread-reservation=1
+| | max-parallelism=160 segment-costs=[56123197] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
+| JOIN BUILD
+| | join-table-id=03 plan-id=04 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | mem-estimate=54.93MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| |
+| 71:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)]
+| | mem-estimate=26.52MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=30.00M cost=26123197
+| | in pipelines: 70(GETNEXT)
+| |
+| F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)] hosts=10 instances=100 (adjusted from 120)
+| Per-Instance Resources: mem-estimate=715.42MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=100 segment-costs=[998712806, 334518771] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
+| 70:AGGREGATE [FINALIZE]
| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address, tpcds_partitioned_parquet_snap.date_dim_1.d_year
-| | mem-estimate=2.79GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=21 row-size=169B cardinality=1.99G cost=11732593545
-| | in pipelines: 143(GETNEXT), 14(OPEN)
-| |
-| 142:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address,tpcds_partitioned_parquet_snap.date_dim_1.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=21 row-size=169B cardinality=1.99G cost=1767409028
-| | in pipelines: 14(GETNEXT)
-| |
-| F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=2.19GB mem-reservation=34.26MB thread-reservation=1
-| max-parallelism=1824 segment-costs=[17827120882, 22676121640] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 19:AGGREGATE [STREAMING]
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
+| | mem-estimate=649.35MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=30.00M cost=664015288
+| | in pipelines: 70(GETNEXT), 06(OPEN)
+| |
+| 69:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=384.37M cost=334697518
+| | in pipelines: 06(GETNEXT)
+| |
+| F24:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=509.95MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=430 segment-costs=[2616446902, 4285945495] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 11:AGGREGATE [STREAMING]
| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address, tpcds_partitioned_parquet_snap.date_dim_1.d_year
-| | mem-estimate=2.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=21 row-size=169B cardinality=1.99G cost=11732593545
-| | in pipelines: 14(GETNEXT)
-| |
-| 18:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=39
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
+| | mem-estimate=429.19MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=384.37M cost=2299149579
+| | in pipelines: 06(GETNEXT)
+| |
+| 10:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=04
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=15,17,19 row-size=582B cardinality=1.99G cost=870015958
-| | in pipelines: 14(GETNEXT), 17(OPEN)
+| | tuple-ids=7,9,11 row-size=185B cardinality=406.48M cost=186950480
+| | in pipelines: 06(GETNEXT), 09(OPEN)
| |
-| |--F125:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
+| |--F36:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=430 segment-costs=[54467197]
| | JOIN BUILD
-| | | join-table-id=39 plan-id=40 cohort-id=01
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
+| | | join-table-id=04 plan-id=05 cohort-id=03
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | | runtime filters: RF027[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 141:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=19 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 17(GETNEXT)
+| | 68:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=11 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 09(GETNEXT)
| | |
-| | F11:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 17:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | F23:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[341205999]
+| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | stored statistics:
+| | table: rows=30.00M size=1.55GB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=11 row-size=153B cardinality=30.00M cost=29871228
+| | in pipelines: 09(GETNEXT)
+| |
+| 67:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=7,9 row-size=32B cardinality=441.70M cost=130346843
+| | in pipelines: 06(GETNEXT)
+| |
+| F21:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=128.00KB thread-reservation=1
+| max-parallelism=180 segment-costs=[1711382054]
+| 08:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=05
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=7,9 row-size=32B cardinality=441.70M cost=193333830
+| | in pipelines: 06(GETNEXT), 07(OPEN)
+| |
+| |--F37:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
+| | JOIN BUILD
+| | | join-table-id=05 plan-id=06 cohort-id=03
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| | |
+| | 66:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=9 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 07(GETNEXT)
+| | |
+| | F22:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10483]
+| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=19 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 17(GETNEXT)
-| |
-| 16:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=40
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=9 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 07(GETNEXT)
+| |
+| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| HDFS partitions=1824/1824 files=1824 size=145.75GB
+| runtime filters: RF027[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF028[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk
+| stored statistics:
+| table: rows=2.16G size=145.75GB
+| partitions: 1824/1824 rows=2.16G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=374(filtered from 1824)
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=7 row-size=24B cardinality=441.70M(filtered from 2.16G) cost=152652894
+| in pipelines: 06(GETNEXT)
+|
+38:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=06
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34,41,27,20 row-size=661B cardinality=30.00M cost=13131000
+| in pipelines: 46(GETNEXT), 64(OPEN)
+|
+|--F38:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)] hosts=10 instances=100 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=84.75MB mem-reservation=34.00MB thread-reservation=1
+| | max-parallelism=160 segment-costs=[56123197] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
+| JOIN BUILD
+| | join-table-id=06 plan-id=07 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | runtime filters: RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | mem-estimate=54.93MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| |
+| 65:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=30.00M cost=26123197
+| | in pipelines: 64(GETNEXT)
+| |
+| F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.06GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=180 segment-costs=[1760337155, 334518771] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| 64:AGGREGATE [FINALIZE]
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | mem-estimate=1018.77MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=30.00M cost=1130209988
+| | in pipelines: 64(GETNEXT), 12(OPEN)
+| |
+| 63:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=723.64M cost=630127167
+| | in pipelines: 12(GETNEXT)
+| |
+| F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=946.99MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=810 segment-costs=[5018930073, 8069049063] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 17:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | mem-estimate=853.01MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=723.64M cost=4387103039
+| | in pipelines: 12(GETNEXT)
+| |
+| 16:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=07
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=15,17 row-size=344B cardinality=1.99G cost=870015958
-| | in pipelines: 14(GETNEXT), 15(OPEN)
+| | tuple-ids=14,16,18 row-size=185B cardinality=807.87M cost=372121453
+| | in pipelines: 12(GETNEXT), 15(OPEN)
| |
-| |--F126:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.47GB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[69869990]
+| |--F39:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | | max-parallelism=810 segment-costs=[54467197]
| | JOIN BUILD
-| | | join-table-id=40 plan-id=41 cohort-id=01
+| | | join-table-id=07 plan-id=08 cohort-id=04
| | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | runtime filters: RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | | runtime filters: RF022[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF023[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 140:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=17 row-size=204B cardinality=30.00M cost=39869990
+| | 62:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=18 row-size=153B cardinality=30.00M cost=24467197
| | | in pipelines: 15(GETNEXT)
| | |
-| | F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
+| | F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[341205999]
| | 15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
+| | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=17 row-size=204B cardinality=30.00M cost=46823813
+| | tuple-ids=18 row-size=153B cardinality=30.00M cost=29871228
| | in pipelines: 15(GETNEXT)
| |
-| 14:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| HDFS partitions=1824/1824 files=1824 size=145.75GB
-| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk
+| 61:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=14,16 row-size=32B cardinality=880.06M cost=259705581
+| | in pipelines: 12(GETNEXT)
+| |
+| F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=1.00MB thread-reservation=1
+| max-parallelism=350 segment-costs=[3409790834]
+| 14:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=08
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=14,16 row-size=32B cardinality=880.06M cost=385202077
+| | in pipelines: 12(GETNEXT), 13(OPEN)
+| |
+| |--F40:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
+| | JOIN BUILD
+| | | join-table-id=08 plan-id=09 cohort-id=04
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| | |
+| | 60:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=16 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 13(GETNEXT)
+| | |
+| | F17:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10483]
+| | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | stored statistics:
+| | table: rows=73.05K size=2.17MB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=16 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 13(GETNEXT)
+| |
+| 12:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
+| HDFS partitions=1831/1831 files=1831 size=280.96GB
+| runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk, RF022[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk
| stored statistics:
-| table: rows=2.16G size=145.75GB
-| partitions: 1824/1824 rows=2.16G
+| table: rows=4.32G size=280.96GB
+| partitions: 1831/1831 rows=4.32G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=3.37M
-| mem-estimate=16.00MB mem-reservation=264.00KB thread-reservation=0
-| tuple-ids=15 row-size=140B cardinality=1.99G(filtered from 2.16G) cost=4354495421
-| in pipelines: 14(GETNEXT)
+| extrapolated-rows=disabled max-scan-range-rows=21.52M est-scan-range=374(filtered from 1831)
+| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| tuple-ids=14 row-size=24B cardinality=880.06M(filtered from 4.32G) cost=304148590
+| in pipelines: 12(GETNEXT)
|
-01:UNION
-| mem-estimate=0B mem-reservation=0B thread-reservation=0
-| tuple-ids=14 row-size=116B cardinality=9.85G cost=3873500731
-| in pipelines: 135(GETNEXT), 139(GETNEXT)
+37:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=09
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34,41,27 row-size=495B cardinality=30.00M cost=47037753
+| in pipelines: 46(GETNEXT), 58(OPEN)
|
-|--139:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address, tpcds_partitioned_parquet_snap.date_dim_0.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=169B cardinality=3.97G cost=23408022405
-| | in pipelines: 139(GETNEXT), 08(OPEN)
-| |
-| 138:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address,tpcds_partitioned_parquet_snap.date_dim_0.d_year)]
-| | mem-estimate=30.29MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=13 row-size=169B cardinality=3.97G cost=3526206713
-| | in pipelines: 08(GETNEXT)
-| |
-| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=4.26GB mem-reservation=35.00MB thread-reservation=1
-| max-parallelism=1831 segment-costs=[35588885488, 45241758471] cpu-comparison-result=120 [max(120 (self) vs 31 (sum children))]
-| 13:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address, tpcds_partitioned_parquet_snap.date_dim_0.d_year
-| | mem-estimate=4.17GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=169B cardinality=3.97G cost=23408022405
-| | in pipelines: 08(GETNEXT)
-| |
-| 12:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=37
-| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+|--F41:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)] hosts=10 instances=100 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=100.75MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=160 segment-costs=[56123197] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
+| JOIN BUILD
+| | join-table-id=09 plan-id=10 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | mem-estimate=54.93MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| |
+| 59:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=30.00M cost=26123197
+| | in pipelines: 58(GETNEXT)
+| |
+| F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.86GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=310 segment-costs=[3067099075, 334518771] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| 58:AGGREGATE [FINALIZE]
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
+| | mem-estimate=1.80GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=30.00M cost=1930086569
+| | in pipelines: 58(GETNEXT), 18(OPEN)
+| |
+| 57:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=1.31G cost=1137012506
+| | in pipelines: 18(GETNEXT)
+| |
+| F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.76GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=1460 segment-costs=[9410215497, 14559933564] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 23:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
+| | mem-estimate=1.67GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=1.31G cost=8141744291
+| | in pipelines: 18(GETNEXT)
+| |
+| 22:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=10
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=7,9,11 row-size=582B cardinality=3.97G cost=1735792939
-| | in pipelines: 08(GETNEXT), 11(OPEN)
+| | tuple-ids=21,23,25 row-size=185B cardinality=1.62G cost=747080012
+| | in pipelines: 18(GETNEXT), 21(OPEN)
| |
-| |--F123:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=418.24MB mem-reservation=408.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[170129]
+| |--F42:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=1460 segment-costs=[54467197]
| | JOIN BUILD
-| | | join-table-id=37 plan-id=38 cohort-id=01
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=73049
-| | |
-| | 137:EXCHANGE [BROADCAST]
-| | | mem-estimate=10.24MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=11 row-size=237B cardinality=73.05K cost=97080
-| | | in pipelines: 11(GETNEXT)
-| | |
-| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=4.00MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[158950]
-| | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | | join-table-id=10 plan-id=11 cohort-id=05
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | | runtime filters: RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | |
+| | 56:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=25 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 21(GETNEXT)
+| | |
+| | F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[341205999]
+| | 21:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | stored statistics:
+| | table: rows=30.00M size=1.55GB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=25 row-size=153B cardinality=30.00M cost=29871228
+| | in pipelines: 21(GETNEXT)
+| |
+| 55:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=21,23 row-size=32B cardinality=1.77G cost=521391194
+| | in pipelines: 18(GETNEXT)
+| |
+| F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=8.00MB thread-reservation=1
+| max-parallelism=374 segment-costs=[6845578389]
+| 20:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=11
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=21,23 row-size=32B cardinality=1.77G cost=773340988
+| | in pipelines: 18(GETNEXT), 19(OPEN)
+| |
+| |--F43:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
+| | JOIN BUILD
+| | | join-table-id=11 plan-id=12 cohort-id=05
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
+| | |
+| | 54:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=23 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 19(GETNEXT)
+| | |
+| | F12:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[10483]
+| | 19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | mem-estimate=16.00MB mem-reservation=4.00MB thread-reservation=0
-| | tuple-ids=11 row-size=237B cardinality=73.05K cost=110600
-| | in pipelines: 11(GETNEXT)
-| |
-| 10:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=38
-| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = add(CAST(1999 AS INT), CAST(1 AS INT))
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=23 row-size=8B cardinality=373 cost=10467
+| | in pipelines: 19(GETNEXT)
+| |
+| 18:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+| HDFS partitions=1824/1824 files=1824 size=389.90GB
+| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
+| stored statistics:
+| table: rows=8.64G size=389.90GB
+| partitions: 1824/1824 rows=8.64G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=390.22M est-scan-range=374(filtered from 1824)
+| mem-estimate=16.00MB mem-reservation=8.00MB thread-reservation=0
+| tuple-ids=21 row-size=24B cardinality=1.77G(filtered from 8.64G) cost=610616051
+| in pipelines: 18(GETNEXT)
+|
+36:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=12
+| hash predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_4.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_3.c_customer_id = tpcds_partitioned_parquet_snap.customer_4.c_customer_id
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=34,41 row-size=330B cardinality=162.19M cost=70990594
+| in pipelines: 46(GETNEXT), 51(OPEN)
+|
+|--F44:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)] hosts=10 instances=100 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=103.14MB mem-reservation=34.00MB thread-reservation=1
+| | max-parallelism=160 segment-costs=[76042402] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
+| JOIN BUILD
+| | join-table-id=12 plan-id=13 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_4.c_customer_id
+| | runtime filters: RF009[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_id
+| | mem-estimate=73.32MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40647578
+| |
+| 53:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=41 row-size=165B cardinality=40.65M cost=35394824
+| | in pipelines: 51(GETNEXT)
+| |
+| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=638.32MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=280 segment-costs=[2753212168, 453245929] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| 51:AGGREGATE [FINALIZE]
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2)) > CAST(0 AS DECIMAL(3,0))
+| | mem-estimate=572.25MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=41 row-size=165B cardinality=40.65M cost=2399263927
+| | in pipelines: 51(GETNEXT), 30(OPEN)
+| |
+| 50:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=41 row-size=165B cardinality=406.48M cost=353948241
+| | in pipelines: 30(GETNEXT)
+| |
+| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=523.16MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=460 segment-costs=[2716561250, 4532459269] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 35:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
+| | mem-estimate=429.19MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=41 row-size=165B cardinality=406.48M cost=2399263927
+| | in pipelines: 30(GETNEXT)
+| |
+| 34:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=13
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=7,9 row-size=344B cardinality=3.97G cost=1735792939
-| | in pipelines: 08(GETNEXT), 09(OPEN)
+| | tuple-ids=35,37,39 row-size=185B cardinality=406.48M cost=186950480
+| | in pipelines: 30(GETNEXT), 33(OPEN)
| |
-| |--F124:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=6.49GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=10 segment-costs=[69869990]
+| |--F45:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=460 segment-costs=[54467197]
| | JOIN BUILD
-| | | join-table-id=38 plan-id=39 cohort-id=01
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | mem-estimate=6.46GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | | join-table-id=13 plan-id=14 cohort-id=06
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | | runtime filters: RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 136:EXCHANGE [BROADCAST]
-| | | mem-estimate=12.04MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=9 row-size=204B cardinality=30.00M cost=39869990
-| | | in pipelines: 09(GETNEXT)
+| | 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=39 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 33(GETNEXT)
| | |
-| | F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.81MB mem-reservation=1.00MB thread-reservation=1
-| | max-parallelism=10 segment-costs=[64027278]
-| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[341205999]
+| | 33:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
+| | runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF006[bloom] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
... 144826 lines suppressed ...