You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by mi...@apache.org on 2026/04/04 03:13:07 UTC
(impala) 01/02: IMPALA-14716: Calcite Planner: Make condition estimates more similar to original planner
This is an automated email from the ASF dual-hosted git repository.
michaelsmith pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git
commit 81c82c063e73b966b92b103287346f91b6c98b03
Author: Steve Carlin <sc...@cloudera.com>
AuthorDate: Sun Feb 1 06:56:12 2026 -0800
IMPALA-14716: Calcite Planner: Make condition estimates more similar to original planner
The first pass of condition estimates were derived from a different database.
This commit makes the condition estimates a little bit more similar to what
is being done with the original Impala planner. Using calculations similar to
the current Impala planner is better for the first pass so we have slightly
more of an "apples to apples" comparison of the Calcite planner versus the
original planner. These calculations should be re-examined later, especially
when other features such as generating histogram statistics are implemented.
The default for unknown estimates is now taken from Expr.DEFAULT_SELECTIVITY (.1)
This gets applied to many different expressions, including things like >=, <=,
etc...
The disjunct condition was kept fairly straightforward and match the logic in
CompoundPredicate.computeSelectivity()
However, upon debugging, to obtain closer estimates to the original planner,
the conjunction condition uses code found in PlanNode.computeCombinedSelectivity().
IMPALA-14867 has been created for "between" selectivity which has not yet
been implemented.
An issue with distinct row counts on filters is also fixed with this commit.
The distinct row count on a filter only changes if the filter condition
contains an input reference that matches the column with which we are trying
to find distinct rows. IMPALA-14640 is also fixed by this commit, which now
handles the case where there are no statistics provided.
Testing: Some TestCalciteStats changed due to this commit as well as some
tpcds query plans.
Change-Id: I3b9a25259916504296dbd9a9cb9466be8fac8718
Reviewed-on: http://gerrit.cloudera.org:8080/23930
Tested-by: Impala Public Jenkins <im...@cloudera.com>
Reviewed-by: Michael Smith <mi...@cloudera.com>
---
.../impala/calcite/rules/ImpalaRexExecutor.java | 7 +
.../calcite/schema/FilterSelectivityEstimator.java | 167 +-
.../schema/ImpalaRelMdDistinctRowCount.java | 36 +-
.../impala/calcite/planner/TestCalciteStats.java | 88 +-
.../PlannerTest/calcite_tpcds/tpcds-q04.test | 3071 ++++++++--------
.../PlannerTest/calcite_tpcds/tpcds-q06.test | 988 +++--
.../PlannerTest/calcite_tpcds/tpcds-q07.test | 238 +-
.../PlannerTest/calcite_tpcds/tpcds-q11.test | 1398 +++----
.../PlannerTest/calcite_tpcds/tpcds-q13.test | 566 +--
.../PlannerTest/calcite_tpcds/tpcds-q15.test | 408 ++-
.../PlannerTest/calcite_tpcds/tpcds-q16.test | 1401 ++++---
.../PlannerTest/calcite_tpcds/tpcds-q17.test | 228 +-
.../PlannerTest/calcite_tpcds/tpcds-q18.test | 628 ++--
.../PlannerTest/calcite_tpcds/tpcds-q19.test | 276 +-
.../PlannerTest/calcite_tpcds/tpcds-q23a.test | 926 ++---
.../PlannerTest/calcite_tpcds/tpcds-q23b.test | 2104 +++++------
.../PlannerTest/calcite_tpcds/tpcds-q24a.test | 706 ++--
.../PlannerTest/calcite_tpcds/tpcds-q24b.test | 706 ++--
.../PlannerTest/calcite_tpcds/tpcds-q25.test | 190 +-
.../PlannerTest/calcite_tpcds/tpcds-q26.test | 282 +-
.../PlannerTest/calcite_tpcds/tpcds-q27.test | 272 +-
.../PlannerTest/calcite_tpcds/tpcds-q29.test | 208 +-
.../PlannerTest/calcite_tpcds/tpcds-q30.test | 680 ++--
.../PlannerTest/calcite_tpcds/tpcds-q31.test | 2249 ++++++------
.../PlannerTest/calcite_tpcds/tpcds-q32.test | 719 ++--
.../PlannerTest/calcite_tpcds/tpcds-q33.test | 1132 +++---
.../PlannerTest/calcite_tpcds/tpcds-q34.test | 368 +-
.../PlannerTest/calcite_tpcds/tpcds-q35a.test | 320 +-
.../PlannerTest/calcite_tpcds/tpcds-q39b.test | 64 +-
.../PlannerTest/calcite_tpcds/tpcds-q40.test | 114 +-
.../PlannerTest/calcite_tpcds/tpcds-q41.test | 350 +-
.../PlannerTest/calcite_tpcds/tpcds-q45.test | 1066 +++---
.../PlannerTest/calcite_tpcds/tpcds-q46.test | 812 ++--
.../PlannerTest/calcite_tpcds/tpcds-q48.test | 180 +-
.../PlannerTest/calcite_tpcds/tpcds-q54.test | 758 ++--
.../PlannerTest/calcite_tpcds/tpcds-q56.test | 1176 +++---
.../PlannerTest/calcite_tpcds/tpcds-q58.test | 1608 ++++----
.../PlannerTest/calcite_tpcds/tpcds-q59.test | 641 ++--
.../PlannerTest/calcite_tpcds/tpcds-q60.test | 1140 +++---
.../PlannerTest/calcite_tpcds/tpcds-q61.test | 1094 +++---
.../PlannerTest/calcite_tpcds/tpcds-q64.test | 3872 ++++++++++----------
.../PlannerTest/calcite_tpcds/tpcds-q65.test | 322 +-
.../PlannerTest/calcite_tpcds/tpcds-q66.test | 454 +--
.../PlannerTest/calcite_tpcds/tpcds-q68.test | 1272 +++----
.../PlannerTest/calcite_tpcds/tpcds-q72.test | 1797 +++++----
.../PlannerTest/calcite_tpcds/tpcds-q73.test | 288 +-
.../PlannerTest/calcite_tpcds/tpcds-q74.test | 1398 +++----
.../PlannerTest/calcite_tpcds/tpcds-q75.test | 3624 +++++++++---------
.../PlannerTest/calcite_tpcds/tpcds-q76.test | 242 +-
.../PlannerTest/calcite_tpcds/tpcds-q77.test | 722 ++--
.../PlannerTest/calcite_tpcds/tpcds-q79.test | 290 +-
.../PlannerTest/calcite_tpcds/tpcds-q80.test | 378 +-
.../PlannerTest/calcite_tpcds/tpcds-q81.test | 1554 ++++----
.../PlannerTest/calcite_tpcds/tpcds-q82.test | 262 +-
.../PlannerTest/calcite_tpcds/tpcds-q83.test | 812 ++--
.../PlannerTest/calcite_tpcds/tpcds-q84.test | 693 ++--
.../PlannerTest/calcite_tpcds/tpcds-q85.test | 410 +--
.../PlannerTest/calcite_tpcds/tpcds-q91.test | 600 +--
.../PlannerTest/calcite_tpcds/tpcds-q92.test | 737 ++--
.../PlannerTest/calcite_tpcds/tpcds-q96.test | 232 +-
60 files changed, 24733 insertions(+), 24591 deletions(-)
diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaRexExecutor.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaRexExecutor.java
index 0482e1432..66676e77e 100644
--- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaRexExecutor.java
+++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/rules/ImpalaRexExecutor.java
@@ -39,6 +39,7 @@ import org.apache.impala.analysis.Expr;
import org.apache.impala.analysis.FunctionCallExpr;
import org.apache.impala.analysis.LiteralExpr;
import org.apache.impala.calcite.rel.util.ExprConjunctsConverter;
+import org.apache.impala.calcite.service.CalciteAnalysisResult;
import org.apache.impala.common.AnalysisException;
import org.apache.impala.common.ImpalaException;
import org.apache.impala.service.FeSupport;
@@ -67,6 +68,12 @@ public class ImpalaRexExecutor implements RexExecutor {
// Reducer class used for testing purposes for injection.
private final Reducer reducer_;
+ public ImpalaRexExecutor(CalciteAnalysisResult analysisResult, Reducer reducer) {
+ analyzer_ = analysisResult.getAnalyzer();
+ queryCtx_ = analyzer_.getQueryCtx();
+ reducer_ = reducer;
+ }
+
public ImpalaRexExecutor(Analyzer analyzer, TQueryCtx queryCtx,
Reducer reducer) {
analyzer_ = analyzer;
diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/FilterSelectivityEstimator.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/FilterSelectivityEstimator.java
index 6bc8d3a42..8e67a557d 100644
--- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/FilterSelectivityEstimator.java
+++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/FilterSelectivityEstimator.java
@@ -17,7 +17,10 @@
*/
package org.apache.impala.calcite.schema;
+import java.util.ArrayList;
+import java.util.Collections;
import java.util.HashSet;
+import java.util.List;
import java.util.Set;
import org.apache.calcite.rel.RelNode;
@@ -32,8 +35,8 @@ import org.apache.calcite.sql.SqlKind;
import org.apache.calcite.sql.type.SqlTypeName;
import org.apache.calcite.util.ImmutableBitSet;
import org.apache.calcite.util.Sarg;
+import org.apache.impala.analysis.Expr;
import org.apache.impala.calcite.rel.util.RexInputRefCollector;
-import org.apache.impala.calcite.schema.JoinRelationInfo.EqualityConjunction;
import org.apache.impala.catalog.Column;
import org.apache.impala.catalog.ColumnStats;
@@ -41,6 +44,7 @@ import org.apache.calcite.plan.hep.HepRelVertex;
import org.apache.calcite.rel.core.Join;
import com.google.common.base.Preconditions;
+import com.google.common.collect.ImmutableSet;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
@@ -56,10 +60,6 @@ public class FilterSelectivityEstimator {
private final RelMetadataQuery mq_;
- public static final double RANGE_COMPARISON_SELECTIVITY = 1.0 / 3.0;
-
- public static final double BETWEEN_SELECTIVITY = 1.0 / 9.0;
-
public FilterSelectivityEstimator(RelNode childRel, RelMetadataQuery mq) {
this.mq_ = mq;
this.childRel_ = (childRel instanceof HepRelVertex)
@@ -69,11 +69,16 @@ public class FilterSelectivityEstimator {
}
public Double estimateSelectivity(RexNode rexNode) {
+ Double selectivity = estimateSelectivityInternal(rexNode, true);
+ return selectivity == null ? Expr.DEFAULT_SELECTIVITY : selectivity;
+ }
+
+ public Double estimateSelectivityInternal(RexNode rexNode, boolean topLevel) {
if (rexNode instanceof RexInputRef) {
return estimateInputRefSelectivity((RexInputRef) rexNode);
}
if (rexNode instanceof RexCall) {
- return estimateCallSelectivity((RexCall)rexNode);
+ return estimateCallSelectivity((RexCall)rexNode, topLevel);
}
return 1.0;
}
@@ -110,14 +115,13 @@ public class FilterSelectivityEstimator {
return 0.5;
}
- private Double estimateCallSelectivity(RexCall call) {
+ private Double estimateCallSelectivity(RexCall call, boolean topLevel) {
switch (call.getOperator().getKind()) {
case EQUALS:
- case LIKE:
case IS_NOT_DISTINCT_FROM:
return computeEqualsSelectivity(call);
case AND:
- return computeConjunctionSelectivity(call);
+ return computeConjunctionSelectivity(call, topLevel);
case OR:
return computeDisjunctionSelectivity(call);
case NOT:
@@ -127,21 +131,16 @@ public class FilterSelectivityEstimator {
return computeIsNullSelectivity(call);
case IS_NOT_NULL:
return computeIsNotNullSelectivity(call);
- // TODO: For inequalities, between, and in, we can give a selectivity
- // of 0 if condition is out of range. Also, histogram data would be
- // a nice feature to add :)
- case LESS_THAN_OR_EQUAL:
- case GREATER_THAN_OR_EQUAL:
- case LESS_THAN:
- case GREATER_THAN:
- return RANGE_COMPARISON_SELECTIVITY;
- case BETWEEN:
- // TODO: Impala has better logic than this
- return BETWEEN_SELECTIVITY;
case SEARCH:
return computeSearchSelectivity(call);
+ // This logic is similar to the Expr framework. If there is any other type function
+ // call, the Expr framework doesn't know what to do with it, so it assigns a null.
+ // If this call is part of a conjunction or disjunction, it will not be considered
+ // (e.g. see the computeConjunctionSelectivity caller which ignores the null which
+ // this method returns). If this is the only "call", the caller will assign a
+ // the default selectivity of Expr.DEFAULT_SELECTIVITY.
default:
- return computeEqualsSelectivity(call);
+ return null;
}
}
@@ -155,6 +154,7 @@ public class FilterSelectivityEstimator {
*/
private Double computeNotEqualitySelectivity(RexCall call) {
Double tmpNDV = getMaxNDV(call);
+ if (tmpNDV == null) return null;
return tmpNDV > 1.0 ? (tmpNDV - 1.0) / tmpNDV : 1.0;
}
@@ -167,6 +167,8 @@ public class FilterSelectivityEstimator {
* @return returns "equals" selectivity for call.
*/
private Double computeEqualsSelectivity(RexCall call) {
+ Double tmpNDV = getMaxNDV(call);
+ if (tmpNDV == null) return null;
return 1.0 / getMaxNDV(call);
}
@@ -181,10 +183,10 @@ public class FilterSelectivityEstimator {
// of null rows based on what happens with the outer join. We also only change
// the cardinality if the input ref is on the "outer" side.
if (join.getJoinType() != JoinRelType.INNER) {
- return 1.0 - RANGE_COMPARISON_SELECTIVITY;
+ return 1.0 - Expr.DEFAULT_SELECTIVITY;
}
}
- return computeEqualsSelectivity(call);
+ return null;
}
private Double computeIsNotNullSelectivity(RexCall call) {
@@ -200,12 +202,18 @@ public class FilterSelectivityEstimator {
// of null rows based on what happens with the outer join. We also only change
// the cardinality if the input ref is on the "outer" side.
if (join.getJoinType() != JoinRelType.INNER) {
- return RANGE_COMPARISON_SELECTIVITY;
+ return Expr.DEFAULT_SELECTIVITY;
}
}
-
- //TODO: IMPALA-14235, let's see if we can do better.
- return computeNotEqualitySelectivity(call);
+ // IMPALA-14235: This does not seem right. We are returning an
+ // unknown selectivity here if the child is not a Join or TableScan. If this is the
+ // only condition, the selectivity will be the default of .1 which seems wrong.
+ // Tpcds tests seemed to be good leaving this as null, but this requires further
+ // investigation because we may be able to get better plans if this is changed.
+ // Also, while this is actually similar to the logic in IsNullPredicate does, it is
+ // possible that higher levels (where the child is not just a TableScan or Join) may
+ // still be able to deduce the number of nulls.
+ return null;
}
private Double computeSearchSelectivity(RexCall call) {
@@ -220,61 +228,80 @@ public class FilterSelectivityEstimator {
: Math.max(1.0 - selectivity, 0.0);
} else {
// TODO: Impala has better logic than this
- return BETWEEN_SELECTIVITY;
+ return null;
}
} catch (Exception e) {
LOG.warn("Warning: Bug found when trying to calculate selectivity for search " +
"operator, but instead of throwing an exception, a default selectivity will " +
"be used.");
- return computeEqualsSelectivity(call);
+ return null;
}
}
/**
- * Disjunction Selectivity -> (1 D(1-m1/n)(1-m2/n)) where n is the total
- * number of tuples from child and m1 and m2 is the expected number of tuples
- * from each part of the disjunction predicate.
- * <p>
- * Note we compute m1. m2.. by applying selectivity of the disjunctive element
- * on the cardinality from child.
- *
- * @param call
- * @return returns "disjunction" selectivity for call.
+ * This logic is similar to the logic found in CompoundPredicate
*/
private Double computeDisjunctionSelectivity(RexCall call) {
- Double tmpCardinality;
Double tmpSelectivity;
- double selectivity = 1;
+ double selectivity = 0.0;
+ // Check to see there are operands, which there should be because this
+ // is called when there is a disjunction.
+ Preconditions.checkState(call.getOperands().size() >= 2);
for (RexNode dje : call.getOperands()) {
- tmpCardinality = childCardinality_ * estimateSelectivity(dje);
- tmpSelectivity = (tmpCardinality > 1.0 && tmpCardinality < childCardinality_)
- ? 1.0 - tmpCardinality / childCardinality_
- : 1.0;
-
- selectivity *= tmpSelectivity;
- }
-
- if (selectivity < 0.0) {
- selectivity = 0.0;
+ tmpSelectivity = estimateSelectivityInternal(dje, false);
+ // This logic matches the logic in CompoundPredicate.computeSelectivity()
+ // A null is returned when an inner conjunct has an operand where
+ // the selectivity could not be calculated.
+ if (tmpSelectivity == null) {
+ return null;
+ }
+ // This logic matches the disjunction logic found in
+ // CompoundPredicate.computeSelectivity().
+ selectivity = selectivity + tmpSelectivity - selectivity * tmpSelectivity;
}
-
- return (1.0 - selectivity);
+ return Math.max(0.0, Math.min(1.0, selectivity));
}
/**
- * Selectivity of conjunctive predicate -> (selectivity of conjunctive
- * element1) * (selectivity of conjunctive element2)...
- *
- * @param call
- * @return returns "conjunction" selectivity for call.
+ * This logic is similar to the logic found in PlanNode.computeCombinedSelectivity()
+ * The logic there is a bit more comprehensive on how to deal with missing stats
+ * and overlapping clauses. TODO: Between logic still needs to be handled.
*/
- private Double computeConjunctionSelectivity(RexCall call) {
- double selectivity = 1.0;
+ private Double computeConjunctionSelectivity(RexCall call, boolean topLevel) {
+ List<Double> selectivities = new ArrayList<>();
for (RexNode cje : call.getOperands()) {
- selectivity *= estimateSelectivity(cje);
+ Double selectivity = estimateSelectivityInternal(cje, false);
+ if (selectivity != null) {
+ selectivities.add(selectivity);
+ }
}
- return selectivity;
+ if (selectivities.size() != call.getOperands().size()) {
+ // This logic matches the logic in PlanNode.computeCombinedSelectivity().
+ // At the top level, if there are any underlying conjuncts where the
+ // selectivity could not be calculated, one "default" selectivity is
+ // added in to represent all those conjuncts.
+ // If it is not the top level, the the logic matches what is found in
+ // CompoundPredicate.computeSelectivity() and a null is returned when
+ // an inner conjunct has an operand where the selectivity could not be
+ // calculated.
+ if (topLevel) {
+ selectivities.add(Expr.DEFAULT_SELECTIVITY);
+ } else {
+ return null;
+ }
+ }
+ // Sort the selectivities to get a consistent estimate, regardless of the original
+ // conjunct order. Sort in ascending order such that the most selective conjunct
+ // is fully applied. (comment copied from PlanNode.computeCombinedSelectivity)
+ Collections.sort(selectivities);
+ double selectivity = 1.0;
+ for (int i = 0; i < selectivities.size(); ++i) {
+ // Exponential backoff for each selectivity multiplied into the final result.
+ selectivity *= Math.pow(selectivities.get(i), 1.0 / (double) (i + 1));
+ }
+
+ return Math.max(0.0, Math.min(1.0, selectivity));
}
/**
@@ -288,25 +315,27 @@ public class FilterSelectivityEstimator {
* @return estimated number of nulls from statistics
*/
private long getNumNulls(RexCall call, TableScan t) {
- Preconditions.checkState(call.getOperator().getKind() == SqlKind.IS_NULL ||
- call.getOperator().getKind() == SqlKind.IS_NOT_NULL);
Preconditions.checkState(call.getOperands().size() == 1);
Preconditions.checkState(call.getOperands().get(0) instanceof RexInputRef);
RexInputRef inputRef = (RexInputRef) call.getOperands().get(0);
CalciteTable table = (CalciteTable) t.getTable();
Column column = table.getColumn(inputRef.getIndex());
- return column.getStats() != null ? column.getStats().getNumNulls() : 0;
+ return column.getStats() != null
+ ? Math.max(column.getStats().getNumNulls(), 0)
+ : 0;
}
private Double getMaxNDV(RexCall call) {
- Set<Integer> inputRefs = new HashSet<>();
- for (RexNode op : call.getOperands()) {
- inputRefs.addAll(RexInputRefCollector.getInputRefs(op));
+ Set<Integer> inputRefs = new HashSet<>(RexInputRefCollector.getInputRefs(call));
+
+ if (inputRefs.size() != 1) {
+ return null;
}
double maxNDV = 1.0;
- for (Integer index : inputRefs) {
- maxNDV = Math.max(getDistinctRowCount(index), maxNDV);
+ Double ndv = getDistinctRowCount(inputRefs.toArray(new Integer[0])[0]);
+ if (ndv != null) {
+ maxNDV = Math.max(ndv, maxNDV);
}
return maxNDV;
diff --git a/java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/ImpalaRelMdDistinctRowCount.java b/java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/ImpalaRelMdDistinctRowCount.java
index 93db85c9a..f52a0b465 100644
--- a/java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/ImpalaRelMdDistinctRowCount.java
+++ b/java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/ImpalaRelMdDistinctRowCount.java
@@ -18,8 +18,8 @@
package org.apache.impala.calcite.schema;
import com.google.common.base.Preconditions;
-import com.google.common.collect.ImmutableList;
+import org.apache.calcite.plan.RelOptUtil;
import org.apache.calcite.rel.core.Aggregate;
import org.apache.calcite.rel.core.Filter;
import org.apache.calcite.rel.core.Join;
@@ -75,26 +75,25 @@ public class ImpalaRelMdDistinctRowCount extends RelMdDistinctRowCount {
ImmutableBitSet groupKey, RexNode predicate) {
// Use Calcite distinct row calculation
// number of distinct rows can never be more than number of total rows
- return Math.min(mq.getRowCount(rel),
- super.getDistinctRowCount(rel, mq, groupKey, predicate));
+ Double rows = mq.getRowCount(rel);
+ Double ndv = super.getDistinctRowCount(rel, mq, groupKey, predicate);
+ return ndv == null ? rows : Math.min(rows, ndv);
}
@Override
public Double getDistinctRowCount(Filter rel, RelMetadataQuery mq,
ImmutableBitSet groupKey, RexNode predicate) {
- // For the distinct row count, we take the number of distinct rows before the
- // filter and multiply it by the selectivity
- // TODO: We can do a little better if the "groupKey" is for the column being
- // selected. Specifically, if we find the selectivity for col1 and the condition
- // is "col1 is null", we know there is only one distinct row, but it will multiply
- // by the selectivity of all the distinct rows.
- Double rowCount = mq.getRowCount(rel);
- Preconditions.checkState(rowCount >= 0.0);
- Double childRowCount = mq.getRowCount(rel.getInput(0));
- Double distinctRowCount =
- mq.getDistinctRowCount(rel.getInput(0), groupKey, predicate);
- Preconditions.checkState(rowCount <= childRowCount);
- return Math.max(1.0, distinctRowCount * rowCount / childRowCount);
+ Double rows = mq.getRowCount(rel);
+ Double ndv = super.getDistinctRowCount(rel, mq, groupKey, predicate);
+ if (ndv != null) {
+ RexNode condition = rel.getCondition();
+ if (condition != null && groupKey != null &&
+ RelOptUtil.InputFinder.bits(condition).equals(groupKey)) {
+ Double childRowCount = mq.getRowCount(rel.getInput(0));
+ ndv = Math.max(1.0, ndv * rows / childRowCount);
+ }
+ }
+ return ndv == null ? rows : Math.min(rows, ndv);
}
@Override
@@ -102,7 +101,8 @@ public class ImpalaRelMdDistinctRowCount extends RelMdDistinctRowCount {
ImmutableBitSet groupKey, RexNode predicate) {
// Use Calcite distinct row calculation
// number of distinct rows can never be more than number of total rows
- return Math.min(mq.getRowCount(rel),
- super.getDistinctRowCount(rel, mq, groupKey, predicate));
+ Double rows = mq.getRowCount(rel);
+ Double ndv = super.getDistinctRowCount(rel, mq, groupKey, predicate);
+ return ndv == null ? rows : Math.min(rows, ndv);
}
}
diff --git a/java/calcite-planner/src/test/java/org/apache/impala/calcite/planner/TestCalciteStats.java b/java/calcite-planner/src/test/java/org/apache/impala/calcite/planner/TestCalciteStats.java
index ff90cea4b..691258576 100644
--- a/java/calcite-planner/src/test/java/org/apache/impala/calcite/planner/TestCalciteStats.java
+++ b/java/calcite-planner/src/test/java/org/apache/impala/calcite/planner/TestCalciteStats.java
@@ -29,6 +29,7 @@ import org.apache.calcite.jdbc.JavaTypeFactoryImpl;
import org.apache.calcite.plan.RelOptCluster;
import org.apache.calcite.plan.RelOptCostImpl;
import org.apache.calcite.plan.RelOptPlanner;
+import org.apache.calcite.plan.RelOptRule;
import org.apache.calcite.plan.hep.HepPlanner;
import org.apache.calcite.plan.hep.HepProgramBuilder;
import org.apache.calcite.plan.volcano.VolcanoPlanner;
@@ -40,12 +41,17 @@ import org.apache.calcite.rel.metadata.RelMetadataQuery;
import org.apache.calcite.rel.rules.CoreRules;
import org.apache.calcite.rel.type.RelDataTypeFactory;
import org.apache.calcite.rex.RexBuilder;
+import org.apache.calcite.rex.RexExecutorImpl;
+import org.apache.calcite.rex.RexSimplify;
import org.apache.calcite.rex.RexNode;
import org.apache.calcite.sql.SqlNode;
import org.apache.calcite.util.ImmutableBitSet;
import org.apache.impala.analysis.Expr;
import org.apache.impala.calcite.operators.ImpalaOperatorTable;
+import org.apache.impala.calcite.operators.ImpalaRexSimplify;
import org.apache.impala.calcite.rel.util.PrunedPartitionHelper;
+import org.apache.impala.calcite.rules.ImpalaFilterSimplifyRule;
+import org.apache.impala.calcite.rules.ImpalaRexExecutor;
import org.apache.impala.calcite.schema.ImpalaRelMetadataProvider;
import org.apache.impala.calcite.schema.CalciteTable;
import org.apache.impala.calcite.schema.FilterSelectivityEstimator;
@@ -103,9 +109,19 @@ public class TestCalciteStats extends PlannerTestBase {
RuntimeEnv.INSTANCE.reset();
}
- private RelNode getRelNodeForQuery(String query) throws ImpalaException {
- CalciteAnalysisResult analysisResult = (CalciteAnalysisResult) parseAndAnalyze(query,
+ private CalciteAnalysisResult getCalciteAnalysisResult(String query)
+ throws ImpalaException {
+ return (CalciteAnalysisResult) parseAndAnalyze(query,
feFixture_.createAnalysisCtx(), new CalciteCompilerFactory());
+ }
+
+ private RelNode getRelNodeForQuery(String query) throws ImpalaException {
+ CalciteAnalysisResult analysisResult = getCalciteAnalysisResult(query);
+ return getRelNodeForQuery(analysisResult);
+ }
+
+ private RelNode getRelNodeForQuery(CalciteAnalysisResult analysisResult)
+ throws ImpalaException {
CalciteRelNodeConverter relNodeConverter =
new CalciteRelNodeConverter(analysisResult);
return relNodeConverter.convert(analysisResult.getValidatedNode());
@@ -175,11 +191,15 @@ public class TestCalciteStats extends PlannerTestBase {
RelNode logicalPlan = getRelNodeForQuery("SELECT bigint_col " +
"FROM functional.alltypes where bigint_col = 10 and smallint_col = 10");
RelMetadataQuery mq = getMQ();
- double cardinality = ALL_TYPES_CARD/100.0;
+ double equalsSelectivity = 1.0 / BIGINT_NDV;
+ // selectivity used is .1 * (.1 ^ .5). The second "and" has an exponential backoff
+ // as calculated in FilterSelectivityEstimator.computeConjunctionSelectivity()
+ double cardinality =
+ ALL_TYPES_CARD * equalsSelectivity * Math.pow(equalsSelectivity, .5);
assertEquals(cardinality, (double) mq.getRowCount(logicalPlan), DOUBLE_ERR);
ImmutableBitSet bitSet = ImmutableBitSet.of(0);
- assertEquals(1.0, (double) mq.getDistinctRowCount(logicalPlan, bitSet, null),
- DOUBLE_ERR);
+ assertEquals(BIGINT_NDV,
+ (double) mq.getDistinctRowCount(logicalPlan, bitSet, null), DOUBLE_ERR);
} catch (ImpalaException e) {
throw new RuntimeException(e);
}
@@ -195,7 +215,7 @@ public class TestCalciteStats extends PlannerTestBase {
assertEquals(cardinality, (double) mq.getRowCount(logicalPlan), DOUBLE_ERR);
ImmutableBitSet bitSet = ImmutableBitSet.of(0);
Double distinctRows = 10.0 * cardinality / ALL_TYPES_CARD;
- assertEquals(distinctRows, (double) mq.getDistinctRowCount(logicalPlan,
+ assertEquals(10.0, (double) mq.getDistinctRowCount(logicalPlan,
bitSet, null), DOUBLE_ERR);
} catch (ImpalaException e) {
throw new RuntimeException(e);
@@ -258,13 +278,13 @@ public class TestCalciteStats extends PlannerTestBase {
"FROM functional.alltypes where bigint_col < 5");
RelMetadataQuery mq = getMQ();
double cardinality =
- ALL_TYPES_CARD * FilterSelectivityEstimator.RANGE_COMPARISON_SELECTIVITY;
+ ALL_TYPES_CARD * Expr.DEFAULT_SELECTIVITY;
assertEquals(cardinality, (double) mq.getRowCount(logicalPlan), DOUBLE_ERR);
ImmutableBitSet bitSet = ImmutableBitSet.of(0);
double distinctRows =
- BIGINT_NDV * FilterSelectivityEstimator.RANGE_COMPARISON_SELECTIVITY;
- assertEquals(distinctRows, (double) mq.getDistinctRowCount(logicalPlan,
- bitSet, null), DOUBLE_ERR);
+ BIGINT_NDV;
+ assertEquals(BIGINT_NDV * Expr.DEFAULT_SELECTIVITY,
+ (double) mq.getDistinctRowCount(logicalPlan, bitSet, null), DOUBLE_ERR);
} catch (ImpalaException e) {
throw new RuntimeException(e);
}
@@ -273,35 +293,51 @@ public class TestCalciteStats extends PlannerTestBase {
@Test
public void testFilterBetween() {
try {
- RelNode logicalPlan = getRelNodeForQuery("SELECT bigint_col " +
- "FROM functional.alltypes where bigint_col between 1 and 2");
- // TODO: Need to apply Impala selectivity logic for between
+ CalciteAnalysisResult analysisResult = getCalciteAnalysisResult(
+ "SELECT bigint_col FROM functional.alltypes where bigint_col between 1 and 2");
+ RelNode logicalPlanWithSearch = runFilterRule(analysisResult);
RelMetadataQuery mq = getMQ();
double cardinality =
- ALL_TYPES_CARD * FilterSelectivityEstimator.BETWEEN_SELECTIVITY;
- assertEquals(cardinality, (double) mq.getRowCount(logicalPlan), DOUBLE_ERR);
+ ALL_TYPES_CARD * Expr.DEFAULT_SELECTIVITY;
+ assertEquals(cardinality,
+ (double) mq.getRowCount(logicalPlanWithSearch), DOUBLE_ERR);
ImmutableBitSet bitSet = ImmutableBitSet.of(0);
- double distinctRows =
- BIGINT_NDV * FilterSelectivityEstimator.BETWEEN_SELECTIVITY;
- assertEquals(distinctRows, (double) mq.getDistinctRowCount(logicalPlan,
- bitSet, null), DOUBLE_ERR);
+ assertEquals(BIGINT_NDV * Expr.DEFAULT_SELECTIVITY,
+ (double) mq.getDistinctRowCount(logicalPlanWithSearch, bitSet, null),
+ DOUBLE_ERR);
} catch (ImpalaException e) {
throw new RuntimeException(e);
}
}
+ private RelNode runFilterRule(CalciteAnalysisResult analysisResult)
+ throws ImpalaException {
+ RelNode relNode = getRelNodeForQuery(analysisResult);
+ HepProgramBuilder builder = new HepProgramBuilder();
+ RexBuilder rexBuilder = relNode.getCluster().getRexBuilder();
+ ImpalaRexSimplify simplifier =
+ new ImpalaRexSimplify(rexBuilder, new ImpalaRexExecutor(analysisResult, null));
+ builder.addRuleInstance(new ImpalaFilterSimplifyRule(simplifier));
+ HepPlanner planner = new HepPlanner(builder.build(),
+ relNode.getCluster().getPlanner().getContext(), true, null,
+ RelOptCostImpl.FACTORY);
+ planner.setRoot(relNode);
+ return planner.findBestExp();
+ }
+
@Test
public void testFilterIn() {
try {
- RelNode logicalPlan = getRelNodeForQuery("SELECT bigint_col " +
- "FROM functional.alltypes where bigint_col in (1,2)");
- // TODO: It's using "OR" logic, not "IN" logic
+ CalciteAnalysisResult analysisResult = getCalciteAnalysisResult(
+ "SELECT bigint_col FROM functional.alltypes where bigint_col in (1,2)");
+ RelNode logicalPlan = runFilterRule(analysisResult);
RelMetadataQuery mq = getMQ();
- Double cardinality = ALL_TYPES_CARD * (1.0 - .9 * .9);
+ // multiply the "Equals" cardinality by 2 since there are 2 elements for "In"
+ Double cardinality = 2 * ALL_TYPES_CARD / BIGINT_NDV;
assertEquals(cardinality, (double) mq.getRowCount(logicalPlan), DOUBLE_ERR);
ImmutableBitSet bitSet = ImmutableBitSet.of(0);
- Double distinctRows = 10.0 * cardinality / ALL_TYPES_CARD;
- assertEquals(distinctRows, (double) mq.getDistinctRowCount(logicalPlan,
+ // Should be 2 distinct big int values (which are in the "in" clause)
+ assertEquals(2.0, (double) mq.getDistinctRowCount(logicalPlan,
bitSet, null), DOUBLE_ERR);
} catch (ImpalaException e) {
throw new RuntimeException(e);
@@ -490,7 +526,7 @@ public class TestCalciteStats extends PlannerTestBase {
"functional.alltypes group by bigint_col HAVING bigint_col >= 5");
RelMetadataQuery mq = getMQ();
double selectivity =
- BIGINT_NDV * FilterSelectivityEstimator.RANGE_COMPARISON_SELECTIVITY;
+ BIGINT_NDV * Expr.DEFAULT_SELECTIVITY;;
assertEquals(selectivity, (double) mq.getRowCount(logicalPlan), DOUBLE_ERR);
ImmutableBitSet bitSet = ImmutableBitSet.of(0);
// Using Calcite's distinct row count, can prolly do better here.
diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q04.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q04.test
index b2a8b1e47..a701273d6 100644
--- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q04.test
+++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q04.test
@@ -117,83 +117,302 @@ limit 100
# end query 4 in stream 0 using template query4.tpl
---- PLAN
Max Per-Host Resource Reservation: Memory=491.38MB Threads=1
-Per-Host Resource Estimates: Memory=98.40GB
+Per-Host Resource Estimates: Memory=120.47GB
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=98.40GB mem-reservation=491.38MB thread-reservation=1 runtime-filters-memory=70.00MB
-| max-parallelism=1 segment-costs=[10808104999, 5859651015, 3004714721, 10808104999, 5859651015, 3004714721, 2819378429, 400]
+| Per-Instance Resources: mem-estimate=120.47GB mem-reservation=491.38MB thread-reservation=1 runtime-filters-memory=70.00MB
+| max-parallelism=1 segment-costs=[10808104999, 5859651015, 3218926153, 3218926153, 10808104999, 5859651015, 1770840758, 400]
PLAN-ROOT SINK
-| output exprs: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_birth_country
+| output exprs: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_birth_country
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
41:TOP-N [LIMIT=100]
-| order by: tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_birth_country ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_birth_country ASC NULLS LAST
| mem-estimate=8.27KB mem-reservation=0B thread-reservation=0
-| tuple-ids=42 row-size=85B cardinality=100 cost=2263026260
-| in pipelines: 41(GETNEXT), 05(OPEN)
+| tuple-ids=42 row-size=85B cardinality=100 cost=1183867292
+| in pipelines: 41(GETNEXT), 35(OPEN)
|
40:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_4.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_4.c_customer_id
-| other join predicates: CASE WHEN sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6)) THEN divide(sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_par [...]
-| runtime filters: RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_id
-| mem-estimate=7.16GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6,27,20,13,34,41 row-size=991B cardinality=147.90M cost=105360551
-| in pipelines: 05(GETNEXT), 39(OPEN)
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| other join predicates: CASE WHEN sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6)) THEN divide(sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partition [...]
+| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id
+| mem-estimate=14.55GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=41,34,27,20,13,6 row-size=991B cardinality=79.98M cost=132410712
+| in pipelines: 35(GETNEXT), 05(OPEN)
+|
+|--05:AGGREGATE [FINALIZE]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
+| | mem-estimate=6.93GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=79.98M cost=4721057758
+| | in pipelines: 05(GETNEXT), 00(OPEN)
+| |
+| 04:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | runtime filters: RF031[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=0,2,4 row-size=185B cardinality=799.83M cost=398416277
+| | in pipelines: 00(GETNEXT), 03(OPEN)
+| |
+| |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| | stored statistics:
+| | table: rows=30.00M size=1.55GB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=4 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 03(GETNEXT)
+| |
+| 02:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | runtime filters: RF032[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=0,2 row-size=32B cardinality=871.30M cost=381367031
+| | in pipelines: 00(GETNEXT), 01(OPEN)
+| |
+| |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| | stored statistics:
+| | table: rows=73.05K size=2.17MB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=2 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 01(GETNEXT)
+| |
+| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
+| partition predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk IS NOT NULL
+| HDFS partitions=1830/1831 files=1830 size=280.81GB
+| predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
+| runtime filters: RF031[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF032[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk
+| stored statistics:
+| table: rows=4.32G size=280.96GB
+| partitions: 1830/1830 rows=4.30G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=373(filtered from 1830)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| tuple-ids=0 row-size=24B cardinality=871.30M(filtered from 4.28G) cost=327240201
+| in pipelines: 00(GETNEXT)
+|
+39:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| mem-estimate=27.50GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=41,34,27,20,13 row-size=826B cardinality=147.90M cost=186017937
+| in pipelines: 35(GETNEXT), 11(OPEN)
+|
+|--11:AGGREGATE [FINALIZE]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2)) IS NOT NULL
+| | mem-estimate=8.68GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=147.90M cost=8729673496
+| | in pipelines: 11(GETNEXT), 06(OPEN)
+| |
+| 10:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | runtime filters: RF027[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=7,9,11 row-size=185B cardinality=1.48G cost=711235853
+| | in pipelines: 06(GETNEXT), 09(OPEN)
+| |
+| |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | stored statistics:
+| | table: rows=30.00M size=1.55GB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=11 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 09(GETNEXT)
+| |
+| 08:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=7,9 row-size=32B cardinality=1.61G cost=705182682
+| | in pipelines: 06(GETNEXT), 07(OPEN)
+| |
+| |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
+| | stored statistics:
+| | table: rows=73.05K size=2.17MB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=9 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 07(GETNEXT)
+| |
+| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
+| partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
+| HDFS partitions=1823/1824 files=1823 size=389.69GB
+| predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
+| runtime filters: RF027[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF028[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
+| stored statistics:
+| table: rows=8.64G size=389.90GB
+| partitions: 1823/1823 rows=8.25G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=7 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220
+| in pipelines: 06(GETNEXT)
+|
+38:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| runtime filters: RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| mem-estimate=7.75GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=41,34,27,20 row-size=661B cardinality=44.15M cost=63471223
+| in pipelines: 35(GETNEXT), 17(OPEN)
+|
+|--17:AGGREGATE [FINALIZE]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
+| | mem-estimate=6.01GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=44.15M cost=2605865203
+| | in pipelines: 17(GETNEXT), 13(OPEN)
+| |
+| 16:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | fk/pk conjuncts: none
+| | runtime filters: RF023[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=16,18,14 row-size=185B cardinality=441.48M cost=223234710
+| | in pipelines: 13(GETNEXT), 12(OPEN)
+| |
+| |--12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | stored statistics:
+| | table: rows=30.00M size=1.55GB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=14 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 12(GETNEXT)
+| |
+| 15:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=16,18 row-size=32B cardinality=441.48M cost=193235083
+| | in pipelines: 13(GETNEXT), 14(OPEN)
+| |
+| |--14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
+| | stored statistics:
+| | table: rows=73.05K size=2.17MB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=18 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 14(GETNEXT)
+| |
+| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
+| partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL
+| HDFS partitions=1823/1824 files=1823 size=145.67GB
+| predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
+| runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk
+| stored statistics:
+| table: rows=2.16G size=145.75GB
+| partitions: 1823/1823 rows=2.16G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=16 row-size=24B cardinality=441.48M(filtered from 2.16G) cost=165021409
+| in pipelines: 13(GETNEXT)
|
-|--39:AGGREGATE [FINALIZE]
+37:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| mem-estimate=7.75GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=41,34,27 row-size=495B cardinality=44.15M cost=72662882
+| in pipelines: 35(GETNEXT), 23(OPEN)
+|
+|--23:AGGREGATE [FINALIZE]
| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
-| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
-| | mem-estimate=5.92GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=41 row-size=165B cardinality=40.63M cost=2398033848
-| | in pipelines: 39(GETNEXT), 34(OPEN)
-| |
-| 38:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | runtime filters: RF031[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2)) IS NOT NULL
+| | mem-estimate=6.01GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=44.15M cost=2605865203
+| | in pipelines: 23(GETNEXT), 19(OPEN)
+| |
+| 22:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | fk/pk conjuncts: none
+| | runtime filters: RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=35,37,39 row-size=185B cardinality=406.27M cost=216854633
-| | in pipelines: 34(GETNEXT), 37(OPEN)
+| | tuple-ids=23,25,21 row-size=185B cardinality=441.48M cost=223234710
+| | in pipelines: 19(GETNEXT), 18(OPEN)
| |
-| |--37:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| |--18:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_4.c_customer_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_4.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=39 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 37(GETNEXT)
+| | tuple-ids=21 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 18(GETNEXT)
| |
-| 36:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | runtime filters: RF032[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| 21:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=35,37 row-size=32B cardinality=441.48M cost=193235083
-| | in pipelines: 34(GETNEXT), 35(OPEN)
+| | tuple-ids=23,25 row-size=32B cardinality=441.48M cost=193235083
+| | in pipelines: 19(GETNEXT), 20(OPEN)
| |
-| |--35:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| |--20:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=37 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 35(GETNEXT)
+| | tuple-ids=25 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 20(GETNEXT)
| |
-| 34:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
+| 19:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL
| HDFS partitions=1823/1824 files=1823 size=145.67GB
| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
-| runtime filters: RF031[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF032[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk
+| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk
| stored statistics:
| table: rows=2.16G size=145.75GB
| partitions: 1823/1823 rows=2.16G
@@ -201,38 +420,37 @@ PLAN-ROOT SINK
| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=35 row-size=24B cardinality=441.48M(filtered from 2.16G) cost=165021409
-| in pipelines: 34(GETNEXT)
+| tuple-ids=23 row-size=24B cardinality=441.48M(filtered from 2.16G) cost=165021409
+| in pipelines: 19(GETNEXT)
|
-33:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_3.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_3.c_customer_id
-| other join predicates: CASE WHEN sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6)) THEN divide(sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_par [...]
-| runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+36:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF009[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_id
| mem-estimate=14.55GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6,27,20,13,34 row-size=826B cardinality=147.90M cost=144716495
-| in pipelines: 05(GETNEXT), 32(OPEN)
+| tuple-ids=41,34 row-size=330B cardinality=79.98M cost=132410712
+| in pipelines: 35(GETNEXT), 29(OPEN)
|
-|--32:AGGREGATE [FINALIZE]
+|--29:AGGREGATE [FINALIZE]
| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
| | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address
-| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2)) IS NOT NULL
| | mem-estimate=6.93GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
| | tuple-ids=34 row-size=165B cardinality=79.98M cost=4721057758
-| | in pipelines: 32(GETNEXT), 27(OPEN)
+| | in pipelines: 29(GETNEXT), 24(OPEN)
| |
-| 31:HASH JOIN [INNER JOIN]
+| 28:HASH JOIN [INNER JOIN]
| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | runtime filters: RF026[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk, RF027[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
| | tuple-ids=28,30,32 row-size=185B cardinality=799.83M cost=398416277
-| | in pipelines: 27(GETNEXT), 30(OPEN)
+| | in pipelines: 24(GETNEXT), 27(OPEN)
| |
-| |--30:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| |--27:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
| | HDFS partitions=1/1 files=1 size=1.55GB
| | predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_3.c_customer_sk IS NOT NULL
-| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF007[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF006[bloom] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
@@ -240,34 +458,34 @@ PLAN-ROOT SINK
| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_3.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
| | tuple-ids=32 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 30(GETNEXT)
+| | in pipelines: 27(GETNEXT)
| |
-| 29:HASH JOIN [INNER JOIN]
+| 26:HASH JOIN [INNER JOIN]
| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
| | tuple-ids=28,30 row-size=32B cardinality=871.30M cost=381367031
-| | in pipelines: 27(GETNEXT), 28(OPEN)
+| | in pipelines: 24(GETNEXT), 25(OPEN)
| |
-| |--28:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| |--25:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
| | tuple-ids=30 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 28(GETNEXT)
+| | in pipelines: 25(GETNEXT)
| |
-| 27:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
+| 24:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
| partition predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk IS NOT NULL
| HDFS partitions=1830/1831 files=1830 size=280.81GB
| predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk IS NOT NULL
-| runtime filters: RF027[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk, RF028[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk, RF026[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk
+| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk, RF014[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk
| stored statistics:
| table: rows=4.32G size=280.96GB
| partitions: 1830/1830 rows=4.30G
@@ -276,2087 +494,1872 @@ PLAN-ROOT SINK
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
| tuple-ids=28 row-size=24B cardinality=871.30M(filtered from 4.28G) cost=327240201
-| in pipelines: 27(GETNEXT)
-|
-26:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| runtime filters: RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| mem-estimate=19.65GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6,27,20,13 row-size=661B cardinality=147.90M cost=105360551
-| in pipelines: 05(GETNEXT), 23(OPEN)
-|
-|--25:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | mem-estimate=7.16GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27,20,13 row-size=495B cardinality=40.63M cost=68503860
-| | in pipelines: 23(GETNEXT), 11(OPEN)
-| |
-| |--11:AGGREGATE [FINALIZE]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
-| | | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), 2)) IS NOT NULL
-| | | mem-estimate=5.92GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=13 row-size=165B cardinality=40.63M cost=2398033848
-| | | in pipelines: 11(GETNEXT), 06(OPEN)
-| | |
-| | 10:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | runtime filters: RF023[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=7,9,11 row-size=185B cardinality=406.27M cost=216854633
-| | | in pipelines: 06(GETNEXT), 09(OPEN)
-| | |
-| | |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
-| | | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=11 row-size=153B cardinality=30.00M cost=31557228
-| | | in pipelines: 09(GETNEXT)
-| | |
-| | 08:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=7,9 row-size=32B cardinality=441.48M cost=193235083
-| | | in pipelines: 06(GETNEXT), 07(OPEN)
-| | |
-| | |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
-| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
-| | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | | tuple-ids=9 row-size=8B cardinality=373 cost=12520
-| | | in pipelines: 07(GETNEXT)
-| | |
-| | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
-| | partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL
-| | HDFS partitions=1823/1824 files=1823 size=145.67GB
-| | predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
-| | runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk
-| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1823/1823 rows=2.16G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
-| | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| | tuple-ids=7 row-size=24B cardinality=441.48M(filtered from 2.16G) cost=165021409
-| | in pipelines: 06(GETNEXT)
-| |
-| 24:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF013[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | mem-estimate=14.55GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27,20 row-size=330B cardinality=79.98M cost=132410712
-| | in pipelines: 23(GETNEXT), 17(OPEN)
-| |
-| |--17:AGGREGATE [FINALIZE]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
-| | | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) IS NOT NULL
-| | | mem-estimate=6.93GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=20 row-size=165B cardinality=79.98M cost=4721057758
-| | | in pipelines: 17(GETNEXT), 12(OPEN)
-| | |
-| | 16:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=14,16,18 row-size=185B cardinality=799.83M cost=398416277
-| | | in pipelines: 12(GETNEXT), 15(OPEN)
-| | |
-| | |--15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
-| | | runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF010[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=18 row-size=153B cardinality=30.00M cost=31557228
-| | | in pipelines: 15(GETNEXT)
-| | |
-| | 14:HASH JOIN [INNER JOIN]
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=14,16 row-size=32B cardinality=871.30M cost=381367031
-| | | in pipelines: 12(GETNEXT), 13(OPEN)
-| | |
-| | |--13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT)
-| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
-| | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | | tuple-ids=16 row-size=8B cardinality=373 cost=12520
-| | | in pipelines: 13(GETNEXT)
-| | |
-| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales]
-| | partition predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk IS NOT NULL
-| | HDFS partitions=1830/1831 files=1830 size=280.81GB
-| | predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
-| | runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk
-| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1830/1830 rows=4.30G
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=373(filtered from 1830)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
-| | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
-| | tuple-ids=14 row-size=24B cardinality=871.30M(filtered from 4.28G) cost=327240201
-| | in pipelines: 12(GETNEXT)
-| |
-| 23:AGGREGATE [FINALIZE]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
-| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
-| | mem-estimate=8.68GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=147.90M cost=8729673496
-| | in pipelines: 23(GETNEXT), 18(OPEN)
-| |
-| 22:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | runtime filters: RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=21,23,25 row-size=185B cardinality=1.48G cost=711235853
-| | in pipelines: 18(GETNEXT), 21(OPEN)
-| |
-| |--21:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
-| | runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF013[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF010[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF012[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| | stored statistics:
-| | table: rows=30.00M size=1.55GB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
-| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=25 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 21(GETNEXT)
-| |
-| 20:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=21,23 row-size=32B cardinality=1.61G cost=705182682
-| | in pipelines: 18(GETNEXT), 19(OPEN)
-| |
-| |--19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
-| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=23 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 19(GETNEXT)
-| |
-| 18:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
-| partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL
-| HDFS partitions=1823/1824 files=1823 size=389.69GB
-| predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
-| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk
-| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1823/1823 rows=8.25G
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=21 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220
-| in pipelines: 18(GETNEXT)
+| in pipelines: 24(GETNEXT)
|
-05:AGGREGATE [FINALIZE]
-| output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
-| having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2)) IS NOT NULL
+35:AGGREGATE [FINALIZE]
+| output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
+| having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
| mem-estimate=8.68GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=165B cardinality=147.90M cost=8729673496
-| in pipelines: 05(GETNEXT), 00(OPEN)
+| tuple-ids=41 row-size=165B cardinality=147.90M cost=8729673496
+| in pipelines: 35(GETNEXT), 30(OPEN)
|
-04:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| runtime filters: RF007[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+34:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| runtime filters: RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
| mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4 row-size=185B cardinality=1.48G cost=711235853
-| in pipelines: 00(GETNEXT), 03(OPEN)
+| tuple-ids=35,37,39 row-size=185B cardinality=1.48G cost=711235853
+| in pipelines: 30(GETNEXT), 33(OPEN)
|
-|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+|--33:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
| HDFS partitions=1/1 files=1 size=1.55GB
-| predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
-| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id
+| predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_4.c_customer_sk IS NOT NULL
+| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF009[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF007[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF008[bloom] -> tpcds [...]
| stored statistics:
| table: rows=30.00M size=1.55GB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.10M
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_4.c_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=4 row-size=153B cardinality=30.00M cost=31557228
-| in pipelines: 03(GETNEXT)
+| tuple-ids=39 row-size=153B cardinality=30.00M cost=31557228
+| in pipelines: 33(GETNEXT)
|
-02:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+32:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2 row-size=32B cardinality=1.61G cost=705182682
-| in pipelines: 00(GETNEXT), 01(OPEN)
+| tuple-ids=35,37 row-size=32B cardinality=1.61G cost=705182682
+| in pipelines: 30(GETNEXT), 31(OPEN)
|
-|--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+|--31:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL
| stored statistics:
| table: rows=73.05K size=2.17MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=2 row-size=8B cardinality=373 cost=12520
-| in pipelines: 01(GETNEXT)
+| tuple-ids=37 row-size=8B cardinality=373 cost=12520
+| in pipelines: 31(GETNEXT)
|
-00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
- partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
+30:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
+ partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
- predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
- runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF008[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
+ predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
+ runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk
stored statistics:
table: rows=8.64G size=389.90GB
partitions: 1823/1823 rows=8.25G
columns: all
extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
- parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
+ parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=0 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220
- in pipelines: 00(GETNEXT)
+ tuple-ids=35 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220
+ in pipelines: 30(GETNEXT)
---- DISTRIBUTEDPLAN
-Max Per-Host Resource Reservation: Memory=10.17GB Threads=379
-Per-Host Resource Estimates: Memory=183.50GB
+Max Per-Host Resource Reservation: Memory=10.02GB Threads=373
+Per-Host Resource Estimates: Memory=185.81GB
F31:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=5.02MB mem-reservation=4.00MB thread-reservation=1
+| Per-Instance Resources: mem-estimate=4.93MB mem-reservation=4.00MB thread-reservation=1
| max-parallelism=1 segment-costs=[442] cpu-comparison-result=1440 [max(1 (self) vs 1440 (sum children))]
PLAN-ROOT SINK
-| output exprs: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_birth_country
+| output exprs: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_birth_country
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
78:MERGING-EXCHANGE [UNPARTITIONED]
-| order by: tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_birth_country ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_birth_country ASC NULLS LAST
| limit: 100
-| mem-estimate=1.02MB mem-reservation=0B thread-reservation=0
+| mem-estimate=953.44KB mem-reservation=0B thread-reservation=0
| tuple-ids=42 row-size=85B cardinality=100 cost=42
| in pipelines: 41(GETNEXT)
|
-F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=120
+F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)] hosts=10 instances=110 (adjusted from 120)
Per-Instance Resources: mem-estimate=29.83MB mem-reservation=0B thread-reservation=1
-max-parallelism=260 segment-costs=[2586011054, 253] cpu-comparison-result=1440 [max(120 (self) vs 1440 (sum children))]
+max-parallelism=160 segment-costs=[1503467851, 253] cpu-comparison-result=1440 [max(110 (self) vs 1440 (sum children))]
41:TOP-N [LIMIT=100]
-| order by: tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_birth_country ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_birth_country ASC NULLS LAST
| mem-estimate=8.27KB mem-reservation=0B thread-reservation=0
-| tuple-ids=42 row-size=85B cardinality=100 cost=2263026260
+| tuple-ids=42 row-size=85B cardinality=100 cost=1183867292
| in pipelines: 41(GETNEXT), 46(OPEN)
|
40:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=00
-| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_4.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_4.c_customer_id
-| other join predicates: CASE WHEN sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6)) THEN divide(sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_par [...]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| other join predicates: CASE WHEN sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6)) THEN divide(sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partition [...]
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6,27,20,13,34,41 row-size=991B cardinality=147.90M cost=64733813
+| tuple-ids=41,34,27,20,13,6 row-size=991B cardinality=79.98M cost=52428030
| in pipelines: 46(GETNEXT), 76(OPEN)
|
-|--F32:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=90.89MB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=260 segment-costs=[76003415] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+|--F32:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)] hosts=10 instances=110 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=181.24MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=160 segment-costs=[149629463] cpu-comparison-result=240 [max(110 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_4.c_customer_id
-| | runtime filters: RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_id
-| | mem-estimate=61.07MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738
+| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | mem-estimate=135.41MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=79982682
| |
-| 77:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)]
+| 77:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=41 row-size=165B cardinality=40.63M cost=35376677
+| | tuple-ids=6 row-size=165B cardinality=79.98M cost=69646781
| | in pipelines: 76(GETNEXT)
| |
-| F30:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=651.24MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=280 segment-costs=[2751800623, 453013550] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| F30:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.17GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=550 segment-costs=[5417525566, 891856952] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
| 76:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
-| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
-| | mem-estimate=571.96MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=41 row-size=165B cardinality=40.63M cost=2398033848
-| | in pipelines: 76(GETNEXT), 34(OPEN)
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
+| | mem-estimate=1.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=79.98M cost=4721057758
+| | in pipelines: 76(GETNEXT), 00(OPEN)
| |
-| 75:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address)]
+| 75:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=41 row-size=165B cardinality=406.27M cost=353766775
-| | in pipelines: 34(GETNEXT)
+| | tuple-ids=6 row-size=165B cardinality=799.83M cost=696467808
+| | in pipelines: 00(GETNEXT)
| |
-| F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=522.94MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=460 segment-costs=[2715168496, 4530135523] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| 39:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
-| | mem-estimate=428.97MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=41 row-size=165B cardinality=406.27M cost=2398033848
-| | in pipelines: 34(GETNEXT)
+| F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=938.49MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=900 segment-costs=[5346593754, 8918569464] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 05:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | mem-estimate=844.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=799.83M cost=4721057758
+| | in pipelines: 00(GETNEXT)
| |
-| 38:HASH JOIN [INNER JOIN, PARTITIONED]
+| 04:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=01
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=35,37,39 row-size=185B cardinality=406.27M cost=186854633
-| | in pipelines: 34(GETNEXT), 37(OPEN)
+| | tuple-ids=0,2,4 row-size=185B cardinality=799.83M cost=368416277
+| | in pipelines: 00(GETNEXT), 03(OPEN)
| |
-| |--F33:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
+| |--F33:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=120
| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
-| | | max-parallelism=460 segment-costs=[54467197]
+| | | max-parallelism=900 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=01 plan-id=02 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | runtime filters: RF031[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | | runtime filters: RF031[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 74:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_sk)]
+| | 74:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=39 row-size=153B cardinality=30.00M cost=24467197
-| | | in pipelines: 37(GETNEXT)
+| | | tuple-ids=4 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 03(GETNEXT)
| | |
| | F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[342891999]
-| | 37:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_4.c_customer_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_4.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=39 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 37(GETNEXT)
+| | tuple-ids=4 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 03(GETNEXT)
| |
-| 73:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)]
+| 73:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)]
| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=35,37 row-size=32B cardinality=441.48M cost=130280015
-| | in pipelines: 34(GETNEXT)
+| | tuple-ids=0,2 row-size=32B cardinality=871.30M cost=257119719
+| | in pipelines: 00(GETNEXT)
| |
| F26:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=128.00KB thread-reservation=1
-| max-parallelism=180 segment-costs=[1722951425]
-| 36:HASH JOIN [INNER JOIN, BROADCAST]
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=256.00KB thread-reservation=1
+| max-parallelism=350 segment-costs=[3401959876]
+| 02:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=02
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=35,37 row-size=32B cardinality=441.48M cost=193234710
-| | in pipelines: 34(GETNEXT), 35(OPEN)
+| | tuple-ids=0,2 row-size=32B cardinality=871.30M cost=381366658
+| | in pipelines: 00(GETNEXT), 01(OPEN)
| |
| |--F34:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=02 plan-id=03 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | | runtime filters: RF032[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | | runtime filters: RF032[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 72:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=37 row-size=8B cardinality=373 cost=490
-| | | in pipelines: 35(GETNEXT)
+| | | tuple-ids=2 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 01(GETNEXT)
| | |
| | F27:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| | max-parallelism=1 segment-costs=[12536]
-| | 35:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=37 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 35(GETNEXT)
+| | tuple-ids=2 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 01(GETNEXT)
| |
-| 34:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL
-| HDFS partitions=1823/1824 files=1823 size=145.67GB
-| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
-| runtime filters: RF031[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF032[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk
+| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk IS NOT NULL
+| HDFS partitions=1830/1831 files=1830 size=280.81GB
+| predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
+| runtime filters: RF031[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF032[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk
| stored statistics:
-| table: rows=2.16G size=145.75GB
-| partitions: 1823/1823 rows=2.16G
+| table: rows=4.32G size=280.96GB
+| partitions: 1830/1830 rows=4.30G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=35 row-size=24B cardinality=441.48M(filtered from 2.16G) cost=165021409
-| in pipelines: 34(GETNEXT)
+| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=373(filtered from 1830)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| tuple-ids=0 row-size=24B cardinality=871.30M(filtered from 4.28G) cost=327240201
+| in pipelines: 00(GETNEXT)
|
-33:HASH JOIN [INNER JOIN, PARTITIONED]
+39:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=03
-| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_3.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_3.c_customer_id
-| other join predicates: CASE WHEN sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6)) THEN divide(sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_par [...]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6,27,20,13,34 row-size=826B cardinality=147.90M cost=64733813
+| tuple-ids=41,34,27,20,13 row-size=826B cardinality=147.90M cost=38122543
| in pipelines: 46(GETNEXT), 70(OPEN)
|
-|--F35:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=153.95MB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=260 segment-costs=[149629463] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+|--F35:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)] hosts=10 instances=110 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=285.86MB mem-reservation=34.00MB thread-reservation=1
+| | max-parallelism=160 segment-costs=[276678749] cpu-comparison-result=240 [max(110 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=03 plan-id=04 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_3.c_customer_id
-| | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_id
-| | mem-estimate=124.13MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=79982682
+| | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | mem-estimate=256.04MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=147895394
| |
-| 71:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)]
+| 71:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=34 row-size=165B cardinality=79.98M cost=69646781
+| | tuple-ids=13 row-size=165B cardinality=147.90M cost=128783355
| | in pipelines: 70(GETNEXT)
| |
-| F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id,tpcds_partitioned_parquet_snap.customer_3.c_first_name,tpcds_partitioned_parquet_snap.customer_3.c_last_name,tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_3.c_birth_country,tpcds_partitioned_parquet_snap.customer_3.c_login,tpcds_partitioned_parquet_snap.customer_3.c_email_address)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=1.18GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=550 segment-costs=[5417525566, 891856952] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=2.10GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=1010 segment-costs=[10017507045, 1649126185] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
| 70:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address
-| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
-| | mem-estimate=1.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=34 row-size=165B cardinality=79.98M cost=4721057758
-| | in pipelines: 70(GETNEXT), 27(OPEN)
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2)) IS NOT NULL
+| | mem-estimate=2.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=147.90M cost=8729673496
+| | in pipelines: 70(GETNEXT), 06(OPEN)
| |
-| 69:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id,tpcds_partitioned_parquet_snap.customer_3.c_first_name,tpcds_partitioned_parquet_snap.customer_3.c_last_name,tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_3.c_birth_country,tpcds_partitioned_parquet_snap.customer_3.c_login,tpcds_partitioned_parquet_snap.customer_3.c_email_address)]
+| 69:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=34 row-size=165B cardinality=799.83M cost=696467808
-| | in pipelines: 27(GETNEXT)
+| | tuple-ids=13 row-size=165B cardinality=1.48G cost=1287833549
+| | in pipelines: 06(GETNEXT)
| |
-| F24:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=938.49MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=900 segment-costs=[5346593754, 8918569464] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| 32:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address
-| | mem-estimate=844.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=34 row-size=165B cardinality=799.83M cost=4721057758
-| | in pipelines: 27(GETNEXT)
+| F24:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.62GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=1650 segment-costs=[9886347547, 16491261804] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 11:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
+| | mem-estimate=1.52GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=1.48G cost=8729673496
+| | in pipelines: 06(GETNEXT)
| |
-| 31:HASH JOIN [INNER JOIN, PARTITIONED]
+| 10:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=04
-| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=28,30,32 row-size=185B cardinality=799.83M cost=368416277
-| | in pipelines: 27(GETNEXT), 30(OPEN)
+| | tuple-ids=7,9,11 row-size=185B cardinality=1.48G cost=681235853
+| | in pipelines: 06(GETNEXT), 09(OPEN)
| |
-| |--F36:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)] hosts=10 instances=120
-| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=900 segment-costs=[54467197]
+| |--F36:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=1650 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=04 plan-id=05 cohort-id=03
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | runtime filters: RF026[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk, RF027[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | | runtime filters: RF027[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 68:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_sk)]
+| | 68:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)]
| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=32 row-size=153B cardinality=30.00M cost=24467197
-| | | in pipelines: 30(GETNEXT)
+| | | tuple-ids=11 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 09(GETNEXT)
| | |
| | F23:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[342891999]
-| | 30:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_3.c_customer_sk IS NOT NULL
-| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_3.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=32 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 30(GETNEXT)
+| | tuple-ids=11 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 09(GETNEXT)
| |
-| 67:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)]
+| 67:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)]
| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=28,30 row-size=32B cardinality=871.30M cost=257119719
-| | in pipelines: 27(GETNEXT)
+| | tuple-ids=7,9 row-size=32B cardinality=1.61G cost=475438198
+| | in pipelines: 06(GETNEXT)
| |
| F21:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
-| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=256.00KB thread-reservation=1
-| max-parallelism=350 segment-costs=[3401959876]
-| 29:HASH JOIN [INNER JOIN, BROADCAST]
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=373 segment-costs=[6315884965]
+| 08:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=05
-| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=28,30 row-size=32B cardinality=871.30M cost=381366658
-| | in pipelines: 27(GETNEXT), 28(OPEN)
+| | tuple-ids=7,9 row-size=32B cardinality=1.61G cost=705182309
+| | in pipelines: 06(GETNEXT), 07(OPEN)
| |
| |--F37:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=05 plan-id=06 cohort-id=03
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 66:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=30 row-size=8B cardinality=373 cost=490
-| | | in pipelines: 28(GETNEXT)
+| | | tuple-ids=9 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 07(GETNEXT)
| | |
| | F22:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| | max-parallelism=1 segment-costs=[12536]
-| | 28:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=30 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 28(GETNEXT)
+| | tuple-ids=9 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 07(GETNEXT)
| |
-| 27:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| partition predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk IS NOT NULL
-| HDFS partitions=1830/1831 files=1830 size=280.81GB
-| predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk IS NOT NULL
-| runtime filters: RF027[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk, RF028[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk, RF026[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk
+| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
+| HDFS partitions=1823/1824 files=1823 size=389.69GB
+| predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
+| runtime filters: RF027[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF028[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
| stored statistics:
-| table: rows=4.32G size=280.96GB
-| partitions: 1830/1830 rows=4.30G
+| table: rows=8.64G size=389.90GB
+| partitions: 1823/1823 rows=8.25G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=373(filtered from 1830)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
-| tuple-ids=28 row-size=24B cardinality=871.30M(filtered from 4.28G) cost=327240201
-| in pipelines: 27(GETNEXT)
+| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=7 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220
+| in pipelines: 06(GETNEXT)
|
-26:HASH JOIN [INNER JOIN, PARTITIONED]
+38:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=06
-| hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6,27,20,13 row-size=661B cardinality=147.90M cost=64733813
-| in pipelines: 46(GETNEXT), 51(OPEN)
+| tuple-ids=41,34,27,20 row-size=661B cardinality=44.15M cost=19323471
+| in pipelines: 46(GETNEXT), 64(OPEN)
|
-|--F38:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=197.54MB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=260 segment-costs=[249715245] cpu-comparison-result=720 [max(120 (self) vs 720 (sum children))]
+|--F38:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)] hosts=10 instances=110 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=101.98MB mem-reservation=34.00MB thread-reservation=1
+| | max-parallelism=160 segment-costs=[82590434] cpu-comparison-result=240 [max(110 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=06 plan-id=07 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| | runtime filters: RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| | mem-estimate=167.71MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738
+| | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | runtime filters: RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | mem-estimate=72.15MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=44147752
| |
-| 25:HASH JOIN [INNER JOIN, PARTITIONED]
+| 65:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=44.15M cost=38442682
+| | in pipelines: 64(GETNEXT)
+| |
+| F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=694.21MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=300 segment-costs=[2990292024, 492275059] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| 64:AGGREGATE [FINALIZE]
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
+| | mem-estimate=621.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=44.15M cost=2605865203
+| | in pipelines: 64(GETNEXT), 13(OPEN)
+| |
+| 63:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=441.48M cost=384426821
+| | in pipelines: 13(GETNEXT)
+| |
+| F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=560.12MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=500 segment-costs=[2929379928, 4922750583] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 17:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | mem-estimate=466.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=441.48M cost=2605865203
+| | in pipelines: 13(GETNEXT)
+| |
+| 16:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=07
-| | hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | fk/pk conjuncts: none
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27,20,13 row-size=495B cardinality=40.63M cost=27877122
-| | in pipelines: 51(GETNEXT), 63(OPEN)
+| | tuple-ids=16,18,14 row-size=185B cardinality=441.48M cost=193234710
+| | in pipelines: 13(GETNEXT), 12(OPEN)
| |
-| |--F39:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=120
-| | | Per-Instance Resources: mem-estimate=106.89MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=260 segment-costs=[76003415] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| |--F39:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=500 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=07 plan-id=08 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | | mem-estimate=61.07MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738
-| | |
-| | 64:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)]
-| | | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=13 row-size=165B cardinality=40.63M cost=35376677
-| | | in pipelines: 63(GETNEXT)
-| | |
-| | F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=651.24MB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=280 segment-costs=[2751800623, 453013550] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
-| | 63:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
-| | | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), 2)) IS NOT NULL
-| | | mem-estimate=571.96MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=13 row-size=165B cardinality=40.63M cost=2398033848
-| | | in pipelines: 63(GETNEXT), 06(OPEN)
-| | |
-| | 62:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)]
-| | | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=13 row-size=165B cardinality=406.27M cost=353766775
-| | | in pipelines: 06(GETNEXT)
-| | |
-| | F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=522.94MB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=460 segment-costs=[2715168496, 4530135523] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| | 11:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
-| | | mem-estimate=428.97MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=13 row-size=165B cardinality=406.27M cost=2398033848
-| | | in pipelines: 06(GETNEXT)
-| | |
-| | 10:HASH JOIN [INNER JOIN, PARTITIONED]
-| | | hash-table-id=08
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=7,9,11 row-size=185B cardinality=406.27M cost=186854633
-| | | in pipelines: 06(GETNEXT), 09(OPEN)
-| | |
-| | |--F40:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
-| | | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
-| | | | max-parallelism=460 segment-costs=[54467197]
-| | | JOIN BUILD
-| | | | join-table-id=08 plan-id=09 cohort-id=05
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | | runtime filters: RF023[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 61:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)]
-| | | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=11 row-size=153B cardinality=30.00M cost=24467197
-| | | | in pipelines: 09(GETNEXT)
-| | | |
-| | | F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[342891999]
-| | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
-| | | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=11 row-size=153B cardinality=30.00M cost=31557228
-| | | in pipelines: 09(GETNEXT)
-| | |
-| | 60:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)]
-| | | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=7,9 row-size=32B cardinality=441.48M cost=130280015
-| | | in pipelines: 06(GETNEXT)
-| | |
-| | F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| | Per-Instance Resources: mem-estimate=34.75MB mem-reservation=128.00KB thread-reservation=1
-| | max-parallelism=180 segment-costs=[1722951425]
-| | 08:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=09
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=7,9 row-size=32B cardinality=441.48M cost=193234710
-| | | in pipelines: 06(GETNEXT), 07(OPEN)
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | | runtime filters: RF023[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | |--F41:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | | | max-parallelism=10 segment-costs=[863]
-| | | JOIN BUILD
-| | | | join-table-id=09 plan-id=10 cohort-id=05
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
-| | | |
-| | | 59:EXCHANGE [BROADCAST]
-| | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=9 row-size=8B cardinality=373 cost=490
-| | | | in pipelines: 07(GETNEXT)
-| | | |
-| | | F17:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[12536]
-| | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
-| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
-| | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | | tuple-ids=9 row-size=8B cardinality=373 cost=12520
-| | | in pipelines: 07(GETNEXT)
+| | 62:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=14 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 12(GETNEXT)
| | |
-| | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| | partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL
-| | HDFS partitions=1823/1824 files=1823 size=145.67GB
-| | predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
-| | runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk
+| | F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[342891999]
+| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1823/1823 rows=2.16G
+| | table: rows=30.00M size=1.55GB
| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
-| | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| | tuple-ids=7 row-size=24B cardinality=441.48M(filtered from 2.16G) cost=165021409
-| | in pipelines: 06(GETNEXT)
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=14 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 12(GETNEXT)
| |
-| 24:HASH JOIN [INNER JOIN, PARTITIONED]
-| | hash-table-id=10
-| | hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27,20 row-size=330B cardinality=79.98M cost=52428030
-| | in pipelines: 51(GETNEXT), 56(OPEN)
+| 61:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=16,18 row-size=32B cardinality=441.48M cost=130280015
+| | in pipelines: 13(GETNEXT)
| |
-| |--F42:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=120
-| | | Per-Instance Resources: mem-estimate=169.95MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=260 segment-costs=[149629463] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
-| | JOIN BUILD
-| | | join-table-id=10 plan-id=11 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF013[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | | mem-estimate=124.13MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=79982682
-| | |
-| | 58:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)]
-| | | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=20 row-size=165B cardinality=79.98M cost=69646781
-| | | in pipelines: 56(GETNEXT)
-| | |
-| | F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=1.18GB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=550 segment-costs=[5417525566, 891856952] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
-| | 56:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
-| | | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) IS NOT NULL
-| | | mem-estimate=1.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=20 row-size=165B cardinality=79.98M cost=4721057758
-| | | in pipelines: 56(GETNEXT), 12(OPEN)
-| | |
-| | 55:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)]
-| | | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=20 row-size=165B cardinality=799.83M cost=696467808
-| | | in pipelines: 12(GETNEXT)
-| | |
-| | F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=938.49MB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=900 segment-costs=[5346593754, 8918569464] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| | 17:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
-| | | mem-estimate=844.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=20 row-size=165B cardinality=799.83M cost=4721057758
-| | | in pipelines: 12(GETNEXT)
+| F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=128.00KB thread-reservation=1
+| max-parallelism=180 segment-costs=[1722951425]
+| 15:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=08
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=16,18 row-size=32B cardinality=441.48M cost=193234710
+| | in pipelines: 13(GETNEXT), 14(OPEN)
+| |
+| |--F40:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
+| | JOIN BUILD
+| | | join-table-id=08 plan-id=09 cohort-id=04
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
-| | 16:HASH JOIN [INNER JOIN, PARTITIONED]
-| | | hash-table-id=11
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=14,16,18 row-size=185B cardinality=799.83M cost=368416277
-| | | in pipelines: 12(GETNEXT), 15(OPEN)
+| | 60:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=18 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 14(GETNEXT)
| | |
-| | |--F43:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=120
-| | | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | | max-parallelism=900 segment-costs=[54467197]
-| | | JOIN BUILD
-| | | | join-table-id=11 plan-id=12 cohort-id=06
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 54:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_sk)]
-| | | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=18 row-size=153B cardinality=30.00M cost=24467197
-| | | | in pipelines: 15(GETNEXT)
-| | | |
-| | | F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| | | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[342891999]
-| | | 15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
-| | | runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF010[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=18 row-size=153B cardinality=30.00M cost=31557228
-| | | in pipelines: 15(GETNEXT)
+| | F17:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[12536]
+| | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
+| | stored statistics:
+| | table: rows=73.05K size=2.17MB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=18 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 14(GETNEXT)
+| |
+| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL
+| HDFS partitions=1823/1824 files=1823 size=145.67GB
+| predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
+| runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk
+| stored statistics:
+| table: rows=2.16G size=145.75GB
+| partitions: 1823/1823 rows=2.16G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=16 row-size=24B cardinality=441.48M(filtered from 2.16G) cost=165021409
+| in pipelines: 13(GETNEXT)
+|
+37:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=09
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=41,34,27 row-size=495B cardinality=44.15M cost=28515130
+| in pipelines: 46(GETNEXT), 58(OPEN)
+|
+|--F41:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)] hosts=10 instances=110 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=117.98MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=160 segment-costs=[82590434] cpu-comparison-result=240 [max(110 (self) vs 240 (sum children))]
+| JOIN BUILD
+| | join-table-id=09 plan-id=10 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | mem-estimate=72.15MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=44147752
+| |
+| 59:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=44.15M cost=38442682
+| | in pipelines: 58(GETNEXT)
+| |
+| F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=694.21MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=300 segment-costs=[2990292024, 492275059] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| 58:AGGREGATE [FINALIZE]
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2)) IS NOT NULL
+| | mem-estimate=621.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=44.15M cost=2605865203
+| | in pipelines: 58(GETNEXT), 19(OPEN)
+| |
+| 57:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=441.48M cost=384426821
+| | in pipelines: 19(GETNEXT)
+| |
+| F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=560.12MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=500 segment-costs=[2929379928, 4922750583] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 23:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
+| | mem-estimate=466.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=441.48M cost=2605865203
+| | in pipelines: 19(GETNEXT)
+| |
+| 22:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=10
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | fk/pk conjuncts: none
+| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=23,25,21 row-size=185B cardinality=441.48M cost=193234710
+| | in pipelines: 19(GETNEXT), 18(OPEN)
+| |
+| |--F42:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=500 segment-costs=[54467197]
+| | JOIN BUILD
+| | | join-table-id=10 plan-id=11 cohort-id=05
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | | runtime filters: RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 53:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)]
-| | | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=14,16 row-size=32B cardinality=871.30M cost=257119719
-| | | in pipelines: 12(GETNEXT)
+| | 56:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=21 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 18(GETNEXT)
| | |
-| | F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
-| | Per-Instance Resources: mem-estimate=34.75MB mem-reservation=256.00KB thread-reservation=1
-| | max-parallelism=350 segment-costs=[3401959876]
-| | 14:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=12
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=14,16 row-size=32B cardinality=871.30M cost=381366658
-| | | in pipelines: 12(GETNEXT), 13(OPEN)
+| | F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[342891999]
+| | 18:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | stored statistics:
+| | table: rows=30.00M size=1.55GB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=21 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 18(GETNEXT)
+| |
+| 55:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=23,25 row-size=32B cardinality=441.48M cost=130280015
+| | in pipelines: 19(GETNEXT)
+| |
+| F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=128.00KB thread-reservation=1
+| max-parallelism=180 segment-costs=[1722951425]
+| 21:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=11
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=23,25 row-size=32B cardinality=441.48M cost=193234710
+| | in pipelines: 19(GETNEXT), 20(OPEN)
+| |
+| |--F43:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
+| | JOIN BUILD
+| | | join-table-id=11 plan-id=12 cohort-id=05
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
-| | |--F44:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | | | max-parallelism=10 segment-costs=[863]
-| | | JOIN BUILD
-| | | | join-table-id=12 plan-id=13 cohort-id=06
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
-| | | |
-| | | 52:EXCHANGE [BROADCAST]
-| | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=16 row-size=8B cardinality=373 cost=490
-| | | | in pipelines: 13(GETNEXT)
-| | | |
-| | | F11:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[12536]
-| | | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT)
-| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
-| | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | | tuple-ids=16 row-size=8B cardinality=373 cost=12520
-| | | in pipelines: 13(GETNEXT)
+| | 54:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=25 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 20(GETNEXT)
| | |
-| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| | partition predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk IS NOT NULL
-| | HDFS partitions=1830/1831 files=1830 size=280.81GB
-| | predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
-| | runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk
+| | F12:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[12536]
+| | 20:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1830/1830 rows=4.30G
+| | table: rows=73.05K size=2.17MB
| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=373(filtered from 1830)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
-| | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
-| | tuple-ids=14 row-size=24B cardinality=871.30M(filtered from 4.28G) cost=327240201
-| | in pipelines: 12(GETNEXT)
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=25 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 20(GETNEXT)
| |
-| 57:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)]
+| 19:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL
+| HDFS partitions=1823/1824 files=1823 size=145.67GB
+| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
+| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk
+| stored statistics:
+| table: rows=2.16G size=145.75GB
+| partitions: 1823/1823 rows=2.16G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=23 row-size=24B cardinality=441.48M(filtered from 2.16G) cost=165021409
+| in pipelines: 19(GETNEXT)
+|
+36:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=12
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=41,34 row-size=330B cardinality=79.98M cost=52428030
+| in pipelines: 46(GETNEXT), 51(OPEN)
+|
+|--F44:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)] hosts=10 instances=110 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=181.24MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=160 segment-costs=[149629463] cpu-comparison-result=240 [max(110 (self) vs 240 (sum children))]
+| JOIN BUILD
+| | join-table-id=12 plan-id=13 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF009[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| | mem-estimate=135.41MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=79982682
+| |
+| 53:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=147.90M cost=128783355
+| | tuple-ids=34 row-size=165B cardinality=79.98M cost=69646781
| | in pipelines: 51(GETNEXT)
| |
-| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=2.11GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=1010 segment-costs=[10017507045, 1649126185] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id,tpcds_partitioned_parquet_snap.customer_3.c_first_name,tpcds_partitioned_parquet_snap.customer_3.c_last_name,tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_3.c_birth_country,tpcds_partitioned_parquet_snap.customer_3.c_login,tpcds_partitioned_parquet_snap.customer_3.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.17GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=550 segment-costs=[5417525566, 891856952] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
| 51:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
-| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
-| | mem-estimate=2.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=147.90M cost=8729673496
-| | in pipelines: 51(GETNEXT), 18(OPEN)
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2)) IS NOT NULL
+| | mem-estimate=1.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=34 row-size=165B cardinality=79.98M cost=4721057758
+| | in pipelines: 51(GETNEXT), 24(OPEN)
| |
-| 50:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)]
+| 50:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id,tpcds_partitioned_parquet_snap.customer_3.c_first_name,tpcds_partitioned_parquet_snap.customer_3.c_last_name,tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_3.c_birth_country,tpcds_partitioned_parquet_snap.customer_3.c_login,tpcds_partitioned_parquet_snap.customer_3.c_email_address)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=1.48G cost=1287833549
-| | in pipelines: 18(GETNEXT)
+| | tuple-ids=34 row-size=165B cardinality=799.83M cost=696467808
+| | in pipelines: 24(GETNEXT)
| |
-| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=1.62GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=1650 segment-costs=[9886347547, 16491261804] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| 23:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
-| | mem-estimate=1.52GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=1.48G cost=8729673496
-| | in pipelines: 18(GETNEXT)
+| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=938.49MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=900 segment-costs=[5346593754, 8918569464] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 29:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address
+| | mem-estimate=844.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=34 row-size=165B cardinality=799.83M cost=4721057758
+| | in pipelines: 24(GETNEXT)
| |
-| 22:HASH JOIN [INNER JOIN, PARTITIONED]
+| 28:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=13
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=21,23,25 row-size=185B cardinality=1.48G cost=681235853
-| | in pipelines: 18(GETNEXT), 21(OPEN)
+| | tuple-ids=28,30,32 row-size=185B cardinality=799.83M cost=368416277
+| | in pipelines: 24(GETNEXT), 27(OPEN)
| |
-| |--F45:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
-| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
-| | | max-parallelism=1650 segment-costs=[54467197]
+| |--F45:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | | max-parallelism=900 segment-costs=[54467197]
| | JOIN BUILD
-| | | join-table-id=13 plan-id=14 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | | runtime filters: RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | | join-table-id=13 plan-id=14 cohort-id=06
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)]
+| | 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_sk)]
| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=25 row-size=153B cardinality=30.00M cost=24467197
-| | | in pipelines: 21(GETNEXT)
+| | | tuple-ids=32 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 27(GETNEXT)
| | |
| | F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Host Shared Resources: mem-estimate=32.00MB mem-reservation=32.00MB thread-reservation=0 runtime-filters-memory=32.00MB
| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[342891999]
-| | 21:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 27:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
-| | runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF013[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF010[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF012[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_3.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF007[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF006[bloom] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_3.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=25 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 21(GETNEXT)
+| | tuple-ids=32 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 27(GETNEXT)
| |
-| 48:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)]
+| 48:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)]
| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=21,23 row-size=32B cardinality=1.61G cost=475438198
-| | in pipelines: 18(GETNEXT)
+| | tuple-ids=28,30 row-size=32B cardinality=871.30M cost=257119719
+| | in pipelines: 24(GETNEXT)
| |
| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=512.00KB thread-reservation=1
-| max-parallelism=373 segment-costs=[6315884965]
-| 20:HASH JOIN [INNER JOIN, BROADCAST]
+| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=256.00KB thread-reservation=1
+| max-parallelism=350 segment-costs=[3401959876]
+| 26:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=14
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=21,23 row-size=32B cardinality=1.61G cost=705182309
-| | in pipelines: 18(GETNEXT), 19(OPEN)
+| | tuple-ids=28,30 row-size=32B cardinality=871.30M cost=381366658
+| | in pipelines: 24(GETNEXT), 25(OPEN)
| |
| |--F46:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
-| | | join-table-id=14 plan-id=15 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | | join-table-id=14 plan-id=15 cohort-id=06
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 47:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=23 row-size=8B cardinality=373 cost=490
-| | | in pipelines: 19(GETNEXT)
+| | | tuple-ids=30 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 25(GETNEXT)
| | |
| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| | max-parallelism=1 segment-costs=[12536]
-| | 19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 25:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=23 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 19(GETNEXT)
+| | tuple-ids=30 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 25(GETNEXT)
| |
-| 18:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
-| partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL
-| HDFS partitions=1823/1824 files=1823 size=389.69GB
-| predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
-| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk
+| 24:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk IS NOT NULL
+| HDFS partitions=1830/1831 files=1830 size=280.81GB
+| predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk IS NOT NULL
+| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk, RF014[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk
| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1823/1823 rows=8.25G
+| table: rows=4.32G size=280.96GB
+| partitions: 1830/1830 rows=4.30G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=21 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220
-| in pipelines: 18(GETNEXT)
+| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=373(filtered from 1830)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| tuple-ids=28 row-size=24B cardinality=871.30M(filtered from 4.28G) cost=327240201
+| in pipelines: 24(GETNEXT)
|
-65:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)]
+52:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)]
| mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| tuple-ids=6 row-size=165B cardinality=147.90M cost=128783355
+| tuple-ids=41 row-size=165B cardinality=147.90M cost=128783355
| in pipelines: 46(GETNEXT)
|
-F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)] hosts=10 instances=120
-Per-Instance Resources: mem-estimate=2.11GB mem-reservation=34.00MB thread-reservation=1
+F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address)] hosts=10 instances=120
+Per-Instance Resources: mem-estimate=2.10GB mem-reservation=34.00MB thread-reservation=1
max-parallelism=1010 segment-costs=[10017507045, 1649126185] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
46:AGGREGATE [FINALIZE]
-| output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2))
-| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
-| having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2)) IS NOT NULL
+| output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2))
+| group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
+| having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
| mem-estimate=2.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=165B cardinality=147.90M cost=8729673496
-| in pipelines: 46(GETNEXT), 00(OPEN)
+| tuple-ids=41 row-size=165B cardinality=147.90M cost=8729673496
+| in pipelines: 46(GETNEXT), 30(OPEN)
|
-45:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)]
+45:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address)]
| mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| tuple-ids=6 row-size=165B cardinality=1.48G cost=1287833549
-| in pipelines: 00(GETNEXT)
+| tuple-ids=41 row-size=165B cardinality=1.48G cost=1287833549
+| in pipelines: 30(GETNEXT)
|
-F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
+F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
Per-Instance Resources: mem-estimate=1.62GB mem-reservation=34.00MB thread-reservation=1
max-parallelism=1650 segment-costs=[9886347547, 16491261804] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-05:AGGREGATE [STREAMING]
-| output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+35:AGGREGATE [STREAMING]
+| output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
| mem-estimate=1.52GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=165B cardinality=1.48G cost=8729673496
-| in pipelines: 00(GETNEXT)
+| tuple-ids=41 row-size=165B cardinality=1.48G cost=8729673496
+| in pipelines: 30(GETNEXT)
|
-04:HASH JOIN [INNER JOIN, PARTITIONED]
+34:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=15
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4 row-size=185B cardinality=1.48G cost=681235853
-| in pipelines: 00(GETNEXT), 03(OPEN)
+| tuple-ids=35,37,39 row-size=185B cardinality=1.48G cost=681235853
+| in pipelines: 30(GETNEXT), 33(OPEN)
|
-|--F47:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
+|--F47:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
| | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
| | max-parallelism=1650 segment-costs=[54467197]
| JOIN BUILD
| | join-table-id=15 plan-id=16 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | runtime filters: RF007[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | build expressions: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | runtime filters: RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
| | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
-| 44:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
+| 44:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_sk)]
| | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=153B cardinality=30.00M cost=24467197
-| | in pipelines: 03(GETNEXT)
+| | tuple-ids=39 row-size=153B cardinality=30.00M cost=24467197
+| | in pipelines: 33(GETNEXT)
| |
| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| Per-Host Shared Resources: mem-estimate=48.00MB mem-reservation=48.00MB thread-reservation=0 runtime-filters-memory=48.00MB
| Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| max-parallelism=10 segment-costs=[342891999]
-| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| 33:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| HDFS partitions=1/1 files=1 size=1.55GB
-| predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
-| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id
+| predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_4.c_customer_sk IS NOT NULL
+| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF009[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF007[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF008[bloom] -> tpcds [...]
| stored statistics:
| table: rows=30.00M size=1.55GB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.10M
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_4.c_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=4 row-size=153B cardinality=30.00M cost=31557228
-| in pipelines: 03(GETNEXT)
+| tuple-ids=39 row-size=153B cardinality=30.00M cost=31557228
+| in pipelines: 33(GETNEXT)
|
-43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)]
+43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)]
| mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
-| tuple-ids=0,2 row-size=32B cardinality=1.61G cost=475438198
-| in pipelines: 00(GETNEXT)
+| tuple-ids=35,37 row-size=32B cardinality=1.61G cost=475438198
+| in pipelines: 30(GETNEXT)
|
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
Per-Instance Resources: mem-estimate=34.75MB mem-reservation=512.00KB thread-reservation=1
max-parallelism=373 segment-costs=[6315884965]
-02:HASH JOIN [INNER JOIN, BROADCAST]
+32:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=16
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2 row-size=32B cardinality=1.61G cost=705182309
-| in pipelines: 00(GETNEXT), 01(OPEN)
+| tuple-ids=35,37 row-size=32B cardinality=1.61G cost=705182309
+| in pipelines: 30(GETNEXT), 31(OPEN)
|
|--F48:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[863]
| JOIN BUILD
| | join-table-id=16 plan-id=17 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | build expressions: tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| |
| 42:EXCHANGE [BROADCAST]
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=2 row-size=8B cardinality=373 cost=490
-| | in pipelines: 01(GETNEXT)
+| | tuple-ids=37 row-size=8B cardinality=373 cost=490
+| | in pipelines: 31(GETNEXT)
| |
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| max-parallelism=1 segment-costs=[12536]
-| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| 31:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL
| stored statistics:
| table: rows=73.05K size=2.17MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=2 row-size=8B cardinality=373 cost=12520
-| in pipelines: 01(GETNEXT)
+| tuple-ids=37 row-size=8B cardinality=373 cost=12520
+| in pipelines: 31(GETNEXT)
|
-00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
- partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
+30:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+ partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
- predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
- runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF008[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
+ predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
+ runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk
stored statistics:
table: rows=8.64G size=389.90GB
partitions: 1823/1823 rows=8.25G
columns: all
extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
- parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
+ parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=0 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220
- in pipelines: 00(GETNEXT)
+ tuple-ids=35 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220
+ in pipelines: 30(GETNEXT)
---- PARALLELPLANS
-Max Per-Host Resource Reservation: Memory=10.17GB Threads=379
-Per-Host Resource Estimates: Memory=183.50GB
+Max Per-Host Resource Reservation: Memory=10.02GB Threads=373
+Per-Host Resource Estimates: Memory=185.81GB
F31:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=5.02MB mem-reservation=4.00MB thread-reservation=1
+| Per-Instance Resources: mem-estimate=4.93MB mem-reservation=4.00MB thread-reservation=1
| max-parallelism=1 segment-costs=[442] cpu-comparison-result=1440 [max(1 (self) vs 1440 (sum children))]
PLAN-ROOT SINK
-| output exprs: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_birth_country
+| output exprs: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_birth_country
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
78:MERGING-EXCHANGE [UNPARTITIONED]
-| order by: tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_birth_country ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_birth_country ASC NULLS LAST
| limit: 100
-| mem-estimate=1.02MB mem-reservation=0B thread-reservation=0
+| mem-estimate=953.44KB mem-reservation=0B thread-reservation=0
| tuple-ids=42 row-size=85B cardinality=100 cost=42
| in pipelines: 41(GETNEXT)
|
-F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=120
+F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)] hosts=10 instances=110 (adjusted from 120)
Per-Instance Resources: mem-estimate=29.83MB mem-reservation=0B thread-reservation=1
-max-parallelism=260 segment-costs=[2586011054, 253] cpu-comparison-result=1440 [max(120 (self) vs 1440 (sum children))]
+max-parallelism=160 segment-costs=[1503467851, 253] cpu-comparison-result=1440 [max(110 (self) vs 1440 (sum children))]
41:TOP-N [LIMIT=100]
-| order by: tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_birth_country ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_birth_country ASC NULLS LAST
| mem-estimate=8.27KB mem-reservation=0B thread-reservation=0
-| tuple-ids=42 row-size=85B cardinality=100 cost=2263026260
+| tuple-ids=42 row-size=85B cardinality=100 cost=1183867292
| in pipelines: 41(GETNEXT), 46(OPEN)
|
40:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=00
-| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_4.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_4.c_customer_id
-| other join predicates: CASE WHEN sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6)) THEN divide(sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_par [...]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| other join predicates: CASE WHEN sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6)) THEN divide(sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partition [...]
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6,27,20,13,34,41 row-size=991B cardinality=147.90M cost=64733813
+| tuple-ids=41,34,27,20,13,6 row-size=991B cardinality=79.98M cost=52428030
| in pipelines: 46(GETNEXT), 76(OPEN)
|
-|--F32:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=90.89MB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=260 segment-costs=[76003415] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+|--F32:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)] hosts=10 instances=110 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=181.24MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=160 segment-costs=[149629463] cpu-comparison-result=240 [max(110 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_4.c_customer_id
-| | runtime filters: RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_id
-| | mem-estimate=61.07MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738
+| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | mem-estimate=135.41MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=79982682
| |
-| 77:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)]
+| 77:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=41 row-size=165B cardinality=40.63M cost=35376677
+| | tuple-ids=6 row-size=165B cardinality=79.98M cost=69646781
| | in pipelines: 76(GETNEXT)
| |
-| F30:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=651.24MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=280 segment-costs=[2751800623, 453013550] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| F30:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.17GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=550 segment-costs=[5417525566, 891856952] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
| 76:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
-| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
-| | mem-estimate=571.96MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=41 row-size=165B cardinality=40.63M cost=2398033848
-| | in pipelines: 76(GETNEXT), 34(OPEN)
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
+| | mem-estimate=1.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=79.98M cost=4721057758
+| | in pipelines: 76(GETNEXT), 00(OPEN)
| |
-| 75:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address)]
+| 75:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=41 row-size=165B cardinality=406.27M cost=353766775
-| | in pipelines: 34(GETNEXT)
+| | tuple-ids=6 row-size=165B cardinality=799.83M cost=696467808
+| | in pipelines: 00(GETNEXT)
| |
-| F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=522.94MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=460 segment-costs=[2715168496, 4530135523] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| 39:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
-| | mem-estimate=428.97MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=41 row-size=165B cardinality=406.27M cost=2398033848
-| | in pipelines: 34(GETNEXT)
+| F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=938.49MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=900 segment-costs=[5346593754, 8918569464] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 05:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | mem-estimate=844.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=799.83M cost=4721057758
+| | in pipelines: 00(GETNEXT)
| |
-| 38:HASH JOIN [INNER JOIN, PARTITIONED]
+| 04:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=01
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=35,37,39 row-size=185B cardinality=406.27M cost=186854633
-| | in pipelines: 34(GETNEXT), 37(OPEN)
+| | tuple-ids=0,2,4 row-size=185B cardinality=799.83M cost=368416277
+| | in pipelines: 00(GETNEXT), 03(OPEN)
| |
-| |--F33:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
+| |--F33:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=120
| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
-| | | max-parallelism=460 segment-costs=[54467197]
+| | | max-parallelism=900 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=01 plan-id=02 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
-| | | runtime filters: RF031[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | | runtime filters: RF031[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 74:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_sk)]
+| | 74:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=39 row-size=153B cardinality=30.00M cost=24467197
-| | | in pipelines: 37(GETNEXT)
+| | | tuple-ids=4 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 03(GETNEXT)
| | |
| | F28:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[342891999]
-| | 37:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_4.c_customer_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_4.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=39 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 37(GETNEXT)
+| | tuple-ids=4 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 03(GETNEXT)
| |
-| 73:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)]
+| 73:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)]
| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=35,37 row-size=32B cardinality=441.48M cost=130280015
-| | in pipelines: 34(GETNEXT)
+| | tuple-ids=0,2 row-size=32B cardinality=871.30M cost=257119719
+| | in pipelines: 00(GETNEXT)
| |
| F26:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=128.00KB thread-reservation=1
-| max-parallelism=180 segment-costs=[1722951425]
-| 36:HASH JOIN [INNER JOIN, BROADCAST]
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=256.00KB thread-reservation=1
+| max-parallelism=350 segment-costs=[3401959876]
+| 02:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=02
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=35,37 row-size=32B cardinality=441.48M cost=193234710
-| | in pipelines: 34(GETNEXT), 35(OPEN)
+| | tuple-ids=0,2 row-size=32B cardinality=871.30M cost=381366658
+| | in pipelines: 00(GETNEXT), 01(OPEN)
| |
| |--F34:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=02 plan-id=03 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
-| | | runtime filters: RF032[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | | runtime filters: RF032[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 72:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=37 row-size=8B cardinality=373 cost=490
-| | | in pipelines: 35(GETNEXT)
+| | | tuple-ids=2 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 01(GETNEXT)
| | |
| | F27:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| | max-parallelism=1 segment-costs=[12536]
-| | 35:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=37 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 35(GETNEXT)
+| | tuple-ids=2 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 01(GETNEXT)
| |
-| 34:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL
-| HDFS partitions=1823/1824 files=1823 size=145.67GB
-| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
-| runtime filters: RF031[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF032[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk
+| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk IS NOT NULL
+| HDFS partitions=1830/1831 files=1830 size=280.81GB
+| predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
+| runtime filters: RF031[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF032[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk
| stored statistics:
-| table: rows=2.16G size=145.75GB
-| partitions: 1823/1823 rows=2.16G
+| table: rows=4.32G size=280.96GB
+| partitions: 1830/1830 rows=4.30G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=35 row-size=24B cardinality=441.48M(filtered from 2.16G) cost=165021409
-| in pipelines: 34(GETNEXT)
+| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=373(filtered from 1830)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| tuple-ids=0 row-size=24B cardinality=871.30M(filtered from 4.28G) cost=327240201
+| in pipelines: 00(GETNEXT)
|
-33:HASH JOIN [INNER JOIN, PARTITIONED]
+39:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=03
-| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_3.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_3.c_customer_id
-| other join predicates: CASE WHEN sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6)) THEN divide(sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_par [...]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6,27,20,13,34 row-size=826B cardinality=147.90M cost=64733813
+| tuple-ids=41,34,27,20,13 row-size=826B cardinality=147.90M cost=38122543
| in pipelines: 46(GETNEXT), 70(OPEN)
|
-|--F35:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=153.95MB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=260 segment-costs=[149629463] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+|--F35:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)] hosts=10 instances=110 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=285.86MB mem-reservation=34.00MB thread-reservation=1
+| | max-parallelism=160 segment-costs=[276678749] cpu-comparison-result=240 [max(110 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=03 plan-id=04 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_3.c_customer_id
-| | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_id
-| | mem-estimate=124.13MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=79982682
+| | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | mem-estimate=256.04MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=147895394
| |
-| 71:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)]
+| 71:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=34 row-size=165B cardinality=79.98M cost=69646781
+| | tuple-ids=13 row-size=165B cardinality=147.90M cost=128783355
| | in pipelines: 70(GETNEXT)
| |
-| F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id,tpcds_partitioned_parquet_snap.customer_3.c_first_name,tpcds_partitioned_parquet_snap.customer_3.c_last_name,tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_3.c_birth_country,tpcds_partitioned_parquet_snap.customer_3.c_login,tpcds_partitioned_parquet_snap.customer_3.c_email_address)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=1.18GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=550 segment-costs=[5417525566, 891856952] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=2.10GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=1010 segment-costs=[10017507045, 1649126185] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
| 70:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address
-| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
-| | mem-estimate=1.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=34 row-size=165B cardinality=79.98M cost=4721057758
-| | in pipelines: 70(GETNEXT), 27(OPEN)
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2)) IS NOT NULL
+| | mem-estimate=2.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=147.90M cost=8729673496
+| | in pipelines: 70(GETNEXT), 06(OPEN)
| |
-| 69:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id,tpcds_partitioned_parquet_snap.customer_3.c_first_name,tpcds_partitioned_parquet_snap.customer_3.c_last_name,tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_3.c_birth_country,tpcds_partitioned_parquet_snap.customer_3.c_login,tpcds_partitioned_parquet_snap.customer_3.c_email_address)]
+| 69:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=34 row-size=165B cardinality=799.83M cost=696467808
-| | in pipelines: 27(GETNEXT)
+| | tuple-ids=13 row-size=165B cardinality=1.48G cost=1287833549
+| | in pipelines: 06(GETNEXT)
| |
-| F24:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=938.49MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=900 segment-costs=[5346593754, 8918569464] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| 32:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address
-| | mem-estimate=844.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=34 row-size=165B cardinality=799.83M cost=4721057758
-| | in pipelines: 27(GETNEXT)
+| F24:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.62GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=1650 segment-costs=[9886347547, 16491261804] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 11:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
+| | mem-estimate=1.52GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=13 row-size=165B cardinality=1.48G cost=8729673496
+| | in pipelines: 06(GETNEXT)
| |
-| 31:HASH JOIN [INNER JOIN, PARTITIONED]
+| 10:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=04
-| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=28,30,32 row-size=185B cardinality=799.83M cost=368416277
-| | in pipelines: 27(GETNEXT), 30(OPEN)
+| | tuple-ids=7,9,11 row-size=185B cardinality=1.48G cost=681235853
+| | in pipelines: 06(GETNEXT), 09(OPEN)
| |
-| |--F36:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)] hosts=10 instances=120
-| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=900 segment-costs=[54467197]
+| |--F36:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=1650 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=04 plan-id=05 cohort-id=03
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
-| | | runtime filters: RF026[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk, RF027[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | | runtime filters: RF027[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 68:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_sk)]
+| | 68:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)]
| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=32 row-size=153B cardinality=30.00M cost=24467197
-| | | in pipelines: 30(GETNEXT)
+| | | tuple-ids=11 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 09(GETNEXT)
| | |
| | F23:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[342891999]
-| | 30:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_3.c_customer_sk IS NOT NULL
-| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_3.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=32 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 30(GETNEXT)
+| | tuple-ids=11 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 09(GETNEXT)
| |
-| 67:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)]
+| 67:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)]
| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=28,30 row-size=32B cardinality=871.30M cost=257119719
-| | in pipelines: 27(GETNEXT)
+| | tuple-ids=7,9 row-size=32B cardinality=1.61G cost=475438198
+| | in pipelines: 06(GETNEXT)
| |
| F21:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
-| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=256.00KB thread-reservation=1
-| max-parallelism=350 segment-costs=[3401959876]
-| 29:HASH JOIN [INNER JOIN, BROADCAST]
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=373 segment-costs=[6315884965]
+| 08:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=05
-| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=28,30 row-size=32B cardinality=871.30M cost=381366658
-| | in pipelines: 27(GETNEXT), 28(OPEN)
+| | tuple-ids=7,9 row-size=32B cardinality=1.61G cost=705182309
+| | in pipelines: 06(GETNEXT), 07(OPEN)
| |
| |--F37:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=05 plan-id=06 cohort-id=03
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
-| | | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | | runtime filters: RF028[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 66:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=30 row-size=8B cardinality=373 cost=490
-| | | in pipelines: 28(GETNEXT)
+| | | tuple-ids=9 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 07(GETNEXT)
| | |
| | F22:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| | max-parallelism=1 segment-costs=[12536]
-| | 28:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=30 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 28(GETNEXT)
+| | tuple-ids=9 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 07(GETNEXT)
| |
-| 27:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| partition predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk IS NOT NULL
-| HDFS partitions=1830/1831 files=1830 size=280.81GB
-| predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk IS NOT NULL
-| runtime filters: RF027[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk, RF028[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk, RF026[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk
+| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
+| HDFS partitions=1823/1824 files=1823 size=389.69GB
+| predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
+| runtime filters: RF027[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF028[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
| stored statistics:
-| table: rows=4.32G size=280.96GB
-| partitions: 1830/1830 rows=4.30G
+| table: rows=8.64G size=389.90GB
+| partitions: 1823/1823 rows=8.25G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=373(filtered from 1830)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
-| tuple-ids=28 row-size=24B cardinality=871.30M(filtered from 4.28G) cost=327240201
-| in pipelines: 27(GETNEXT)
+| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=7 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220
+| in pipelines: 06(GETNEXT)
|
-26:HASH JOIN [INNER JOIN, PARTITIONED]
+38:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=06
-| hash predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6,27,20,13 row-size=661B cardinality=147.90M cost=64733813
-| in pipelines: 46(GETNEXT), 51(OPEN)
+| tuple-ids=41,34,27,20 row-size=661B cardinality=44.15M cost=19323471
+| in pipelines: 46(GETNEXT), 64(OPEN)
|
-|--F38:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=197.54MB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=260 segment-costs=[249715245] cpu-comparison-result=720 [max(120 (self) vs 720 (sum children))]
+|--F38:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)] hosts=10 instances=110 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=101.98MB mem-reservation=34.00MB thread-reservation=1
+| | max-parallelism=160 segment-costs=[82590434] cpu-comparison-result=240 [max(110 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=06 plan-id=07 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| | runtime filters: RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| | mem-estimate=167.71MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738
+| | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | runtime filters: RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | mem-estimate=72.15MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=44147752
| |
-| 25:HASH JOIN [INNER JOIN, PARTITIONED]
+| 65:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=44.15M cost=38442682
+| | in pipelines: 64(GETNEXT)
+| |
+| F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=694.21MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=300 segment-costs=[2990292024, 492275059] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| 64:AGGREGATE [FINALIZE]
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
+| | mem-estimate=621.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=44.15M cost=2605865203
+| | in pipelines: 64(GETNEXT), 13(OPEN)
+| |
+| 63:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=441.48M cost=384426821
+| | in pipelines: 13(GETNEXT)
+| |
+| F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=560.12MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=500 segment-costs=[2929379928, 4922750583] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 17:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | mem-estimate=466.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=441.48M cost=2605865203
+| | in pipelines: 13(GETNEXT)
+| |
+| 16:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=07
-| | hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | fk/pk conjuncts: none
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27,20,13 row-size=495B cardinality=40.63M cost=27877122
-| | in pipelines: 51(GETNEXT), 63(OPEN)
+| | tuple-ids=16,18,14 row-size=185B cardinality=441.48M cost=193234710
+| | in pipelines: 13(GETNEXT), 12(OPEN)
| |
-| |--F39:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=120
-| | | Per-Instance Resources: mem-estimate=106.89MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=260 segment-costs=[76003415] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| |--F39:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=500 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=07 plan-id=08 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | | mem-estimate=61.07MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738
-| | |
-| | 64:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)]
-| | | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=13 row-size=165B cardinality=40.63M cost=35376677
-| | | in pipelines: 63(GETNEXT)
-| | |
-| | F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=651.24MB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=280 segment-costs=[2751800623, 453013550] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
-| | 63:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
-| | | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), 2)) IS NOT NULL
-| | | mem-estimate=571.96MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=13 row-size=165B cardinality=40.63M cost=2398033848
-| | | in pipelines: 63(GETNEXT), 06(OPEN)
-| | |
-| | 62:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)]
-| | | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=13 row-size=165B cardinality=406.27M cost=353766775
-| | | in pipelines: 06(GETNEXT)
-| | |
-| | F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=522.94MB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=460 segment-costs=[2715168496, 4530135523] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| | 11:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
-| | | mem-estimate=428.97MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=13 row-size=165B cardinality=406.27M cost=2398033848
-| | | in pipelines: 06(GETNEXT)
-| | |
-| | 10:HASH JOIN [INNER JOIN, PARTITIONED]
-| | | hash-table-id=08
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=7,9,11 row-size=185B cardinality=406.27M cost=186854633
-| | | in pipelines: 06(GETNEXT), 09(OPEN)
-| | |
-| | |--F40:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
-| | | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
-| | | | max-parallelism=460 segment-costs=[54467197]
-| | | JOIN BUILD
-| | | | join-table-id=08 plan-id=09 cohort-id=05
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | | runtime filters: RF023[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 61:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)]
-| | | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=11 row-size=153B cardinality=30.00M cost=24467197
-| | | | in pipelines: 09(GETNEXT)
-| | | |
-| | | F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[342891999]
-| | | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
-| | | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=11 row-size=153B cardinality=30.00M cost=31557228
-| | | in pipelines: 09(GETNEXT)
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | | runtime filters: RF023[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 60:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)]
-| | | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=7,9 row-size=32B cardinality=441.48M cost=130280015
-| | | in pipelines: 06(GETNEXT)
+| | 62:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=14 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 12(GETNEXT)
| | |
-| | F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| | Per-Instance Resources: mem-estimate=34.75MB mem-reservation=128.00KB thread-reservation=1
-| | max-parallelism=180 segment-costs=[1722951425]
-| | 08:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=09
-| | | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=7,9 row-size=32B cardinality=441.48M cost=193234710
-| | | in pipelines: 06(GETNEXT), 07(OPEN)
+| | F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[342891999]
+| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | stored statistics:
+| | table: rows=30.00M size=1.55GB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=14 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 12(GETNEXT)
+| |
+| 61:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=16,18 row-size=32B cardinality=441.48M cost=130280015
+| | in pipelines: 13(GETNEXT)
+| |
+| F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=128.00KB thread-reservation=1
+| max-parallelism=180 segment-costs=[1722951425]
+| 15:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=08
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=16,18 row-size=32B cardinality=441.48M cost=193234710
+| | in pipelines: 13(GETNEXT), 14(OPEN)
+| |
+| |--F40:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
+| | JOIN BUILD
+| | | join-table-id=08 plan-id=09 cohort-id=04
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
-| | |--F41:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | | | max-parallelism=10 segment-costs=[863]
-| | | JOIN BUILD
-| | | | join-table-id=09 plan-id=10 cohort-id=05
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | | runtime filters: RF024[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
-| | | |
-| | | 59:EXCHANGE [BROADCAST]
-| | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=9 row-size=8B cardinality=373 cost=490
-| | | | in pipelines: 07(GETNEXT)
-| | | |
-| | | F17:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[12536]
-| | | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT)
-| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
-| | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | | tuple-ids=9 row-size=8B cardinality=373 cost=12520
-| | | in pipelines: 07(GETNEXT)
+| | 60:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=18 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 14(GETNEXT)
| | |
-| | 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| | partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL
-| | HDFS partitions=1823/1824 files=1823 size=145.67GB
-| | predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
-| | runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk
+| | F17:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[12536]
+| | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
| | stored statistics:
-| | table: rows=2.16G size=145.75GB
-| | partitions: 1823/1823 rows=2.16G
+| | table: rows=73.05K size=2.17MB
| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
-| | mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| | tuple-ids=7 row-size=24B cardinality=441.48M(filtered from 2.16G) cost=165021409
-| | in pipelines: 06(GETNEXT)
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=18 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 14(GETNEXT)
| |
-| 24:HASH JOIN [INNER JOIN, PARTITIONED]
+| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL
+| HDFS partitions=1823/1824 files=1823 size=145.67GB
+| predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
+| runtime filters: RF023[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF024[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk
+| stored statistics:
+| table: rows=2.16G size=145.75GB
+| partitions: 1823/1823 rows=2.16G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=16 row-size=24B cardinality=441.48M(filtered from 2.16G) cost=165021409
+| in pipelines: 13(GETNEXT)
+|
+37:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=09
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=41,34,27 row-size=495B cardinality=44.15M cost=28515130
+| in pipelines: 46(GETNEXT), 58(OPEN)
+|
+|--F41:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)] hosts=10 instances=110 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=117.98MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=160 segment-costs=[82590434] cpu-comparison-result=240 [max(110 (self) vs 240 (sum children))]
+| JOIN BUILD
+| | join-table-id=09 plan-id=10 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | mem-estimate=72.15MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=44147752
+| |
+| 59:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=44.15M cost=38442682
+| | in pipelines: 58(GETNEXT)
+| |
+| F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=694.21MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=300 segment-costs=[2990292024, 492275059] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| 58:AGGREGATE [FINALIZE]
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), 2)) IS NOT NULL
+| | mem-estimate=621.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=44.15M cost=2605865203
+| | in pipelines: 58(GETNEXT), 19(OPEN)
+| |
+| 57:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=441.48M cost=384426821
+| | in pipelines: 19(GETNEXT)
+| |
+| F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=560.12MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=500 segment-costs=[2929379928, 4922750583] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 23:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_wholesale_cost), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt), tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
+| | mem-estimate=466.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=27 row-size=165B cardinality=441.48M cost=2605865203
+| | in pipelines: 19(GETNEXT)
+| |
+| 22:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=10
-| | hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | fk/pk conjuncts: none
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27,20 row-size=330B cardinality=79.98M cost=52428030
-| | in pipelines: 51(GETNEXT), 56(OPEN)
+| | tuple-ids=23,25,21 row-size=185B cardinality=441.48M cost=193234710
+| | in pipelines: 19(GETNEXT), 18(OPEN)
| |
-| |--F42:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=120
-| | | Per-Instance Resources: mem-estimate=169.95MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=260 segment-costs=[149629463] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| |--F42:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=500 segment-costs=[54467197]
| | JOIN BUILD
-| | | join-table-id=10 plan-id=11 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF013[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | | mem-estimate=124.13MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=79982682
-| | |
-| | 58:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)]
-| | | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=20 row-size=165B cardinality=79.98M cost=69646781
-| | | in pipelines: 56(GETNEXT)
-| | |
-| | F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=1.18GB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=550 segment-costs=[5417525566, 891856952] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
-| | 56:AGGREGATE [FINALIZE]
-| | | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2))
-| | | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
-| | | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), 2)) IS NOT NULL
-| | | mem-estimate=1.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=20 row-size=165B cardinality=79.98M cost=4721057758
-| | | in pipelines: 56(GETNEXT), 12(OPEN)
-| | |
-| | 55:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)]
-| | | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=20 row-size=165B cardinality=799.83M cost=696467808
-| | | in pipelines: 12(GETNEXT)
-| | |
-| | F13:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=120
-| | Per-Instance Resources: mem-estimate=938.49MB mem-reservation=34.00MB thread-reservation=1
-| | max-parallelism=900 segment-costs=[5346593754, 8918569464] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| | 17:AGGREGATE [STREAMING]
-| | | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
-| | | mem-estimate=844.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=20 row-size=165B cardinality=799.83M cost=4721057758
-| | | in pipelines: 12(GETNEXT)
-| | |
-| | 16:HASH JOIN [INNER JOIN, PARTITIONED]
-| | | hash-table-id=11
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=14,16,18 row-size=185B cardinality=799.83M cost=368416277
-| | | in pipelines: 12(GETNEXT), 15(OPEN)
-| | |
-| | |--F43:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=120
-| | | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | | max-parallelism=900 segment-costs=[54467197]
-| | | JOIN BUILD
-| | | | join-table-id=11 plan-id=12 cohort-id=06
-| | | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| | | |
-| | | 54:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_sk)]
-| | | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=18 row-size=153B cardinality=30.00M cost=24467197
-| | | | in pipelines: 15(GETNEXT)
-| | | |
-| | | F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| | | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
-| | | max-parallelism=10 segment-costs=[342891999]
-| | | 15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=1.55GB
-| | | predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
-| | | runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF010[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
-| | | stored statistics:
-| | | table: rows=30.00M size=1.55GB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
-| | | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | | tuple-ids=18 row-size=153B cardinality=30.00M cost=31557228
-| | | in pipelines: 15(GETNEXT)
+| | | join-table-id=10 plan-id=11 cohort-id=05
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | | runtime filters: RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 53:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)]
-| | | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=14,16 row-size=32B cardinality=871.30M cost=257119719
-| | | in pipelines: 12(GETNEXT)
+| | 56:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)]
+| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=21 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 18(GETNEXT)
| | |
-| | F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| | Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
-| | Per-Instance Resources: mem-estimate=34.75MB mem-reservation=256.00KB thread-reservation=1
-| | max-parallelism=350 segment-costs=[3401959876]
-| | 14:HASH JOIN [INNER JOIN, BROADCAST]
-| | | hash-table-id=12
-| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=14,16 row-size=32B cardinality=871.30M cost=381366658
-| | | in pipelines: 12(GETNEXT), 13(OPEN)
+| | F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
+| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[342891999]
+| | 18:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | stored statistics:
+| | table: rows=30.00M size=1.55GB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=21 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 18(GETNEXT)
+| |
+| 55:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)]
+| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=23,25 row-size=32B cardinality=441.48M cost=130280015
+| | in pipelines: 19(GETNEXT)
+| |
+| F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=128.00KB thread-reservation=1
+| max-parallelism=180 segment-costs=[1722951425]
+| 21:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=11
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=23,25 row-size=32B cardinality=441.48M cost=193234710
+| | in pipelines: 19(GETNEXT), 20(OPEN)
+| |
+| |--F43:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=10 segment-costs=[863]
+| | JOIN BUILD
+| | | join-table-id=11 plan-id=12 cohort-id=05
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
-| | |--F44:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | | | max-parallelism=10 segment-costs=[863]
-| | | JOIN BUILD
-| | | | join-table-id=12 plan-id=13 cohort-id=06
-| | | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
-| | | |
-| | | 52:EXCHANGE [BROADCAST]
-| | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | | tuple-ids=16 row-size=8B cardinality=373 cost=490
-| | | | in pipelines: 13(GETNEXT)
-| | | |
-| | | F11:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
-| | | max-parallelism=1 segment-costs=[12536]
-| | | 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | | HDFS partitions=1/1 files=1 size=2.17MB
-| | | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
-| | | stored statistics:
-| | | table: rows=73.05K size=2.17MB
-| | | columns: all
-| | | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT)
-| | | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
-| | | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | | tuple-ids=16 row-size=8B cardinality=373 cost=12520
-| | | in pipelines: 13(GETNEXT)
+| | 54:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=25 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 20(GETNEXT)
| | |
-| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
-| | partition predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk IS NOT NULL
-| | HDFS partitions=1830/1831 files=1830 size=280.81GB
-| | predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
-| | runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk
+| | F12:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| | max-parallelism=1 segment-costs=[12536]
+| | 20:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
| | stored statistics:
-| | table: rows=4.32G size=280.96GB
-| | partitions: 1830/1830 rows=4.30G
+| | table: rows=73.05K size=2.17MB
| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=373(filtered from 1830)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
-| | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
-| | tuple-ids=14 row-size=24B cardinality=871.30M(filtered from 4.28G) cost=327240201
-| | in pipelines: 12(GETNEXT)
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| | tuple-ids=25 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 20(GETNEXT)
| |
-| 57:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)]
+| 19:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL
+| HDFS partitions=1823/1824 files=1823 size=145.67GB
+| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
+| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk
+| stored statistics:
+| table: rows=2.16G size=145.75GB
+| partitions: 1823/1823 rows=2.16G
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=23 row-size=24B cardinality=441.48M(filtered from 2.16G) cost=165021409
+| in pipelines: 19(GETNEXT)
+|
+36:HASH JOIN [INNER JOIN, PARTITIONED]
+| hash-table-id=12
+| hash predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_4.c_customer_id = tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=41,34 row-size=330B cardinality=79.98M cost=52428030
+| in pipelines: 46(GETNEXT), 51(OPEN)
+|
+|--F44:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)] hosts=10 instances=110 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=181.24MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=160 segment-costs=[149629463] cpu-comparison-result=240 [max(110 (self) vs 240 (sum children))]
+| JOIN BUILD
+| | join-table-id=12 plan-id=13 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF009[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_id
+| | mem-estimate=135.41MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=79982682
+| |
+| 53:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=147.90M cost=128783355
+| | tuple-ids=34 row-size=165B cardinality=79.98M cost=69646781
| | in pipelines: 51(GETNEXT)
| |
-| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=2.11GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=1010 segment-costs=[10017507045, 1649126185] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id,tpcds_partitioned_parquet_snap.customer_3.c_first_name,tpcds_partitioned_parquet_snap.customer_3.c_last_name,tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_3.c_birth_country,tpcds_partitioned_parquet_snap.customer_3.c_login,tpcds_partitioned_parquet_snap.customer_3.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=1.17GB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=550 segment-costs=[5417525566, 891856952] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
| 51:AGGREGATE [FINALIZE]
-| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
-| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
-| | mem-estimate=2.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=147.90M cost=8729673496
-| | in pipelines: 51(GETNEXT), 18(OPEN)
+| | output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2))
+| | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address
+| | having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), 2)) IS NOT NULL
+| | mem-estimate=1.10GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=34 row-size=165B cardinality=79.98M cost=4721057758
+| | in pipelines: 51(GETNEXT), 24(OPEN)
| |
-| 50:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)]
+| 50:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_id,tpcds_partitioned_parquet_snap.customer_3.c_first_name,tpcds_partitioned_parquet_snap.customer_3.c_last_name,tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_3.c_birth_country,tpcds_partitioned_parquet_snap.customer_3.c_login,tpcds_partitioned_parquet_snap.customer_3.c_email_address)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=1.48G cost=1287833549
-| | in pipelines: 18(GETNEXT)
+| | tuple-ids=34 row-size=165B cardinality=799.83M cost=696467808
+| | in pipelines: 24(GETNEXT)
| |
-| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=1.62GB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=1650 segment-costs=[9886347547, 16491261804] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| 23:AGGREGATE [STREAMING]
-| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
-| | mem-estimate=1.52GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=1.48G cost=8729673496
-| | in pipelines: 18(GETNEXT)
+| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=938.49MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=900 segment-costs=[5346593754, 8918569464] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 29:AGGREGATE [STREAMING]
+| | output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_list_price, tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_wholesale_cost), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_discount_amt), tpcds_partitioned_parquet_snap.catalog_sales_0.cs_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| | group by: tpcds_partitioned_parquet_snap.customer_3.c_customer_id, tpcds_partitioned_parquet_snap.customer_3.c_first_name, tpcds_partitioned_parquet_snap.customer_3.c_last_name, tpcds_partitioned_parquet_snap.customer_3.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_3.c_birth_country, tpcds_partitioned_parquet_snap.customer_3.c_login, tpcds_partitioned_parquet_snap.customer_3.c_email_address
+| | mem-estimate=844.52MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=34 row-size=165B cardinality=799.83M cost=4721057758
+| | in pipelines: 24(GETNEXT)
| |
-| 22:HASH JOIN [INNER JOIN, PARTITIONED]
+| 28:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=13
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=21,23,25 row-size=185B cardinality=1.48G cost=681235853
-| | in pipelines: 18(GETNEXT), 21(OPEN)
+| | tuple-ids=28,30,32 row-size=185B cardinality=799.83M cost=368416277
+| | in pipelines: 24(GETNEXT), 27(OPEN)
| |
-| |--F45:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
-| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
-| | | max-parallelism=1650 segment-costs=[54467197]
+| |--F45:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | | max-parallelism=900 segment-costs=[54467197]
| | JOIN BUILD
-| | | join-table-id=13 plan-id=14 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | | runtime filters: RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | | join-table-id=13 plan-id=14 cohort-id=06
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
+| | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_3.c_customer_sk
| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)]
+| | 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_3.c_customer_sk)]
| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=25 row-size=153B cardinality=30.00M cost=24467197
-| | | in pipelines: 21(GETNEXT)
+| | | tuple-ids=32 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 27(GETNEXT)
| | |
| | F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Host Shared Resources: mem-estimate=32.00MB mem-reservation=32.00MB thread-reservation=0 runtime-filters-memory=32.00MB
| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[342891999]
-| | 21:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 27:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
-| | runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF013[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF010[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF012[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| | predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_3.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF007[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id, RF006[bloom] -> tpcds_partitioned_parquet_snap.customer_3.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_3.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_3.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=25 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 21(GETNEXT)
+| | tuple-ids=32 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 27(GETNEXT)
| |
-| 48:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)]
+| 48:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk)]
| | mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=21,23 row-size=32B cardinality=1.61G cost=475438198
-| | in pipelines: 18(GETNEXT)
+| | tuple-ids=28,30 row-size=32B cardinality=871.30M cost=257119719
+| | in pipelines: 24(GETNEXT)
| |
| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=512.00KB thread-reservation=1
-| max-parallelism=373 segment-costs=[6315884965]
-| 20:HASH JOIN [INNER JOIN, BROADCAST]
+| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
+| Per-Instance Resources: mem-estimate=34.75MB mem-reservation=256.00KB thread-reservation=1
+| max-parallelism=350 segment-costs=[3401959876]
+| 26:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=14
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=21,23 row-size=32B cardinality=1.61G cost=705182309
-| | in pipelines: 18(GETNEXT), 19(OPEN)
+| | tuple-ids=28,30 row-size=32B cardinality=871.30M cost=381366658
+| | in pipelines: 24(GETNEXT), 25(OPEN)
| |
| |--F46:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
-| | | join-table-id=14 plan-id=15 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | | join-table-id=14 plan-id=15 cohort-id=06
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
+| | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 47:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=23 row-size=8B cardinality=373 cost=490
-| | | in pipelines: 19(GETNEXT)
+| | | tuple-ids=30 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 25(GETNEXT)
| | |
| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| | max-parallelism=1 segment-costs=[12536]
-| | 19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 25:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_3.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim_3.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=23 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 19(GETNEXT)
+| | tuple-ids=30 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 25(GETNEXT)
| |
-| 18:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
-| partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL
-| HDFS partitions=1823/1824 files=1823 size=389.69GB
-| predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
-| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk
+| 24:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk IS NOT NULL
+| HDFS partitions=1830/1831 files=1830 size=280.81GB
+| predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk IS NOT NULL
+| runtime filters: RF015[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk, RF016[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_sold_date_sk, RF014[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk
| stored statistics:
-| table: rows=8.64G size=389.90GB
-| partitions: 1823/1823 rows=8.25G
+| table: rows=4.32G size=280.96GB
+| partitions: 1830/1830 rows=4.30G
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=21 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220
-| in pipelines: 18(GETNEXT)
+| extrapolated-rows=disabled max-scan-range-rows=5.09M est-scan-range=373(filtered from 1830)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_bill_customer_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| tuple-ids=28 row-size=24B cardinality=871.30M(filtered from 4.28G) cost=327240201
+| in pipelines: 24(GETNEXT)
|
-65:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)]
+52:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id)]
| mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| tuple-ids=6 row-size=165B cardinality=147.90M cost=128783355
+| tuple-ids=41 row-size=165B cardinality=147.90M cost=128783355
| in pipelines: 46(GETNEXT)
|
-F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)] hosts=10 instances=120
-Per-Instance Resources: mem-estimate=2.11GB mem-reservation=34.00MB thread-reservation=1
+F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address)] hosts=10 instances=120
+Per-Instance Resources: mem-estimate=2.10GB mem-reservation=34.00MB thread-reservation=1
max-parallelism=1010 segment-costs=[10017507045, 1649126185] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
46:AGGREGATE [FINALIZE]
-| output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2))
-| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
-| having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), 2)) IS NOT NULL
+| output: sum:merge(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2))
+| group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
+| having: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), 2)) > CAST(0 AS DECIMAL(38,6))
| mem-estimate=2.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=165B cardinality=147.90M cost=8729673496
-| in pipelines: 46(GETNEXT), 00(OPEN)
+| tuple-ids=41 row-size=165B cardinality=147.90M cost=8729673496
+| in pipelines: 46(GETNEXT), 30(OPEN)
|
-45:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)]
+45:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_id,tpcds_partitioned_parquet_snap.customer_4.c_first_name,tpcds_partitioned_parquet_snap.customer_4.c_last_name,tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_4.c_birth_country,tpcds_partitioned_parquet_snap.customer_4.c_login,tpcds_partitioned_parquet_snap.customer_4.c_email_address)]
| mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| tuple-ids=6 row-size=165B cardinality=1.48G cost=1287833549
-| in pipelines: 00(GETNEXT)
+| tuple-ids=41 row-size=165B cardinality=1.48G cost=1287833549
+| in pipelines: 30(GETNEXT)
|
-F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
+F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
Per-Instance Resources: mem-estimate=1.62GB mem-reservation=34.00MB thread-reservation=1
max-parallelism=1650 segment-costs=[9886347547, 16491261804] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-05:AGGREGATE [STREAMING]
-| output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
-| group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+35:AGGREGATE [STREAMING]
+| output: sum(divide(add(subtract(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_wholesale_cost), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt), tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_sales_price), CAST(2 AS DECIMAL(3,0))))
+| group by: tpcds_partitioned_parquet_snap.customer_4.c_customer_id, tpcds_partitioned_parquet_snap.customer_4.c_first_name, tpcds_partitioned_parquet_snap.customer_4.c_last_name, tpcds_partitioned_parquet_snap.customer_4.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_4.c_birth_country, tpcds_partitioned_parquet_snap.customer_4.c_login, tpcds_partitioned_parquet_snap.customer_4.c_email_address
| mem-estimate=1.52GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=6 row-size=165B cardinality=1.48G cost=8729673496
-| in pipelines: 00(GETNEXT)
+| tuple-ids=41 row-size=165B cardinality=1.48G cost=8729673496
+| in pipelines: 30(GETNEXT)
|
-04:HASH JOIN [INNER JOIN, PARTITIONED]
+34:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=15
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4 row-size=185B cardinality=1.48G cost=681235853
-| in pipelines: 00(GETNEXT), 03(OPEN)
+| tuple-ids=35,37,39 row-size=185B cardinality=1.48G cost=681235853
+| in pipelines: 30(GETNEXT), 33(OPEN)
|
-|--F47:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
+|--F47:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
| | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
| | max-parallelism=1650 segment-costs=[54467197]
| JOIN BUILD
| | join-table-id=15 plan-id=16 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | runtime filters: RF007[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | build expressions: tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
+| | runtime filters: RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_4.c_customer_sk
| | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
-| 44:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
+| 44:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_4.c_customer_sk)]
| | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=153B cardinality=30.00M cost=24467197
-| | in pipelines: 03(GETNEXT)
+| | tuple-ids=39 row-size=153B cardinality=30.00M cost=24467197
+| | in pipelines: 33(GETNEXT)
| |
| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| Per-Host Shared Resources: mem-estimate=48.00MB mem-reservation=48.00MB thread-reservation=0 runtime-filters-memory=48.00MB
| Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| max-parallelism=10 segment-costs=[342891999]
-| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| 33:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| HDFS partitions=1/1 files=1 size=1.55GB
-| predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
-| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id
+| predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_4.c_customer_sk IS NOT NULL
+| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF009[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF007[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_4.c_customer_id, RF008[bloom] -> tpcds [...]
| stored statistics:
| table: rows=30.00M size=1.55GB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.10M
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_4.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_4.c_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=4 row-size=153B cardinality=30.00M cost=31557228
-| in pipelines: 03(GETNEXT)
+| tuple-ids=39 row-size=153B cardinality=30.00M cost=31557228
+| in pipelines: 33(GETNEXT)
|
-43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)]
+43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)]
| mem-estimate=14.69MB mem-reservation=0B thread-reservation=0
-| tuple-ids=0,2 row-size=32B cardinality=1.61G cost=475438198
-| in pipelines: 00(GETNEXT)
+| tuple-ids=35,37 row-size=32B cardinality=1.61G cost=475438198
+| in pipelines: 30(GETNEXT)
|
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
Per-Instance Resources: mem-estimate=34.75MB mem-reservation=512.00KB thread-reservation=1
max-parallelism=373 segment-costs=[6315884965]
-02:HASH JOIN [INNER JOIN, BROADCAST]
+32:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=16
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2 row-size=32B cardinality=1.61G cost=705182309
-| in pipelines: 00(GETNEXT), 01(OPEN)
+| tuple-ids=35,37 row-size=32B cardinality=1.61G cost=705182309
+| in pipelines: 30(GETNEXT), 31(OPEN)
|
|--F48:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[863]
| JOIN BUILD
| | join-table-id=16 plan-id=17 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | build expressions: tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
+| | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| |
| 42:EXCHANGE [BROADCAST]
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=2 row-size=8B cardinality=373 cost=490
-| | in pipelines: 01(GETNEXT)
+| | tuple-ids=37 row-size=8B cardinality=373 cost=490
+| | in pipelines: 31(GETNEXT)
| |
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| max-parallelism=1 segment-costs=[12536]
-| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| 31:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL
| stored statistics:
| table: rows=73.05K size=2.17MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2000 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_4.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_4.d_date_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=2 row-size=8B cardinality=373 cost=12520
-| in pipelines: 01(GETNEXT)
+| tuple-ids=37 row-size=8B cardinality=373 cost=12520
+| in pipelines: 31(GETNEXT)
|
-00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
- partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
+30:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+ partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
- predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
- runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF008[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk
+ predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
+ runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk
stored statistics:
table: rows=8.64G size=389.90GB
partitions: 1823/1823 rows=8.25G
columns: all
extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
- parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
+ parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=0 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220
- in pipelines: 00(GETNEXT)
+ tuple-ids=35 row-size=24B cardinality=1.61G(filtered from 7.88G) cost=630443220
+ in pipelines: 30(GETNEXT)
====
diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q06.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q06.test
index 959eef42b..ec794c893 100644
--- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q06.test
+++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q06.test
@@ -28,7 +28,7 @@ Max Per-Host Resource Reservation: Memory=145.44MB Threads=1
Per-Host Resource Estimates: Memory=2.86GB
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=2.86GB mem-reservation=145.44MB thread-reservation=1 runtime-filters-memory=36.00MB
-| max-parallelism=1 segment-costs=[17041, 0, 166538, 310809299, 6, 10]
+| max-parallelism=1 segment-costs=[166538, 17041, 0, 2996694588, 6, 10]
PLAN-ROOT SINK
| output exprs: tpcds_partitioned_parquet_snap.customer_address.ca_state, count()
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=10
@@ -48,22 +48,77 @@ PLAN-ROOT SINK
| in pipelines: 16(GETNEXT), 00(OPEN)
|
15:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=0,2,7,8,10,12,16 row-size=102B cardinality=118.89M cost=53491774
+| in pipelines: 00(GETNEXT), 10(OPEN)
+|
+|--14:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
+| | fk/pk conjuncts: none
+| | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq, RF011[min_max] <- tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
+| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=12,16 row-size=12B cardinality=30 cost=14
+| | in pipelines: 10(GETNEXT), 13(OPEN)
+| |
+| |--13:CARDINALITY CHECK
+| | | limit: 1
+| | | mem-estimate=0B mem-reservation=0B thread-reservation=0
+| | | tuple-ids=16 row-size=4B cardinality=1 cost=0
+| | | in pipelines: 13(GETNEXT), 12(OPEN)
+| | |
+| | 12:AGGREGATE [FINALIZE]
+| | | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
+| | | limit: 2
+| | | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| | | tuple-ids=16 row-size=4B cardinality=108 cost=313
+| | | in pipelines: 12(GETNEXT), 11(OPEN)
+| | |
+| | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
+| | stored statistics:
+| | table: rows=73.05K size=2.17MB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
+| | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| | tuple-ids=14 row-size=12B cardinality=108 cost=16728
+| | in pipelines: 11(GETNEXT)
+| |
+| 10:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| HDFS partitions=1/1 files=1 size=2.17MB
+| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_month_seq IS NOT NULL
+| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_month_seq, RF010[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_month_seq
+| stored statistics:
+| table: rows=73.05K size=2.17MB
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=73.05K
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_month_seq IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=12 row-size=8B cardinality=30(filtered from 73.05K) cost=12520
+| in pipelines: 10(GETNEXT)
+|
+09:HASH JOIN [INNER JOIN]
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
| mem-estimate=1.48GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,6,7,12,15,13 row-size=102B cardinality=118.89M cost=84763705
-| in pipelines: 00(GETNEXT), 13(OPEN)
+| tuple-ids=0,2,7,8,10 row-size=90B cardinality=124.56M(filtered from 7.23G) cost=1371769044
+| in pipelines: 00(GETNEXT), 06(OPEN)
|
-|--14:HASH JOIN [INNER JOIN]
+|--08:HASH JOIN [INNER JOIN]
| | hash predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk = tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk = tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
-| | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | fk/pk conjuncts: none
+| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF009[min_max] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
| | mem-estimate=1.22GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=15,13 row-size=26B cardinality=30.00M cost=39283500
-| | in pipelines: 13(GETNEXT), 12(OPEN)
+| | tuple-ids=8,10 row-size=26B cardinality=30.00M cost=39283500
+| | in pipelines: 06(GETNEXT), 07(OPEN)
| |
-| |--12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
| | HDFS partitions=1/1 files=1 size=1.55GB
| | predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | stored statistics:
@@ -72,47 +127,47 @@ PLAN-ROOT SINK
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=13 row-size=8B cardinality=30.00M cost=5142000
-| | in pipelines: 12(GETNEXT)
+| | tuple-ids=10 row-size=8B cardinality=30.00M cost=5142000
+| | in pipelines: 07(GETNEXT)
| |
-| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
+| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
| HDFS partitions=1/1 files=1 size=307.36MB
| predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
-| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| runtime filters: RF009[min_max] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF008[bloom] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
| stored statistics:
| table: rows=15.00M size=307.36MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=1.58M
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=15 row-size=18B cardinality=15.00M cost=1717500
-| in pipelines: 13(GETNEXT)
+| tuple-ids=8 row-size=18B cardinality=15.00M cost=1717500
+| in pipelines: 06(GETNEXT)
|
-11:HASH JOIN [INNER JOIN]
+05:HASH JOIN [INNER JOIN]
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk
-| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.item.i_item_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.item.i_item_sk
+| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.item.i_item_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.item.i_item_sk
| mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,6,7,12 row-size=76B cardinality=129.52M cost=57065341
-| in pipelines: 00(GETNEXT), 07(OPEN)
+| tuple-ids=0,2,7 row-size=64B cardinality=124.56M(filtered from 7.87G) cost=1459170622
+| in pipelines: 00(GETNEXT), 01(OPEN)
|
-|--10:HASH JOIN [INNER JOIN]
+|--04:HASH JOIN [INNER JOIN]
| | hash predicates: tpcds_partitioned_parquet_snap.item.i_category = tpcds_partitioned_parquet_snap.item_0.i_category
| | fk/pk conjuncts: none
| | other join predicates: CAST(tpcds_partitioned_parquet_snap.item.i_current_price AS DECIMAL(14,7)) > multiply(CAST(1.2 AS DECIMAL(2,1)), avg(tpcds_partitioned_parquet_snap.item_0.i_current_price))
-| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.item_0.i_category, RF009[min_max] <- tpcds_partitioned_parquet_snap.item_0.i_category
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.item_0.i_category, RF007[min_max] <- tpcds_partitioned_parquet_snap.item_0.i_category
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=7,12 row-size=52B cardinality=360.00K cost=157240
-| | in pipelines: 07(GETNEXT), 09(OPEN)
+| | tuple-ids=2,7 row-size=52B cardinality=360.00K cost=157240
+| | in pipelines: 01(GETNEXT), 03(OPEN)
| |
-| |--09:AGGREGATE [FINALIZE]
+| |--03:AGGREGATE [FINALIZE]
| | | output: avg(tpcds_partitioned_parquet_snap.item_0.i_current_price)
| | | group by: tpcds_partitioned_parquet_snap.item_0.i_category
| | | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=12 row-size=26B cardinality=10 cost=105075
-| | | in pipelines: 09(GETNEXT), 08(OPEN)
+| | | tuple-ids=7 row-size=26B cardinality=10 cost=105075
+| | | in pipelines: 03(GETNEXT), 02(OPEN)
| | |
-| | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
+| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
| | HDFS partitions=1/1 files=1 size=33.54MB
| | predicates: tpcds_partitioned_parquet_snap.item_0.i_category IS NOT NULL
| | stored statistics:
@@ -121,82 +176,27 @@ PLAN-ROOT SINK
| | extrapolated-rows=disabled max-scan-range-rows=101.54K
| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_0.i_category IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=9 row-size=22B cardinality=359.14K cost=61463
-| | in pipelines: 08(GETNEXT)
+| | tuple-ids=4 row-size=22B cardinality=359.14K cost=61463
+| | in pipelines: 02(GETNEXT)
| |
-| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
+| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item]
| HDFS partitions=1/1 files=1 size=33.54MB
| predicates: tpcds_partitioned_parquet_snap.item.i_current_price IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL
-| runtime filters: RF009[min_max] -> tpcds_partitioned_parquet_snap.item.i_category, RF008[bloom] -> tpcds_partitioned_parquet_snap.item.i_category
+| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.item.i_category, RF006[bloom] -> tpcds_partitioned_parquet_snap.item.i_category
| stored statistics:
| table: rows=360.00K size=33.54MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=101.54K
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_current_price IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=7 row-size=26B cardinality=358.67K cost=102431
-| in pipelines: 07(GETNEXT)
-|
-06:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2,6 row-size=24B cardinality=129.58M cost=56717105
-| in pipelines: 00(GETNEXT), 01(OPEN)
-|
-|--05:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
-| | fk/pk conjuncts: none
-| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq, RF007[min_max] <- tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
-| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=2,6 row-size=12B cardinality=30 cost=14
-| | in pipelines: 01(GETNEXT), 04(OPEN)
-| |
-| |--04:CARDINALITY CHECK
-| | | limit: 1
-| | | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=1 cost=0
-| | | in pipelines: 04(GETNEXT), 03(OPEN)
-| | |
-| | 03:AGGREGATE [FINALIZE]
-| | | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
-| | | limit: 2
-| | | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=108 cost=313
-| | | in pipelines: 03(GETNEXT), 02(OPEN)
-| | |
-| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
-| | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
-| | tuple-ids=4 row-size=12B cardinality=108 cost=16728
-| | in pipelines: 02(GETNEXT)
-| |
-| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_month_seq IS NOT NULL
-| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_month_seq, RF006[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_month_seq
-| stored statistics:
-| table: rows=73.05K size=2.17MB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_month_seq IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=2 row-size=8B cardinality=30(filtered from 73.05K) cost=12520
+| tuple-ids=2 row-size=26B cardinality=358.67K cost=102431
| in pipelines: 01(GETNEXT)
|
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL
- runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk
+ runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk
stored statistics:
table: rows=8.64G size=389.90GB
partitions: 1823/1823 rows=8.25G
@@ -204,50 +204,51 @@ PLAN-ROOT SINK
extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=30(filtered from 1823)
parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=0 row-size=12B cardinality=129.58M(filtered from 7.88G) cost=31072113
+ tuple-ids=0 row-size=12B cardinality=124.56M(filtered from 7.88G) cost=31072113
in pipelines: 00(GETNEXT)
---- DISTRIBUTEDPLAN
-Max Per-Host Resource Reservation: Memory=651.81MB Threads=33
-Per-Host Resource Estimates: Memory=1.32GB
-F13:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
+Max Per-Host Resource Reservation: Memory=995.81MB Threads=30
+Per-Host Resource Estimates: Memory=2.60GB
+F12:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=4.02MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[11] cpu-comparison-result=140 [max(1 (self) vs 140 (sum children))]
+| max-parallelism=1 segment-costs=[11] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
PLAN-ROOT SINK
| output exprs: tpcds_partitioned_parquet_snap.customer_address.ca_state, count()
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=10
|
-33:MERGING-EXCHANGE [UNPARTITIONED]
+32:MERGING-EXCHANGE [UNPARTITIONED]
| order by: count() ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_address.ca_state ASC NULLS LAST
| limit: 100
| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
| tuple-ids=18 row-size=22B cardinality=5 cost=1
| in pipelines: 17(GETNEXT)
|
-F12:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_state)] hosts=10 instances=10 (adjusted from 120)
-Per-Instance Resources: mem-estimate=10.52MB mem-reservation=1.94MB thread-reservation=1
-max-parallelism=10 segment-costs=[3222, 6, 4] cpu-comparison-result=140 [max(10 (self) vs 140 (sum children))]
+F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_state)] hosts=10 instances=10 (adjusted from 120)
+Per-Instance Resources: mem-estimate=13.06MB mem-reservation=1.94MB thread-reservation=1
+max-parallelism=10 segment-costs=[3222, 6, 4] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
17:TOP-N [LIMIT=100]
| order by: count() ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_address.ca_state ASC NULLS LAST
| mem-estimate=110B mem-reservation=0B thread-reservation=0
| tuple-ids=18 row-size=22B cardinality=5 cost=6
-| in pipelines: 17(GETNEXT), 32(OPEN)
+| in pipelines: 17(GETNEXT), 31(OPEN)
|
-32:AGGREGATE [FINALIZE]
+31:AGGREGATE [FINALIZE]
| output: count:merge()
| group by: tpcds_partitioned_parquet_snap.customer_address.ca_state
| having: count() >= CAST(10 AS BIGINT)
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
| tuple-ids=17 row-size=22B cardinality=5 cost=1923
-| in pipelines: 32(GETNEXT), 00(OPEN)
+| in pipelines: 31(GETNEXT), 00(OPEN)
|
-31:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_state)]
-| mem-estimate=533.15KB mem-reservation=0B thread-reservation=0
+30:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_state)]
+| mem-estimate=3.06MB mem-reservation=0B thread-reservation=0
| tuple-ids=17 row-size=22B cardinality=6.12K cost=1299
| in pipelines: 00(GETNEXT)
|
-F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=20 (adjusted from 120)
-Per-Instance Resources: mem-estimate=32.24MB mem-reservation=2.00MB thread-reservation=1
-max-parallelism=20 segment-costs=[168174460, 11823] cpu-comparison-result=140 [max(140 (self) vs 65 (sum children))]
+F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+Per-Host Shared Resources: mem-estimate=18.00MB mem-reservation=18.00MB thread-reservation=0 runtime-filters-memory=18.00MB
+Per-Instance Resources: mem-estimate=27.02MB mem-reservation=2.50MB thread-reservation=1
+max-parallelism=1050 segment-costs=[10421290131, 11823] cpu-comparison-result=120 [max(120 (self) vs 55 (sum children))]
16:AGGREGATE [STREAMING]
| output: count()
| group by: tpcds_partitioned_parquet_snap.customer_address.ca_state
@@ -255,57 +256,171 @@ max-parallelism=20 segment-costs=[168174460, 11823] cpu-comparison-result=140 [m
| tuple-ids=17 row-size=22B cardinality=6.12K cost=34791653
| in pipelines: 00(GETNEXT)
|
-15:HASH JOIN [INNER JOIN, PARTITIONED]
+15:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=00
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=0,2,7,8,10,12,16 row-size=102B cardinality=118.89M cost=1875676278
+| in pipelines: 00(GETNEXT), 10(OPEN)
+|
+|--F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | max-parallelism=10 segment-costs=[60] cpu-comparison-result=11 [max(11 (self) vs 1 (sum children))]
+| JOIN BUILD
+| | join-table-id=00 plan-id=01 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=30
+| |
+| 29:EXCHANGE [BROADCAST]
+| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=12,16 row-size=12B cardinality=30 cost=30
+| | in pipelines: 10(GETNEXT)
+| |
+| F07:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
+| Per-Instance Resources: mem-estimate=16.08MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[12535]
+| 14:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=01
+| | hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
+| | fk/pk conjuncts: none
+| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=12,16 row-size=12B cardinality=30 cost=13
+| | in pipelines: 10(GETNEXT), 13(OPEN)
+| |
+| |--F14:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | | max-parallelism=1 segment-costs=[1] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
+| | JOIN BUILD
+| | | join-table-id=01 plan-id=02 cohort-id=02
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
+| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq, RF011[min_max] <- tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
+| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=1
+| | |
+| | 28:EXCHANGE [BROADCAST]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=16 row-size=4B cardinality=1 cost=0
+| | | in pipelines: 13(GETNEXT)
+| | |
+| | F10:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=32.00KB mem-reservation=0B thread-reservation=1
+| | max-parallelism=1 segment-costs=[0, 0] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
+| | 13:CARDINALITY CHECK
+| | | limit: 1
+| | | mem-estimate=0B mem-reservation=0B thread-reservation=0
+| | | tuple-ids=16 row-size=4B cardinality=1 cost=0
+| | | in pipelines: 13(GETNEXT), 26(OPEN)
+| | |
+| | 27:EXCHANGE [UNPARTITIONED]
+| | | limit: 2
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=16 row-size=4B cardinality=2 cost=0
+| | | in pipelines: 26(GETNEXT)
+| | |
+| | F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq)] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=10.03MB mem-reservation=1.94MB thread-reservation=1
+| | max-parallelism=1 segment-costs=[5, 1] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
+| | 26:AGGREGATE [FINALIZE]
+| | | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
+| | | limit: 2
+| | | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| | | tuple-ids=16 row-size=4B cardinality=2 cost=5
+| | | in pipelines: 26(GETNEXT), 11(OPEN)
+| | |
+| | 25:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq)]
+| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=16 row-size=4B cardinality=2 cost=0
+| | | in pipelines: 11(GETNEXT)
+| | |
+| | F08:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | Per-Instance Resources: mem-estimate=26.03MB mem-reservation=2.25MB thread-reservation=1
+| | max-parallelism=1 segment-costs=[16764, 1]
+| | 12:AGGREGATE [STREAMING]
+| | | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
+| | | limit: 2
+| | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
+| | | tuple-ids=16 row-size=4B cardinality=2 cost=36
+| | | in pipelines: 11(GETNEXT)
+| | |
+| | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | HDFS partitions=1/1 files=1 size=2.17MB
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
+| | stored statistics:
+| | table: rows=73.05K size=2.17MB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=73.05K
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
+| | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
+| | tuple-ids=14 row-size=12B cardinality=108 cost=16728
+| | in pipelines: 11(GETNEXT)
+| |
+| 10:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| HDFS partitions=1/1 files=1 size=2.17MB
+| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_month_seq IS NOT NULL
+| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_month_seq, RF010[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_month_seq
+| stored statistics:
+| table: rows=73.05K size=2.17MB
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=73.05K
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_month_seq IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=12 row-size=8B cardinality=30(filtered from 73.05K) cost=12520
+| in pipelines: 10(GETNEXT)
+|
+09:HASH JOIN [INNER JOIN, BROADCAST]
+| hash-table-id=02
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,6,7,12,15,13 row-size=102B cardinality=118.89M cost=54763705
-| in pipelines: 00(GETNEXT), 13(OPEN)
+| tuple-ids=0,2,7,8,10 row-size=90B cardinality=7.23G cost=3252298079
+| in pipelines: 00(GETNEXT), 06(OPEN)
|
-|--F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=20 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=101.93MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | max-parallelism=20 segment-costs=[38025000] cpu-comparison-result=40 [max(40 (self) vs 20 (sum children))]
+|--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=1.50GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=10 segment-costs=[69869990] cpu-comparison-result=30 [max(30 (self) vs 20 (sum children))]
| JOIN BUILD
-| | join-table-id=00 plan-id=01 cohort-id=01
+| | join-table-id=02 plan-id=03 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | mem-estimate=75.59MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | mem-estimate=1.48GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
-| 30:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
+| 24:EXCHANGE [BROADCAST]
| | mem-estimate=10.33MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=15,13 row-size=26B cardinality=30.00M cost=8025000
-| | in pipelines: 13(GETNEXT)
+| | tuple-ids=8,10 row-size=26B cardinality=30.00M cost=39869990
+| | in pipelines: 06(GETNEXT)
| |
-| F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] hosts=10 instances=10
-| Per-Instance Resources: mem-estimate=12.87MB mem-reservation=0B thread-reservation=1
-| max-parallelism=10 segment-costs=[93336000]
-| 14:HASH JOIN [INNER JOIN, PARTITIONED]
-| | hash-table-id=01
+| F06:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] hosts=10 instances=10
+| Per-Instance Resources: mem-estimate=10.35MB mem-reservation=0B thread-reservation=1
+| max-parallelism=10 segment-costs=[15594000]
+| 08:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=03
| | hash predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk = tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk = tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | fk/pk conjuncts: none
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=15,13 row-size=26B cardinality=30.00M cost=9283500
-| | in pipelines: 13(GETNEXT), 12(OPEN)
+| | tuple-ids=8,10 row-size=26B cardinality=30.00M cost=9283500
+| | in pipelines: 06(GETNEXT), 07(OPEN)
| |
-| |--F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] hosts=10 instances=10
+| |--F16:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=151.22MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
| | | max-parallelism=10 segment-costs=[34437000]
| | JOIN BUILD
-| | | join-table-id=01 plan-id=02 cohort-id=02
+| | | join-table-id=03 plan-id=04 cohort-id=03
| | | build expressions: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
-| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF009[min_max] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
| | | mem-estimate=125.11MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 28:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)]
+| | 23:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)]
| | | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=13 row-size=8B cardinality=30.00M cost=4437000
-| | | in pipelines: 12(GETNEXT)
+| | | tuple-ids=10 row-size=8B cardinality=30.00M cost=4437000
+| | | in pipelines: 07(GETNEXT)
| | |
-| | F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=16.47MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[36054000]
-| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
| | predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | stored statistics:
@@ -314,115 +429,106 @@ max-parallelism=20 segment-costs=[168174460, 11823] cpu-comparison-result=140 [m
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=13 row-size=8B cardinality=30.00M cost=5142000
-| | in pipelines: 12(GETNEXT)
+| | tuple-ids=10 row-size=8B cardinality=30.00M cost=5142000
+| | in pipelines: 07(GETNEXT)
| |
-| 27:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)]
+| 22:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)]
| | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=15 row-size=18B cardinality=15.00M cost=2908500
-| | in pipelines: 13(GETNEXT)
+| | tuple-ids=8 row-size=18B cardinality=15.00M cost=2908500
+| | in pipelines: 06(GETNEXT)
| |
-| F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
| Per-Instance Resources: mem-estimate=16.86MB mem-reservation=128.00KB thread-reservation=1
| max-parallelism=10 segment-costs=[26833500]
-| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
+| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
| HDFS partitions=1/1 files=1 size=307.36MB
| predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
-| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| runtime filters: RF009[min_max] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF008[bloom] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
| stored statistics:
| table: rows=15.00M size=307.36MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=1.58M
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=15 row-size=18B cardinality=15.00M cost=1717500
-| in pipelines: 13(GETNEXT)
+| tuple-ids=8 row-size=18B cardinality=15.00M cost=1717500
+| in pipelines: 06(GETNEXT)
|
-29:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)]
-| mem-estimate=21.23MB mem-reservation=0B thread-reservation=0
-| tuple-ids=0,2,6,7,12 row-size=76B cardinality=129.52M cost=78619102
-| in pipelines: 00(GETNEXT)
-|
-F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-Per-Host Shared Resources: mem-estimate=18.00MB mem-reservation=18.00MB thread-reservation=0 runtime-filters-memory=18.00MB
-Per-Instance Resources: mem-estimate=23.49MB mem-reservation=512.00KB thread-reservation=1
-max-parallelism=490 segment-costs=[4877793238]
-11:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=02
+05:HASH JOIN [INNER JOIN, BROADCAST]
+| hash-table-id=04
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,6,7,12 row-size=76B cardinality=129.52M cost=56705341
-| in pipelines: 00(GETNEXT), 07(OPEN)
+| tuple-ids=0,2,7 row-size=64B cardinality=7.57G(filtered from 7.87G) cost=3369339657
+| in pipelines: 00(GETNEXT), 01(OPEN)
|
-|--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+|--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=419.23MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[838440] cpu-comparison-result=14 [max(14 (self) vs 4 (sum children))]
| JOIN BUILD
-| | join-table-id=02 plan-id=03 cohort-id=01
+| | join-table-id=04 plan-id=05 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.item.i_item_sk
-| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.item.i_item_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.item.i_item_sk
+| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.item.i_item_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.item.i_item_sk
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
| |
-| 26:EXCHANGE [BROADCAST]
+| 21:EXCHANGE [BROADCAST]
| | mem-estimate=10.23MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=7,12 row-size=52B cardinality=360.00K cost=478440
-| | in pipelines: 07(GETNEXT)
+| | tuple-ids=2,7 row-size=52B cardinality=360.00K cost=478440
+| | in pipelines: 01(GETNEXT)
| |
-| F05:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
+| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
| Per-Instance Resources: mem-estimate=16.23MB mem-reservation=512.00KB thread-reservation=1
| max-parallelism=4 segment-costs=[325572]
-| 10:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=03
+| 04:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=05
| | hash predicates: tpcds_partitioned_parquet_snap.item.i_category = tpcds_partitioned_parquet_snap.item_0.i_category
| | fk/pk conjuncts: none
| | other join predicates: CAST(tpcds_partitioned_parquet_snap.item.i_current_price AS DECIMAL(14,7)) > multiply(CAST(1.2 AS DECIMAL(2,1)), avg(tpcds_partitioned_parquet_snap.item_0.i_current_price))
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=7,12 row-size=52B cardinality=360.00K cost=157230
-| | in pipelines: 07(GETNEXT), 24(OPEN)
+| | tuple-ids=2,7 row-size=52B cardinality=360.00K cost=157230
+| | in pipelines: 01(GETNEXT), 19(OPEN)
| |
-| |--F17:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
+| |--F18:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
| | | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=4 segment-costs=[14] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
| | JOIN BUILD
-| | | join-table-id=03 plan-id=04 cohort-id=03
+| | | join-table-id=05 plan-id=06 cohort-id=04
| | | build expressions: tpcds_partitioned_parquet_snap.item_0.i_category
-| | | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.item_0.i_category, RF009[min_max] <- tpcds_partitioned_parquet_snap.item_0.i_category
+| | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.item_0.i_category, RF007[min_max] <- tpcds_partitioned_parquet_snap.item_0.i_category
| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=10
| | |
-| | 25:EXCHANGE [BROADCAST]
+| | 20:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=12 row-size=26B cardinality=10 cost=4
-| | | in pipelines: 24(GETNEXT)
+| | | tuple-ids=7 row-size=26B cardinality=10 cost=4
+| | | in pipelines: 19(GETNEXT)
| | |
-| | F07:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category)] hosts=4 instances=4
+| | F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category)] hosts=4 instances=4
| | Per-Instance Resources: mem-estimate=10.12MB mem-reservation=1.94MB thread-reservation=1
| | max-parallelism=4 segment-costs=[46, 0] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
-| | 24:AGGREGATE [FINALIZE]
+| | 19:AGGREGATE [FINALIZE]
| | | output: avg:merge(tpcds_partitioned_parquet_snap.item_0.i_current_price)
| | | group by: tpcds_partitioned_parquet_snap.item_0.i_category
| | | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=12 row-size=26B cardinality=10 cost=37
-| | | in pipelines: 24(GETNEXT), 08(OPEN)
+| | | tuple-ids=7 row-size=26B cardinality=10 cost=37
+| | | in pipelines: 19(GETNEXT), 02(OPEN)
| | |
-| | 23:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_category)]
+| | 18:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_category)]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=11 row-size=26B cardinality=40 cost=9
-| | | in pipelines: 08(GETNEXT)
+| | | tuple-ids=6 row-size=26B cardinality=40 cost=9
+| | | in pipelines: 02(GETNEXT)
| | |
-| | F06:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
+| | F02:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
| | Per-Instance Resources: mem-estimate=26.47MB mem-reservation=2.50MB thread-reservation=1
| | max-parallelism=4 segment-costs=[166617, 87]
-| | 09:AGGREGATE [STREAMING]
+| | 03:AGGREGATE [STREAMING]
| | | output: avg(tpcds_partitioned_parquet_snap.item_0.i_current_price)
| | | group by: tpcds_partitioned_parquet_snap.item_0.i_category
| | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=11 row-size=26B cardinality=40 cost=105154
-| | | in pipelines: 08(GETNEXT)
+| | | tuple-ids=6 row-size=26B cardinality=40 cost=105154
+| | | in pipelines: 02(GETNEXT)
| | |
-| | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
+| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
| | HDFS partitions=1/1 files=1 size=33.54MB
| | predicates: tpcds_partitioned_parquet_snap.item_0.i_category IS NOT NULL
| | stored statistics:
@@ -431,111 +537,175 @@ max-parallelism=490 segment-costs=[4877793238]
| | extrapolated-rows=disabled max-scan-range-rows=101.54K
| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_0.i_category IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=9 row-size=22B cardinality=359.14K cost=61463
-| | in pipelines: 08(GETNEXT)
+| | tuple-ids=4 row-size=22B cardinality=359.14K cost=61463
+| | in pipelines: 02(GETNEXT)
| |
-| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
+| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
| HDFS partitions=1/1 files=1 size=33.54MB
| predicates: tpcds_partitioned_parquet_snap.item.i_current_price IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL
-| runtime filters: RF009[min_max] -> tpcds_partitioned_parquet_snap.item.i_category, RF008[bloom] -> tpcds_partitioned_parquet_snap.item.i_category
+| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.item.i_category, RF006[bloom] -> tpcds_partitioned_parquet_snap.item.i_category
| stored statistics:
| table: rows=360.00K size=33.54MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=101.54K
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_current_price IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=7 row-size=26B cardinality=358.67K cost=102431
-| in pipelines: 07(GETNEXT)
+| tuple-ids=2 row-size=26B cardinality=358.67K cost=102431
+| in pipelines: 01(GETNEXT)
|
-06:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=04
+00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+ partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
+ HDFS partitions=1823/1824 files=1823 size=389.69GB
+ predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL
+ runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk
+ stored statistics:
+ table: rows=8.64G size=389.90GB
+ partitions: 1823/1823 rows=8.25G
+ columns: all
+ extrapolated-rows=disabled max-scan-range-rows=12.22M
+ parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL
+ mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+ tuple-ids=0 row-size=12B cardinality=7.57G(filtered from 7.88G) cost=1889184464
+ in pipelines: 00(GETNEXT)
+---- PARALLELPLANS
+Max Per-Host Resource Reservation: Memory=995.81MB Threads=30
+Per-Host Resource Estimates: Memory=2.60GB
+F12:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
+| Per-Instance Resources: mem-estimate=4.02MB mem-reservation=4.00MB thread-reservation=1
+| max-parallelism=1 segment-costs=[11] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
+PLAN-ROOT SINK
+| output exprs: tpcds_partitioned_parquet_snap.customer_address.ca_state, count()
+| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=10
+|
+32:MERGING-EXCHANGE [UNPARTITIONED]
+| order by: count() ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_address.ca_state ASC NULLS LAST
+| limit: 100
+| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| tuple-ids=18 row-size=22B cardinality=5 cost=1
+| in pipelines: 17(GETNEXT)
+|
+F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_state)] hosts=10 instances=10 (adjusted from 120)
+Per-Instance Resources: mem-estimate=13.06MB mem-reservation=1.94MB thread-reservation=1
+max-parallelism=10 segment-costs=[3222, 6, 4] cpu-comparison-result=120 [max(10 (self) vs 120 (sum children))]
+17:TOP-N [LIMIT=100]
+| order by: count() ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_address.ca_state ASC NULLS LAST
+| mem-estimate=110B mem-reservation=0B thread-reservation=0
+| tuple-ids=18 row-size=22B cardinality=5 cost=6
+| in pipelines: 17(GETNEXT), 31(OPEN)
+|
+31:AGGREGATE [FINALIZE]
+| output: count:merge()
+| group by: tpcds_partitioned_parquet_snap.customer_address.ca_state
+| having: count() >= CAST(10 AS BIGINT)
+| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=17 row-size=22B cardinality=5 cost=1923
+| in pipelines: 31(GETNEXT), 00(OPEN)
+|
+30:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_state)]
+| mem-estimate=3.06MB mem-reservation=0B thread-reservation=0
+| tuple-ids=17 row-size=22B cardinality=6.12K cost=1299
+| in pipelines: 00(GETNEXT)
+|
+F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+Per-Host Shared Resources: mem-estimate=18.00MB mem-reservation=18.00MB thread-reservation=0 runtime-filters-memory=18.00MB
+Per-Instance Resources: mem-estimate=27.02MB mem-reservation=2.50MB thread-reservation=1
+max-parallelism=1050 segment-costs=[10421290131, 11823] cpu-comparison-result=120 [max(120 (self) vs 55 (sum children))]
+16:AGGREGATE [STREAMING]
+| output: count()
+| group by: tpcds_partitioned_parquet_snap.customer_address.ca_state
+| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=17 row-size=22B cardinality=6.12K cost=34791653
+| in pipelines: 00(GETNEXT)
+|
+15:HASH JOIN [INNER JOIN, BROADCAST]
+| hash-table-id=00
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2,6 row-size=24B cardinality=129.58M cost=1965957540
-| in pipelines: 00(GETNEXT), 01(OPEN)
+| tuple-ids=0,2,7,8,10,12,16 row-size=102B cardinality=118.89M cost=1875676278
+| in pipelines: 00(GETNEXT), 10(OPEN)
|
-|--F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+|--F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[60] cpu-comparison-result=11 [max(11 (self) vs 1 (sum children))]
| JOIN BUILD
-| | join-table-id=04 plan-id=05 cohort-id=01
+| | join-table-id=00 plan-id=01 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=30
| |
-| 22:EXCHANGE [BROADCAST]
+| 29:EXCHANGE [BROADCAST]
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=2,6 row-size=12B cardinality=30 cost=30
-| | in pipelines: 01(GETNEXT)
+| | tuple-ids=12,16 row-size=12B cardinality=30 cost=30
+| | in pipelines: 10(GETNEXT)
| |
-| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| F07:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
| Per-Instance Resources: mem-estimate=16.08MB mem-reservation=512.00KB thread-reservation=1
| max-parallelism=1 segment-costs=[12535]
-| 05:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=05
+| 14:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=01
| | hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
| | fk/pk conjuncts: none
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=2,6 row-size=12B cardinality=30 cost=13
-| | in pipelines: 01(GETNEXT), 04(OPEN)
+| | tuple-ids=12,16 row-size=12B cardinality=30 cost=13
+| | in pipelines: 10(GETNEXT), 13(OPEN)
| |
-| |--F19:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| |--F14:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=1 segment-costs=[1] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
| | JOIN BUILD
-| | | join-table-id=05 plan-id=06 cohort-id=04
+| | | join-table-id=01 plan-id=02 cohort-id=02
| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
-| | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq, RF007[min_max] <- tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
+| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq, RF011[min_max] <- tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=1
| | |
-| | 21:EXCHANGE [BROADCAST]
+| | 28:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=1 cost=0
-| | | in pipelines: 04(GETNEXT)
+| | | tuple-ids=16 row-size=4B cardinality=1 cost=0
+| | | in pipelines: 13(GETNEXT)
| | |
-| | F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
+| | F10:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=32.00KB mem-reservation=0B thread-reservation=1
| | max-parallelism=1 segment-costs=[0, 0] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
-| | 04:CARDINALITY CHECK
+| | 13:CARDINALITY CHECK
| | | limit: 1
| | | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=1 cost=0
-| | | in pipelines: 04(GETNEXT), 19(OPEN)
+| | | tuple-ids=16 row-size=4B cardinality=1 cost=0
+| | | in pipelines: 13(GETNEXT), 26(OPEN)
| | |
-| | 20:EXCHANGE [UNPARTITIONED]
+| | 27:EXCHANGE [UNPARTITIONED]
| | | limit: 2
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=2 cost=0
-| | | in pipelines: 19(GETNEXT)
+| | | tuple-ids=16 row-size=4B cardinality=2 cost=0
+| | | in pipelines: 26(GETNEXT)
| | |
-| | F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq)] hosts=1 instances=1
+| | F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq)] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=10.03MB mem-reservation=1.94MB thread-reservation=1
| | max-parallelism=1 segment-costs=[5, 1] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
-| | 19:AGGREGATE [FINALIZE]
+| | 26:AGGREGATE [FINALIZE]
| | | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
| | | limit: 2
| | | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=2 cost=5
-| | | in pipelines: 19(GETNEXT), 02(OPEN)
+| | | tuple-ids=16 row-size=4B cardinality=2 cost=5
+| | | in pipelines: 26(GETNEXT), 11(OPEN)
| | |
-| | 18:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq)]
+| | 25:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq)]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=2 cost=0
-| | | in pipelines: 02(GETNEXT)
+| | | tuple-ids=16 row-size=4B cardinality=2 cost=0
+| | | in pipelines: 11(GETNEXT)
| | |
-| | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| | F08:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=26.03MB mem-reservation=2.25MB thread-reservation=1
| | max-parallelism=1 segment-costs=[16764, 1]
-| | 03:AGGREGATE [STREAMING]
+| | 12:AGGREGATE [STREAMING]
| | | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
| | | limit: 2
| | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=2 cost=36
-| | | in pipelines: 02(GETNEXT)
+| | | tuple-ids=16 row-size=4B cardinality=2 cost=36
+| | | in pipelines: 11(GETNEXT)
| | |
-| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 11:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
| | stored statistics:
@@ -545,136 +715,73 @@ max-parallelism=490 segment-costs=[4877793238]
| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
| | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
-| | tuple-ids=4 row-size=12B cardinality=108 cost=16728
-| | in pipelines: 02(GETNEXT)
+| | tuple-ids=14 row-size=12B cardinality=108 cost=16728
+| | in pipelines: 11(GETNEXT)
| |
-| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| 10:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| HDFS partitions=1/1 files=1 size=2.17MB
| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_month_seq IS NOT NULL
-| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_month_seq, RF006[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_month_seq
+| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_month_seq, RF010[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_month_seq
| stored statistics:
| table: rows=73.05K size=2.17MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=73.05K
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_month_seq IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=2 row-size=8B cardinality=30(filtered from 73.05K) cost=12520
-| in pipelines: 01(GETNEXT)
+| tuple-ids=12 row-size=8B cardinality=30(filtered from 73.05K) cost=12520
+| in pipelines: 10(GETNEXT)
|
-00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
- partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
- HDFS partitions=1823/1824 files=1823 size=389.69GB
- predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL
- runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk
- stored statistics:
- table: rows=8.64G size=389.90GB
- partitions: 1823/1823 rows=8.25G
- columns: all
- extrapolated-rows=disabled max-scan-range-rows=12.22M
- parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL
- mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=0 row-size=12B cardinality=7.57G(filtered from 7.88G) cost=1889184464
- in pipelines: 00(GETNEXT)
----- PARALLELPLANS
-Max Per-Host Resource Reservation: Memory=651.81MB Threads=33
-Per-Host Resource Estimates: Memory=1.32GB
-F13:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=4.02MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[11] cpu-comparison-result=140 [max(1 (self) vs 140 (sum children))]
-PLAN-ROOT SINK
-| output exprs: tpcds_partitioned_parquet_snap.customer_address.ca_state, count()
-| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=10
-|
-33:MERGING-EXCHANGE [UNPARTITIONED]
-| order by: count() ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_address.ca_state ASC NULLS LAST
-| limit: 100
-| mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| tuple-ids=18 row-size=22B cardinality=5 cost=1
-| in pipelines: 17(GETNEXT)
-|
-F12:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_state)] hosts=10 instances=10 (adjusted from 120)
-Per-Instance Resources: mem-estimate=10.52MB mem-reservation=1.94MB thread-reservation=1
-max-parallelism=10 segment-costs=[3222, 6, 4] cpu-comparison-result=140 [max(10 (self) vs 140 (sum children))]
-17:TOP-N [LIMIT=100]
-| order by: count() ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_address.ca_state ASC NULLS LAST
-| mem-estimate=110B mem-reservation=0B thread-reservation=0
-| tuple-ids=18 row-size=22B cardinality=5 cost=6
-| in pipelines: 17(GETNEXT), 32(OPEN)
-|
-32:AGGREGATE [FINALIZE]
-| output: count:merge()
-| group by: tpcds_partitioned_parquet_snap.customer_address.ca_state
-| having: count() >= CAST(10 AS BIGINT)
-| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=17 row-size=22B cardinality=5 cost=1923
-| in pipelines: 32(GETNEXT), 00(OPEN)
-|
-31:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_state)]
-| mem-estimate=533.15KB mem-reservation=0B thread-reservation=0
-| tuple-ids=17 row-size=22B cardinality=6.12K cost=1299
-| in pipelines: 00(GETNEXT)
-|
-F11:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=20 (adjusted from 120)
-Per-Instance Resources: mem-estimate=32.24MB mem-reservation=2.00MB thread-reservation=1
-max-parallelism=20 segment-costs=[168174460, 11823] cpu-comparison-result=140 [max(140 (self) vs 65 (sum children))]
-16:AGGREGATE [STREAMING]
-| output: count()
-| group by: tpcds_partitioned_parquet_snap.customer_address.ca_state
-| mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=17 row-size=22B cardinality=6.12K cost=34791653
-| in pipelines: 00(GETNEXT)
-|
-15:HASH JOIN [INNER JOIN, PARTITIONED]
-| hash-table-id=00
+09:HASH JOIN [INNER JOIN, BROADCAST]
+| hash-table-id=02
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,6,7,12,15,13 row-size=102B cardinality=118.89M cost=54763705
-| in pipelines: 00(GETNEXT), 13(OPEN)
+| tuple-ids=0,2,7,8,10 row-size=90B cardinality=7.23G cost=3252298079
+| in pipelines: 00(GETNEXT), 06(OPEN)
|
-|--F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=20 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=101.93MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | max-parallelism=20 segment-costs=[38025000] cpu-comparison-result=40 [max(40 (self) vs 20 (sum children))]
+|--F15:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=1.50GB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=10 segment-costs=[69869990] cpu-comparison-result=30 [max(30 (self) vs 20 (sum children))]
| JOIN BUILD
-| | join-table-id=00 plan-id=01 cohort-id=01
+| | join-table-id=02 plan-id=03 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | mem-estimate=75.59MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | mem-estimate=1.48GB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
-| 30:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
+| 24:EXCHANGE [BROADCAST]
| | mem-estimate=10.33MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=15,13 row-size=26B cardinality=30.00M cost=8025000
-| | in pipelines: 13(GETNEXT)
+| | tuple-ids=8,10 row-size=26B cardinality=30.00M cost=39869990
+| | in pipelines: 06(GETNEXT)
| |
-| F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] hosts=10 instances=10
-| Per-Instance Resources: mem-estimate=12.87MB mem-reservation=0B thread-reservation=1
-| max-parallelism=10 segment-costs=[93336000]
-| 14:HASH JOIN [INNER JOIN, PARTITIONED]
-| | hash-table-id=01
+| F06:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] hosts=10 instances=10
+| Per-Instance Resources: mem-estimate=10.35MB mem-reservation=0B thread-reservation=1
+| max-parallelism=10 segment-costs=[15594000]
+| 08:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=03
| | hash predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk = tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk = tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | fk/pk conjuncts: none
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=15,13 row-size=26B cardinality=30.00M cost=9283500
-| | in pipelines: 13(GETNEXT), 12(OPEN)
+| | tuple-ids=8,10 row-size=26B cardinality=30.00M cost=9283500
+| | in pipelines: 06(GETNEXT), 07(OPEN)
| |
-| |--F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] hosts=10 instances=10
+| |--F16:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=151.22MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
| | | max-parallelism=10 segment-costs=[34437000]
| | JOIN BUILD
-| | | join-table-id=01 plan-id=02 cohort-id=02
+| | | join-table-id=03 plan-id=04 cohort-id=03
| | | build expressions: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
-| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF009[min_max] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
| | | mem-estimate=125.11MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 28:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)]
+| | 23:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)]
| | | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=13 row-size=8B cardinality=30.00M cost=4437000
-| | | in pipelines: 12(GETNEXT)
+| | | tuple-ids=10 row-size=8B cardinality=30.00M cost=4437000
+| | | in pipelines: 07(GETNEXT)
| | |
-| | F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=16.47MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[36054000]
-| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
| | predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | stored statistics:
@@ -683,115 +790,106 @@ max-parallelism=20 segment-costs=[168174460, 11823] cpu-comparison-result=140 [m
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=13 row-size=8B cardinality=30.00M cost=5142000
-| | in pipelines: 12(GETNEXT)
+| | tuple-ids=10 row-size=8B cardinality=30.00M cost=5142000
+| | in pipelines: 07(GETNEXT)
| |
-| 27:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)]
+| 22:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)]
| | mem-estimate=10.21MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=15 row-size=18B cardinality=15.00M cost=2908500
-| | in pipelines: 13(GETNEXT)
+| | tuple-ids=8 row-size=18B cardinality=15.00M cost=2908500
+| | in pipelines: 06(GETNEXT)
| |
-| F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
| Per-Instance Resources: mem-estimate=16.86MB mem-reservation=128.00KB thread-reservation=1
| max-parallelism=10 segment-costs=[26833500]
-| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
+| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
| HDFS partitions=1/1 files=1 size=307.36MB
| predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
-| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| runtime filters: RF009[min_max] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF008[bloom] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
| stored statistics:
| table: rows=15.00M size=307.36MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=1.58M
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=15 row-size=18B cardinality=15.00M cost=1717500
-| in pipelines: 13(GETNEXT)
-|
-29:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)]
-| mem-estimate=21.23MB mem-reservation=0B thread-reservation=0
-| tuple-ids=0,2,6,7,12 row-size=76B cardinality=129.52M cost=78619102
-| in pipelines: 00(GETNEXT)
+| tuple-ids=8 row-size=18B cardinality=15.00M cost=1717500
+| in pipelines: 06(GETNEXT)
|
-F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-Per-Host Shared Resources: mem-estimate=18.00MB mem-reservation=18.00MB thread-reservation=0 runtime-filters-memory=18.00MB
-Per-Instance Resources: mem-estimate=23.49MB mem-reservation=512.00KB thread-reservation=1
-max-parallelism=490 segment-costs=[4877793238]
-11:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=02
+05:HASH JOIN [INNER JOIN, BROADCAST]
+| hash-table-id=04
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_item_sk = tpcds_partitioned_parquet_snap.item.i_item_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,6,7,12 row-size=76B cardinality=129.52M cost=56705341
-| in pipelines: 00(GETNEXT), 07(OPEN)
+| tuple-ids=0,2,7 row-size=64B cardinality=7.57G(filtered from 7.87G) cost=3369339657
+| in pipelines: 00(GETNEXT), 01(OPEN)
|
-|--F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+|--F17:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=419.23MB mem-reservation=409.00MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[838440] cpu-comparison-result=14 [max(14 (self) vs 4 (sum children))]
| JOIN BUILD
-| | join-table-id=02 plan-id=03 cohort-id=01
+| | join-table-id=04 plan-id=05 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.item.i_item_sk
-| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.item.i_item_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.item.i_item_sk
+| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.item.i_item_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.item.i_item_sk
| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=360000
| |
-| 26:EXCHANGE [BROADCAST]
+| 21:EXCHANGE [BROADCAST]
| | mem-estimate=10.23MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=7,12 row-size=52B cardinality=360.00K cost=478440
-| | in pipelines: 07(GETNEXT)
+| | tuple-ids=2,7 row-size=52B cardinality=360.00K cost=478440
+| | in pipelines: 01(GETNEXT)
| |
-| F05:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
+| F01:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
| Per-Instance Resources: mem-estimate=16.23MB mem-reservation=512.00KB thread-reservation=1
| max-parallelism=4 segment-costs=[325572]
-| 10:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=03
+| 04:HASH JOIN [INNER JOIN, BROADCAST]
+| | hash-table-id=05
| | hash predicates: tpcds_partitioned_parquet_snap.item.i_category = tpcds_partitioned_parquet_snap.item_0.i_category
| | fk/pk conjuncts: none
| | other join predicates: CAST(tpcds_partitioned_parquet_snap.item.i_current_price AS DECIMAL(14,7)) > multiply(CAST(1.2 AS DECIMAL(2,1)), avg(tpcds_partitioned_parquet_snap.item_0.i_current_price))
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=7,12 row-size=52B cardinality=360.00K cost=157230
-| | in pipelines: 07(GETNEXT), 24(OPEN)
+| | tuple-ids=2,7 row-size=52B cardinality=360.00K cost=157230
+| | in pipelines: 01(GETNEXT), 19(OPEN)
| |
-| |--F17:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
+| |--F18:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
| | | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=4 segment-costs=[14] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
| | JOIN BUILD
-| | | join-table-id=03 plan-id=04 cohort-id=03
+| | | join-table-id=05 plan-id=06 cohort-id=04
| | | build expressions: tpcds_partitioned_parquet_snap.item_0.i_category
-| | | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.item_0.i_category, RF009[min_max] <- tpcds_partitioned_parquet_snap.item_0.i_category
+| | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.item_0.i_category, RF007[min_max] <- tpcds_partitioned_parquet_snap.item_0.i_category
| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=10
| | |
-| | 25:EXCHANGE [BROADCAST]
+| | 20:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=12 row-size=26B cardinality=10 cost=4
-| | | in pipelines: 24(GETNEXT)
+| | | tuple-ids=7 row-size=26B cardinality=10 cost=4
+| | | in pipelines: 19(GETNEXT)
| | |
-| | F07:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category)] hosts=4 instances=4
+| | F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.item_0.i_category)] hosts=4 instances=4
| | Per-Instance Resources: mem-estimate=10.12MB mem-reservation=1.94MB thread-reservation=1
| | max-parallelism=4 segment-costs=[46, 0] cpu-comparison-result=4 [max(4 (self) vs 4 (sum children))]
-| | 24:AGGREGATE [FINALIZE]
+| | 19:AGGREGATE [FINALIZE]
| | | output: avg:merge(tpcds_partitioned_parquet_snap.item_0.i_current_price)
| | | group by: tpcds_partitioned_parquet_snap.item_0.i_category
| | | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=12 row-size=26B cardinality=10 cost=37
-| | | in pipelines: 24(GETNEXT), 08(OPEN)
+| | | tuple-ids=7 row-size=26B cardinality=10 cost=37
+| | | in pipelines: 19(GETNEXT), 02(OPEN)
| | |
-| | 23:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_category)]
+| | 18:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.item_0.i_category)]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=11 row-size=26B cardinality=40 cost=9
-| | | in pipelines: 08(GETNEXT)
+| | | tuple-ids=6 row-size=26B cardinality=40 cost=9
+| | | in pipelines: 02(GETNEXT)
| | |
-| | F06:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
+| | F02:PLAN FRAGMENT [RANDOM] hosts=4 instances=4
| | Per-Instance Resources: mem-estimate=26.47MB mem-reservation=2.50MB thread-reservation=1
| | max-parallelism=4 segment-costs=[166617, 87]
-| | 09:AGGREGATE [STREAMING]
+| | 03:AGGREGATE [STREAMING]
| | | output: avg(tpcds_partitioned_parquet_snap.item_0.i_current_price)
| | | group by: tpcds_partitioned_parquet_snap.item_0.i_category
| | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=11 row-size=26B cardinality=40 cost=105154
-| | | in pipelines: 08(GETNEXT)
+| | | tuple-ids=6 row-size=26B cardinality=40 cost=105154
+| | | in pipelines: 02(GETNEXT)
| | |
-| | 08:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
+| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
| | HDFS partitions=1/1 files=1 size=33.54MB
| | predicates: tpcds_partitioned_parquet_snap.item_0.i_category IS NOT NULL
| | stored statistics:
@@ -800,141 +898,27 @@ max-parallelism=490 segment-costs=[4877793238]
| | extrapolated-rows=disabled max-scan-range-rows=101.54K
| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.item_0.i_category IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=9 row-size=22B cardinality=359.14K cost=61463
-| | in pipelines: 08(GETNEXT)
+| | tuple-ids=4 row-size=22B cardinality=359.14K cost=61463
+| | in pipelines: 02(GETNEXT)
| |
-| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
+| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.item, RANDOM]
| HDFS partitions=1/1 files=1 size=33.54MB
| predicates: tpcds_partitioned_parquet_snap.item.i_current_price IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL
-| runtime filters: RF009[min_max] -> tpcds_partitioned_parquet_snap.item.i_category, RF008[bloom] -> tpcds_partitioned_parquet_snap.item.i_category
+| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.item.i_category, RF006[bloom] -> tpcds_partitioned_parquet_snap.item.i_category
| stored statistics:
| table: rows=360.00K size=33.54MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=101.54K
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.item.i_current_price IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_category IS NOT NULL, tpcds_partitioned_parquet_snap.item.i_item_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=7 row-size=26B cardinality=358.67K cost=102431
-| in pipelines: 07(GETNEXT)
-|
-06:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=04
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2,6 row-size=24B cardinality=129.58M cost=1965957540
-| in pipelines: 00(GETNEXT), 01(OPEN)
-|
-|--F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[60] cpu-comparison-result=11 [max(11 (self) vs 1 (sum children))]
-| JOIN BUILD
-| | join-table-id=04 plan-id=05 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=30
-| |
-| 22:EXCHANGE [BROADCAST]
-| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=2,6 row-size=12B cardinality=30 cost=30
-| | in pipelines: 01(GETNEXT)
-| |
-| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
-| Per-Instance Resources: mem-estimate=16.08MB mem-reservation=512.00KB thread-reservation=1
-| max-parallelism=1 segment-costs=[12535]
-| 05:HASH JOIN [INNER JOIN, BROADCAST]
-| | hash-table-id=05
-| | hash predicates: tpcds_partitioned_parquet_snap.date_dim.d_month_seq = tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
-| | fk/pk conjuncts: none
-| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=2,6 row-size=12B cardinality=30 cost=13
-| | in pipelines: 01(GETNEXT), 04(OPEN)
-| |
-| |--F19:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | | Per-Instance Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | | max-parallelism=1 segment-costs=[1] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
-| | JOIN BUILD
-| | | join-table-id=05 plan-id=06 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
-| | | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq, RF007[min_max] <- tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
-| | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 cost=1
-| | |
-| | 21:EXCHANGE [BROADCAST]
-| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=1 cost=0
-| | | in pipelines: 04(GETNEXT)
-| | |
-| | F04:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=32.00KB mem-reservation=0B thread-reservation=1
-| | max-parallelism=1 segment-costs=[0, 0] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
-| | 04:CARDINALITY CHECK
-| | | limit: 1
-| | | mem-estimate=0B mem-reservation=0B thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=1 cost=0
-| | | in pipelines: 04(GETNEXT), 19(OPEN)
-| | |
-| | 20:EXCHANGE [UNPARTITIONED]
-| | | limit: 2
-| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=2 cost=0
-| | | in pipelines: 19(GETNEXT)
-| | |
-| | F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq)] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=10.03MB mem-reservation=1.94MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[5, 1] cpu-comparison-result=1 [max(1 (self) vs 1 (sum children))]
-| | 19:AGGREGATE [FINALIZE]
-| | | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
-| | | limit: 2
-| | | mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=2 cost=5
-| | | in pipelines: 19(GETNEXT), 02(OPEN)
-| | |
-| | 18:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq)]
-| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=2 cost=0
-| | | in pipelines: 02(GETNEXT)
-| | |
-| | F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| | Per-Instance Resources: mem-estimate=26.03MB mem-reservation=2.25MB thread-reservation=1
-| | max-parallelism=1 segment-costs=[16764, 1]
-| | 03:AGGREGATE [STREAMING]
-| | | group by: tpcds_partitioned_parquet_snap.date_dim_0.d_month_seq
-| | | limit: 2
-| | | mem-estimate=10.00MB mem-reservation=2.00MB spill-buffer=64.00KB thread-reservation=0
-| | | tuple-ids=6 row-size=4B cardinality=2 cost=36
-| | | in pipelines: 02(GETNEXT)
-| | |
-| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
-| | stored statistics:
-| | table: rows=73.05K size=2.17MB
-| | columns: all
-| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(2002 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_moy = CAST(3 AS INT)
-| | mem-estimate=16.00MB mem-reservation=256.00KB thread-reservation=0
-| | tuple-ids=4 row-size=12B cardinality=108 cost=16728
-| | in pipelines: 02(GETNEXT)
-| |
-| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_month_seq IS NOT NULL
-| runtime filters: RF007[min_max] -> tpcds_partitioned_parquet_snap.date_dim.d_month_seq, RF006[bloom] -> tpcds_partitioned_parquet_snap.date_dim.d_month_seq
-| stored statistics:
-| table: rows=73.05K size=2.17MB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL, tpcds_partitioned_parquet_snap.date_dim.d_month_seq IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=2 row-size=8B cardinality=30(filtered from 73.05K) cost=12520
+| tuple-ids=2 row-size=26B cardinality=358.67K cost=102431
| in pipelines: 01(GETNEXT)
|
00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL
- runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk
+ runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk
stored statistics:
table: rows=8.64G size=389.90GB
partitions: 1823/1823 rows=8.25G
diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q07.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q07.test
index 6ef8ea27a..80a057d6c 100644
--- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q07.test
+++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q07.test
@@ -25,7 +25,7 @@ Max Per-Host Resource Reservation: Memory=67.88MB Threads=1
Per-Host Resource Estimates: Memory=130MB
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=130.38MB mem-reservation=67.88MB thread-reservation=1 runtime-filters-memory=4.00MB
-| max-parallelism=1 segment-costs=[2539730583, 1831104, 500]
+| max-parallelism=1 segment-costs=[1214520044, 1831104, 500]
PLAN-ROOT SINK
| output exprs: tpcds_partitioned_parquet_snap.item.i_item_id, avg(tpcds_partitioned_parquet_snap.store_sales.ss_quantity), avg(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), avg(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), avg(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=500
@@ -85,14 +85,34 @@ PLAN-ROOT SINK
| in pipelines: 06(GETNEXT)
|
05:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk
+| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk
+| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=2,4,6 row-size=114B cardinality=84.50M(filtered from 385.62M) cost=91550628
+| in pipelines: 01(GETNEXT), 04(OPEN)
+|
+|--04:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion]
+| HDFS partitions=1/1 files=1 size=100.50KB
+| predicates: tpcds_partitioned_parquet_snap.promotion.p_channel_email = 'N' OR tpcds_partitioned_parquet_snap.promotion.p_channel_event = 'N', tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL
+| stored statistics:
+| table: rows=1.80K size=100.50KB
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=1.80K
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
+| tuple-ids=6 row-size=30B cardinality=1.80K cost=256
+| in pipelines: 04(GETNEXT)
+|
+03:HASH JOIN [INNER JOIN]
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
+| runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
| mem-estimate=8.50MB mem-reservation=8.50MB spill-buffer=512.00KB thread-reservation=0
-| tuple-ids=2,4,6 row-size=114B cardinality=84.50M(filtered from 385.62M) cost=91646227
-| in pipelines: 01(GETNEXT), 04(OPEN)
+| tuple-ids=2,4 row-size=84B cardinality=84.50M(filtered from 385.62M) cost=91646227
+| in pipelines: 01(GETNEXT), 02(OPEN)
|
-|--04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics]
+|--02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics]
| HDFS partitions=1/1 files=1 size=11.15MB
| predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F', tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
| stored statistics:
@@ -102,34 +122,14 @@ PLAN-ROOT SINK
| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F'
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F', tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=6 row-size=52B cardinality=97.40K cost=646596
-| in pipelines: 04(GETNEXT)
-|
-03:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk
-| runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk
-| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=2,4 row-size=62B cardinality=84.50M(filtered from 7.70G) cost=1416761167
-| in pipelines: 01(GETNEXT), 02(OPEN)
-|
-|--02:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion]
-| HDFS partitions=1/1 files=1 size=100.50KB
-| predicates: tpcds_partitioned_parquet_snap.promotion.p_channel_email = 'N' OR tpcds_partitioned_parquet_snap.promotion.p_channel_event = 'N', tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL
-| stored statistics:
-| table: rows=1.80K size=100.50KB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=1.80K
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
-| tuple-ids=4 row-size=30B cardinality=1.80K cost=256
+| tuple-ids=4 row-size=52B cardinality=97.40K cost=646596
| in pipelines: 02(GETNEXT)
|
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL
- runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF006[bloom] -> tpcds_partitione [...]
+ runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF006[bloom] -> tpcds_partitione [...]
stored statistics:
table: rows=8.64G size=389.90GB
partitions: 1823/1823 rows=8.25G
@@ -180,7 +180,7 @@ max-parallelism=10 segment-costs=[19719889, 1831104, 188] cpu-comparison-result=
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
Per-Instance Resources: mem-estimate=35.50MB mem-reservation=17.50MB thread-reservation=1
-max-parallelism=260 segment-costs=[2594390238, 94692667] cpu-comparison-result=120 [max(120 (self) vs 56 (sum children))]
+max-parallelism=130 segment-costs=[1269179699, 94692667] cpu-comparison-result=120 [max(120 (self) vs 56 (sum children))]
09:AGGREGATE [STREAMING]
| output: avg(CAST(tpcds_partitioned_parquet_snap.store_sales.ss_quantity AS BIGINT)), avg(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), avg(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), avg(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)
| group by: tpcds_partitioned_parquet_snap.item.i_item_id
@@ -265,84 +265,84 @@ max-parallelism=260 segment-costs=[2594390238, 94692667] cpu-comparison-result=1
|
05:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=02
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk
+| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
| tuple-ids=2,4,6 row-size=114B cardinality=84.50M(filtered from 385.62M) cost=91548828
| in pipelines: 01(GETNEXT), 04(OPEN)
|
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=108.33MB mem-reservation=103.00MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[226839]
+| | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | max-parallelism=10 segment-costs=[4190]
| JOIN BUILD
| | join-table-id=02 plan-id=03 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| | mem-estimate=102.00MB mem-reservation=102.00MB spill-buffer=512.00KB thread-reservation=0 cost=97399
+| | build expressions: tpcds_partitioned_parquet_snap.promotion.p_promo_sk
+| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk
+| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1800
| |
| 12:EXCHANGE [BROADCAST]
-| | mem-estimate=5.33MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=6 row-size=52B cardinality=97.40K cost=129440
+| | mem-estimate=86.73KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=6 row-size=30B cardinality=1.80K cost=2390
| | in pipelines: 04(GETNEXT)
| |
-| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Instance Resources: mem-estimate=16.22MB mem-reservation=1.00MB thread-reservation=1
-| max-parallelism=10 segment-costs=[662261]
-| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
-| HDFS partitions=1/1 files=1 size=11.15MB
-| predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F', tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
+| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| Per-Instance Resources: mem-estimate=16.13MB mem-reservation=32.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[440]
+| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM]
+| HDFS partitions=1/1 files=1 size=100.50KB
+| predicates: tpcds_partitioned_parquet_snap.promotion.p_channel_email = 'N' OR tpcds_partitioned_parquet_snap.promotion.p_channel_event = 'N', tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL
| stored statistics:
-| table: rows=1.92M size=11.15MB
+| table: rows=1.80K size=100.50KB
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=197.97K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F'
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F', tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=6 row-size=52B cardinality=97.40K cost=646596
+| extrapolated-rows=disabled max-scan-range-rows=1.80K
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
+| tuple-ids=6 row-size=30B cardinality=1.80K cost=256
| in pipelines: 04(GETNEXT)
|
03:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=03
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=2,4 row-size=62B cardinality=84.50M(filtered from 7.70G) cost=1416759367
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
+| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
+| tuple-ids=2,4 row-size=84B cardinality=84.50M(filtered from 385.62M) cost=91548828
| in pipelines: 01(GETNEXT), 02(OPEN)
|
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[4190]
+| | Per-Instance Resources: mem-estimate=108.33MB mem-reservation=103.00MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | max-parallelism=10 segment-costs=[226839]
| JOIN BUILD
| | join-table-id=03 plan-id=04 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.promotion.p_promo_sk
-| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk
-| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1800
+| | build expressions: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
+| | mem-estimate=102.00MB mem-reservation=102.00MB spill-buffer=512.00KB thread-reservation=0 cost=97399
| |
| 11:EXCHANGE [BROADCAST]
-| | mem-estimate=86.73KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=30B cardinality=1.80K cost=2390
+| | mem-estimate=5.33MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=4 row-size=52B cardinality=97.40K cost=129440
| | in pipelines: 02(GETNEXT)
| |
-| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=16.13MB mem-reservation=32.00KB thread-reservation=1
-| max-parallelism=1 segment-costs=[440]
-| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM]
-| HDFS partitions=1/1 files=1 size=100.50KB
-| predicates: tpcds_partitioned_parquet_snap.promotion.p_channel_email = 'N' OR tpcds_partitioned_parquet_snap.promotion.p_channel_event = 'N', tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL
+| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| Per-Instance Resources: mem-estimate=16.22MB mem-reservation=1.00MB thread-reservation=1
+| max-parallelism=10 segment-costs=[662261]
+| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
+| HDFS partitions=1/1 files=1 size=11.15MB
+| predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F', tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
| stored statistics:
-| table: rows=1.80K size=100.50KB
+| table: rows=1.92M size=11.15MB
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=1.80K
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
-| tuple-ids=4 row-size=30B cardinality=1.80K cost=256
+| extrapolated-rows=disabled max-scan-range-rows=197.97K
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F'
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F', tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| tuple-ids=4 row-size=52B cardinality=97.40K cost=646596
| in pipelines: 02(GETNEXT)
|
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL
- runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF006[bloom] -> tpcds_partitione [...]
+ runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF006[bloom] -> tpcds_partitione [...]
stored statistics:
table: rows=8.64G size=389.90GB
partitions: 1823/1823 rows=8.25G
@@ -393,7 +393,7 @@ max-parallelism=10 segment-costs=[19719889, 1831104, 188] cpu-comparison-result=
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
Per-Host Shared Resources: mem-estimate=4.00MB mem-reservation=4.00MB thread-reservation=0 runtime-filters-memory=4.00MB
Per-Instance Resources: mem-estimate=35.50MB mem-reservation=17.50MB thread-reservation=1
-max-parallelism=260 segment-costs=[2594390238, 94692667] cpu-comparison-result=120 [max(120 (self) vs 56 (sum children))]
+max-parallelism=130 segment-costs=[1269179699, 94692667] cpu-comparison-result=120 [max(120 (self) vs 56 (sum children))]
09:AGGREGATE [STREAMING]
| output: avg(CAST(tpcds_partitioned_parquet_snap.store_sales.ss_quantity AS BIGINT)), avg(tpcds_partitioned_parquet_snap.store_sales.ss_list_price), avg(tpcds_partitioned_parquet_snap.store_sales.ss_coupon_amt), avg(tpcds_partitioned_parquet_snap.store_sales.ss_sales_price)
| group by: tpcds_partitioned_parquet_snap.item.i_item_id
@@ -478,84 +478,84 @@ max-parallelism=260 segment-costs=[2594390238, 94692667] cpu-comparison-result=1
|
05:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=02
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk
+| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
| tuple-ids=2,4,6 row-size=114B cardinality=84.50M(filtered from 385.62M) cost=91548828
| in pipelines: 01(GETNEXT), 04(OPEN)
|
|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=108.33MB mem-reservation=103.00MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[226839]
+| | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | max-parallelism=10 segment-costs=[4190]
| JOIN BUILD
| | join-table-id=02 plan-id=03 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| | mem-estimate=102.00MB mem-reservation=102.00MB spill-buffer=512.00KB thread-reservation=0 cost=97399
+| | build expressions: tpcds_partitioned_parquet_snap.promotion.p_promo_sk
+| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk
+| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1800
| |
| 12:EXCHANGE [BROADCAST]
-| | mem-estimate=5.33MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=6 row-size=52B cardinality=97.40K cost=129440
+| | mem-estimate=86.73KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=6 row-size=30B cardinality=1.80K cost=2390
| | in pipelines: 04(GETNEXT)
| |
-| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Instance Resources: mem-estimate=16.22MB mem-reservation=1.00MB thread-reservation=1
-| max-parallelism=10 segment-costs=[662261]
-| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
-| HDFS partitions=1/1 files=1 size=11.15MB
-| predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F', tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
+| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| Per-Instance Resources: mem-estimate=16.13MB mem-reservation=32.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[440]
+| 04:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM]
+| HDFS partitions=1/1 files=1 size=100.50KB
+| predicates: tpcds_partitioned_parquet_snap.promotion.p_channel_email = 'N' OR tpcds_partitioned_parquet_snap.promotion.p_channel_event = 'N', tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL
| stored statistics:
-| table: rows=1.92M size=11.15MB
+| table: rows=1.80K size=100.50KB
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=197.97K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F'
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F', tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=6 row-size=52B cardinality=97.40K cost=646596
+| extrapolated-rows=disabled max-scan-range-rows=1.80K
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
+| tuple-ids=6 row-size=30B cardinality=1.80K cost=256
| in pipelines: 04(GETNEXT)
|
03:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=03
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk = tpcds_partitioned_parquet_snap.promotion.p_promo_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=2,4 row-size=62B cardinality=84.50M(filtered from 7.70G) cost=1416759367
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
+| mem-estimate=0B mem-reservation=0B spill-buffer=512.00KB thread-reservation=0
+| tuple-ids=2,4 row-size=84B cardinality=84.50M(filtered from 385.62M) cost=91548828
| in pipelines: 01(GETNEXT), 02(OPEN)
|
|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=24.33MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[4190]
+| | Per-Instance Resources: mem-estimate=108.33MB mem-reservation=103.00MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | max-parallelism=10 segment-costs=[226839]
| JOIN BUILD
| | join-table-id=03 plan-id=04 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.promotion.p_promo_sk
-| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.promotion.p_promo_sk
-| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1800
+| | build expressions: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
+| | mem-estimate=102.00MB mem-reservation=102.00MB spill-buffer=512.00KB thread-reservation=0 cost=97399
| |
| 11:EXCHANGE [BROADCAST]
-| | mem-estimate=86.73KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=30B cardinality=1.80K cost=2390
+| | mem-estimate=5.33MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=4 row-size=52B cardinality=97.40K cost=129440
| | in pipelines: 02(GETNEXT)
| |
-| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=16.13MB mem-reservation=32.00KB thread-reservation=1
-| max-parallelism=1 segment-costs=[440]
-| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.promotion, RANDOM]
-| HDFS partitions=1/1 files=1 size=100.50KB
-| predicates: tpcds_partitioned_parquet_snap.promotion.p_channel_email = 'N' OR tpcds_partitioned_parquet_snap.promotion.p_channel_event = 'N', tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL
+| F01:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| Per-Instance Resources: mem-estimate=16.22MB mem-reservation=1.00MB thread-reservation=1
+| max-parallelism=10 segment-costs=[662261]
+| 02:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
+| HDFS partitions=1/1 files=1 size=11.15MB
+| predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F', tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
| stored statistics:
-| table: rows=1.80K size=100.50KB
+| table: rows=1.92M size=11.15MB
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=1.80K
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.promotion.p_promo_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
-| tuple-ids=4 row-size=30B cardinality=1.80K cost=256
+| extrapolated-rows=disabled max-scan-range-rows=197.97K
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F'
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'College', tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'W', tpcds_partitioned_parquet_snap.customer_demographics.cd_gender = 'F', tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| tuple-ids=4 row-size=52B cardinality=97.40K cost=646596
| in pipelines: 02(GETNEXT)
|
01:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_item_sk IS NOT NULL
- runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF006[bloom] -> tpcds_partitione [...]
+ runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_item_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_promo_sk, RF006[bloom] -> tpcds_partitione [...]
stored statistics:
table: rows=8.64G size=389.90GB
partitions: 1823/1823 rows=8.25G
diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q11.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q11.test
index 0f0631754..7213cae41 100644
--- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q11.test
+++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q11.test
@@ -82,151 +82,150 @@ limit 100
# end query 11 in stream 0 using template query11.tpl
---- PLAN
Max Per-Host Resource Reservation: Memory=381.00MB Threads=1
-Per-Host Resource Estimates: Memory=52.24GB
+Per-Host Resource Estimates: Memory=53.01GB
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=52.24GB mem-reservation=381.00MB thread-reservation=1 runtime-filters-memory=100.00MB
-| max-parallelism=1 segment-costs=[10613759109, 1249916952, 4052171215, 2953843791, 590377604, 400]
+| Per-Instance Resources: mem-estimate=53.01GB mem-reservation=381.00MB thread-reservation=1 runtime-filters-memory=100.00MB
+| max-parallelism=1 segment-costs=[10613759109, 3168055223, 4052171215, 1304679278, 600091089, 400]
PLAN-ROOT SINK
-| output exprs: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_login
+| output exprs: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_login
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
27:TOP-N [LIMIT=100]
-| order by: tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_login ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_login ASC NULLS LAST
| mem-estimate=7.42KB mem-reservation=0B thread-reservation=0
| tuple-ids=28 row-size=76B cardinality=100 cost=420117698
-| in pipelines: 27(GETNEXT), 17(OPEN)
+| in pipelines: 27(GETNEXT), 23(OPEN)
|
26:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
| other join predicates: CASE WHEN sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt)) > CAST(0 AS DECIMAL(38,2)) THEN divide(sum(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt)), sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))) [...]
-| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| mem-estimate=7.16GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20,13,6,27 row-size=661B cardinality=30.00M cost=53757738
-| in pipelines: 17(GETNEXT), 25(OPEN)
+| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id
+| mem-estimate=5.36GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=27,20,13,6 row-size=661B cardinality=30.00M cost=43131000
+| in pipelines: 23(GETNEXT), 05(OPEN)
|
-|--25:AGGREGATE [FINALIZE]
-| | output: sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
-| | having: sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt)) > CAST(0 AS DECIMAL(38,2))
-| | mem-estimate=5.92GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=40.63M cost=2398033848
-| | in pipelines: 25(GETNEXT), 20(OPEN)
-| |
-| 24:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+|--05:AGGREGATE [FINALIZE]
+| | output: sum(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | mem-estimate=6.01GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=30.00M cost=742489258
+| | in pipelines: 05(GETNEXT), 01(OPEN)
+| |
+| 04:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | fk/pk conjuncts: none
+| | runtime filters: RF019[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=21,23,25 row-size=177B cardinality=406.27M cost=216854633
-| | in pipelines: 20(GETNEXT), 23(OPEN)
+| | tuple-ids=2,4,0 row-size=177B cardinality=441.48M cost=223234710
+| | in pipelines: 01(GETNEXT), 00(OPEN)
| |
-| |--23:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| |--00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=25 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 23(GETNEXT)
+| | tuple-ids=0 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 00(GETNEXT)
| |
-| 22:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| 03:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=21,23 row-size=24B cardinality=441.48M cost=193235083
-| | in pipelines: 20(GETNEXT), 21(OPEN)
+| | tuple-ids=2,4 row-size=24B cardinality=441.48M cost=193235083
+| | in pipelines: 01(GETNEXT), 02(OPEN)
| |
-| |--21:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| |--02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=23 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 21(GETNEXT)
+| | tuple-ids=4 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 02(GETNEXT)
| |
-| 20:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
-| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL
+| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
+| partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL
| HDFS partitions=1823/1824 files=1823 size=145.67GB
-| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
-| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk
+| predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
+| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk
| stored statistics:
| table: rows=2.16G size=145.75GB
| partitions: 1823/1823 rows=2.16G
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=21 row-size=16B cardinality=441.48M(filtered from 2.16G) cost=114150479
-| in pipelines: 20(GETNEXT)
+| tuple-ids=2 row-size=16B cardinality=441.48M(filtered from 2.16G) cost=114150479
+| in pipelines: 01(GETNEXT)
|
-19:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
-| runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id
+25:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| mem-estimate=5.36GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20,13,6 row-size=495B cardinality=30.00M cost=43131000
-| in pipelines: 17(GETNEXT), 05(OPEN)
+| tuple-ids=27,20,13 row-size=495B cardinality=30.00M cost=46759898
+| in pipelines: 23(GETNEXT), 11(OPEN)
|
-|--05:AGGREGATE [FINALIZE]
+|--11:AGGREGATE [FINALIZE]
| | output: sum(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
| | mem-estimate=8.68GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=6 row-size=165B cardinality=30.00M cost=2168085602
-| | in pipelines: 05(GETNEXT), 00(OPEN)
+| | tuple-ids=13 row-size=165B cardinality=30.00M cost=2168085602
+| | in pipelines: 11(GETNEXT), 06(OPEN)
| |
-| 04:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| 10:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=0,2,4 row-size=177B cardinality=1.48G cost=711235853
-| | in pipelines: 00(GETNEXT), 03(OPEN)
+| | tuple-ids=7,9,11 row-size=177B cardinality=1.48G cost=711235853
+| | in pipelines: 06(GETNEXT), 09(OPEN)
| |
-| |--03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
-| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=4 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 03(GETNEXT)
+| | tuple-ids=11 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 09(GETNEXT)
| |
-| 02:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| 08:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=0,2 row-size=24B cardinality=1.61G cost=705182682
-| | in pipelines: 00(GETNEXT), 01(OPEN)
+| | tuple-ids=7,9 row-size=24B cardinality=1.61G cost=705182682
+| | in pipelines: 06(GETNEXT), 07(OPEN)
| |
-| |--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=2 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 01(GETNEXT)
+| | tuple-ids=9 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 07(GETNEXT)
| |
-| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
+| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
| partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
| HDFS partitions=1823/1824 files=1823 size=389.69GB
| predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
@@ -238,132 +237,133 @@ PLAN-ROOT SINK
| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=0 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330
-| in pipelines: 00(GETNEXT)
+| tuple-ids=7 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330
+| in pipelines: 06(GETNEXT)
|
-18:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| mem-estimate=5.36GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20,13 row-size=330B cardinality=30.00M cost=73371168
-| in pipelines: 17(GETNEXT), 11(OPEN)
+24:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| mem-estimate=7.75GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=27,20 row-size=330B cardinality=44.15M cost=90082493
+| in pipelines: 23(GETNEXT), 17(OPEN)
|
-|--11:AGGREGATE [FINALIZE]
-| | output: sum(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
-| | mem-estimate=5.92GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=165B cardinality=30.00M cost=694107009
-| | in pipelines: 11(GETNEXT), 06(OPEN)
-| |
-| 10:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+|--17:AGGREGATE [FINALIZE]
+| | output: sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | having: sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt)) > CAST(0 AS DECIMAL(38,2))
+| | mem-estimate=6.01GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=44.15M cost=2605865203
+| | in pipelines: 17(GETNEXT), 13(OPEN)
+| |
+| 16:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | fk/pk conjuncts: none
+| | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
| | mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=7,9,11 row-size=177B cardinality=406.27M cost=216854633
-| | in pipelines: 06(GETNEXT), 09(OPEN)
+| | tuple-ids=16,18,14 row-size=177B cardinality=441.48M cost=223234710
+| | in pipelines: 13(GETNEXT), 12(OPEN)
| |
-| |--09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| |--12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
-| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
+| | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF002[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=11 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 09(GETNEXT)
+| | tuple-ids=14 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 12(GETNEXT)
| |
-| 08:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| 15:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=7,9 row-size=24B cardinality=441.48M cost=193235083
-| | in pipelines: 06(GETNEXT), 07(OPEN)
+| | tuple-ids=16,18 row-size=24B cardinality=441.48M cost=193235083
+| | in pipelines: 13(GETNEXT), 14(OPEN)
| |
-| |--07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| |--14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=9 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 07(GETNEXT)
+| | tuple-ids=18 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 14(GETNEXT)
| |
-| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
-| partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL
+| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales]
+| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL
| HDFS partitions=1823/1824 files=1823 size=145.67GB
-| predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
-| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk
+| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
+| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk
| stored statistics:
| table: rows=2.16G size=145.75GB
| partitions: 1823/1823 rows=2.16G
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=7 row-size=16B cardinality=441.48M(filtered from 2.16G) cost=114150479
-| in pipelines: 06(GETNEXT)
+| tuple-ids=16 row-size=16B cardinality=441.48M(filtered from 2.16G) cost=114150479
+| in pipelines: 13(GETNEXT)
|
-17:AGGREGATE [FINALIZE]
+23:AGGREGATE [FINALIZE]
| output: sum(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt))
-| group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
| having: sum(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt)) > CAST(0 AS DECIMAL(38,2))
| mem-estimate=8.68GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20 row-size=165B cardinality=147.90M cost=8729673496
-| in pipelines: 17(GETNEXT), 12(OPEN)
+| tuple-ids=27 row-size=165B cardinality=147.90M cost=8729673496
+| in pipelines: 23(GETNEXT), 18(OPEN)
|
-16:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+22:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
| mem-estimate=5.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=14,16,18 row-size=177B cardinality=1.48G cost=711235853
-| in pipelines: 12(GETNEXT), 15(OPEN)
+| tuple-ids=21,23,25 row-size=177B cardinality=1.48G cost=711235853
+| in pipelines: 18(GETNEXT), 21(OPEN)
|
-|--15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+|--21:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
| HDFS partitions=1/1 files=1 size=1.55GB
-| predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
-| runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF004[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF004[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF002[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id
| stored statistics:
| table: rows=30.00M size=1.55GB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.10M
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=18 row-size=153B cardinality=30.00M cost=31557228
-| in pipelines: 15(GETNEXT)
+| tuple-ids=25 row-size=153B cardinality=30.00M cost=31557228
+| in pipelines: 21(GETNEXT)
|
-14:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+20:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=14,16 row-size=24B cardinality=1.61G cost=705182682
-| in pipelines: 12(GETNEXT), 13(OPEN)
+| tuple-ids=21,23 row-size=24B cardinality=1.61G cost=705182682
+| in pipelines: 18(GETNEXT), 19(OPEN)
|
-|--13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+|--19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
+| predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
| stored statistics:
| table: rows=73.05K size=2.17MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=16 row-size=8B cardinality=373 cost=12520
-| in pipelines: 13(GETNEXT)
+| tuple-ids=23 row-size=8B cardinality=373 cost=12520
+| in pipelines: 19(GETNEXT)
|
-12:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
+18:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
@@ -375,316 +375,315 @@ PLAN-ROOT SINK
extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=14 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330
- in pipelines: 12(GETNEXT)
+ tuple-ids=21 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330
+ in pipelines: 18(GETNEXT)
---- DISTRIBUTEDPLAN
-Max Per-Host Resource Reservation: Memory=6.37GB Threads=223
-Per-Host Resource Estimates: Memory=117.70GB
+Max Per-Host Resource Reservation: Memory=6.31GB Threads=224
+Per-Host Resource Estimates: Memory=119.75GB
F21:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=4.38MB mem-reservation=4.00MB thread-reservation=1
| max-parallelism=1 segment-costs=[440] cpu-comparison-result=960 [max(1 (self) vs 960 (sum children))]
PLAN-ROOT SINK
-| output exprs: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_login
+| output exprs: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_login
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
52:MERGING-EXCHANGE [UNPARTITIONED]
-| order by: tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_login ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_login ASC NULLS LAST
| limit: 100
| mem-estimate=391.22KB mem-reservation=0B thread-reservation=0
| tuple-ids=28 row-size=76B cardinality=100 cost=40
| in pipelines: 27(GETNEXT)
|
-F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
+F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
Per-Instance Resources: mem-estimate=29.83MB mem-reservation=0B thread-reservation=1
-max-parallelism=70 segment-costs=[618534221, 230] cpu-comparison-result=960 [max(50 (self) vs 960 (sum children))]
+max-parallelism=70 segment-costs=[624726692, 230] cpu-comparison-result=960 [max(50 (self) vs 960 (sum children))]
27:TOP-N [LIMIT=100]
-| order by: tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_login ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_login ASC NULLS LAST
| mem-estimate=7.42KB mem-reservation=0B thread-reservation=0
| tuple-ids=28 row-size=76B cardinality=100 cost=420117698
| in pipelines: 27(GETNEXT), 32(OPEN)
|
26:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=00
-| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
| other join predicates: CASE WHEN sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt)) > CAST(0 AS DECIMAL(38,2)) THEN divide(sum(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt)), sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))) [...]
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20,13,6,27 row-size=661B cardinality=30.00M cost=13131000
+| tuple-ids=27,20,13,6 row-size=661B cardinality=30.00M cost=13131000
| in pipelines: 32(GETNEXT), 50(OPEN)
|
-|--F22:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=192.40MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | max-parallelism=70 segment-costs=[76003415] cpu-comparison-result=240 [max(50 (self) vs 240 (sum children))]
+|--F22:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=154.03MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=70 segment-costs=[56123197] cpu-comparison-result=240 [max(50 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| | mem-estimate=146.57MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738
+| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | mem-estimate=109.86MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
-| 51:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)]
-| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=40.63M cost=35376677
+| 51:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)]
+| | mem-estimate=28.17MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=30.00M cost=26123197
| | in pipelines: 50(GETNEXT)
| |
-| F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=604.99MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=280 segment-costs=[2751800623, 453013550] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)] hosts=10 instances=110 (adjusted from 120)
+| Per-Instance Resources: mem-estimate=671.14MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=110 segment-costs=[1068557817, 334518771] cpu-comparison-result=240 [max(110 (self) vs 240 (sum children))]
| 50:AGGREGATE [FINALIZE]
-| | output: sum:merge(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
-| | having: sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt)) > CAST(0 AS DECIMAL(38,2))
-| | mem-estimate=571.96MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=40.63M cost=2398033848
-| | in pipelines: 50(GETNEXT), 20(OPEN)
+| | output: sum:merge(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | mem-estimate=638.10MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=30.00M cost=706767826
+| | in pipelines: 50(GETNEXT), 01(OPEN)
| |
-| 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)]
+| 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=406.27M cost=353766775
-| | in pipelines: 20(GETNEXT)
+| | tuple-ids=6 row-size=165B cardinality=415.48M cost=361789991
+| | in pipelines: 01(GETNEXT)
| |
-| F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=522.00MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=460 segment-costs=[2698922124, 4530135523] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| 25:AGGREGATE [STREAMING]
-| | output: sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
-| | mem-estimate=428.97MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=406.27M cost=2398033848
-| | in pipelines: 20(GETNEXT)
+| F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=552.57MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=470 segment-costs=[2795409588, 4632876252] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 05:AGGREGATE [STREAMING]
+| | output: sum(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | mem-estimate=466.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=415.48M cost=2488141235
+| | in pipelines: 01(GETNEXT)
| |
-| 24:HASH JOIN [INNER JOIN, PARTITIONED]
+| 04:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=01
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | fk/pk conjuncts: none
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=21,23,25 row-size=177B cardinality=406.27M cost=186854633
-| | in pipelines: 20(GETNEXT), 23(OPEN)
+| | tuple-ids=2,4,0 row-size=177B cardinality=441.48M cost=193234710
+| | in pipelines: 01(GETNEXT), 00(OPEN)
| |
-| |--F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
-| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=460 segment-costs=[54467197]
+| |--F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=470 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=01 plan-id=02 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | | runtime filters: RF019[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 48:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)]
+| | 48:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=25 row-size=153B cardinality=30.00M cost=24467197
-| | | in pipelines: 23(GETNEXT)
+| | | tuple-ids=0 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 00(GETNEXT)
| | |
| | F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[342891999]
-| | 23:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=25 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 23(GETNEXT)
+| | tuple-ids=0 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 00(GETNEXT)
| |
-| 47:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)]
+| 47:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)]
| | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=21,23 row-size=24B cardinality=441.48M cost=114033643
-| | in pipelines: 20(GETNEXT)
+| | tuple-ids=2,4 row-size=24B cardinality=441.48M cost=114033643
+| | in pipelines: 01(GETNEXT)
| |
| F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
| Per-Instance Resources: mem-estimate=31.00MB mem-reservation=128.00KB thread-reservation=1
| max-parallelism=150 segment-costs=[1444631277]
-| 22:HASH JOIN [INNER JOIN, BROADCAST]
+| 03:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=02
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=21,23 row-size=24B cardinality=441.48M cost=193234710
-| | in pipelines: 20(GETNEXT), 21(OPEN)
+| | tuple-ids=2,4 row-size=24B cardinality=441.48M cost=193234710
+| | in pipelines: 01(GETNEXT), 02(OPEN)
| |
| |--F24:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=02 plan-id=03 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 46:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=23 row-size=8B cardinality=373 cost=490
-| | | in pipelines: 21(GETNEXT)
+| | | tuple-ids=4 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 02(GETNEXT)
| | |
| | F17:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| | max-parallelism=1 segment-costs=[12536]
-| | 21:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=23 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 21(GETNEXT)
+| | tuple-ids=4 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 02(GETNEXT)
| |
-| 20:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL
+| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL
| HDFS partitions=1823/1824 files=1823 size=145.67GB
-| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
-| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk
+| predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
+| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk
| stored statistics:
| table: rows=2.16G size=145.75GB
| partitions: 1823/1823 rows=2.16G
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=21 row-size=16B cardinality=441.48M(filtered from 2.16G) cost=114150479
-| in pipelines: 20(GETNEXT)
+| tuple-ids=2 row-size=16B cardinality=441.48M(filtered from 2.16G) cost=114150479
+| in pipelines: 01(GETNEXT)
|
-19:HASH JOIN [INNER JOIN, PARTITIONED]
+25:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=03
-| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20,13,6 row-size=495B cardinality=30.00M cost=13131000
+| tuple-ids=27,20,13 row-size=495B cardinality=30.00M cost=16759898
| in pipelines: 32(GETNEXT), 44(OPEN)
|
-|--F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=139.68MB mem-reservation=34.00MB thread-reservation=1
+|--F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=155.68MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
| | max-parallelism=70 segment-costs=[56123197] cpu-comparison-result=240 [max(50 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=03 plan-id=04 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_id
-| | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| | mem-estimate=109.86MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
-| 45:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)]
+| 45:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=6 row-size=165B cardinality=30.00M cost=26123197
+| | tuple-ids=13 row-size=165B cardinality=30.00M cost=26123197
| | in pipelines: 44(GETNEXT)
| |
-| F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)] hosts=10 instances=120
+| F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)] hosts=10 instances=120
| Per-Instance Resources: mem-estimate=1.70GB mem-reservation=34.00MB thread-reservation=1
| max-parallelism=290 segment-costs=[2858479680, 334518771] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
| 44:AGGREGATE [FINALIZE]
| | output: sum:merge(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
| | mem-estimate=1.67GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=6 row-size=165B cardinality=30.00M cost=1802389423
-| | in pipelines: 44(GETNEXT), 00(OPEN)
+| | tuple-ids=13 row-size=165B cardinality=30.00M cost=1802389423
+| | in pipelines: 44(GETNEXT), 06(OPEN)
| |
-| 43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)]
+| 43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=6 row-size=165B cardinality=1.21G cost=1056090257
-| | in pipelines: 00(GETNEXT)
+| | tuple-ids=13 row-size=165B cardinality=1.21G cost=1056090257
+| | in pipelines: 06(GETNEXT)
| |
| F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
| Per-Instance Resources: mem-estimate=1.62GB mem-reservation=34.00MB thread-reservation=1
| max-parallelism=1360 segment-costs=[8621866148, 13523689412] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| 05:AGGREGATE [STREAMING]
+| 11:AGGREGATE [STREAMING]
| | output: sum(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
| | mem-estimate=1.52GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=6 row-size=165B cardinality=1.21G cost=7524480900
-| | in pipelines: 00(GETNEXT)
+| | tuple-ids=13 row-size=165B cardinality=1.21G cost=7524480900
+| | in pipelines: 06(GETNEXT)
| |
-| 04:HASH JOIN [INNER JOIN, PARTITIONED]
+| 10:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=04
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=0,2,4 row-size=177B cardinality=1.48G cost=681235853
-| | in pipelines: 00(GETNEXT), 03(OPEN)
+| | tuple-ids=7,9,11 row-size=177B cardinality=1.48G cost=681235853
+| | in pipelines: 06(GETNEXT), 09(OPEN)
| |
| |--F26:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
| | | max-parallelism=1360 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=04 plan-id=05 cohort-id=03
-| | | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 42:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
+| | 42:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)]
| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=4 row-size=153B cardinality=30.00M cost=24467197
-| | | in pipelines: 03(GETNEXT)
+| | | tuple-ids=11 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 09(GETNEXT)
| | |
| | F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[342891999]
-| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
-| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=4 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 03(GETNEXT)
+| | tuple-ids=11 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 09(GETNEXT)
| |
| 41:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)]
| | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=0,2 row-size=24B cardinality=1.61G cost=416149395
-| | in pipelines: 00(GETNEXT)
+| | tuple-ids=7,9 row-size=24B cardinality=1.61G cost=416149395
+| | in pipelines: 06(GETNEXT)
| |
| F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
| Per-Instance Resources: mem-estimate=31.00MB mem-reservation=512.00KB thread-reservation=1
| max-parallelism=373 segment-costs=[5291495835]
-| 02:HASH JOIN [INNER JOIN, BROADCAST]
+| 08:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=05
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=0,2 row-size=24B cardinality=1.61G cost=705182309
-| | in pipelines: 00(GETNEXT), 01(OPEN)
+| | tuple-ids=7,9 row-size=24B cardinality=1.61G cost=705182309
+| | in pipelines: 06(GETNEXT), 07(OPEN)
| |
| |--F27:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=05 plan-id=06 cohort-id=03
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 40:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=2 row-size=8B cardinality=373 cost=490
-| | | in pipelines: 01(GETNEXT)
+| | | tuple-ids=9 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 07(GETNEXT)
| | |
| | F12:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| | max-parallelism=1 segment-costs=[12536]
-| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=2 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 01(GETNEXT)
+| | tuple-ids=9 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 07(GETNEXT)
| |
-| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
| partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
| HDFS partitions=1823/1824 files=1823 size=389.69GB
| predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
@@ -696,275 +695,276 @@ max-parallelism=70 segment-costs=[618534221, 230] cpu-comparison-result=960 [max
| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=0 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330
-| in pipelines: 00(GETNEXT)
+| tuple-ids=7 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330
+| in pipelines: 06(GETNEXT)
|
-18:HASH JOIN [INNER JOIN, PARTITIONED]
+24:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=06
-| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20,13 row-size=330B cardinality=30.00M cost=43371168
+| tuple-ids=27,20 row-size=330B cardinality=44.15M cost=45934741
| in pipelines: 32(GETNEXT), 37(OPEN)
|
-|--F28:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=152.38MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | max-parallelism=70 segment-costs=[56123197] cpu-comparison-result=240 [max(50 (self) vs 240 (sum children))]
+|--F28:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=204.56MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=70 segment-costs=[82590434] cpu-comparison-result=240 [max(50 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=06 plan-id=07 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | mem-estimate=109.86MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | mem-estimate=158.74MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=44147752
| |
-| 39:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)]
-| | mem-estimate=26.52MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=13 row-size=165B cardinality=30.00M cost=26123197
+| 39:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=44.15M cost=38442682
| | in pipelines: 37(GETNEXT)
| |
-| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)] hosts=10 instances=100 (adjusted from 120)
-| Per-Instance Resources: mem-estimate=682.07MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=100 segment-costs=[998294990, 334518771] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
+| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=654.56MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=300 segment-costs=[2990292024, 492275059] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
| 37:AGGREGATE [FINALIZE]
-| | output: sum:merge(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
-| | mem-estimate=649.04MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=165B cardinality=30.00M cost=663759541
-| | in pipelines: 37(GETNEXT), 06(OPEN)
+| | output: sum:merge(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | having: sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt)) > CAST(0 AS DECIMAL(38,2))
+| | mem-estimate=621.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=44.15M cost=2605865203
+| | in pipelines: 37(GETNEXT), 13(OPEN)
| |
-| 36:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)]
+| 36:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=13 row-size=165B cardinality=384.18M cost=334535449
-| | in pipelines: 06(GETNEXT)
+| | tuple-ids=20 row-size=165B cardinality=441.48M cost=384426821
+| | in pipelines: 13(GETNEXT)
| |
-| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=508.79MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=430 segment-costs=[2598908653, 4283870141] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| 11:AGGREGATE [STREAMING]
-| | output: sum(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
-| | mem-estimate=428.97MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=165B cardinality=384.18M cost=2298020377
-| | in pipelines: 06(GETNEXT)
+| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=559.18MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=500 segment-costs=[2913133556, 4922750583] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 17:AGGREGATE [STREAMING]
+| | output: sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | mem-estimate=466.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=441.48M cost=2605865203
+| | in pipelines: 13(GETNEXT)
| |
-| 10:HASH JOIN [INNER JOIN, PARTITIONED]
+| 16:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=07
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | fk/pk conjuncts: none
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=7,9,11 row-size=177B cardinality=406.27M cost=186854633
-| | in pipelines: 06(GETNEXT), 09(OPEN)
+| | tuple-ids=16,18,14 row-size=177B cardinality=441.48M cost=193234710
+| | in pipelines: 13(GETNEXT), 12(OPEN)
| |
-| |--F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| |--F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=430 segment-costs=[54467197]
+| | | max-parallelism=500 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=07 plan-id=08 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 35:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)]
+| | 35:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_sk)]
| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=11 row-size=153B cardinality=30.00M cost=24467197
-| | | in pipelines: 09(GETNEXT)
+| | | tuple-ids=14 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 12(GETNEXT)
| | |
| | F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
+| | Per-Host Shared Resources: mem-estimate=32.00MB mem-reservation=32.00MB thread-reservation=0 runtime-filters-memory=32.00MB
| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[342891999]
-| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
-| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
+| | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF002[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=11 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 09(GETNEXT)
+| | tuple-ids=14 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 12(GETNEXT)
| |
-| 34:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)]
+| 34:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)]
| | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=7,9 row-size=24B cardinality=441.48M cost=114033643
-| | in pipelines: 06(GETNEXT)
+| | tuple-ids=16,18 row-size=24B cardinality=441.48M cost=114033643
+| | in pipelines: 13(GETNEXT)
| |
| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
| Per-Instance Resources: mem-estimate=31.00MB mem-reservation=128.00KB thread-reservation=1
| max-parallelism=150 segment-costs=[1444631277]
-| 08:HASH JOIN [INNER JOIN, BROADCAST]
+| 15:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=08
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=7,9 row-size=24B cardinality=441.48M cost=193234710
-| | in pipelines: 06(GETNEXT), 07(OPEN)
+| | tuple-ids=16,18 row-size=24B cardinality=441.48M cost=193234710
+| | in pipelines: 13(GETNEXT), 14(OPEN)
| |
| |--F30:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=08 plan-id=09 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 33:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=9 row-size=8B cardinality=373 cost=490
-| | | in pipelines: 07(GETNEXT)
+| | | tuple-ids=18 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 14(GETNEXT)
| | |
| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| | max-parallelism=1 segment-costs=[12536]
-| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=9 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 07(GETNEXT)
+| | tuple-ids=18 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 14(GETNEXT)
| |
-| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL
+| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL
| HDFS partitions=1823/1824 files=1823 size=145.67GB
-| predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
-| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk
+| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
+| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk
| stored statistics:
| table: rows=2.16G size=145.75GB
| partitions: 1823/1823 rows=2.16G
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=7 row-size=16B cardinality=441.48M(filtered from 2.16G) cost=114150479
-| in pipelines: 06(GETNEXT)
+| tuple-ids=16 row-size=16B cardinality=441.48M(filtered from 2.16G) cost=114150479
+| in pipelines: 13(GETNEXT)
|
-38:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)]
+38:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)]
| mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| tuple-ids=20 row-size=165B cardinality=147.90M cost=128783355
+| tuple-ids=27 row-size=165B cardinality=147.90M cost=128783355
| in pipelines: 32(GETNEXT)
|
-F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)] hosts=10 instances=120
+F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)] hosts=10 instances=120
Per-Instance Resources: mem-estimate=2.07GB mem-reservation=34.00MB thread-reservation=1
max-parallelism=1010 segment-costs=[10017507045, 1649126185] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
32:AGGREGATE [FINALIZE]
| output: sum:merge(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt))
-| group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
| having: sum(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt)) > CAST(0 AS DECIMAL(38,2))
| mem-estimate=2.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20 row-size=165B cardinality=147.90M cost=8729673496
-| in pipelines: 32(GETNEXT), 12(OPEN)
+| tuple-ids=27 row-size=165B cardinality=147.90M cost=8729673496
+| in pipelines: 32(GETNEXT), 18(OPEN)
|
-31:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)]
+31:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)]
| mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| tuple-ids=20 row-size=165B cardinality=1.48G cost=1287833549
-| in pipelines: 12(GETNEXT)
+| tuple-ids=27 row-size=165B cardinality=1.48G cost=1287833549
+| in pipelines: 18(GETNEXT)
|
F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
Per-Instance Resources: mem-estimate=1.62GB mem-reservation=34.00MB thread-reservation=1
max-parallelism=1650 segment-costs=[9827058744, 16491261804] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-17:AGGREGATE [STREAMING]
+23:AGGREGATE [STREAMING]
| output: sum(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt))
-| group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
| mem-estimate=1.52GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20 row-size=165B cardinality=1.48G cost=8729673496
-| in pipelines: 12(GETNEXT)
+| tuple-ids=27 row-size=165B cardinality=1.48G cost=8729673496
+| in pipelines: 18(GETNEXT)
|
-16:HASH JOIN [INNER JOIN, PARTITIONED]
+22:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=09
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=14,16,18 row-size=177B cardinality=1.48G cost=681235853
-| in pipelines: 12(GETNEXT), 15(OPEN)
+| tuple-ids=21,23,25 row-size=177B cardinality=1.48G cost=681235853
+| in pipelines: 18(GETNEXT), 21(OPEN)
|
|--F31:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
| | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
| | max-parallelism=1650 segment-costs=[54467197]
| JOIN BUILD
| | join-table-id=09 plan-id=10 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
| | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
-| 30:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_sk)]
+| 30:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)]
| | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=18 row-size=153B cardinality=30.00M cost=24467197
-| | in pipelines: 15(GETNEXT)
+| | tuple-ids=25 row-size=153B cardinality=30.00M cost=24467197
+| | in pipelines: 21(GETNEXT)
| |
| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Host Shared Resources: mem-estimate=32.00MB mem-reservation=32.00MB thread-reservation=0 runtime-filters-memory=32.00MB
+| Per-Host Shared Resources: mem-estimate=48.00MB mem-reservation=48.00MB thread-reservation=0 runtime-filters-memory=48.00MB
| Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| max-parallelism=10 segment-costs=[342891999]
-| 15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| 21:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| HDFS partitions=1/1 files=1 size=1.55GB
-| predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
-| runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF004[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF004[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF002[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id
| stored statistics:
| table: rows=30.00M size=1.55GB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.10M
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=18 row-size=153B cardinality=30.00M cost=31557228
-| in pipelines: 15(GETNEXT)
+| tuple-ids=25 row-size=153B cardinality=30.00M cost=31557228
+| in pipelines: 21(GETNEXT)
|
29:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)]
| mem-estimate=13.75MB mem-reservation=0B thread-reservation=0
-| tuple-ids=14,16 row-size=24B cardinality=1.61G cost=416149395
-| in pipelines: 12(GETNEXT)
+| tuple-ids=21,23 row-size=24B cardinality=1.61G cost=416149395
+| in pipelines: 18(GETNEXT)
|
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
Per-Instance Resources: mem-estimate=31.00MB mem-reservation=512.00KB thread-reservation=1
max-parallelism=373 segment-costs=[5291495835]
-14:HASH JOIN [INNER JOIN, BROADCAST]
+20:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=10
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=14,16 row-size=24B cardinality=1.61G cost=705182309
-| in pipelines: 12(GETNEXT), 13(OPEN)
+| tuple-ids=21,23 row-size=24B cardinality=1.61G cost=705182309
+| in pipelines: 18(GETNEXT), 19(OPEN)
|
|--F32:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[863]
| JOIN BUILD
| | join-table-id=10 plan-id=11 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| |
| 28:EXCHANGE [BROADCAST]
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=16 row-size=8B cardinality=373 cost=490
-| | in pipelines: 13(GETNEXT)
+| | tuple-ids=23 row-size=8B cardinality=373 cost=490
+| | in pipelines: 19(GETNEXT)
| |
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| max-parallelism=1 segment-costs=[12536]
-| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| 19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
+| predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
| stored statistics:
| table: rows=73.05K size=2.17MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=16 row-size=8B cardinality=373 cost=12520
-| in pipelines: 13(GETNEXT)
+| tuple-ids=23 row-size=8B cardinality=373 cost=12520
+| in pipelines: 19(GETNEXT)
|
-12:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+18:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
@@ -976,316 +976,315 @@ max-parallelism=373 segment-costs=[5291495835]
extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=14 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330
- in pipelines: 12(GETNEXT)
+ tuple-ids=21 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330
+ in pipelines: 18(GETNEXT)
---- PARALLELPLANS
-Max Per-Host Resource Reservation: Memory=6.37GB Threads=223
-Per-Host Resource Estimates: Memory=117.70GB
+Max Per-Host Resource Reservation: Memory=6.31GB Threads=224
+Per-Host Resource Estimates: Memory=119.75GB
F21:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=4.38MB mem-reservation=4.00MB thread-reservation=1
| max-parallelism=1 segment-costs=[440] cpu-comparison-result=960 [max(1 (self) vs 960 (sum children))]
PLAN-ROOT SINK
-| output exprs: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_login
+| output exprs: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_login
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=400
|
52:MERGING-EXCHANGE [UNPARTITIONED]
-| order by: tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_login ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_login ASC NULLS LAST
| limit: 100
| mem-estimate=391.22KB mem-reservation=0B thread-reservation=0
| tuple-ids=28 row-size=76B cardinality=100 cost=40
| in pipelines: 27(GETNEXT)
|
-F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
+F10:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
Per-Instance Resources: mem-estimate=29.83MB mem-reservation=0B thread-reservation=1
-max-parallelism=70 segment-costs=[618534221, 230] cpu-comparison-result=960 [max(50 (self) vs 960 (sum children))]
+max-parallelism=70 segment-costs=[624726692, 230] cpu-comparison-result=960 [max(50 (self) vs 960 (sum children))]
27:TOP-N [LIMIT=100]
-| order by: tpcds_partitioned_parquet_snap.customer.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer.c_login ASC NULLS LAST
+| order by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_first_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_last_name ASC NULLS LAST, tpcds_partitioned_parquet_snap.customer_0.c_login ASC NULLS LAST
| mem-estimate=7.42KB mem-reservation=0B thread-reservation=0
| tuple-ids=28 row-size=76B cardinality=100 cost=420117698
| in pipelines: 27(GETNEXT), 32(OPEN)
|
26:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=00
-| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_2.c_customer_id
+| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
| other join predicates: CASE WHEN sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt)) > CAST(0 AS DECIMAL(38,2)) THEN divide(sum(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt)), sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))) [...]
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20,13,6,27 row-size=661B cardinality=30.00M cost=13131000
+| tuple-ids=27,20,13,6 row-size=661B cardinality=30.00M cost=13131000
| in pipelines: 32(GETNEXT), 50(OPEN)
|
-|--F22:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=192.40MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | max-parallelism=70 segment-costs=[76003415] cpu-comparison-result=240 [max(50 (self) vs 240 (sum children))]
+|--F22:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=154.03MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=70 segment-costs=[56123197] cpu-comparison-result=240 [max(50 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_id
-| | mem-estimate=146.57MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=40626738
+| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_id, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | mem-estimate=109.86MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
-| 51:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)]
-| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=40.63M cost=35376677
+| 51:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)]
+| | mem-estimate=28.17MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=30.00M cost=26123197
| | in pipelines: 50(GETNEXT)
| |
-| F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=604.99MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=280 segment-costs=[2751800623, 453013550] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
+| F20:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)] hosts=10 instances=110 (adjusted from 120)
+| Per-Instance Resources: mem-estimate=671.14MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=110 segment-costs=[1068557817, 334518771] cpu-comparison-result=240 [max(110 (self) vs 240 (sum children))]
| 50:AGGREGATE [FINALIZE]
-| | output: sum:merge(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
-| | having: sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt)) > CAST(0 AS DECIMAL(38,2))
-| | mem-estimate=571.96MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=40.63M cost=2398033848
-| | in pipelines: 50(GETNEXT), 20(OPEN)
+| | output: sum:merge(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | mem-estimate=638.10MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=30.00M cost=706767826
+| | in pipelines: 50(GETNEXT), 01(OPEN)
| |
-| 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)]
+| 49:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=406.27M cost=353766775
-| | in pipelines: 20(GETNEXT)
+| | tuple-ids=6 row-size=165B cardinality=415.48M cost=361789991
+| | in pipelines: 01(GETNEXT)
| |
-| F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=522.00MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=460 segment-costs=[2698922124, 4530135523] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| 25:AGGREGATE [STREAMING]
-| | output: sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
-| | mem-estimate=428.97MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=27 row-size=165B cardinality=406.27M cost=2398033848
-| | in pipelines: 20(GETNEXT)
+| F19:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=552.57MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=470 segment-costs=[2795409588, 4632876252] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 05:AGGREGATE [STREAMING]
+| | output: sum(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt))
+| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | mem-estimate=466.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=6 row-size=165B cardinality=415.48M cost=2488141235
+| | in pipelines: 01(GETNEXT)
| |
-| 24:HASH JOIN [INNER JOIN, PARTITIONED]
+| 04:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=01
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | fk/pk conjuncts: none
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=21,23,25 row-size=177B cardinality=406.27M cost=186854633
-| | in pipelines: 20(GETNEXT), 23(OPEN)
+| | tuple-ids=2,4,0 row-size=177B cardinality=441.48M cost=193234710
+| | in pipelines: 01(GETNEXT), 00(OPEN)
| |
-| |--F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
-| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=460 segment-costs=[54467197]
+| |--F23:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| | | Per-Instance Resources: mem-estimate=54.45MB mem-reservation=34.00MB thread-reservation=1
+| | | max-parallelism=470 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=01 plan-id=02 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
-| | | runtime filters: RF018[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF019[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | | runtime filters: RF019[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 48:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)]
+| | 48:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=25 row-size=153B cardinality=30.00M cost=24467197
-| | | in pipelines: 23(GETNEXT)
+| | | tuple-ids=0 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 00(GETNEXT)
| | |
| | F18:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[342891999]
-| | 23:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=25 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 23(GETNEXT)
+| | tuple-ids=0 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 00(GETNEXT)
| |
-| 47:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)]
+| 47:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)]
| | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=21,23 row-size=24B cardinality=441.48M cost=114033643
-| | in pipelines: 20(GETNEXT)
+| | tuple-ids=2,4 row-size=24B cardinality=441.48M cost=114033643
+| | in pipelines: 01(GETNEXT)
| |
| F16:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
+| Per-Host Shared Resources: mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0 runtime-filters-memory=1.00MB
| Per-Instance Resources: mem-estimate=31.00MB mem-reservation=128.00KB thread-reservation=1
| max-parallelism=150 segment-costs=[1444631277]
-| 22:HASH JOIN [INNER JOIN, BROADCAST]
+| 03:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=02
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=21,23 row-size=24B cardinality=441.48M cost=193234710
-| | in pipelines: 20(GETNEXT), 21(OPEN)
+| | tuple-ids=2,4 row-size=24B cardinality=441.48M cost=193234710
+| | in pipelines: 01(GETNEXT), 02(OPEN)
| |
| |--F24:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=02 plan-id=03 cohort-id=02
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
-| | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | | runtime filters: RF020[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 46:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=23 row-size=8B cardinality=373 cost=490
-| | | in pipelines: 21(GETNEXT)
+| | | tuple-ids=4 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 02(GETNEXT)
| | |
| | F17:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| | max-parallelism=1 segment-costs=[12536]
-| | 21:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 02:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=23 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 21(GETNEXT)
+| | tuple-ids=4 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 02(GETNEXT)
| |
-| 20:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL
+| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL
| HDFS partitions=1823/1824 files=1823 size=145.67GB
-| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
-| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk, RF018[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk
+| predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
+| runtime filters: RF019[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF020[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk
| stored statistics:
| table: rows=2.16G size=145.75GB
| partitions: 1823/1823 rows=2.16G
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=21 row-size=16B cardinality=441.48M(filtered from 2.16G) cost=114150479
-| in pipelines: 20(GETNEXT)
+| tuple-ids=2 row-size=16B cardinality=441.48M(filtered from 2.16G) cost=114150479
+| in pipelines: 01(GETNEXT)
|
-19:HASH JOIN [INNER JOIN, PARTITIONED]
+25:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=03
-| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer.c_customer_id
+| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20,13,6 row-size=495B cardinality=30.00M cost=13131000
+| tuple-ids=27,20,13 row-size=495B cardinality=30.00M cost=16759898
| in pipelines: 32(GETNEXT), 44(OPEN)
|
-|--F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=139.68MB mem-reservation=34.00MB thread-reservation=1
+|--F25:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=155.68MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
| | max-parallelism=70 segment-costs=[56123197] cpu-comparison-result=240 [max(50 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=03 plan-id=04 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_id
-| | runtime filters: RF003[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| | mem-estimate=109.86MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
-| 45:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id)]
+| 45:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=6 row-size=165B cardinality=30.00M cost=26123197
+| | tuple-ids=13 row-size=165B cardinality=30.00M cost=26123197
| | in pipelines: 44(GETNEXT)
| |
-| F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)] hosts=10 instances=120
+| F15:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)] hosts=10 instances=120
| Per-Instance Resources: mem-estimate=1.70GB mem-reservation=34.00MB thread-reservation=1
| max-parallelism=290 segment-costs=[2858479680, 334518771] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
| 44:AGGREGATE [FINALIZE]
| | output: sum:merge(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
| | mem-estimate=1.67GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=6 row-size=165B cardinality=30.00M cost=1802389423
-| | in pipelines: 44(GETNEXT), 00(OPEN)
+| | tuple-ids=13 row-size=165B cardinality=30.00M cost=1802389423
+| | in pipelines: 44(GETNEXT), 06(OPEN)
| |
-| 43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_id,tpcds_partitioned_parquet_snap.customer.c_first_name,tpcds_partitioned_parquet_snap.customer.c_last_name,tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer.c_birth_country,tpcds_partitioned_parquet_snap.customer.c_login,tpcds_partitioned_parquet_snap.customer.c_email_address)]
+| 43:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=6 row-size=165B cardinality=1.21G cost=1056090257
-| | in pipelines: 00(GETNEXT)
+| | tuple-ids=13 row-size=165B cardinality=1.21G cost=1056090257
+| | in pipelines: 06(GETNEXT)
| |
| F14:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
| Per-Instance Resources: mem-estimate=1.62GB mem-reservation=34.00MB thread-reservation=1
| max-parallelism=1360 segment-costs=[8621866148, 13523689412] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| 05:AGGREGATE [STREAMING]
+| 11:AGGREGATE [STREAMING]
| | output: sum(subtract(tpcds_partitioned_parquet_snap.store_sales.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales.ss_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer.c_customer_id, tpcds_partitioned_parquet_snap.customer.c_first_name, tpcds_partitioned_parquet_snap.customer.c_last_name, tpcds_partitioned_parquet_snap.customer.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer.c_birth_country, tpcds_partitioned_parquet_snap.customer.c_login, tpcds_partitioned_parquet_snap.customer.c_email_address
+| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
| | mem-estimate=1.52GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=6 row-size=165B cardinality=1.21G cost=7524480900
-| | in pipelines: 00(GETNEXT)
+| | tuple-ids=13 row-size=165B cardinality=1.21G cost=7524480900
+| | in pipelines: 06(GETNEXT)
| |
-| 04:HASH JOIN [INNER JOIN, PARTITIONED]
+| 10:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=04
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=0,2,4 row-size=177B cardinality=1.48G cost=681235853
-| | in pipelines: 00(GETNEXT), 03(OPEN)
+| | tuple-ids=7,9,11 row-size=177B cardinality=1.48G cost=681235853
+| | in pipelines: 06(GETNEXT), 09(OPEN)
| |
| |--F26:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)] hosts=10 instances=120
| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
| | | max-parallelism=1360 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=04 plan-id=05 cohort-id=03
-| | | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | | runtime filters: RF014[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF015[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 42:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
+| | 42:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)]
| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=4 row-size=153B cardinality=30.00M cost=24467197
-| | | in pipelines: 03(GETNEXT)
+| | | tuple-ids=11 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 09(GETNEXT)
| | |
| | F13:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[342891999]
-| | 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
-| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer.c_customer_id
+| | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
+| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=4 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 03(GETNEXT)
+| | tuple-ids=11 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 09(GETNEXT)
| |
| 41:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk)]
| | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=0,2 row-size=24B cardinality=1.61G cost=416149395
-| | in pipelines: 00(GETNEXT)
+| | tuple-ids=7,9 row-size=24B cardinality=1.61G cost=416149395
+| | in pipelines: 06(GETNEXT)
| |
| F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
| Per-Instance Resources: mem-estimate=31.00MB mem-reservation=512.00KB thread-reservation=1
| max-parallelism=373 segment-costs=[5291495835]
-| 02:HASH JOIN [INNER JOIN, BROADCAST]
+| 08:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=05
-| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=0,2 row-size=24B cardinality=1.61G cost=705182309
-| | in pipelines: 00(GETNEXT), 01(OPEN)
+| | tuple-ids=7,9 row-size=24B cardinality=1.61G cost=705182309
+| | in pipelines: 06(GETNEXT), 07(OPEN)
| |
| |--F27:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=05 plan-id=06 cohort-id=03
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | | runtime filters: RF016[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 40:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=2 row-size=8B cardinality=373 cost=490
-| | | in pipelines: 01(GETNEXT)
+| | | tuple-ids=9 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 07(GETNEXT)
| | |
| | F12:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| | max-parallelism=1 segment-costs=[12536]
-| | 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=2 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 01(GETNEXT)
+| | tuple-ids=9 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 07(GETNEXT)
| |
-| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
| partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
| HDFS partitions=1823/1824 files=1823 size=389.69GB
| predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
@@ -1297,275 +1296,276 @@ max-parallelism=70 segment-costs=[618534221, 230] cpu-comparison-result=960 [max
| extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=0 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330
-| in pipelines: 00(GETNEXT)
+| tuple-ids=7 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330
+| in pipelines: 06(GETNEXT)
|
-18:HASH JOIN [INNER JOIN, PARTITIONED]
+24:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=06
-| hash predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_1.c_customer_id = tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| hash predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer_2.c_customer_id = tpcds_partitioned_parquet_snap.customer_1.c_customer_id
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20,13 row-size=330B cardinality=30.00M cost=43371168
+| tuple-ids=27,20 row-size=330B cardinality=44.15M cost=45934741
| in pipelines: 32(GETNEXT), 37(OPEN)
|
-|--F28:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=152.38MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | max-parallelism=70 segment-costs=[56123197] cpu-comparison-result=240 [max(50 (self) vs 240 (sum children))]
+|--F28:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)] hosts=10 instances=50 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=204.56MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=70 segment-costs=[82590434] cpu-comparison-result=240 [max(50 (self) vs 240 (sum children))]
| JOIN BUILD
| | join-table-id=06 plan-id=07 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_id
-| | mem-estimate=109.86MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| | mem-estimate=158.74MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=44147752
| |
-| 39:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id)]
-| | mem-estimate=26.52MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=13 row-size=165B cardinality=30.00M cost=26123197
+| 39:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)]
+| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=44.15M cost=38442682
| | in pipelines: 37(GETNEXT)
| |
-| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)] hosts=10 instances=100 (adjusted from 120)
-| Per-Instance Resources: mem-estimate=682.07MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=100 segment-costs=[998294990, 334518771] cpu-comparison-result=240 [max(100 (self) vs 240 (sum children))]
+| F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=654.56MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=300 segment-costs=[2990292024, 492275059] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
| 37:AGGREGATE [FINALIZE]
-| | output: sum:merge(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
-| | mem-estimate=649.04MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=165B cardinality=30.00M cost=663759541
-| | in pipelines: 37(GETNEXT), 06(OPEN)
+| | output: sum:merge(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | having: sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt)) > CAST(0 AS DECIMAL(38,2))
+| | mem-estimate=621.53MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=44.15M cost=2605865203
+| | in pipelines: 37(GETNEXT), 13(OPEN)
| |
-| 36:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_id,tpcds_partitioned_parquet_snap.customer_0.c_first_name,tpcds_partitioned_parquet_snap.customer_0.c_last_name,tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_0.c_birth_country,tpcds_partitioned_parquet_snap.customer_0.c_login,tpcds_partitioned_parquet_snap.customer_0.c_email_address)]
+| 36:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)]
| | mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=13 row-size=165B cardinality=384.18M cost=334535449
-| | in pipelines: 06(GETNEXT)
+| | tuple-ids=20 row-size=165B cardinality=441.48M cost=384426821
+| | in pipelines: 13(GETNEXT)
| |
-| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
-| Per-Instance Resources: mem-estimate=508.79MB mem-reservation=34.00MB thread-reservation=1
-| max-parallelism=430 segment-costs=[2598908653, 4283870141] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-| 11:AGGREGATE [STREAMING]
-| | output: sum(subtract(tpcds_partitioned_parquet_snap.web_sales.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales.ws_ext_discount_amt))
-| | group by: tpcds_partitioned_parquet_snap.customer_0.c_customer_id, tpcds_partitioned_parquet_snap.customer_0.c_first_name, tpcds_partitioned_parquet_snap.customer_0.c_last_name, tpcds_partitioned_parquet_snap.customer_0.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_0.c_birth_country, tpcds_partitioned_parquet_snap.customer_0.c_login, tpcds_partitioned_parquet_snap.customer_0.c_email_address
-| | mem-estimate=428.97MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=13 row-size=165B cardinality=384.18M cost=2298020377
-| | in pipelines: 06(GETNEXT)
+| F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
+| Per-Instance Resources: mem-estimate=559.18MB mem-reservation=34.00MB thread-reservation=1
+| max-parallelism=500 segment-costs=[2913133556, 4922750583] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
+| 17:AGGREGATE [STREAMING]
+| | output: sum(subtract(tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_list_price, tpcds_partitioned_parquet_snap.web_sales_0.ws_ext_discount_amt))
+| | group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| | mem-estimate=466.14MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=20 row-size=165B cardinality=441.48M cost=2605865203
+| | in pipelines: 13(GETNEXT)
| |
-| 10:HASH JOIN [INNER JOIN, PARTITIONED]
+| 16:HASH JOIN [INNER JOIN, PARTITIONED]
| | hash-table-id=07
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | fk/pk conjuncts: none
| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=7,9,11 row-size=177B cardinality=406.27M cost=186854633
-| | in pipelines: 06(GETNEXT), 09(OPEN)
+| | tuple-ids=16,18,14 row-size=177B cardinality=441.48M cost=193234710
+| | in pipelines: 13(GETNEXT), 12(OPEN)
| |
-| |--F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)] hosts=10 instances=120
+| |--F29:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)] hosts=10 instances=120
| | | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | | max-parallelism=430 segment-costs=[54467197]
+| | | max-parallelism=500 segment-costs=[54467197]
| | JOIN BUILD
| | | join-table-id=07 plan-id=08 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
-| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_0.c_customer_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | | runtime filters: RF010[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF011[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
| | | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| | |
-| | 35:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_0.c_customer_sk)]
+| | 35:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_sk)]
| | | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=11 row-size=153B cardinality=30.00M cost=24467197
-| | | in pipelines: 09(GETNEXT)
+| | | tuple-ids=14 row-size=153B cardinality=30.00M cost=24467197
+| | | in pipelines: 12(GETNEXT)
| | |
| | F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
+| | Per-Host Shared Resources: mem-estimate=32.00MB mem-reservation=32.00MB thread-reservation=0 runtime-filters-memory=32.00MB
| | Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| | max-parallelism=10 segment-costs=[342891999]
-| | 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | 12:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| | HDFS partitions=1/1 files=1 size=1.55GB
-| | predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
-| | runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_0.c_customer_id
+| | predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
+| | runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF002[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
| | stored statistics:
| | table: rows=30.00M size=1.55GB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=3.10M
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_0.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_0.c_customer_sk IS NOT NULL
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| | tuple-ids=11 row-size=153B cardinality=30.00M cost=31557228
-| | in pipelines: 09(GETNEXT)
+| | tuple-ids=14 row-size=153B cardinality=30.00M cost=31557228
+| | in pipelines: 12(GETNEXT)
| |
-| 34:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk)]
+| 34:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk)]
| | mem-estimate=13.75MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=7,9 row-size=24B cardinality=441.48M cost=114033643
-| | in pipelines: 06(GETNEXT)
+| | tuple-ids=16,18 row-size=24B cardinality=441.48M cost=114033643
+| | in pipelines: 13(GETNEXT)
| |
| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
| Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
| Per-Instance Resources: mem-estimate=31.00MB mem-reservation=128.00KB thread-reservation=1
| max-parallelism=150 segment-costs=[1444631277]
-| 08:HASH JOIN [INNER JOIN, BROADCAST]
+| 15:HASH JOIN [INNER JOIN, BROADCAST]
| | hash-table-id=08
-| | hash predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | hash predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
| | mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| | tuple-ids=7,9 row-size=24B cardinality=441.48M cost=193234710
-| | in pipelines: 06(GETNEXT), 07(OPEN)
+| | tuple-ids=16,18 row-size=24B cardinality=441.48M cost=193234710
+| | in pipelines: 13(GETNEXT), 14(OPEN)
| |
| |--F30:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | | max-parallelism=10 segment-costs=[863]
| | JOIN BUILD
| | | join-table-id=08 plan-id=09 cohort-id=04
-| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
-| | | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk
+| | | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
| | | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| | |
| | 33:EXCHANGE [BROADCAST]
| | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | | tuple-ids=9 row-size=8B cardinality=373 cost=490
-| | | in pipelines: 07(GETNEXT)
+| | | tuple-ids=18 row-size=8B cardinality=373 cost=490
+| | | in pipelines: 14(GETNEXT)
| | |
| | F06:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| | Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| | max-parallelism=1 segment-costs=[12536]
-| | 07:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| | 14:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| | HDFS partitions=1/1 files=1 size=2.17MB
-| | predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
+| | predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
| | stored statistics:
| | table: rows=73.05K size=2.17MB
| | columns: all
| | extrapolated-rows=disabled max-scan-range-rows=73.05K
-| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT)
-| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_0.d_year = CAST(1999 AS INT), tpcds_partitioned_parquet_snap.date_dim_0.d_date_sk IS NOT NULL
+| | parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
| | mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| | tuple-ids=9 row-size=8B cardinality=373 cost=12520
-| | in pipelines: 07(GETNEXT)
+| | tuple-ids=18 row-size=8B cardinality=373 cost=12520
+| | in pipelines: 14(GETNEXT)
| |
-| 06:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
-| partition predicates: tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk IS NOT NULL
+| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.web_sales, RANDOM]
+| partition predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk IS NOT NULL
| HDFS partitions=1823/1824 files=1823 size=145.67GB
-| predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
-| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk
+| predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
+| runtime filters: RF011[min_max] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk, RF012[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_sold_date_sk, RF010[bloom] -> tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk
| stored statistics:
| table: rows=2.16G size=145.75GB
| partitions: 1823/1823 rows=2.16G
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.37M est-scan-range=373(filtered from 1823)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales.ws_bill_customer_sk IS NOT NULL
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.web_sales_0.ws_bill_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=7 row-size=16B cardinality=441.48M(filtered from 2.16G) cost=114150479
-| in pipelines: 06(GETNEXT)
+| tuple-ids=16 row-size=16B cardinality=441.48M(filtered from 2.16G) cost=114150479
+| in pipelines: 13(GETNEXT)
|
-38:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id)]
+38:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id)]
| mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| tuple-ids=20 row-size=165B cardinality=147.90M cost=128783355
+| tuple-ids=27 row-size=165B cardinality=147.90M cost=128783355
| in pipelines: 32(GETNEXT)
|
-F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)] hosts=10 instances=120
+F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)] hosts=10 instances=120
Per-Instance Resources: mem-estimate=2.07GB mem-reservation=34.00MB thread-reservation=1
max-parallelism=1010 segment-costs=[10017507045, 1649126185] cpu-comparison-result=240 [max(120 (self) vs 240 (sum children))]
32:AGGREGATE [FINALIZE]
| output: sum:merge(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt))
-| group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
| having: sum(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt)) > CAST(0 AS DECIMAL(38,2))
| mem-estimate=2.03GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20 row-size=165B cardinality=147.90M cost=8729673496
-| in pipelines: 32(GETNEXT), 12(OPEN)
+| tuple-ids=27 row-size=165B cardinality=147.90M cost=8729673496
+| in pipelines: 32(GETNEXT), 18(OPEN)
|
-31:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_id,tpcds_partitioned_parquet_snap.customer_1.c_first_name,tpcds_partitioned_parquet_snap.customer_1.c_last_name,tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_1.c_birth_country,tpcds_partitioned_parquet_snap.customer_1.c_login,tpcds_partitioned_parquet_snap.customer_1.c_email_address)]
+31:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_id,tpcds_partitioned_parquet_snap.customer_2.c_first_name,tpcds_partitioned_parquet_snap.customer_2.c_last_name,tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag,tpcds_partitioned_parquet_snap.customer_2.c_birth_country,tpcds_partitioned_parquet_snap.customer_2.c_login,tpcds_partitioned_parquet_snap.customer_2.c_email_address)]
| mem-estimate=29.82MB mem-reservation=0B thread-reservation=0
-| tuple-ids=20 row-size=165B cardinality=1.48G cost=1287833549
-| in pipelines: 12(GETNEXT)
+| tuple-ids=27 row-size=165B cardinality=1.48G cost=1287833549
+| in pipelines: 18(GETNEXT)
|
F03:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
Per-Instance Resources: mem-estimate=1.62GB mem-reservation=34.00MB thread-reservation=1
max-parallelism=1650 segment-costs=[9827058744, 16491261804] cpu-comparison-result=240 [max(240 (self) vs 141 (sum children))]
-17:AGGREGATE [STREAMING]
+23:AGGREGATE [STREAMING]
| output: sum(subtract(tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_list_price, tpcds_partitioned_parquet_snap.store_sales_0.ss_ext_discount_amt))
-| group by: tpcds_partitioned_parquet_snap.customer_1.c_customer_id, tpcds_partitioned_parquet_snap.customer_1.c_first_name, tpcds_partitioned_parquet_snap.customer_1.c_last_name, tpcds_partitioned_parquet_snap.customer_1.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_1.c_birth_country, tpcds_partitioned_parquet_snap.customer_1.c_login, tpcds_partitioned_parquet_snap.customer_1.c_email_address
+| group by: tpcds_partitioned_parquet_snap.customer_2.c_customer_id, tpcds_partitioned_parquet_snap.customer_2.c_first_name, tpcds_partitioned_parquet_snap.customer_2.c_last_name, tpcds_partitioned_parquet_snap.customer_2.c_preferred_cust_flag, tpcds_partitioned_parquet_snap.customer_2.c_birth_country, tpcds_partitioned_parquet_snap.customer_2.c_login, tpcds_partitioned_parquet_snap.customer_2.c_email_address
| mem-estimate=1.52GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=20 row-size=165B cardinality=1.48G cost=8729673496
-| in pipelines: 12(GETNEXT)
+| tuple-ids=27 row-size=165B cardinality=1.48G cost=8729673496
+| in pipelines: 18(GETNEXT)
|
-16:HASH JOIN [INNER JOIN, PARTITIONED]
+22:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=09
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk = tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=14,16,18 row-size=177B cardinality=1.48G cost=681235853
-| in pipelines: 12(GETNEXT), 15(OPEN)
+| tuple-ids=21,23,25 row-size=177B cardinality=1.48G cost=681235853
+| in pipelines: 18(GETNEXT), 21(OPEN)
|
|--F31:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)] hosts=10 instances=120
| | Per-Instance Resources: mem-estimate=70.45MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
| | max-parallelism=1650 segment-costs=[54467197]
| JOIN BUILD
| | join-table-id=09 plan-id=10 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
-| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_1.c_customer_sk
+| | build expressions: tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.customer_2.c_customer_sk
| | mem-estimate=42.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
-| 30:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_1.c_customer_sk)]
+| 30:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_2.c_customer_sk)]
| | mem-estimate=11.53MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=18 row-size=153B cardinality=30.00M cost=24467197
-| | in pipelines: 15(GETNEXT)
+| | tuple-ids=25 row-size=153B cardinality=30.00M cost=24467197
+| | in pipelines: 21(GETNEXT)
| |
| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Host Shared Resources: mem-estimate=32.00MB mem-reservation=32.00MB thread-reservation=0 runtime-filters-memory=32.00MB
+| Per-Host Shared Resources: mem-estimate=48.00MB mem-reservation=48.00MB thread-reservation=0 runtime-filters-memory=48.00MB
| Per-Instance Resources: mem-estimate=89.66MB mem-reservation=1.00MB thread-reservation=1
| max-parallelism=10 segment-costs=[342891999]
-| 15:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| 21:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
| HDFS partitions=1/1 files=1 size=1.55GB
-| predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
-| runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF004[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_1.c_customer_id
+| predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
+| runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF003[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF001[min_max] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF004[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF002[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer_2.c_customer_id
| stored statistics:
| table: rows=30.00M size=1.55GB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=3.10M
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_1.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_1.c_customer_sk IS NOT NULL
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_2.c_customer_id IS NOT NULL, tpcds_partitioned_parquet_snap.customer_2.c_customer_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=18 row-size=153B cardinality=30.00M cost=31557228
-| in pipelines: 15(GETNEXT)
+| tuple-ids=25 row-size=153B cardinality=30.00M cost=31557228
+| in pipelines: 21(GETNEXT)
|
29:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk)]
| mem-estimate=13.75MB mem-reservation=0B thread-reservation=0
-| tuple-ids=14,16 row-size=24B cardinality=1.61G cost=416149395
-| in pipelines: 12(GETNEXT)
+| tuple-ids=21,23 row-size=24B cardinality=1.61G cost=416149395
+| in pipelines: 18(GETNEXT)
|
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
Per-Instance Resources: mem-estimate=31.00MB mem-reservation=512.00KB thread-reservation=1
max-parallelism=373 segment-costs=[5291495835]
-14:HASH JOIN [INNER JOIN, BROADCAST]
+20:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=10
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=14,16 row-size=24B cardinality=1.61G cost=705182309
-| in pipelines: 12(GETNEXT), 13(OPEN)
+| tuple-ids=21,23 row-size=24B cardinality=1.61G cost=705182309
+| in pipelines: 18(GETNEXT), 19(OPEN)
|
|--F32:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[863]
| JOIN BUILD
| | join-table-id=10 plan-id=11 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
-| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk
+| | build expressions: tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
+| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| |
| 28:EXCHANGE [BROADCAST]
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=16 row-size=8B cardinality=373 cost=490
-| | in pipelines: 13(GETNEXT)
+| | tuple-ids=23 row-size=8B cardinality=373 cost=490
+| | in pipelines: 19(GETNEXT)
| |
| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
| max-parallelism=1 segment-costs=[12536]
-| 13:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| 19:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
+| predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
| stored statistics:
| table: rows=73.05K size=2.17MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_1.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_1.d_date_sk IS NOT NULL
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim_2.d_year = CAST(1998 AS INT), tpcds_partitioned_parquet_snap.date_dim_2.d_date_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=16 row-size=8B cardinality=373 cost=12520
-| in pipelines: 13(GETNEXT)
+| tuple-ids=23 row-size=8B cardinality=373 cost=12520
+| in pipelines: 19(GETNEXT)
|
-12:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+18:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
partition predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
@@ -1577,6 +1577,6 @@ max-parallelism=373 segment-costs=[5291495835]
extrapolated-rows=disabled max-scan-range-rows=12.22M est-scan-range=373(filtered from 1823)
parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales_0.ss_customer_sk IS NOT NULL
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=14 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330
- in pipelines: 12(GETNEXT)
+ tuple-ids=21 row-size=16B cardinality=1.61G(filtered from 7.88G) cost=436097330
+ in pipelines: 18(GETNEXT)
====
diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q13.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q13.test
index 6c3020446..3d00bfaf3 100644
--- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q13.test
+++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q13.test
@@ -55,7 +55,7 @@ Max Per-Host Resource Reservation: Memory=65.02MB Threads=1
Per-Host Resource Estimates: Memory=280MB
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=279.72MB mem-reservation=65.02MB thread-reservation=1 runtime-filters-memory=6.00MB
-| max-parallelism=1 segment-costs=[1646384122, 0]
+| max-parallelism=1 segment-costs=[1783746087, 0]
PLAN-ROOT SINK
| output exprs: avg(tpcds_partitioned_parquet_snap.store_sales.ss_quantity), avg(tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), avg(tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost)
| mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
@@ -63,19 +63,19 @@ PLAN-ROOT SINK
11:AGGREGATE [FINALIZE]
| output: avg(CAST(tpcds_partitioned_parquet_snap.store_sales.ss_quantity AS BIGINT)), avg(tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), avg(tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost)
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=13 row-size=40B cardinality=1 cost=158204
-| in pipelines: 11(GETNEXT), 00(OPEN)
+| tuple-ids=13 row-size=40B cardinality=1 cost=8569797
+| in pipelines: 11(GETNEXT), 02(OPEN)
|
10:HASH JOIN [INNER JOIN]
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
+| fk/pk conjuncts: none
| other join predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'Unknown' OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(1 AS INT), tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'U' OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(1 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parq [...]
| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
| mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0
-| tuple-ids=0,2,4,6,8,10 row-size=142B cardinality=565.02K cost=1636062
-| in pipelines: 00(GETNEXT), 09(OPEN)
+| tuple-ids=4,6,8,10,2,0 row-size=142B cardinality=30.61M cost=13609899
+| in pipelines: 02(GETNEXT), 00(OPEN)
|
-|--09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics]
+|--00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics]
| HDFS partitions=1/1 files=1 size=11.15MB
| predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('2 yr Degree', 'College', 'Unknown'), tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('2 yr Degree', 'Unknown') OR tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'S', tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('College', 'Unknown') OR tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = [...]
| stored statistics:
@@ -85,17 +85,39 @@ PLAN-ROOT SINK
| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('2 yr Degree', 'College', 'Unknown'), tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IN ('S', 'U', 'W')
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('2 yr Degree', 'College', 'Unknown'), tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IN ('S', 'U', 'W'), tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=10 row-size=39B cardinality=213.47K cost=888808
-| in pipelines: 09(GETNEXT)
+| tuple-ids=0 row-size=39B cardinality=213.47K cost=888808
+| in pipelines: 00(GETNEXT)
+|
+09:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| fk/pk conjuncts: none
+| other join predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'NE', 'OK', 'TX', 'WV') OR tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'NE', 'OK', 'TX', 'WV') OR tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(150.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('GA', 'KY', 'SC', 'TN', ' [...]
+| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| mem-estimate=154.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=4,6,8,10,2 row-size=103B cardinality=30.61M cost=16003526
+| in pipelines: 02(GETNEXT), 01(OPEN)
+|
+|--01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
+| HDFS partitions=1/1 files=1 size=307.36MB
+| predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States', tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
+| stored statistics:
+| table: rows=15.00M size=307.36MB
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=1.58M
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States'
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States', tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=2 row-size=43B cardinality=2.61M cost=5368500
+| in pipelines: 01(GETNEXT)
|
08:HASH JOIN [INNER JOIN]
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
| other join predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(100.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (C [...]
-| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
+| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2,4,6,8 row-size=103B cardinality=5.15M cost=7696494
-| in pipelines: 00(GETNEXT), 07(OPEN)
+| tuple-ids=4,6,8,10 row-size=60B cardinality=30.61M cost=45759565
+| in pipelines: 02(GETNEXT), 07(OPEN)
|
|--07:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics]
| HDFS partitions=1/1 files=1 size=41.69KB
@@ -107,38 +129,37 @@ PLAN-ROOT SINK
| parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT))
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
-| tuple-ids=8 row-size=8B cardinality=1.44K cost=1234
+| tuple-ids=10 row-size=8B cardinality=1.44K cost=1234
| in pipelines: 07(GETNEXT)
|
06:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| other join predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'NE', 'OK', 'TX', 'WV') OR tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'NE', 'OK', 'TX', 'WV') OR tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(150.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('GA', 'KY', 'SC', 'TN', ' [...]
-| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| mem-estimate=154.91MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4,6 row-size=95B cardinality=26.36M cost=47596529
-| in pipelines: 00(GETNEXT), 05(OPEN)
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=4,6,8 row-size=52B cardinality=156.77M cost=68619859
+| in pipelines: 02(GETNEXT), 05(OPEN)
|
-|--05:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
-| HDFS partitions=1/1 files=1 size=307.36MB
-| predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States', tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
+|--05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
+| HDFS partitions=1/1 files=1 size=2.17MB
+| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| stored statistics:
-| table: rows=15.00M size=307.36MB
+| table: rows=73.05K size=2.17MB
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=1.58M
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States'
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States', tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=6 row-size=43B cardinality=2.61M cost=5368500
+| extrapolated-rows=disabled max-scan-range-rows=73.05K
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=8 row-size=8B cardinality=373 cost=12520
| in pipelines: 05(GETNEXT)
|
04:HASH JOIN [INNER JOIN]
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk
-| runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk
+| runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF009[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2,4 row-size=52B cardinality=156.77M cost=68620836
-| in pipelines: 00(GETNEXT), 03(OPEN)
+| tuple-ids=4,6 row-size=44B cardinality=156.77M(filtered from 766.63M) cost=179127303
+| in pipelines: 02(GETNEXT), 03(OPEN)
|
|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.store]
| HDFS partitions=1/1 files=1 size=119.76KB
@@ -149,35 +170,14 @@ PLAN-ROOT SINK
| extrapolated-rows=disabled max-scan-range-rows=1.35K
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store.s_store_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
-| tuple-ids=4 row-size=4B cardinality=1.35K cost=115
+| tuple-ids=6 row-size=4B cardinality=1.35K cost=115
| in pipelines: 03(GETNEXT)
|
-02:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2 row-size=48B cardinality=156.77M cost=68619859
-| in pipelines: 00(GETNEXT), 01(OPEN)
-|
-|--01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim]
-| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
-| stored statistics:
-| table: rows=73.05K size=2.17MB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=2 row-size=8B cardinality=373 cost=12520
-| in pipelines: 01(GETNEXT)
-|
-00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
+02:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales]
partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ [...]
- runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF004[bloom] -> tpcds_partitioned [...]
+ runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF009[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF004[bloom] -> tpcds_partitioned_ [...]
stored statistics:
table: rows=8.64G size=389.90GB
partitions: 1823/1823 rows=8.25G
@@ -186,8 +186,8 @@ PLAN-ROOT SINK
parquet statistics predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2))
parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price IS NOT NULL, tpcds_partitioned_parquet_s [...]
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=0 row-size=40B cardinality=156.77M(filtered from 766.63M) cost=1445784961
- in pipelines: 00(GETNEXT)
+ tuple-ids=4 row-size=40B cardinality=156.77M(filtered from 766.63M) cost=1445784961
+ in pipelines: 02(GETNEXT)
---- DISTRIBUTEDPLAN
Max Per-Host Resource Reservation: Memory=701.45MB Threads=23
Per-Host Resource Estimates: Memory=986MB
@@ -212,21 +212,21 @@ PLAN-ROOT SINK
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
Per-Host Shared Resources: mem-estimate=6.00MB mem-reservation=6.00MB thread-reservation=0 runtime-filters-memory=6.00MB
Per-Instance Resources: mem-estimate=16.02MB mem-reservation=512.00KB thread-reservation=1
-max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [max(120 (self) vs 73 (sum children))]
+max-parallelism=180 segment-costs=[1774651180, 370] cpu-comparison-result=120 [max(120 (self) vs 73 (sum children))]
11:AGGREGATE
| output: avg(CAST(tpcds_partitioned_parquet_snap.store_sales.ss_quantity AS BIGINT)), avg(tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), avg(tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost)
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=12 row-size=40B cardinality=120 cost=158204
-| in pipelines: 11(GETNEXT), 00(OPEN)
+| tuple-ids=12 row-size=40B cardinality=120 cost=8569797
+| in pipelines: 11(GETNEXT), 02(OPEN)
|
10:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=00
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
+| fk/pk conjuncts: none
| other join predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'Unknown' OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(1 AS INT), tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'U' OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(1 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parq [...]
| mem-estimate=0B mem-reservation=0B spill-buffer=1.00MB thread-reservation=0
-| tuple-ids=0,2,4,6,8,10 row-size=142B cardinality=565.02K cost=1422592
-| in pipelines: 00(GETNEXT), 09(OPEN)
+| tuple-ids=4,6,8,10,2,0 row-size=142B cardinality=30.61M cost=13396429
+| in pipelines: 02(GETNEXT), 00(OPEN)
|
|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=213.27MB mem-reservation=205.00MB thread-reservation=1 runtime-filters-memory=1.00MB
@@ -239,13 +239,13 @@ max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [m
| |
| 16:EXCHANGE [BROADCAST]
| | mem-estimate=8.27MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=10 row-size=39B cardinality=213.47K cost=283700
-| | in pipelines: 09(GETNEXT)
+| | tuple-ids=0 row-size=39B cardinality=213.47K cost=283700
+| | in pipelines: 00(GETNEXT)
| |
| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| Per-Instance Resources: mem-estimate=16.17MB mem-reservation=1.00MB thread-reservation=1
| max-parallelism=10 segment-costs=[915650]
-| 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
+| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
| HDFS partitions=1/1 files=1 size=11.15MB
| predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('2 yr Degree', 'College', 'Unknown'), tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('2 yr Degree', 'Unknown') OR tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'S', tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('College', 'Unknown') OR tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = [...]
| stored statistics:
@@ -255,33 +255,72 @@ max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [m
| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('2 yr Degree', 'College', 'Unknown'), tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IN ('S', 'U', 'W')
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('2 yr Degree', 'College', 'Unknown'), tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IN ('S', 'U', 'W'), tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=10 row-size=39B cardinality=213.47K cost=888808
-| in pipelines: 09(GETNEXT)
+| tuple-ids=0 row-size=39B cardinality=213.47K cost=888808
+| in pipelines: 00(GETNEXT)
|
-08:HASH JOIN [INNER JOIN, BROADCAST]
+09:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=01
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| fk/pk conjuncts: none
+| other join predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'NE', 'OK', 'TX', 'WV') OR tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'NE', 'OK', 'TX', 'WV') OR tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(150.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('GA', 'KY', 'SC', 'TN', ' [...]
+| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=4,6,8,10,2 row-size=103B cardinality=30.61M cost=13396429
+| in pipelines: 02(GETNEXT), 01(OPEN)
+|
+|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=420.46MB mem-reservation=410.00MB thread-reservation=1 runtime-filters-memory=2.00MB
+| | max-parallelism=10 segment-costs=[6071927]
+| JOIN BUILD
+| | join-table-id=01 plan-id=02 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=2607097
+| |
+| 15:EXCHANGE [BROADCAST]
+| | mem-estimate=10.46MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=2 row-size=43B cardinality=2.61M cost=3464830
+| | in pipelines: 01(GETNEXT)
+| |
+| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| Per-Instance Resources: mem-estimate=16.18MB mem-reservation=128.00KB thread-reservation=1
+| max-parallelism=10 segment-costs=[5727497]
+| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
+| HDFS partitions=1/1 files=1 size=307.36MB
+| predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States', tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
+| stored statistics:
+| table: rows=15.00M size=307.36MB
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=1.58M
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States'
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States', tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=2 row-size=43B cardinality=2.61M cost=5368500
+| in pipelines: 01(GETNEXT)
+|
+08:HASH JOIN [INNER JOIN, BROADCAST]
+| hash-table-id=02
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
| other join predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(100.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (C [...]
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2,4,6,8 row-size=103B cardinality=5.15M cost=7695054
-| in pipelines: 00(GETNEXT), 07(OPEN)
+| tuple-ids=4,6,8,10 row-size=60B cardinality=30.61M cost=45758125
+| in pipelines: 02(GETNEXT), 07(OPEN)
|
-|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[3350]
| JOIN BUILD
-| | join-table-id=01 plan-id=02 cohort-id=01
+| | join-table-id=02 plan-id=03 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
-| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
+| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1440
| |
-| 15:EXCHANGE [BROADCAST]
+| 14:EXCHANGE [BROADCAST]
| | mem-estimate=23.25KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=8 row-size=8B cardinality=1.44K cost=1910
+| | tuple-ids=10 row-size=8B cardinality=1.44K cost=1910
| | in pipelines: 07(GETNEXT)
| |
-| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=64.00KB thread-reservation=1
| max-parallelism=1 segment-costs=[1296]
| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM]
@@ -294,71 +333,70 @@ max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [m
| parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT))
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
-| tuple-ids=8 row-size=8B cardinality=1.44K cost=1234
+| tuple-ids=10 row-size=8B cardinality=1.44K cost=1234
| in pipelines: 07(GETNEXT)
|
06:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=02
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| other join predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'NE', 'OK', 'TX', 'WV') OR tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'NE', 'OK', 'TX', 'WV') OR tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(150.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('GA', 'KY', 'SC', 'TN', ' [...]
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4,6 row-size=95B cardinality=26.36M cost=44989432
-| in pipelines: 00(GETNEXT), 05(OPEN)
+| hash-table-id=03
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=4,6,8 row-size=52B cardinality=156.77M cost=68619486
+| in pipelines: 02(GETNEXT), 05(OPEN)
|
-|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=420.46MB mem-reservation=410.00MB thread-reservation=1 runtime-filters-memory=2.00MB
-| | max-parallelism=10 segment-costs=[6071927]
+|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | max-parallelism=10 segment-costs=[863]
| JOIN BUILD
-| | join-table-id=02 plan-id=03 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=2607097
+| | join-table-id=03 plan-id=04 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| |
-| 14:EXCHANGE [BROADCAST]
-| | mem-estimate=10.46MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=6 row-size=43B cardinality=2.61M cost=3464830
+| 13:EXCHANGE [BROADCAST]
+| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=8 row-size=8B cardinality=373 cost=490
| | in pipelines: 05(GETNEXT)
| |
-| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Instance Resources: mem-estimate=16.18MB mem-reservation=128.00KB thread-reservation=1
-| max-parallelism=10 segment-costs=[5727497]
-| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
-| HDFS partitions=1/1 files=1 size=307.36MB
-| predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States', tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
+| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[12536]
+| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| HDFS partitions=1/1 files=1 size=2.17MB
+| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| stored statistics:
-| table: rows=15.00M size=307.36MB
+| table: rows=73.05K size=2.17MB
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=1.58M
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States'
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States', tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=6 row-size=43B cardinality=2.61M cost=5368500
+| extrapolated-rows=disabled max-scan-range-rows=73.05K
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=8 row-size=8B cardinality=373 cost=12520
| in pipelines: 05(GETNEXT)
|
04:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=03
+| hash-table-id=04
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2,4 row-size=52B cardinality=156.77M cost=68619486
-| in pipelines: 00(GETNEXT), 03(OPEN)
+| tuple-ids=4,6 row-size=44B cardinality=156.77M(filtered from 766.63M) cost=179125953
+| in pipelines: 02(GETNEXT), 03(OPEN)
|
-|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+|--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[3140]
| JOIN BUILD
-| | join-table-id=03 plan-id=04 cohort-id=01
+| | join-table-id=04 plan-id=05 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.store.s_store_sk
-| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk
+| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF009[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1350
| |
-| 13:EXCHANGE [BROADCAST]
+| 12:EXCHANGE [BROADCAST]
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=4B cardinality=1.35K cost=1790
+| | tuple-ids=6 row-size=4B cardinality=1.35K cost=1790
| | in pipelines: 03(GETNEXT)
| |
-| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=16.03MB mem-reservation=16.00KB thread-reservation=1
| max-parallelism=1 segment-costs=[158]
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
@@ -370,52 +408,14 @@ max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [m
| extrapolated-rows=disabled max-scan-range-rows=1.35K
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store.s_store_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
-| tuple-ids=4 row-size=4B cardinality=1.35K cost=115
+| tuple-ids=6 row-size=4B cardinality=1.35K cost=115
| in pipelines: 03(GETNEXT)
|
-02:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=04
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2 row-size=48B cardinality=156.77M cost=68619486
-| in pipelines: 00(GETNEXT), 01(OPEN)
-|
-|--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[863]
-| JOIN BUILD
-| | join-table-id=04 plan-id=05 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
-| |
-| 12:EXCHANGE [BROADCAST]
-| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=2 row-size=8B cardinality=373 cost=490
-| | in pipelines: 01(GETNEXT)
-| |
-| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
-| max-parallelism=1 segment-costs=[12536]
-| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
-| stored statistics:
-| table: rows=73.05K size=2.17MB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=2 row-size=8B cardinality=373 cost=12520
-| in pipelines: 01(GETNEXT)
-|
-00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+02:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ [...]
- runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF004[bloom] -> tpcds_partitioned [...]
+ runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF009[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF004[bloom] -> tpcds_partitioned_ [...]
stored statistics:
table: rows=8.64G size=389.90GB
partitions: 1823/1823 rows=8.25G
@@ -424,66 +424,65 @@ max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [m
parquet statistics predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2))
parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price IS NOT NULL, tpcds_partitioned_parquet_s [...]
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=0 row-size=40B cardinality=156.77M(filtered from 766.63M) cost=1445784961
- in pipelines: 00(GETNEXT)
+ tuple-ids=4 row-size=40B cardinality=156.77M(filtered from 766.63M) cost=1445784961
+ in pipelines: 02(GETNEXT)
---- PARALLELPLANS
-Max Per-Host Resource Reservation: Memory=701.45MB Threads=23
-Per-Host Resource Estimates: Memory=986MB
-F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=635.22KB mem-reservation=0B thread-reservation=1
-| max-parallelism=1 segment-costs=[68, 0] cpu-comparison-result=120 [max(1 (self) vs 120 (sum children))]
+Max Per-Host Resource Reservation: Memory=123.45MB Threads=24
+Per-Host Resource Estimates: Memory=463MB
+F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
+| Per-Instance Resources: mem-estimate=68.03KB mem-reservation=0B thread-reservation=1
+| max-parallelism=1 segment-costs=[68, 0] cpu-comparison-result=130 [max(1 (self) vs 130 (sum children))]
PLAN-ROOT SINK
| output exprs: avg(tpcds_partitioned_parquet_snap.store_sales.ss_quantity), avg(tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), avg(tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost)
| mem-estimate=0B mem-reservation=0B thread-reservation=0 cost=0
|
-18:AGGREGATE [FINALIZE]
+19:AGGREGATE [FINALIZE]
| output: avg:merge(tpcds_partitioned_parquet_snap.store_sales.ss_quantity), avg:merge(tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), avg:merge(tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), sum:merge(tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost)
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
| tuple-ids=13 row-size=40B cardinality=1 cost=33
-| in pipelines: 18(GETNEXT), 11(OPEN)
+| in pipelines: 19(GETNEXT), 11(OPEN)
|
-17:EXCHANGE [UNPARTITIONED]
-| mem-estimate=619.22KB mem-reservation=0B thread-reservation=0
+18:EXCHANGE [UNPARTITIONED]
+| mem-estimate=52.03KB mem-reservation=0B thread-reservation=0
| tuple-ids=12 row-size=40B cardinality=120 cost=35
| in pipelines: 11(GETNEXT)
|
-F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
-Per-Host Shared Resources: mem-estimate=6.00MB mem-reservation=6.00MB thread-reservation=0 runtime-filters-memory=6.00MB
-Per-Instance Resources: mem-estimate=16.02MB mem-reservation=512.00KB thread-reservation=1
-max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [max(120 (self) vs 73 (sum children))]
+F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] hosts=10 instances=10 (adjusted from 120)
+Per-Instance Resources: mem-estimate=18.92MB mem-reservation=0B thread-reservation=1
+max-parallelism=10 segment-costs=[50589347, 370] cpu-comparison-result=130 [max(130 (self) vs 73 (sum children))]
11:AGGREGATE
| output: avg(CAST(tpcds_partitioned_parquet_snap.store_sales.ss_quantity AS BIGINT)), avg(tpcds_partitioned_parquet_snap.store_sales.ss_ext_sales_price), avg(tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost), sum(tpcds_partitioned_parquet_snap.store_sales.ss_ext_wholesale_cost)
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=12 row-size=40B cardinality=120 cost=158204
-| in pipelines: 11(GETNEXT), 00(OPEN)
+| tuple-ids=12 row-size=40B cardinality=120 cost=8569797
+| in pipelines: 11(GETNEXT), 02(OPEN)
|
10:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=00
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk = tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
+| fk/pk conjuncts: none
| other join predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status = 'Unknown' OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(1 AS INT), tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'U' OR tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count = CAST(1 AS INT), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parq [...]
| mem-estimate=0B mem-reservation=0B spill-buffer=1.00MB thread-reservation=0
-| tuple-ids=0,2,4,6,8,10 row-size=142B cardinality=565.02K cost=1422592
-| in pipelines: 00(GETNEXT), 09(OPEN)
+| tuple-ids=4,6,8,10,2,0 row-size=142B cardinality=30.61M cost=13396429
+| in pipelines: 02(GETNEXT), 00(OPEN)
|
-|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=213.27MB mem-reservation=205.00MB thread-reservation=1 runtime-filters-memory=1.00MB
+|--F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=26.27MB mem-reservation=18.00MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[497170]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk
-| | mem-estimate=204.00MB mem-reservation=204.00MB spill-buffer=1.00MB thread-reservation=0 cost=213470
+| | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0 cost=213470
| |
-| 16:EXCHANGE [BROADCAST]
+| 17:EXCHANGE [BROADCAST]
| | mem-estimate=8.27MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=10 row-size=39B cardinality=213.47K cost=283700
-| | in pipelines: 09(GETNEXT)
+| | tuple-ids=0 row-size=39B cardinality=213.47K cost=283700
+| | in pipelines: 00(GETNEXT)
| |
-| F05:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| Per-Instance Resources: mem-estimate=16.17MB mem-reservation=1.00MB thread-reservation=1
| max-parallelism=10 segment-costs=[915650]
-| 09:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
+| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_demographics, RANDOM]
| HDFS partitions=1/1 files=1 size=11.15MB
| predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('2 yr Degree', 'College', 'Unknown'), tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('2 yr Degree', 'Unknown') OR tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = 'S', tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('College', 'Unknown') OR tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status = [...]
| stored statistics:
@@ -493,33 +492,81 @@ max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [m
| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('2 yr Degree', 'College', 'Unknown'), tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IN ('S', 'U', 'W')
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_demographics.cd_education_status IN ('2 yr Degree', 'College', 'Unknown'), tpcds_partitioned_parquet_snap.customer_demographics.cd_marital_status IN ('S', 'U', 'W'), tpcds_partitioned_parquet_snap.customer_demographics.cd_demo_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=10 row-size=39B cardinality=213.47K cost=888808
-| in pipelines: 09(GETNEXT)
+| tuple-ids=0 row-size=39B cardinality=213.47K cost=888808
+| in pipelines: 00(GETNEXT)
|
-08:HASH JOIN [INNER JOIN, BROADCAST]
+09:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=01
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| fk/pk conjuncts: none
+| other join predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'NE', 'OK', 'TX', 'WV') OR tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'NE', 'OK', 'TX', 'WV') OR tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(150.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('GA', 'KY', 'SC', 'TN', ' [...]
+| mem-estimate=0B mem-reservation=0B spill-buffer=1.00MB thread-reservation=0
+| tuple-ids=4,6,8,10,2 row-size=103B cardinality=30.61M cost=13396429
+| in pipelines: 02(GETNEXT), 01(OPEN)
+|
+|--F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)] hosts=10 instances=10 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=29.46MB mem-reservation=19.00MB thread-reservation=1 runtime-filters-memory=2.00MB
+| | max-parallelism=10 segment-costs=[3412429]
+| JOIN BUILD
+| | join-table-id=01 plan-id=02 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB thread-reservation=0 cost=2607097
+| |
+| 16:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)]
+| | mem-estimate=10.46MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=2 row-size=43B cardinality=2.61M cost=805332
+| | in pipelines: 01(GETNEXT)
+| |
+| F04:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| Per-Instance Resources: mem-estimate=17.84MB mem-reservation=128.00KB thread-reservation=1
+| max-parallelism=10 segment-costs=[13931249]
+| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
+| HDFS partitions=1/1 files=1 size=307.36MB
+| predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States', tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
+| stored statistics:
+| table: rows=15.00M size=307.36MB
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=1.58M
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States'
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States', tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
+| tuple-ids=2 row-size=43B cardinality=2.61M cost=5368500
+| in pipelines: 01(GETNEXT)
+|
+15:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk)]
+| mem-estimate=18.91MB mem-reservation=0B thread-reservation=0
+| tuple-ids=4,6,8,10 row-size=60B cardinality=30.61M cost=15226692
+| in pipelines: 02(GETNEXT)
+|
+F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+Per-Host Shared Resources: mem-estimate=6.00MB mem-reservation=6.00MB thread-reservation=0 runtime-filters-memory=6.00MB
+Per-Instance Resources: mem-estimate=18.97MB mem-reservation=512.00KB thread-reservation=1
+max-parallelism=200 segment-costs=[1920625430]
+08:HASH JOIN [INNER JOIN, BROADCAST]
+| hash-table-id=02
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk = tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
| other join predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(100.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT)) OR tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (C [...]
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2,4,6,8 row-size=103B cardinality=5.15M cost=7695054
-| in pipelines: 00(GETNEXT), 07(OPEN)
+| tuple-ids=4,6,8,10 row-size=60B cardinality=30.61M cost=45758125
+| in pipelines: 02(GETNEXT), 07(OPEN)
|
-|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[3350]
| JOIN BUILD
-| | join-table-id=01 plan-id=02 cohort-id=01
+| | join-table-id=02 plan-id=03 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
-| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
+| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1440
| |
-| 15:EXCHANGE [BROADCAST]
+| 14:EXCHANGE [BROADCAST]
| | mem-estimate=23.25KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=8 row-size=8B cardinality=1.44K cost=1910
+| | tuple-ids=10 row-size=8B cardinality=1.44K cost=1910
| | in pipelines: 07(GETNEXT)
| |
-| F04:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=64.00KB thread-reservation=1
| max-parallelism=1 segment-costs=[1296]
| 07:SCAN HDFS [tpcds_partitioned_parquet_snap.household_demographics, RANDOM]
@@ -532,71 +579,70 @@ max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [m
| parquet statistics predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT))
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.household_demographics.hd_dep_count IN (CAST(1 AS INT), CAST(3 AS INT)), tpcds_partitioned_parquet_snap.household_demographics.hd_demo_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=0
-| tuple-ids=8 row-size=8B cardinality=1.44K cost=1234
+| tuple-ids=10 row-size=8B cardinality=1.44K cost=1234
| in pipelines: 07(GETNEXT)
|
06:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=02
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| other join predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'NE', 'OK', 'TX', 'WV') OR tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'NE', 'OK', 'TX', 'WV') OR tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(150.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('GA', 'KY', 'SC', 'TN', ' [...]
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4,6 row-size=95B cardinality=26.36M cost=44989432
-| in pipelines: 00(GETNEXT), 05(OPEN)
+| hash-table-id=03
+| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
+| tuple-ids=4,6,8 row-size=52B cardinality=156.77M cost=68619486
+| in pipelines: 02(GETNEXT), 05(OPEN)
|
-|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=420.46MB mem-reservation=410.00MB thread-reservation=1 runtime-filters-memory=2.00MB
-| | max-parallelism=10 segment-costs=[6071927]
+|--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
+| | max-parallelism=10 segment-costs=[863]
| JOIN BUILD
-| | join-table-id=02 plan-id=03 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| | mem-estimate=408.00MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=2607097
+| | join-table-id=03 plan-id=04 cohort-id=01
+| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
| |
-| 14:EXCHANGE [BROADCAST]
-| | mem-estimate=10.46MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=6 row-size=43B cardinality=2.61M cost=3464830
+| 13:EXCHANGE [BROADCAST]
+| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
+| | tuple-ids=8 row-size=8B cardinality=373 cost=490
| | in pipelines: 05(GETNEXT)
| |
-| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Instance Resources: mem-estimate=16.18MB mem-reservation=128.00KB thread-reservation=1
-| max-parallelism=10 segment-costs=[5727497]
-| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
-| HDFS partitions=1/1 files=1 size=307.36MB
-| predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States', tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
+| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
+| max-parallelism=1 segment-costs=[12536]
+| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
+| HDFS partitions=1/1 files=1 size=2.17MB
+| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
| stored statistics:
-| table: rows=15.00M size=307.36MB
+| table: rows=73.05K size=2.17MB
| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=1.58M
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States'
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'KY', 'NE', 'OK', 'SC', 'TN', 'TX', 'WV'), tpcds_partitioned_parquet_snap.customer_address.ca_country = 'United States', tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=6 row-size=43B cardinality=2.61M cost=5368500
+| extrapolated-rows=disabled max-scan-range-rows=73.05K
+| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT)
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
+| tuple-ids=8 row-size=8B cardinality=373 cost=12520
| in pipelines: 05(GETNEXT)
|
04:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=03
+| hash-table-id=04
| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_store_sk = tpcds_partitioned_parquet_snap.store.s_store_sk
| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2,4 row-size=52B cardinality=156.77M cost=68619486
-| in pipelines: 00(GETNEXT), 03(OPEN)
+| tuple-ids=4,6 row-size=44B cardinality=156.77M(filtered from 766.63M) cost=179125953
+| in pipelines: 02(GETNEXT), 03(OPEN)
|
-|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+|--F12:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[3140]
| JOIN BUILD
-| | join-table-id=03 plan-id=04 cohort-id=01
+| | join-table-id=04 plan-id=05 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.store.s_store_sk
-| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk
+| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.store.s_store_sk, RF009[min_max] <- tpcds_partitioned_parquet_snap.store.s_store_sk
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=1350
| |
-| 13:EXCHANGE [BROADCAST]
+| 12:EXCHANGE [BROADCAST]
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=4B cardinality=1.35K cost=1790
+| | tuple-ids=6 row-size=4B cardinality=1.35K cost=1790
| | in pipelines: 03(GETNEXT)
| |
-| F02:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
+| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=16.03MB mem-reservation=16.00KB thread-reservation=1
| max-parallelism=1 segment-costs=[158]
| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.store, RANDOM]
@@ -608,52 +654,14 @@ max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [m
| extrapolated-rows=disabled max-scan-range-rows=1.35K
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.store.s_store_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=0
-| tuple-ids=4 row-size=4B cardinality=1.35K cost=115
+| tuple-ids=6 row-size=4B cardinality=1.35K cost=115
| in pipelines: 03(GETNEXT)
|
-02:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=04
-| hash predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=64.00KB thread-reservation=0
-| tuple-ids=0,2 row-size=48B cardinality=156.77M cost=68619486
-| in pipelines: 00(GETNEXT), 01(OPEN)
-|
-|--F11:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
-| | max-parallelism=10 segment-costs=[863]
-| JOIN BUILD
-| | join-table-id=04 plan-id=05 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | runtime filters: RF008[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=373
-| |
-| 12:EXCHANGE [BROADCAST]
-| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
-| | tuple-ids=2 row-size=8B cardinality=373 cost=490
-| | in pipelines: 01(GETNEXT)
-| |
-| F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=512.00KB thread-reservation=1
-| max-parallelism=1 segment-costs=[12536]
-| 01:SCAN HDFS [tpcds_partitioned_parquet_snap.date_dim, RANDOM]
-| HDFS partitions=1/1 files=1 size=2.17MB
-| predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
-| stored statistics:
-| table: rows=73.05K size=2.17MB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=73.05K
-| parquet statistics predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT)
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.date_dim.d_year = CAST(2001 AS INT), tpcds_partitioned_parquet_snap.date_dim.d_date_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
-| tuple-ids=2 row-size=8B cardinality=373 cost=12520
-| in pipelines: 01(GETNEXT)
-|
-00:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
+02:SCAN HDFS [tpcds_partitioned_parquet_snap.store_sales, RANDOM]
partition predicates: tpcds_partitioned_parquet_snap.store_sales.ss_sold_date_sk IS NOT NULL
HDFS partitions=1823/1824 files=1823 size=389.69GB
predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price IS NOT NULL, tpcds_partitioned_parquet_snap.store_sales.ss_ [...]
- runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF007[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF004[bloom] -> tpcds_partitioned [...]
+ runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF003[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF005[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_hdemo_sk, RF009[min_max] -> tpcds_partitioned_parquet_snap.store_sales.ss_store_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_cdemo_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.store_sales.ss_addr_sk, RF004[bloom] -> tpcds_partitioned_ [...]
stored statistics:
table: rows=8.64G size=389.90GB
partitions: 1823/1823 rows=8.25G
@@ -662,6 +670,6 @@ max-parallelism=170 segment-costs=[1637289215, 370] cpu-comparison-result=120 [m
parquet statistics predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2))
parquet dictionary predicates: tpcds_partitioned_parquet_snap.store_sales.ss_net_profit <= CAST(300.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_net_profit >= CAST(50.00 AS DECIMAL(7,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price <= CAST(200.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price >= CAST(50.00 AS DECIMAL(5,2)), tpcds_partitioned_parquet_snap.store_sales.ss_sales_price IS NOT NULL, tpcds_partitioned_parquet_s [...]
mem-estimate=16.00MB mem-reservation=512.00KB thread-reservation=0
- tuple-ids=0 row-size=40B cardinality=156.77M(filtered from 766.63M) cost=1445784961
- in pipelines: 00(GETNEXT)
+ tuple-ids=4 row-size=40B cardinality=156.77M(filtered from 766.63M) cost=1445784961
+ in pipelines: 02(GETNEXT)
====
diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q15.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q15.test
index c18844c74..4b78537ed 100644
--- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q15.test
+++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q15.test
@@ -20,11 +20,11 @@ select ca_zip
# end query 15 in stream 0 using template query15.tpl
---- PLAN
-Max Per-Host Resource Reservation: Memory=105.12MB Threads=1
-Per-Host Resource Estimates: Memory=1.93GB
+Max Per-Host Resource Reservation: Memory=103.81MB Threads=1
+Per-Host Resource Estimates: Memory=3.25GB
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=1.93GB mem-reservation=105.12MB thread-reservation=1 runtime-filters-memory=33.00MB
-| max-parallelism=1 segment-costs=[805831114, 76337, 200]
+| Per-Instance Resources: mem-estimate=3.25GB mem-reservation=103.81MB thread-reservation=1 runtime-filters-memory=33.00MB
+| max-parallelism=1 segment-costs=[655541798, 76337, 200]
PLAN-ROOT SINK
| output exprs: tpcds_partitioned_parquet_snap.customer_address.ca_zip, sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price)
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=200
@@ -43,51 +43,51 @@ PLAN-ROOT SINK
| in pipelines: 07(GETNEXT), 00(OPEN)
|
06:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| other join predicates: substr(tpcds_partitioned_parquet_snap.customer_address.ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('80348', '81792', '83405', '85392', '85460', '85669', '86197', '86475', '88274') OR tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'WA') OR tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price > CAST(500.00 AS DECIMAL(7,2))
-| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| mem-estimate=884.68MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4,6 row-size=67B cardinality=398.84M cost=189572816
-| in pipelines: 00(GETNEXT), 05(OPEN)
+| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| mem-estimate=1.95GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=0,2,4,6 row-size=67B cardinality=398.84M cost=213714282
+| in pipelines: 00(GETNEXT), 03(OPEN)
|
-|--05:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
+|--05:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk = tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | fk/pk conjuncts: none
+| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | mem-estimate=1.22GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=4,6 row-size=43B cardinality=30.00M cost=39283500
+| | in pipelines: 03(GETNEXT), 04(OPEN)
+| |
+| |--04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| | stored statistics:
+| | table: rows=30.00M size=1.55GB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=6 row-size=8B cardinality=30.00M cost=5142000
+| | in pipelines: 04(GETNEXT)
+| |
+| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address]
| HDFS partitions=1/1 files=1 size=307.36MB
| predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
+| runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
| stored statistics:
| table: rows=15.00M size=307.36MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=1.58M
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=6 row-size=35B cardinality=15.00M cost=2797500
-| in pipelines: 05(GETNEXT)
-|
-04:HASH JOIN [INNER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| mem-estimate=996.88MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4 row-size=32B cardinality=398.84M cost=213714282
-| in pipelines: 00(GETNEXT), 03(OPEN)
-|
-|--03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer]
-| HDFS partitions=1/1 files=1 size=1.55GB
-| predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
-| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
-| stored statistics:
-| table: rows=30.00M size=1.55GB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=3.10M
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=4 row-size=8B cardinality=30.00M cost=5142000
+| tuple-ids=4 row-size=35B cardinality=15.00M cost=2797500
| in pipelines: 03(GETNEXT)
|
02:HASH JOIN [INNER JOIN]
| hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
| tuple-ids=0,2 row-size=24B cardinality=434.48M cost=190172299
| in pipelines: 00(GETNEXT), 01(OPEN)
@@ -109,7 +109,7 @@ PLAN-ROOT SINK
partition predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk IS NOT NULL
HDFS partitions=1830/1831 files=1830 size=280.81GB
predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
- runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk
+ runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk
stored statistics:
table: rows=4.32G size=280.96GB
partitions: 1830/1830 rows=4.30G
@@ -120,47 +120,46 @@ PLAN-ROOT SINK
tuple-ids=0 row-size=12B cardinality=434.48M(filtered from 4.28G) cost=87725853
in pipelines: 00(GETNEXT)
---- DISTRIBUTEDPLAN
-Max Per-Host Resource Reservation: Memory=651.06MB Threads=16
-Per-Host Resource Estimates: Memory=2.22GB
-F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
+Max Per-Host Resource Reservation: Memory=427.81MB Threads=32
+Per-Host Resource Estimates: Memory=1.05GB
+F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=4.04MB mem-reservation=4.00MB thread-reservation=1
-| max-parallelism=1 segment-costs=[231] cpu-comparison-result=80 [max(1 (self) vs 80 (sum children))]
+| max-parallelism=1 segment-costs=[231] cpu-comparison-result=170 [max(1 (self) vs 170 (sum children))]
PLAN-ROOT SINK
| output exprs: tpcds_partitioned_parquet_snap.customer_address.ca_zip, sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price)
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=200
|
-14:MERGING-EXCHANGE [UNPARTITIONED]
+16:MERGING-EXCHANGE [UNPARTITIONED]
| order by: tpcds_partitioned_parquet_snap.customer_address.ca_zip ASC NULLS LAST
| limit: 100
| mem-estimate=36.46KB mem-reservation=0B thread-reservation=0
| tuple-ids=9 row-size=33B cardinality=100 cost=31
| in pipelines: 08(GETNEXT)
|
-F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_zip)] hosts=10 instances=10 (adjusted from 120)
-Per-Instance Resources: mem-estimate=16.73MB mem-reservation=1.94MB thread-reservation=1
-max-parallelism=10 segment-costs=[704393, 76337, 117] cpu-comparison-result=80 [max(10 (self) vs 80 (sum children))]
+F06:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_zip)] hosts=10 instances=10 (adjusted from 120)
+Per-Instance Resources: mem-estimate=15.65MB mem-reservation=1.94MB thread-reservation=1
+max-parallelism=10 segment-costs=[704393, 76337, 117] cpu-comparison-result=170 [max(10 (self) vs 170 (sum children))]
08:TOP-N [LIMIT=100]
| order by: tpcds_partitioned_parquet_snap.customer_address.ca_zip ASC NULLS LAST
| mem-estimate=3.22KB mem-reservation=0B thread-reservation=0
| tuple-ids=9 row-size=33B cardinality=100 cost=76337
-| in pipelines: 08(GETNEXT), 13(OPEN)
+| in pipelines: 08(GETNEXT), 15(OPEN)
|
-13:AGGREGATE [FINALIZE]
+15:AGGREGATE [FINALIZE]
| output: sum:merge(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price)
| group by: tpcds_partitioned_parquet_snap.customer_address.ca_zip
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
| tuple-ids=8 row-size=33B cardinality=10.17K cost=383519
-| in pipelines: 13(GETNEXT), 00(OPEN)
+| in pipelines: 15(GETNEXT), 00(OPEN)
|
-12:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_zip)]
-| mem-estimate=6.73MB mem-reservation=0B thread-reservation=0
+14:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_zip)]
+| mem-estimate=5.65MB mem-reservation=0B thread-reservation=0
| tuple-ids=8 row-size=33B cardinality=1.22M cost=320874
| in pipelines: 00(GETNEXT)
|
-F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=80 (adjusted from 120)
-Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
-Per-Instance Resources: mem-estimate=27.45MB mem-reservation=2.25MB thread-reservation=1
-max-parallelism=80 segment-costs=[756028270, 3222661] cpu-comparison-result=80 [max(80 (self) vs 51 (sum children))]
+F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=50 (adjusted from 120)
+Per-Instance Resources: mem-estimate=25.20MB mem-reservation=2.00MB thread-reservation=1
+max-parallelism=50 segment-costs=[415783800, 3222661] cpu-comparison-result=170 [max(170 (self) vs 91 (sum children))]
07:AGGREGATE [STREAMING]
| output: sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price)
| group by: tpcds_partitioned_parquet_snap.customer_address.ca_zip
@@ -168,83 +167,100 @@ max-parallelism=80 segment-costs=[756028270, 3222661] cpu-comparison-result=80 [
| tuple-ids=8 row-size=33B cardinality=1.22M cost=119843206
| in pipelines: 00(GETNEXT)
|
-06:HASH JOIN [INNER JOIN, BROADCAST]
+06:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=00
-| hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| other join predicates: substr(tpcds_partitioned_parquet_snap.customer_address.ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('80348', '81792', '83405', '85392', '85460', '85669', '86197', '86475', '88274') OR tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'WA') OR tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price > CAST(500.00 AS DECIMAL(7,2))
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4,6 row-size=67B cardinality=398.84M cost=174572816
-| in pipelines: 00(GETNEXT), 05(OPEN)
+| tuple-ids=0,2,4,6 row-size=67B cardinality=398.84M cost=183714282
+| in pipelines: 00(GETNEXT), 03(OPEN)
|
-|--F06:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=911.06MB mem-reservation=288.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | max-parallelism=10 segment-costs=[34934990]
+|--F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=50 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=66.96MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=50 segment-costs=[40371000] cpu-comparison-result=80 [max(80 (self) vs 30 (sum children))]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| | mem-estimate=884.68MB mem-reservation=272.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
+| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | mem-estimate=39.96MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| |
+| 13:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
+| | mem-estimate=11.00MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=4,6 row-size=43B cardinality=30.00M cost=10371000
+| | in pipelines: 03(GETNEXT)
+| |
+| F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] hosts=10 instances=20 (adjusted from 10)
+| Per-Instance Resources: mem-estimate=20.34MB mem-reservation=0B thread-reservation=1
+| max-parallelism=20 segment-costs=[127353000]
+| 05:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=01
+| | hash predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk = tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | fk/pk conjuncts: none
+| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=4,6 row-size=43B cardinality=30.00M cost=9283500
+| | in pipelines: 03(GETNEXT), 04(OPEN)
| |
-| 11:EXCHANGE [BROADCAST]
+| |--F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] hosts=10 instances=20 (adjusted from 10)
+| | | Per-Instance Resources: mem-estimate=88.67MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | | max-parallelism=20 segment-costs=[34437000]
+| | JOIN BUILD
+| | | join-table-id=01 plan-id=02 cohort-id=02
+| | | build expressions: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | | mem-estimate=62.55MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | |
+| | 11:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)]
+| | | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=6 row-size=8B cardinality=30.00M cost=4437000
+| | | in pipelines: 04(GETNEXT)
+| | |
+| | F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[36054000]
+| | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| | stored statistics:
+| | table: rows=30.00M size=1.55GB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=6 row-size=8B cardinality=30.00M cost=5142000
+| | in pipelines: 04(GETNEXT)
+| |
+| 10:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)]
| | mem-estimate=10.38MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=6 row-size=35B cardinality=15.00M cost=19934990
-| | in pipelines: 05(GETNEXT)
+| | tuple-ids=4 row-size=35B cardinality=15.00M cost=4081500
+| | in pipelines: 03(GETNEXT)
| |
-| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Instance Resources: mem-estimate=16.15MB mem-reservation=128.00KB thread-reservation=1
-| max-parallelism=10 segment-costs=[4539000]
-| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
+| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
+| Per-Instance Resources: mem-estimate=19.05MB mem-reservation=128.00KB thread-reservation=1
+| max-parallelism=10 segment-costs=[44335500]
+| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
| HDFS partitions=1/1 files=1 size=307.36MB
| predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
+| runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
| stored statistics:
| table: rows=15.00M size=307.36MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=1.58M
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=6 row-size=35B cardinality=15.00M cost=2797500
-| in pipelines: 05(GETNEXT)
-|
-04:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=01
-| hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4 row-size=32B cardinality=398.84M cost=183714282
-| in pipelines: 00(GETNEXT), 03(OPEN)
-|
-|--F07:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=1023.00MB mem-reservation=288.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | max-parallelism=10 segment-costs=[69869990]
-| JOIN BUILD
-| | join-table-id=01 plan-id=02 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | mem-estimate=996.88MB mem-reservation=272.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| |
-| 10:EXCHANGE [BROADCAST]
-| | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=8B cardinality=30.00M cost=39869990
-| | in pipelines: 03(GETNEXT)
-| |
-| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=1.00MB thread-reservation=1
-| max-parallelism=10 segment-costs=[6438000]
-| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| HDFS partitions=1/1 files=1 size=1.55GB
-| predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
-| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
-| stored statistics:
-| table: rows=30.00M size=1.55GB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=3.10M
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=4 row-size=8B cardinality=30.00M cost=5142000
+| tuple-ids=4 row-size=35B cardinality=15.00M cost=2797500
| in pipelines: 03(GETNEXT)
|
+12:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)]
+| mem-estimate=13.75MB mem-reservation=0B thread-reservation=0
+| tuple-ids=0,2 row-size=24B cardinality=434.48M cost=112226312
+| in pipelines: 00(GETNEXT)
+|
+F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
+Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
+Per-Instance Resources: mem-estimate=22.25MB mem-reservation=256.00KB thread-reservation=1
+max-parallelism=140 segment-costs=[1397119728]
02:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=02
| hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
@@ -253,14 +269,14 @@ max-parallelism=80 segment-costs=[756028270, 3222661] cpu-comparison-result=80 [
| tuple-ids=0,2 row-size=24B cardinality=434.48M cost=190172113
| in pipelines: 00(GETNEXT), 01(OPEN)
|
-|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=16.52MB mem-reservation=16.50MB thread-reservation=1 runtime-filters-memory=1.00MB
+|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[426]
| JOIN BUILD
| | join-table-id=02 plan-id=03 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | mem-estimate=15.50MB mem-reservation=15.50MB spill-buffer=64.00KB thread-reservation=0 cost=186
+| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=186
| |
| 09:EXCHANGE [BROADCAST]
| | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0
@@ -287,7 +303,7 @@ max-parallelism=80 segment-costs=[756028270, 3222661] cpu-comparison-result=80 [
partition predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk IS NOT NULL
HDFS partitions=1830/1831 files=1830 size=280.81GB
predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
- runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk
+ runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk
stored statistics:
table: rows=4.32G size=280.96GB
partitions: 1830/1830 rows=4.30G
@@ -298,46 +314,46 @@ max-parallelism=80 segment-costs=[756028270, 3222661] cpu-comparison-result=80 [
tuple-ids=0 row-size=12B cardinality=434.48M(filtered from 4.28G) cost=87725853
in pipelines: 00(GETNEXT)
---- PARALLELPLANS
-Max Per-Host Resource Reservation: Memory=751.81MB Threads=29
-Per-Host Resource Estimates: Memory=1.84GB
-F06:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
+Max Per-Host Resource Reservation: Memory=427.81MB Threads=32
+Per-Host Resource Estimates: Memory=1.05GB
+F07:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Instance Resources: mem-estimate=4.04MB mem-reservation=4.00MB thread-reservation=1
| max-parallelism=1 segment-costs=[231] cpu-comparison-result=170 [max(1 (self) vs 170 (sum children))]
PLAN-ROOT SINK
| output exprs: tpcds_partitioned_parquet_snap.customer_address.ca_zip, sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price)
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=200
|
-15:MERGING-EXCHANGE [UNPARTITIONED]
+16:MERGING-EXCHANGE [UNPARTITIONED]
| order by: tpcds_partitioned_parquet_snap.customer_address.ca_zip ASC NULLS LAST
| limit: 100
| mem-estimate=36.46KB mem-reservation=0B thread-reservation=0
| tuple-ids=9 row-size=33B cardinality=100 cost=31
| in pipelines: 08(GETNEXT)
|
-F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_zip)] hosts=10 instances=10 (adjusted from 120)
+F06:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_zip)] hosts=10 instances=10 (adjusted from 120)
Per-Instance Resources: mem-estimate=15.65MB mem-reservation=1.94MB thread-reservation=1
max-parallelism=10 segment-costs=[704393, 76337, 117] cpu-comparison-result=170 [max(10 (self) vs 170 (sum children))]
08:TOP-N [LIMIT=100]
| order by: tpcds_partitioned_parquet_snap.customer_address.ca_zip ASC NULLS LAST
| mem-estimate=3.22KB mem-reservation=0B thread-reservation=0
| tuple-ids=9 row-size=33B cardinality=100 cost=76337
-| in pipelines: 08(GETNEXT), 14(OPEN)
+| in pipelines: 08(GETNEXT), 15(OPEN)
|
-14:AGGREGATE [FINALIZE]
+15:AGGREGATE [FINALIZE]
| output: sum:merge(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price)
| group by: tpcds_partitioned_parquet_snap.customer_address.ca_zip
| mem-estimate=10.00MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
| tuple-ids=8 row-size=33B cardinality=10.17K cost=383519
-| in pipelines: 14(GETNEXT), 00(OPEN)
+| in pipelines: 15(GETNEXT), 00(OPEN)
|
-13:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_zip)]
+14:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_zip)]
| mem-estimate=5.65MB mem-reservation=0B thread-reservation=0
| tuple-ids=8 row-size=33B cardinality=1.22M cost=320874
| in pipelines: 00(GETNEXT)
|
-F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] hosts=10 instances=50 (adjusted from 120)
-Per-Instance Resources: mem-estimate=26.60MB mem-reservation=2.00MB thread-reservation=1
-max-parallelism=50 segment-costs=[426791434, 3222661] cpu-comparison-result=170 [max(170 (self) vs 91 (sum children))]
+F05:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=50 (adjusted from 120)
+Per-Instance Resources: mem-estimate=25.20MB mem-reservation=2.00MB thread-reservation=1
+max-parallelism=50 segment-costs=[415783800, 3222661] cpu-comparison-result=170 [max(170 (self) vs 91 (sum children))]
07:AGGREGATE [STREAMING]
| output: sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price)
| group by: tpcds_partitioned_parquet_snap.customer_address.ca_zip
@@ -347,90 +363,98 @@ max-parallelism=50 segment-costs=[426791434, 3222661] cpu-comparison-result=170
|
06:HASH JOIN [INNER JOIN, PARTITIONED]
| hash-table-id=00
-| hash predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk = tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
+| hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
| other join predicates: substr(tpcds_partitioned_parquet_snap.customer_address.ca_zip, CAST(1 AS BIGINT), CAST(5 AS BIGINT)) IN ('80348', '81792', '83405', '85392', '85460', '85669', '86197', '86475', '88274') OR tpcds_partitioned_parquet_snap.customer_address.ca_state IN ('CA', 'GA', 'WA') OR tpcds_partitioned_parquet_snap.catalog_sales.cs_sales_price > CAST(500.00 AS DECIMAL(7,2))
| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4,6 row-size=67B cardinality=398.84M cost=174572816
-| in pipelines: 00(GETNEXT), 05(OPEN)
+| tuple-ids=0,2,4,6 row-size=67B cardinality=398.84M cost=183714282
+| in pipelines: 00(GETNEXT), 03(OPEN)
|
-|--F07:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)] hosts=10 instances=50 (adjusted from 120)
-| | Per-Instance Resources: mem-estimate=60.38MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | max-parallelism=50 segment-costs=[19081500]
+|--F08:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)] hosts=10 instances=50 (adjusted from 120)
+| | Per-Instance Resources: mem-estimate=66.96MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | max-parallelism=50 segment-costs=[40371000] cpu-comparison-result=80 [max(80 (self) vs 30 (sum children))]
| JOIN BUILD
| | join-table-id=00 plan-id=01 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
-| | mem-estimate=34.00MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=15000000
+| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF001[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
+| | mem-estimate=39.96MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
| |
-| 12:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)]
+| 13:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_customer_sk)]
+| | mem-estimate=11.00MB mem-reservation=0B thread-reservation=0
+| | tuple-ids=4,6 row-size=43B cardinality=30.00M cost=10371000
+| | in pipelines: 03(GETNEXT)
+| |
+| F04:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] hosts=10 instances=20 (adjusted from 10)
+| Per-Instance Resources: mem-estimate=20.34MB mem-reservation=0B thread-reservation=1
+| max-parallelism=20 segment-costs=[127353000]
+| 05:HASH JOIN [INNER JOIN, PARTITIONED]
+| | hash-table-id=01
+| | hash predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk = tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | fk/pk conjuncts: none
+| | mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=4,6 row-size=43B cardinality=30.00M cost=9283500
+| | in pipelines: 03(GETNEXT), 04(OPEN)
+| |
+| |--F09:PLAN FRAGMENT [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)] hosts=10 instances=20 (adjusted from 10)
+| | | Per-Instance Resources: mem-estimate=88.67MB mem-reservation=50.00MB thread-reservation=1 runtime-filters-memory=16.00MB
+| | | max-parallelism=20 segment-costs=[34437000]
+| | JOIN BUILD
+| | | join-table-id=01 plan-id=02 cohort-id=02
+| | | build expressions: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF005[min_max] <- tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
+| | | mem-estimate=62.55MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
+| | |
+| | 11:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)]
+| | | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
+| | | tuple-ids=6 row-size=8B cardinality=30.00M cost=4437000
+| | | in pipelines: 04(GETNEXT)
+| | |
+| | F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| | Per-Instance Resources: mem-estimate=16.94MB mem-reservation=1.00MB thread-reservation=1
+| | max-parallelism=10 segment-costs=[36054000]
+| | 04:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
+| | HDFS partitions=1/1 files=1 size=1.55GB
+| | predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| | stored statistics:
+| | table: rows=30.00M size=1.55GB
+| | columns: all
+| | extrapolated-rows=disabled max-scan-range-rows=3.10M
+| | parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
+| | mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
+| | tuple-ids=6 row-size=8B cardinality=30.00M cost=5142000
+| | in pipelines: 04(GETNEXT)
+| |
+| 10:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer_address.ca_address_sk)]
| | mem-estimate=10.38MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=6 row-size=35B cardinality=15.00M cost=4081500
-| | in pipelines: 05(GETNEXT)
+| | tuple-ids=4 row-size=35B cardinality=15.00M cost=4081500
+| | in pipelines: 03(GETNEXT)
| |
-| F03:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Instance Resources: mem-estimate=23.62MB mem-reservation=128.00KB thread-reservation=1
+| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
+| Per-Instance Resources: mem-estimate=19.05MB mem-reservation=128.00KB thread-reservation=1
| max-parallelism=10 segment-costs=[44335500]
-| 05:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
+| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer_address, RANDOM]
| HDFS partitions=1/1 files=1 size=307.36MB
| predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
+| runtime filters: RF005[min_max] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.customer_address.ca_address_sk
| stored statistics:
| table: rows=15.00M size=307.36MB
| columns: all
| extrapolated-rows=disabled max-scan-range-rows=1.58M
| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer_address.ca_address_sk IS NOT NULL
| mem-estimate=16.00MB mem-reservation=128.00KB thread-reservation=0
-| tuple-ids=6 row-size=35B cardinality=15.00M cost=2797500
-| in pipelines: 05(GETNEXT)
+| tuple-ids=4 row-size=35B cardinality=15.00M cost=2797500
+| in pipelines: 03(GETNEXT)
|
-11:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.customer.c_current_addr_sk)]
-| mem-estimate=15.16MB mem-reservation=0B thread-reservation=0
-| tuple-ids=0,2,4 row-size=32B cardinality=398.84M cost=132375412
+12:EXCHANGE [HASH(tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk)]
+| mem-estimate=13.75MB mem-reservation=0B thread-reservation=0
+| tuple-ids=0,2 row-size=24B cardinality=434.48M cost=112226312
| in pipelines: 00(GETNEXT)
|
F00:PLAN FRAGMENT [RANDOM] hosts=10 instances=120
Per-Host Shared Resources: mem-estimate=17.00MB mem-reservation=17.00MB thread-reservation=0 runtime-filters-memory=17.00MB
-Per-Instance Resources: mem-estimate=24.59MB mem-reservation=256.00KB thread-reservation=1
-max-parallelism=186 segment-costs=[1899993346]
-04:HASH JOIN [INNER JOIN, BROADCAST]
-| hash-table-id=01
-| hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk = tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| mem-estimate=0B mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=0,2,4 row-size=32B cardinality=398.84M cost=183714282
-| in pipelines: 00(GETNEXT), 03(OPEN)
-|
-|--F08:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| | Per-Instance Resources: mem-estimate=1023.00MB mem-reservation=424.00MB thread-reservation=1 runtime-filters-memory=16.00MB
-| | max-parallelism=10 segment-costs=[69869990]
-| JOIN BUILD
-| | join-table-id=01 plan-id=02 cohort-id=01
-| | build expressions: tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk, RF003[min_max] <- tpcds_partitioned_parquet_snap.customer.c_customer_sk
-| | mem-estimate=996.88MB mem-reservation=408.00MB spill-buffer=2.00MB thread-reservation=0 cost=30000000
-| |
-| 10:EXCHANGE [BROADCAST]
-| | mem-estimate=10.12MB mem-reservation=0B thread-reservation=0
-| | tuple-ids=4 row-size=8B cardinality=30.00M cost=39869990
-| | in pipelines: 03(GETNEXT)
-| |
-| F02:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
-| Per-Host Shared Resources: mem-estimate=16.00MB mem-reservation=16.00MB thread-reservation=0 runtime-filters-memory=16.00MB
-| Per-Instance Resources: mem-estimate=16.05MB mem-reservation=1.00MB thread-reservation=1
-| max-parallelism=10 segment-costs=[6438000]
-| 03:SCAN HDFS [tpcds_partitioned_parquet_snap.customer, RANDOM]
-| HDFS partitions=1/1 files=1 size=1.55GB
-| predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
-| runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.customer.c_current_addr_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.customer.c_current_addr_sk
-| stored statistics:
-| table: rows=30.00M size=1.55GB
-| columns: all
-| extrapolated-rows=disabled max-scan-range-rows=3.10M
-| parquet dictionary predicates: tpcds_partitioned_parquet_snap.customer.c_current_addr_sk IS NOT NULL, tpcds_partitioned_parquet_snap.customer.c_customer_sk IS NOT NULL
-| mem-estimate=16.00MB mem-reservation=1.00MB thread-reservation=0
-| tuple-ids=4 row-size=8B cardinality=30.00M cost=5142000
-| in pipelines: 03(GETNEXT)
-|
+Per-Instance Resources: mem-estimate=22.25MB mem-reservation=256.00KB thread-reservation=1
+max-parallelism=140 segment-costs=[1397119728]
02:HASH JOIN [INNER JOIN, BROADCAST]
| hash-table-id=02
| hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk = tpcds_partitioned_parquet_snap.date_dim.d_date_sk
@@ -439,13 +463,13 @@ max-parallelism=186 segment-costs=[1899993346]
| tuple-ids=0,2 row-size=24B cardinality=434.48M cost=190172113
| in pipelines: 00(GETNEXT), 01(OPEN)
|
-|--F09:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
+|--F10:PLAN FRAGMENT [RANDOM] hosts=10 instances=10
| | Per-Instance Resources: mem-estimate=24.27MB mem-reservation=24.25MB thread-reservation=1 runtime-filters-memory=1.00MB
| | max-parallelism=10 segment-costs=[426]
| JOIN BUILD
| | join-table-id=02 plan-id=03 cohort-id=01
| | build expressions: tpcds_partitioned_parquet_snap.date_dim.d_date_sk
-| | runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
+| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.date_dim.d_date_sk
| | mem-estimate=23.25MB mem-reservation=23.25MB spill-buffer=64.00KB thread-reservation=0 cost=186
| |
| 09:EXCHANGE [BROADCAST]
@@ -473,7 +497,7 @@ max-parallelism=186 segment-costs=[1899993346]
partition predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk IS NOT NULL
HDFS partitions=1830/1831 files=1830 size=280.81GB
predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk IS NOT NULL
- runtime filters: RF003[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF004[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk
+ runtime filters: RF001[min_max] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF000[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_bill_customer_sk, RF002[bloom] -> tpcds_partitioned_parquet_snap.catalog_sales.cs_sold_date_sk
stored statistics:
table: rows=4.32G size=280.96GB
partitions: 1830/1830 rows=4.30G
diff --git a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q16.test b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q16.test
index 1af6f1053..6810d4b35 100644
--- a/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q16.test
+++ b/testdata/workloads/functional-planner/queries/PlannerTest/calcite_tpcds/tpcds-q16.test
@@ -31,50 +31,49 @@ limit 100
# end query 16 in stream 0 using template query16.tpl
---- PLAN
-Max Per-Host Resource Reservation: Memory=198.91MB Threads=1
-Per-Host Resource Estimates: Memory=13.63GB
+Max Per-Host Resource Reservation: Memory=226.00MB Threads=1
+Per-Host Resource Estimates: Memory=13.30GB
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
-| Per-Instance Resources: mem-estimate=13.63GB mem-reservation=198.91MB thread-reservation=1 runtime-filters-memory=40.00MB
-| max-parallelism=1 segment-costs=[2331318143, 2360025524, 908560583, 2848770608, 370814, 0, 3]
+| Per-Instance Resources: mem-estimate=13.30GB mem-reservation=226.00MB thread-reservation=1 runtime-filters-memory=55.00MB
+| max-parallelism=1 segment-costs=[2331318143, 908560583, 4102622428, 7535971, 0, 3]
PLAN-ROOT SINK
| output exprs: count(tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number), sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_ship_cost), sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_net_profit)
| mem-estimate=4.00MB mem-reservation=4.00MB spill-buffer=2.00MB thread-reservation=0 cost=3
|
-24:TOP-N [LIMIT=100]
+23:TOP-N [LIMIT=100]
| order by: count(tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number) ASC NULLS LAST
| mem-estimate=40B mem-reservation=0B thread-reservation=0
-| tuple-ids=25 row-size=40B cardinality=1 cost=0
-| in pipelines: 24(GETNEXT), 23(OPEN)
+| tuple-ids=24 row-size=40B cardinality=1 cost=0
+| in pipelines: 23(GETNEXT), 22(OPEN)
|
-23:AGGREGATE [FINALIZE]
+22:AGGREGATE [FINALIZE]
| output: count(tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number), sum:merge(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_ship_cost), sum:merge(tpcds_partitioned_parquet_snap.catalog_sales.cs_net_profit)
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=24 row-size=40B cardinality=1 cost=370814
-| in pipelines: 23(GETNEXT), 22(OPEN)
+| tuple-ids=23 row-size=40B cardinality=1 cost=7535971
+| in pipelines: 22(GETNEXT), 21(OPEN)
|
-22:AGGREGATE
+21:AGGREGATE
| output: sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_ext_ship_cost), sum(tpcds_partitioned_parquet_snap.catalog_sales.cs_net_profit)
| group by: tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number
-| mem-estimate=87.57MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=23 row-size=40B cardinality=1.77M cost=5243845
-| in pipelines: 22(GETNEXT), 01(OPEN)
+| mem-estimate=1.74GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=22 row-size=40B cardinality=35.89M cost=106569403
+| in pipelines: 21(GETNEXT), 10(OPEN)
|
-21:HASH JOIN [RIGHT OUTER JOIN]
-| hash predicates: tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number = tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number
-| fk/pk conjuncts: none
-| other predicates: if(TupleIsNull(2), NULL, TRUE) IS NULL
-| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number, RF001[min_max] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number
-| mem-estimate=131.15MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| tuple-ids=2N,22,3,5,7,9 row-size=108B cardinality=1.77M cost=72312054
-| in pipelines: 01(GETNEXT), 19(OPEN)
+20:HASH JOIN [RIGHT SEMI JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_order_number = tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number, tpcds_partitioned_parquet_snap.catalog_sales_1.cs_warehouse_sk = tpcds_partitioned_parquet_snap.catalog_sales.cs_warehouse_sk
+| runtime filters: RF000[bloom] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number, RF001[bloom] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_warehouse_sk, RF002[min_max] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number, RF003[min_max] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_warehouse_sk
+| mem-estimate=3.94GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=2N,3,5,7,9 row-size=96B cardinality=35.89M cost=96913134
+| in pipelines: 10(GETNEXT), 01(OPEN)
|
-|--20:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_order_number = tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number, tpcds_partitioned_parquet_snap.catalog_sales_1.cs_warehouse_sk = tpcds_partitioned_parquet_snap.catalog_sales.cs_warehouse_sk
-| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_order_number = tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number, tpcds_partitioned_parquet_snap.catalog_sales_1.cs_warehouse_sk = tpcds_partitioned_parquet_snap.catalog_sales.cs_warehouse_sk
-| | runtime filters: RF002[bloom] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number, RF003[bloom] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_warehouse_sk, RF004[min_max] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number, RF005[min_max] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_warehouse_sk
+|--09:HASH JOIN [RIGHT OUTER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number = tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number
+| | fk/pk conjuncts: none
+| | other predicates: if(TupleIsNull(2), NULL, TRUE) IS NULL
+| | runtime filters: RF012[bloom] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number, RF013[min_max] <- tpcds_partitioned_parquet_snap.catalog_sales.cs_order_number
| | mem-estimate=2.62GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=22,3,5,7,9 row-size=100B cardinality=1.13M cost=77677952
-| | in pipelines: 19(GETNEXT), 02(OPEN)
+| | tuple-ids=2N,3,5,7,9 row-size=96B cardinality=35.89M cost=100313626
+| | in pipelines: 01(GETNEXT), 02(OPEN)
| |
| |--08:HASH JOIN [INNER JOIN]
| | | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales.cs_call_center_sk = tpcds_partitioned_parquet_snap.call_center.cc_call_center_sk
@@ -153,231 +152,239 @@ PLAN-ROOT SINK
| | tuple-ids=3 row-size=32B cardinality=79.51M(filtered from 4.28G) cost=2597662888
| | in pipelines: 02(GETNEXT)
| |
-| 19:AGGREGATE [FINALIZE]
+| 01:AGGREGATE [FINALIZE]
+| | group by: tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number
+| | mem-estimate=5.15GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=2 row-size=8B cardinality=276.27M cost=846652549
+| | in pipelines: 01(GETNEXT), 00(OPEN)
+| |
+| 00:SCAN HDFS [tpcds_partitioned_parquet_snap.catalog_returns]
+| HDFS partitions=2060/2060 files=2060 size=32.77GB
+| predicates: tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number IS NOT NULL
+| runtime filters: RF013[min_max] -> tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number, RF012[bloom] -> tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number
+| stored statistics:
+| table: rows=432.02M size=32.77GB
+| partitions: 2060/2060 rows=432.02M
+| columns: all
+| extrapolated-rows=disabled max-scan-range-rows=416.82K
+| parquet dictionary predicates: tpcds_partitioned_parquet_snap.catalog_returns.cr_order_number IS NOT NULL
+| mem-estimate=16.00MB mem-reservation=32.00KB thread-reservation=0
+| tuple-ids=0 row-size=8B cardinality=432.02M cost=61908034
+| in pipelines: 00(GETNEXT)
+|
+19:HASH JOIN [INNER JOIN]
+| hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number = tpcds_partitioned_parquet_snap.catalog_sales_1.cs_order_number
+| fk/pk conjuncts: none
+| other join predicates: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_warehouse_sk != tpcds_partitioned_parquet_snap.catalog_sales_0.cs_warehouse_sk
+| runtime filters: RF004[bloom] <- tpcds_partitioned_parquet_snap.catalog_sales_1.cs_order_number, RF005[min_max] <- tpcds_partitioned_parquet_snap.catalog_sales_1.cs_order_number
+| mem-estimate=1.01GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| tuple-ids=11,21 row-size=24B cardinality=212.57M cost=115991651
+| in pipelines: 10(GETNEXT), 18(OPEN)
+|
+|--18:AGGREGATE [FINALIZE]
| | group by: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_warehouse_sk, tpcds_partitioned_parquet_snap.catalog_sales_1.cs_order_number
-| | mem-estimate=4.75GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=22 row-size=12B cardinality=212.57M cost=1254736016
-| | in pipelines: 19(GETNEXT), 09(OPEN)
+| | mem-estimate=525.24MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
+| | tuple-ids=21 row-size=12B cardinality=22.95M cost=135454369
+| | in pipelines: 18(GETNEXT), 11(OPEN)
| |
-| 18:HASH JOIN [INNER JOIN]
-| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_0.cs_order_number = tpcds_partitioned_parquet_snap.catalog_sales_1.cs_order_number
-| | fk/pk conjuncts: none
-| | other join predicates: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_warehouse_sk != tpcds_partitioned_parquet_snap.catalog_sales_0.cs_warehouse_sk
-| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.catalog_sales_1.cs_order_number, RF007[min_max] <- tpcds_partitioned_parquet_snap.catalog_sales_1.cs_order_number
-| | mem-estimate=1.01GB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | tuple-ids=11,21 row-size=24B cardinality=212.57M cost=115991651
-| | in pipelines: 09(GETNEXT), 17(OPEN)
+| 17:HASH JOIN [INNER JOIN]
+| | hash predicates: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_call_center_sk = tpcds_partitioned_parquet_snap.call_center_0.cc_call_center_sk
+| | fk/pk conjuncts: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_call_center_sk = tpcds_partitioned_parquet_snap.call_center_0.cc_call_center_sk
+| | runtime filters: RF006[bloom] <- tpcds_partitioned_parquet_snap.call_center_0.cc_call_center_sk, RF007[min_max] <- tpcds_partitioned_parquet_snap.call_center_0.cc_call_center_sk
+| | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0
+| | tuple-ids=13,15,17,19 row-size=80B cardinality=22.95M cost=24339588
+| | in pipelines: 11(GETNEXT), 16(OPEN)
| |
-| |--17:AGGREGATE [FINALIZE]
-| | | group by: tpcds_partitioned_parquet_snap.catalog_sales_1.cs_warehouse_sk, tpcds_partitioned_parquet_snap.catalog_sales_1.cs_order_number
-| | | mem-estimate=525.24MB mem-reservation=34.00MB spill-buffer=2.00MB thread-reservation=0
-| | | tuple-ids=21 row-size=12B cardinality=22.95M cost=135454369
... 66069 lines suppressed ...