You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by al...@apache.org on 2022/02/07 20:50:33 UTC
[arrow-datafusion] branch alamb/less_repartitioing updated (463c048 -> 2858e34)
This is an automated email from the ASF dual-hosted git repository.
alamb pushed a change to branch alamb/less_repartitioing
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion.git.
discard 463c048 Add notion of sortedness to `ExecutionPlan`, use to avoid repartitioning when that would result in incorrect behavior
This update removed existing revisions from the reference, leaving the
reference pointing at a previous point in the repository history.
* -- * -- N refs/heads/alamb/less_repartitioing (2858e34)
\
O -- O -- O (463c048)
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
datafusion/src/physical_optimizer/repartition.rs | 361 +++------------------
datafusion/src/physical_plan/analyze.rs | 5 -
datafusion/src/physical_plan/coalesce_batches.rs | 5 -
.../src/physical_plan/coalesce_partitions.rs | 5 -
datafusion/src/physical_plan/cross_join.rs | 5 -
datafusion/src/physical_plan/empty.rs | 5 -
datafusion/src/physical_plan/explain.rs | 6 +-
datafusion/src/physical_plan/file_format/avro.rs | 5 -
datafusion/src/physical_plan/file_format/csv.rs | 5 -
datafusion/src/physical_plan/file_format/json.rs | 5 -
.../src/physical_plan/file_format/parquet.rs | 5 -
datafusion/src/physical_plan/filter.rs | 10 -
datafusion/src/physical_plan/hash_aggregate.rs | 9 -
datafusion/src/physical_plan/hash_join.rs | 5 -
datafusion/src/physical_plan/limit.rs | 40 +--
datafusion/src/physical_plan/memory.rs | 5 -
datafusion/src/physical_plan/mod.rs | 55 +---
datafusion/src/physical_plan/planner.rs | 4 -
datafusion/src/physical_plan/projection.rs | 11 +-
datafusion/src/physical_plan/repartition.rs | 5 -
datafusion/src/physical_plan/sorts/sort.rs | 8 -
.../physical_plan/sorts/sort_preserving_merge.rs | 10 +-
datafusion/src/physical_plan/union.rs | 7 +-
datafusion/src/physical_plan/values.rs | 5 -
.../src/physical_plan/windows/window_agg_exec.rs | 9 -
datafusion/src/test/exec.rs | 24 +-
datafusion/tests/custom_sources.rs | 4 -
datafusion/tests/provider_filter_pushdown.rs | 5 -
datafusion/tests/statistics.rs | 9 +-
datafusion/tests/user_defined_plan.rs | 5 -
30 files changed, 77 insertions(+), 565 deletions(-)