You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by al...@apache.org on 2022/02/07 20:50:33 UTC

[arrow-datafusion] branch alamb/less_repartitioing updated (463c048 -> 2858e34)

This is an automated email from the ASF dual-hosted git repository.

alamb pushed a change to branch alamb/less_repartitioing
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion.git.


 discard 463c048  Add notion of sortedness to `ExecutionPlan`, use to avoid repartitioning when that would result in incorrect behavior

This update removed existing revisions from the reference, leaving the
reference pointing at a previous point in the repository history.

 * -- * -- N   refs/heads/alamb/less_repartitioing (2858e34)
            \
             O -- O -- O   (463c048)

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 datafusion/src/physical_optimizer/repartition.rs   | 361 +++------------------
 datafusion/src/physical_plan/analyze.rs            |   5 -
 datafusion/src/physical_plan/coalesce_batches.rs   |   5 -
 .../src/physical_plan/coalesce_partitions.rs       |   5 -
 datafusion/src/physical_plan/cross_join.rs         |   5 -
 datafusion/src/physical_plan/empty.rs              |   5 -
 datafusion/src/physical_plan/explain.rs            |   6 +-
 datafusion/src/physical_plan/file_format/avro.rs   |   5 -
 datafusion/src/physical_plan/file_format/csv.rs    |   5 -
 datafusion/src/physical_plan/file_format/json.rs   |   5 -
 .../src/physical_plan/file_format/parquet.rs       |   5 -
 datafusion/src/physical_plan/filter.rs             |  10 -
 datafusion/src/physical_plan/hash_aggregate.rs     |   9 -
 datafusion/src/physical_plan/hash_join.rs          |   5 -
 datafusion/src/physical_plan/limit.rs              |  40 +--
 datafusion/src/physical_plan/memory.rs             |   5 -
 datafusion/src/physical_plan/mod.rs                |  55 +---
 datafusion/src/physical_plan/planner.rs            |   4 -
 datafusion/src/physical_plan/projection.rs         |  11 +-
 datafusion/src/physical_plan/repartition.rs        |   5 -
 datafusion/src/physical_plan/sorts/sort.rs         |   8 -
 .../physical_plan/sorts/sort_preserving_merge.rs   |  10 +-
 datafusion/src/physical_plan/union.rs              |   7 +-
 datafusion/src/physical_plan/values.rs             |   5 -
 .../src/physical_plan/windows/window_agg_exec.rs   |   9 -
 datafusion/src/test/exec.rs                        |  24 +-
 datafusion/tests/custom_sources.rs                 |   4 -
 datafusion/tests/provider_filter_pushdown.rs       |   5 -
 datafusion/tests/statistics.rs                     |   9 +-
 datafusion/tests/user_defined_plan.rs              |   5 -
 30 files changed, 77 insertions(+), 565 deletions(-)