You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by gi...@apache.org on 2023/01/26 19:11:01 UTC
[arrow-datafusion] branch dependabot/cargo/master/cranelift-native-0.92.0 updated (5e1cd03e8 -> 481ddda42)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/master/cranelift-native-0.92.0
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion.git
discard 5e1cd03e8 Update cranelift-native requirement from 0.89.0 to 0.92.0
add 8dc4c9607 Sqllogictest: use the same normalization for all tests (#5013)
add 64714ee7e [Enhancement] early check table exist before create (#4998)
add 25ab1f937 [sqllogictest] Create empty tables (#5026)
add 930c8deff [sqllogictets] Remove postgres container orchestration (#5015)
add 624f02d15 Support for bounded execution when window frame involves UNBOUNDED PRECEDING (#5003)
add 5d4038a84 Infer values for inserts (#4977)
add 9f498bbc8 Add dictionary_expresions feature (#4386) (#4999)
add ab00bc118 [Feature] support describe file (#4995)
add 0820eb987 Cleanup CI (#5040) (#5047)
add 13dfdd674 [BugFix] fix explain csv/json/avro exec can not see metrics bug (#5018)
add c313601b5 Ensure insert projections are of correct type (#5049)
add cb05490df Update links to logical plans module. (#5037)
add 3f5b83482 Remove python based posgres comparsion `integration-test` (#5031)
add e30711d04 Use correct schema in substrait ReadRel (#5050)
add c947b051c Improve join type support in substrait (#5051)
add f627ed98e Remove unnecessary pyo3 dependency from datafusion crate (#5048)
add 43aca8903 Retain schema order in projection (#5053)
add e3f0fce5d minor: Fix docs for create_default_catalog_and_schema (#5032)
add b5d90b6cb Fix homebrew publish script (#5044)
add 2aa14900e [sqllogictest] Read subdirectories in `test_files` (#5033)
add 4a33f2708 Change ExecutionPlan::maintains_input_order to return vector (to support multi children executors better) (#5035)
add 5238e8c97 Fix limit when size of batch to poll == skip/fetch value (#5066)
add a4ebd395c Simplify the `PushDownLimit`. (#5021)
add be4586858 Minor: Move some aggregate error tests to sqllogictests (#5055)
add 14e153e75 Validate assignment target column existence for UPDATE statements (#5069)
add 552eea719 Add decimal support to substrait serde (#5054)
add e24a7ecc6 Add `release-crates.sh` script (#5070)
add 8b716d398 Fix CREATE SCHEMA schema name double quoting issue. (#5059)
add bc9b78d95 Release 17.0.0 (#5073)
add 556fffbf2 Implemented a ReadOptions trait for cleaner code. (#5025)
add 481ddda42 Update cranelift-native requirement from 0.89.0 to 0.92.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (5e1cd03e8)
\
N -- N -- N refs/heads/dependabot/cargo/master/cranelift-native-0.92.0 (481ddda42)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/actions/setup-builder/action.yaml | 9 +
.github/workflows/cancel.yml | 46 ----
.github/workflows/dev.yml | 4 +
.github/workflows/dev_pr.yml | 4 +
.github/workflows/rust.yml | 204 +++++++----------
benchmarks/Cargo.toml | 6 +-
datafusion-cli/Cargo.lock | 16 +-
datafusion-cli/Cargo.toml | 4 +-
datafusion-cli/src/command.rs | 10 +-
datafusion-examples/Cargo.toml | 2 +-
datafusion/CHANGELOG.md | 147 ++++++++++++
datafusion/common/Cargo.toml | 2 +-
datafusion/common/src/config.rs | 3 +-
datafusion/core/Cargo.toml | 24 +-
datafusion/core/src/datasource/listing/table.rs | 10 +-
datafusion/core/src/execution/context.rs | 208 +++++++++--------
datafusion/core/src/execution/options.rs | 184 +++++++++++----
datafusion/core/src/lib.rs | 16 +-
.../core/src/physical_optimizer/repartition.rs | 30 +--
.../src/physical_optimizer/sort_enforcement.rs | 115 ++++++++--
datafusion/core/src/physical_optimizer/utils.rs | 55 +----
datafusion/core/src/physical_plan/common.rs | 63 ++++++
.../core/src/physical_plan/file_format/avro.rs | 8 +-
.../core/src/physical_plan/file_format/csv.rs | 26 ++-
.../src/physical_plan/file_format/file_stream.rs | 11 +-
.../core/src/physical_plan/file_format/json.rs | 8 +-
.../core/src/physical_plan/file_format/parquet.rs | 8 +-
datafusion/core/src/physical_plan/filter.rs | 4 +-
datafusion/core/src/physical_plan/limit.rs | 41 +++-
datafusion/core/src/physical_plan/mod.rs | 4 +-
datafusion/core/src/physical_plan/planner.rs | 5 +
datafusion/core/src/physical_plan/projection.rs | 4 +-
.../core/src/physical_plan/repartition/mod.rs | 6 +-
datafusion/core/src/physical_plan/union.rs | 71 +++---
.../windows/bounded_window_agg_exec.rs | 13 +-
datafusion/core/src/physical_plan/windows/mod.rs | 6 +-
.../src/physical_plan/windows/window_agg_exec.rs | 4 +-
.../core/src/scheduler/pipeline/execution.rs | 2 +-
datafusion/core/tests/path_partition.rs | 2 +-
datafusion/core/tests/sql/aggregates.rs | 114 ----------
datafusion/core/tests/sql/create_drop.rs | 48 +++-
datafusion/core/tests/sql/parquet.rs | 2 +-
datafusion/core/tests/sql/select.rs | 1 +
datafusion/core/tests/sql/window.rs | 140 +++++++++++-
datafusion/core/tests/sqllogictests/README.md | 27 ++-
.../postgres/postgres_create_table.sql | 21 --
.../src/engines/datafusion/create_table.rs | 68 ++++++
.../datafusion/{insert/mod.rs => insert.rs} | 4 +-
.../sqllogictests/src/engines/datafusion/mod.rs | 61 +++--
.../src/engines/datafusion/normalize.rs | 72 ++----
.../src/engines/datafusion/{insert => }/util.rs | 0
.../sqllogictests/src/engines/postgres/image.rs | 57 -----
.../sqllogictests/src/engines/postgres/mod.rs | 215 ++++++++++++++----
datafusion/core/tests/sqllogictests/src/main.rs | 159 ++++++-------
datafusion/core/tests/sqllogictests/src/setup.rs | 39 ----
.../tests/sqllogictests/test_files/aggregate.slt | 177 ++++++++++-----
.../core/tests/sqllogictests/test_files/ddl.slt | 48 +++-
.../tests/sqllogictests/test_files/describe.slt | 64 ++++++
.../{ => pg_compat}/pg_compat_simple.slt | 63 ++++++
.../test_files/{ => pg_compat}/pg_compat_types.slt | 0
.../test_files/{ => pg_compat}/pg_compat_union.slt | 57 +++++
.../{ => pg_compat}/pg_compat_window.slt | 57 +++++
.../core/tests/sqllogictests/test_files/tpch.slt | 10 +-
datafusion/core/tests/window_fuzz.rs | 156 +++++++++----
datafusion/expr/Cargo.toml | 4 +-
datafusion/expr/src/lib.rs | 11 +-
datafusion/expr/src/logical_plan/mod.rs | 10 +-
datafusion/expr/src/logical_plan/plan.rs | 25 ++-
datafusion/expr/src/utils.rs | 1 +
datafusion/jit/Cargo.toml | 6 +-
datafusion/optimizer/Cargo.toml | 10 +-
.../optimizer/src/common_subexpr_eliminate.rs | 1 +
datafusion/optimizer/src/push_down_limit.rs | 249 ++++++++++++---------
datafusion/optimizer/src/push_down_projection.rs | 1 +
datafusion/physical-expr/Cargo.toml | 15 +-
datafusion/physical-expr/src/aggregate/average.rs | 10 +-
datafusion/physical-expr/src/expressions/binary.rs | 1 +
datafusion/physical-expr/src/expressions/mod.rs | 2 +-
datafusion/physical-expr/src/utils.rs | 84 ++++++-
datafusion/physical-expr/src/window/aggregate.rs | 143 +++++++-----
datafusion/physical-expr/src/window/built_in.rs | 99 +++++---
datafusion/physical-expr/src/window/mod.rs | 2 +-
datafusion/physical-expr/src/window/nth_value.rs | 42 ++--
.../src/window/partition_evaluator.rs | 6 +
.../physical-expr/src/window/sliding_aggregate.rs | 159 +++----------
datafusion/physical-expr/src/window/window_expr.rs | 181 +++++++++++++--
datafusion/proto/Cargo.toml | 8 +-
datafusion/proto/src/logical_plan/mod.rs | 5 +-
datafusion/row/Cargo.toml | 6 +-
datafusion/sql/Cargo.toml | 9 +-
datafusion/sql/src/parser.rs | 8 +-
datafusion/sql/src/planner.rs | 2 +-
datafusion/sql/src/statement.rs | 181 ++++++++++-----
datafusion/sql/tests/integration_test.rs | 112 ++++++++-
datafusion/substrait/Cargo.toml | 4 +-
datafusion/substrait/src/consumer.rs | 140 +++++++-----
datafusion/substrait/src/producer.rs | 38 ++--
datafusion/substrait/tests/roundtrip.rs | 34 ++-
datafusion/substrait/tests/testdata/data.csv | 4 +-
dev/release/README.md | 44 +++-
dev/release/crate-deps.dot | 2 +
dev/release/crate-deps.svg | 32 ++-
dev/release/publish_homebrew.sh | 13 +-
dev/release/release-crates.sh | 45 ++++
dev/update_datafusion_versions.py | 1 +
docs/source/contributor-guide/index.md | 49 ----
docs/source/user-guide/configs.md | 2 +-
integration-tests/README.md | 49 ----
integration-tests/__init__.py | 15 --
integration-tests/create_test_table.sql | 34 ---
integration-tests/create_test_table_postgres.sql | 15 --
integration-tests/requirements.in | 18 --
integration-tests/requirements.txt | 114 ----------
integration-tests/sqls/character_length.sql | 17 --
.../sqls/partitioned_window_built_in_functions.sql | 29 ---
integration-tests/sqls/self_join_with_alias.sql | 22 --
integration-tests/sqls/simple_aggregation.sql | 24 --
integration-tests/sqls/simple_except.sql | 25 ---
integration-tests/sqls/simple_except_all.sql | 25 ---
integration-tests/sqls/simple_group_by.sql | 27 ---
integration-tests/sqls/simple_intersect.sql | 25 ---
integration-tests/sqls/simple_intersect_all.sql | 25 ---
integration-tests/sqls/simple_math_expressions.sql | 22 --
integration-tests/sqls/simple_ordered_row.sql | 26 ---
integration-tests/sqls/simple_row_past_future.sql | 24 --
integration-tests/sqls/simple_select.sql | 17 --
integration-tests/sqls/simple_sort.sql | 22 --
integration-tests/sqls/simple_sort_nulls_order.sql | 22 --
integration-tests/sqls/simple_union_all.sql | 17 --
.../sqls/simple_window_built_in_functions.sql | 29 ---
.../sqls/simple_window_full_aggregation.sql | 25 ---
integration-tests/sqls/simple_window_groups.sql | 71 ------
.../sqls/simple_window_lead_built_in_functions.sql | 27 ---
.../sqls/simple_window_ordered_aggregation.sql | 26 ---
.../sqls/simple_window_partition_aggregation.sql | 26 ---
.../simple_window_partition_order_aggregation.sql | 26 ---
integration-tests/sqls/simple_window_range.sql | 29 ---
.../simple_window_ranked_built_in_functions.sql | 24 --
integration-tests/sqls/values_list.sql | 19 --
integration-tests/test_psql_parity.py | 91 --------
140 files changed, 3108 insertions(+), 2745 deletions(-)
delete mode 100644 .github/workflows/cancel.yml
delete mode 100644 datafusion/core/tests/sqllogictests/postgres/postgres_create_table.sql
create mode 100644 datafusion/core/tests/sqllogictests/src/engines/datafusion/create_table.rs
rename datafusion/core/tests/sqllogictests/src/engines/datafusion/{insert/mod.rs => insert.rs} (98%)
rename datafusion/core/tests/sqllogictests/src/engines/datafusion/{insert => }/util.rs (100%)
delete mode 100644 datafusion/core/tests/sqllogictests/src/engines/postgres/image.rs
create mode 100644 datafusion/core/tests/sqllogictests/test_files/describe.slt
rename datafusion/core/tests/sqllogictests/test_files/{ => pg_compat}/pg_compat_simple.slt (94%)
rename datafusion/core/tests/sqllogictests/test_files/{ => pg_compat}/pg_compat_types.slt (100%)
rename datafusion/core/tests/sqllogictests/test_files/{ => pg_compat}/pg_compat_union.slt (58%)
rename datafusion/core/tests/sqllogictests/test_files/{ => pg_compat}/pg_compat_window.slt (98%)
create mode 100644 dev/release/release-crates.sh
delete mode 100644 integration-tests/README.md
delete mode 100644 integration-tests/__init__.py
delete mode 100644 integration-tests/create_test_table.sql
delete mode 100644 integration-tests/create_test_table_postgres.sql
delete mode 100644 integration-tests/requirements.in
delete mode 100644 integration-tests/requirements.txt
delete mode 100644 integration-tests/sqls/character_length.sql
delete mode 100644 integration-tests/sqls/partitioned_window_built_in_functions.sql
delete mode 100644 integration-tests/sqls/self_join_with_alias.sql
delete mode 100644 integration-tests/sqls/simple_aggregation.sql
delete mode 100644 integration-tests/sqls/simple_except.sql
delete mode 100644 integration-tests/sqls/simple_except_all.sql
delete mode 100644 integration-tests/sqls/simple_group_by.sql
delete mode 100644 integration-tests/sqls/simple_intersect.sql
delete mode 100644 integration-tests/sqls/simple_intersect_all.sql
delete mode 100644 integration-tests/sqls/simple_math_expressions.sql
delete mode 100644 integration-tests/sqls/simple_ordered_row.sql
delete mode 100644 integration-tests/sqls/simple_row_past_future.sql
delete mode 100644 integration-tests/sqls/simple_select.sql
delete mode 100644 integration-tests/sqls/simple_sort.sql
delete mode 100644 integration-tests/sqls/simple_sort_nulls_order.sql
delete mode 100644 integration-tests/sqls/simple_union_all.sql
delete mode 100644 integration-tests/sqls/simple_window_built_in_functions.sql
delete mode 100644 integration-tests/sqls/simple_window_full_aggregation.sql
delete mode 100644 integration-tests/sqls/simple_window_groups.sql
delete mode 100644 integration-tests/sqls/simple_window_lead_built_in_functions.sql
delete mode 100644 integration-tests/sqls/simple_window_ordered_aggregation.sql
delete mode 100644 integration-tests/sqls/simple_window_partition_aggregation.sql
delete mode 100644 integration-tests/sqls/simple_window_partition_order_aggregation.sql
delete mode 100644 integration-tests/sqls/simple_window_range.sql
delete mode 100644 integration-tests/sqls/simple_window_ranked_built_in_functions.sql
delete mode 100644 integration-tests/sqls/values_list.sql
delete mode 100644 integration-tests/test_psql_parity.py