You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by gi...@apache.org on 2023/01/24 22:45:23 UTC
[arrow-datafusion] branch dependabot/cargo/master/pyo3-0.18.0 updated (f87548123 -> e6db1304d)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/master/pyo3-0.18.0
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion.git
discard f87548123 Update pyo3 requirement from 0.17.1 to 0.18.0
add db9214aa4 Upgrade to Substrait 0.4.0 (#4966)
add 7062c2efc Add Substrait to features (#4955)
add 2fdc7b836 Split function (#4958)
add ba9fc129b propagate planning error (#4940)
add ef4ca7e8f Improve documentation for ExprVisitor, port simple uses to new walking function (#4916)
add 8a34fe139 fix: `FieldNotFound` error message without valid fields (#4942)
add 896fd3f8f Add DataFusionError::Substrait variant to DataFusionError enum (#4971)
add 64fa312ec Minor: Reduce redundancy creating window_agg in sort_enforcement tests (#4945)
add e6a050058 Infer prepared statement parameter types (#4701)
add 96cf046be Unify Row hash and hash implementation (#4924)
add 19f6f19c1 refactor: display input partitions for `RepartitionExec` (#4969)
add dde23efed Support join-filter pushdown for semi/anti join (#4923)
add 5025aa58f re-export substrait crate (#4988)
add 6dce728a3 refactor and add simple function to deserialize and serialize proto b… (#4892)
add 22d106a65 fix(4981): incorrect error wrapping in `OnceFut` (#4983)
add e566bfc4a Only add outer filter once when transforming exists/in subquery to join (#4944)
add 65555d770 Minor: Document how to create ListingTables (#5001)
add 5dd5ffd5e Allow overriding error type in DataFusion Result (#5000)
add 03601bee5 minor: Update data type support documentation (#4984)
add 92d0a054c Bump sqllogictest to v0.11.1 (#5002)
add b71cae8aa Add support for linear range calculation in WINDOW functions (#4989)
add 1d69f28f1 (#4462) Postgres compatibility tests using sqllogictest (#4834)
add cff53a053 Minor: improve internal error message (#5006)
add 9c119961c Minor: Remove invalid comments (#5012)
add f5439c806 AVG(null) is NULL (not zero) (#5008)
add 350cb4728 Simplify GroupByHash implementation (to prepare for more work) (#4972)
add e713547fb Implement `std::error::Error::source()` for `DataFusionError`, make `DataFusionError::find_root` more generic (#4992)
add 407caad40 Check placeholder __timeTo and return Datafusion::Plan error (#5017)
add 8dc4c9607 Sqllogictest: use the same normalization for all tests (#5013)
add 64714ee7e [Enhancement] early check table exist before create (#4998)
add 25ab1f937 [sqllogictest] Create empty tables (#5026)
add 930c8deff [sqllogictets] Remove postgres container orchestration (#5015)
add 624f02d15 Support for bounded execution when window frame involves UNBOUNDED PRECEDING (#5003)
add 5d4038a84 Infer values for inserts (#4977)
add 9f498bbc8 Add dictionary_expresions feature (#4386) (#4999)
add ab00bc118 [Feature] support describe file (#4995)
add 0820eb987 Cleanup CI (#5040) (#5047)
add 13dfdd674 [BugFix] fix explain csv/json/avro exec can not see metrics bug (#5018)
add c313601b5 Ensure insert projections are of correct type (#5049)
add cb05490df Update links to logical plans module. (#5037)
add 3f5b83482 Remove python based posgres comparsion `integration-test` (#5031)
add e30711d04 Use correct schema in substrait ReadRel (#5050)
add c947b051c Improve join type support in substrait (#5051)
add f627ed98e Remove unnecessary pyo3 dependency from datafusion crate (#5048)
add e6db1304d Update pyo3 requirement from 0.17.1 to 0.18.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f87548123)
\
N -- N -- N refs/heads/dependabot/cargo/master/pyo3-0.18.0 (e6db1304d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/actions/setup-builder/action.yaml | 9 +
.github/workflows/cancel.yml | 46 -
.github/workflows/dev.yml | 7 +-
.github/workflows/dev_pr.yml | 4 +
.github/workflows/rust.yml | 187 +--
README.md | 3 +-
datafusion-cli/src/command.rs | 14 +-
datafusion-cli/src/functions.rs | 2 +-
datafusion-cli/src/main.rs | 6 +-
datafusion-cli/src/print_format.rs | 2 +-
datafusion/common/src/column.rs | 12 +-
datafusion/common/src/dfschema.rs | 17 +-
datafusion/common/src/error.rs | 181 ++-
datafusion/common/src/lib.rs | 4 +-
datafusion/common/src/scalar.rs | 2 +-
datafusion/common/src/{bisect.rs => utils.rs} | 119 +-
datafusion/core/Cargo.toml | 15 +-
.../core/src/avro_to_arrow/arrow_array_reader.rs | 2 +-
datafusion/core/src/datasource/listing/table.rs | 94 +-
datafusion/core/src/error.rs | 2 +-
datafusion/core/src/execution/context.rs | 146 +-
datafusion/core/src/lib.rs | 16 +-
.../src/physical_optimizer/dist_enforcement.rs | 112 +-
.../core/src/physical_optimizer/repartition.rs | 28 +-
.../src/physical_optimizer/sort_enforcement.rs | 65 +-
.../core/src/physical_plan/aggregates/hash.rs | 563 --------
.../core/src/physical_plan/aggregates/mod.rs | 44 +-
.../core/src/physical_plan/aggregates/row_hash.rs | 864 +++++++-----
datafusion/core/src/physical_plan/common.rs | 2 +-
datafusion/core/src/physical_plan/display.rs | 5 +-
.../core/src/physical_plan/file_format/avro.rs | 8 +-
.../core/src/physical_plan/file_format/csv.rs | 26 +-
.../src/physical_plan/file_format/file_stream.rs | 11 +-
.../core/src/physical_plan/file_format/json.rs | 8 +-
.../core/src/physical_plan/file_format/parquet.rs | 8 +-
datafusion/core/src/physical_plan/joins/utils.rs | 57 +-
datafusion/core/src/physical_plan/mod.rs | 16 +-
datafusion/core/src/physical_plan/planner.rs | 48 +-
.../core/src/physical_plan/repartition/mod.rs | 7 +-
.../windows/bounded_window_agg_exec.rs | 9 +-
datafusion/core/src/physical_plan/windows/mod.rs | 6 +-
datafusion/core/src/test_util.rs | 5 +-
datafusion/core/tests/dataframe.rs | 89 ++
datafusion/core/tests/path_partition.rs | 2 +-
datafusion/core/tests/sql/aggregates.rs | 29 +
datafusion/core/tests/sql/avro.rs | 2 +-
datafusion/core/tests/sql/create_drop.rs | 48 +-
datafusion/core/tests/sql/explain_analyze.rs | 19 +-
datafusion/core/tests/sql/joins.rs | 183 ++-
datafusion/core/tests/sql/json.rs | 2 +-
datafusion/core/tests/sql/select.rs | 1 +
datafusion/core/tests/sql/window.rs | 175 ++-
datafusion/core/tests/sqllogictests/README.md | 30 +
.../tests/sqllogictests/src/engines/conversion.rs | 90 ++
.../src/engines/datafusion/create_table.rs | 68 +
.../src/{ => engines/datafusion}/error.rs | 2 +-
.../mod.rs => engines/datafusion/insert.rs} | 8 +-
.../sqllogictests/src/engines/datafusion/mod.rs | 108 ++
.../src/{ => engines/datafusion}/normalize.rs | 62 +-
.../src/{insert => engines/datafusion}/util.rs | 0
.../core/tests/sqllogictests/src/engines/mod.rs | 4 +-
.../sqllogictests/src/engines/postgres/mod.rs | 305 ++++
datafusion/core/tests/sqllogictests/src/main.rs | 173 ++-
datafusion/core/tests/sqllogictests/src/setup.rs | 39 -
.../tests/sqllogictests/test_files/aggregate.slt | 186 ++-
.../core/tests/sqllogictests/test_files/ddl.slt | 48 +-
.../tests/sqllogictests/test_files/describe.slt | 64 +
.../core/tests/sqllogictests/test_files/join.slt | 43 +-
.../sqllogictests/test_files/pg_compat_simple.slt | 579 ++++++++
.../sqllogictests/test_files/pg_compat_types.slt | 122 ++
.../sqllogictests/test_files/pg_compat_union.slt | 236 ++++
.../sqllogictests/test_files/pg_compat_window.slt | 1490 ++++++++++++++++++++
.../tests/sqllogictests/test_files/subquery.slt | 62 +
.../core/tests/sqllogictests/test_files/tpch.slt | 10 +-
datafusion/core/tests/user_defined_plan.rs | 2 +-
datafusion/core/tests/window_fuzz.rs | 156 +-
datafusion/expr/src/expr.rs | 2 +-
datafusion/expr/src/expr_schema.rs | 17 +-
datafusion/expr/src/expr_visitor.rs | 91 +-
datafusion/expr/src/lib.rs | 11 +-
datafusion/expr/src/logical_plan/mod.rs | 10 +-
datafusion/expr/src/logical_plan/plan.rs | 130 +-
datafusion/expr/src/utils.rs | 95 +-
.../optimizer/src/common_subexpr_eliminate.rs | 1 +
.../optimizer/src/decorrelate_where_exists.rs | 86 +-
datafusion/optimizer/src/decorrelate_where_in.rs | 54 +-
datafusion/optimizer/src/push_down_filter.rs | 189 ++-
datafusion/optimizer/src/push_down_projection.rs | 1 +
.../optimizer/src/scalar_subquery_to_join.rs | 2 +-
datafusion/optimizer/src/utils.rs | 33 +-
datafusion/physical-expr/Cargo.toml | 7 +-
datafusion/physical-expr/src/aggregate/average.rs | 12 +-
datafusion/physical-expr/src/aggregate/count.rs | 4 +-
datafusion/physical-expr/src/expressions/binary.rs | 3 +-
datafusion/physical-expr/src/expressions/mod.rs | 2 +-
datafusion/physical-expr/src/window/aggregate.rs | 138 +-
datafusion/physical-expr/src/window/built_in.rs | 106 +-
datafusion/physical-expr/src/window/mod.rs | 2 +-
datafusion/physical-expr/src/window/nth_value.rs | 46 +-
.../src/window/partition_evaluator.rs | 8 +-
.../physical-expr/src/window/sliding_aggregate.rs | 158 +--
datafusion/physical-expr/src/window/window_expr.rs | 181 ++-
.../physical-expr/src/window/window_frame_state.rs | 44 +-
datafusion/proto/src/logical_plan/from_proto.rs | 10 +-
datafusion/proto/src/logical_plan/mod.rs | 5 +-
datafusion/proto/src/logical_plan/to_proto.rs | 13 +-
datafusion/sql/src/expr/mod.rs | 48 +
datafusion/sql/src/expr/value.rs | 11 +-
datafusion/sql/src/parser.rs | 8 +-
datafusion/sql/src/planner.rs | 2 +-
datafusion/sql/src/select.rs | 2 -
datafusion/sql/src/statement.rs | 109 +-
datafusion/sql/tests/integration_test.rs | 191 ++-
datafusion/substrait/Cargo.toml | 2 +-
datafusion/substrait/src/consumer.rs | 45 +-
datafusion/substrait/src/lib.rs | 3 +
datafusion/substrait/src/producer.rs | 39 +-
datafusion/substrait/src/serializer.rs | 26 +-
datafusion/substrait/tests/roundtrip.rs | 18 +-
docs/source/contributor-guide/index.md | 49 -
docs/source/user-guide/sql/data_types.md | 26 +-
docs/source/user-guide/sql/scalar_functions.md | 13 +
integration-tests/README.md | 49 -
integration-tests/__init__.py | 15 -
integration-tests/create_test_table.sql | 34 -
integration-tests/create_test_table_postgres.sql | 15 -
integration-tests/requirements.in | 18 -
integration-tests/requirements.txt | 114 --
integration-tests/sqls/character_length.sql | 17 -
.../sqls/partitioned_window_built_in_functions.sql | 29 -
integration-tests/sqls/self_join_with_alias.sql | 22 -
integration-tests/sqls/simple_aggregation.sql | 24 -
integration-tests/sqls/simple_except.sql | 25 -
integration-tests/sqls/simple_except_all.sql | 25 -
integration-tests/sqls/simple_group_by.sql | 27 -
integration-tests/sqls/simple_intersect.sql | 25 -
integration-tests/sqls/simple_intersect_all.sql | 25 -
integration-tests/sqls/simple_math_expressions.sql | 22 -
integration-tests/sqls/simple_ordered_row.sql | 26 -
integration-tests/sqls/simple_row_past_future.sql | 24 -
integration-tests/sqls/simple_select.sql | 17 -
integration-tests/sqls/simple_sort.sql | 22 -
integration-tests/sqls/simple_sort_nulls_order.sql | 22 -
integration-tests/sqls/simple_union_all.sql | 17 -
.../sqls/simple_window_built_in_functions.sql | 29 -
.../sqls/simple_window_full_aggregation.sql | 25 -
integration-tests/sqls/simple_window_groups.sql | 71 -
.../sqls/simple_window_lead_built_in_functions.sql | 27 -
.../sqls/simple_window_ordered_aggregation.sql | 26 -
.../sqls/simple_window_partition_aggregation.sql | 26 -
.../simple_window_partition_order_aggregation.sql | 26 -
integration-tests/sqls/simple_window_range.sql | 29 -
.../simple_window_ranked_built_in_functions.sql | 24 -
integration-tests/sqls/values_list.sql | 19 -
integration-tests/test_psql_parity.py | 91 --
155 files changed, 6745 insertions(+), 3534 deletions(-)
delete mode 100644 .github/workflows/cancel.yml
rename datafusion/common/src/{bisect.rs => utils.rs} (63%)
delete mode 100644 datafusion/core/src/physical_plan/aggregates/hash.rs
create mode 100644 datafusion/core/tests/sqllogictests/src/engines/conversion.rs
create mode 100644 datafusion/core/tests/sqllogictests/src/engines/datafusion/create_table.rs
rename datafusion/core/tests/sqllogictests/src/{ => engines/datafusion}/error.rs (96%)
rename datafusion/core/tests/sqllogictests/src/{insert/mod.rs => engines/datafusion/insert.rs} (95%)
create mode 100644 datafusion/core/tests/sqllogictests/src/engines/datafusion/mod.rs
rename datafusion/core/tests/sqllogictests/src/{ => engines/datafusion}/normalize.rs (61%)
rename datafusion/core/tests/sqllogictests/src/{insert => engines/datafusion}/util.rs (100%)
copy benchmarks/src/lib.rs => datafusion/core/tests/sqllogictests/src/engines/mod.rs (93%)
create mode 100644 datafusion/core/tests/sqllogictests/src/engines/postgres/mod.rs
create mode 100644 datafusion/core/tests/sqllogictests/test_files/describe.slt
create mode 100644 datafusion/core/tests/sqllogictests/test_files/pg_compat_simple.slt
create mode 100644 datafusion/core/tests/sqllogictests/test_files/pg_compat_types.slt
create mode 100644 datafusion/core/tests/sqllogictests/test_files/pg_compat_union.slt
create mode 100644 datafusion/core/tests/sqllogictests/test_files/pg_compat_window.slt
create mode 100644 datafusion/core/tests/sqllogictests/test_files/subquery.slt
delete mode 100644 integration-tests/README.md
delete mode 100644 integration-tests/__init__.py
delete mode 100644 integration-tests/create_test_table.sql
delete mode 100644 integration-tests/create_test_table_postgres.sql
delete mode 100644 integration-tests/requirements.in
delete mode 100644 integration-tests/requirements.txt
delete mode 100644 integration-tests/sqls/character_length.sql
delete mode 100644 integration-tests/sqls/partitioned_window_built_in_functions.sql
delete mode 100644 integration-tests/sqls/self_join_with_alias.sql
delete mode 100644 integration-tests/sqls/simple_aggregation.sql
delete mode 100644 integration-tests/sqls/simple_except.sql
delete mode 100644 integration-tests/sqls/simple_except_all.sql
delete mode 100644 integration-tests/sqls/simple_group_by.sql
delete mode 100644 integration-tests/sqls/simple_intersect.sql
delete mode 100644 integration-tests/sqls/simple_intersect_all.sql
delete mode 100644 integration-tests/sqls/simple_math_expressions.sql
delete mode 100644 integration-tests/sqls/simple_ordered_row.sql
delete mode 100644 integration-tests/sqls/simple_row_past_future.sql
delete mode 100644 integration-tests/sqls/simple_select.sql
delete mode 100644 integration-tests/sqls/simple_sort.sql
delete mode 100644 integration-tests/sqls/simple_sort_nulls_order.sql
delete mode 100644 integration-tests/sqls/simple_union_all.sql
delete mode 100644 integration-tests/sqls/simple_window_built_in_functions.sql
delete mode 100644 integration-tests/sqls/simple_window_full_aggregation.sql
delete mode 100644 integration-tests/sqls/simple_window_groups.sql
delete mode 100644 integration-tests/sqls/simple_window_lead_built_in_functions.sql
delete mode 100644 integration-tests/sqls/simple_window_ordered_aggregation.sql
delete mode 100644 integration-tests/sqls/simple_window_partition_aggregation.sql
delete mode 100644 integration-tests/sqls/simple_window_partition_order_aggregation.sql
delete mode 100644 integration-tests/sqls/simple_window_range.sql
delete mode 100644 integration-tests/sqls/simple_window_ranked_built_in_functions.sql
delete mode 100644 integration-tests/sqls/values_list.sql
delete mode 100644 integration-tests/test_psql_parity.py