You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2025/07/28 19:43:49 UTC
(datafusion) branch dependabot/cargo/main/substrait-0.59.0 updated (0fc8af68fc -> 620e7c1b6a)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/main/substrait-0.59.0
in repository https://gitbox.apache.org/repos/asf/datafusion.git
omit 0fc8af68fc chore(deps): bump substrait from 0.58.0 to 0.59.0
add b7da86e9ad feat(spark): Implement Spark `string` function `luhn_check` (#16848)
add bb1b55cfba chore(deps): bump aws-config from 1.8.2 to 1.8.3 (#16912)
add 070517a87f Derive UDF equality from PartialEq, Hash (#16842)
add 675b96c2b4 Ensure Substrait consumer can handle expressions in VirtualTable (#16857)
add 8b9204cfeb Mutable Join Unwind (#16883)
add 2ff02b25ec feat(spark): implement Spark datetime function last_day (#16828)
add 5e0b2d0554 fix(datafusion-proto): support serializing/deserilizing ArrowFormat tables (#16875)
add 871d4b55dc ScalarValue Default + Min + Max (#16891)
add 4f533582d6 fix: `PlaceholderRowExec::partition_statistics` (#16851)
add 84c8881b64 minor: add is_superset() method for Interval's (#16895)
add 9deec2ad72 minor: implement with_new_expressions for AggregateFunctionExpr (#16897)
add cbda394c0d Update enforce_distribution.rs (#16913)
add 4b9a468cc1 feat: Add `ScalarValue::{new_one,new_zero,new_ten,distance}` support for `Decimal128` and `Decimal256` (#16831)
add fd08e726dc Implement Helpers for ScopedTimerGuard and Time Structs (#16911)
add 8bf7123687 Fix Partial Sort Get Slice Point Between Batches (#16881)
add 71dbdf6f19 fix: skip predicates on struct unnest in PushDownFilter (#16790)
add e033d42251 optimize initcap function by avoiding memory allocation (#16878)
add ff777eae44 Fix `schema_adapter` integration tests not running (#16835)
add 8d74be8ce4 Docs: Update Upgrading.md to reflect 49.0.0 is released (#16853)
add e412859a04 Update release process (#16929)
add 939d3c544e Fix `next_up` and `next_down` behavior for zero float values (#16745)
add 9f3e7dce69 Add Fetch Property to OutputRequirementExec (#16892)
add c6d5520716 feat: support distinct for window (#16925)
add e1a5cdf6db Support multiple ordered `array_agg` aggregations (#16625)
add ec8c34b711 chore(deps): bump tokio from 1.46.1 to 1.47.0 (#16952)
add d3def0ea8b chore(deps): bump serde_json from 1.0.140 to 1.0.141 (#16951)
add 620e7c1b6a chore(deps): bump substrait from 0.58.0 to 0.59.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (0fc8af68fc)
\
N -- N -- N refs/heads/dependabot/cargo/main/substrait-0.59.0 (620e7c1b6a)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
Cargo.lock | 105 ++-
Cargo.toml | 2 +-
datafusion-cli/Cargo.toml | 2 +-
datafusion-examples/examples/advanced_udwf.rs | 1 +
datafusion/catalog/src/streaming.rs | 34 +-
datafusion/common-runtime/Cargo.toml | 2 +-
datafusion/common-runtime/src/common.rs | 21 +-
datafusion/common/src/rounding.rs | 40 +-
datafusion/common/src/scalar/mod.rs | 953 ++++++++++++++++++++-
datafusion/core/src/physical_planner.rs | 2 +
datafusion/core/tests/core_integration.rs | 3 +
datafusion/core/tests/fuzz_cases/window_fuzz.rs | 3 +
.../schema_adapter_integration_tests.rs | 509 -----------
datafusion/core/tests/memory_limit/mod.rs | 6 +-
datafusion/core/tests/parquet/schema_adapter.rs | 3 +-
.../tests/physical_optimizer/enforce_sorting.rs | 138 ++-
.../physical_optimizer/partition_statistics.rs | 30 +
.../physical_optimizer/projection_pushdown.rs | 1 +
.../core/tests/physical_optimizer/test_utils.rs | 1 +
.../src/test => core/tests/schema_adapter}/mod.rs | 2 +-
.../schema_adapter_integration_tests.rs | 363 ++++++++
.../user_defined/user_defined_scalar_functions.rs | 171 +---
datafusion/expr-common/src/interval_arithmetic.rs | 225 +++++
datafusion/expr/src/async_udf.rs | 38 +-
datafusion/expr/src/expr.rs | 27 +-
datafusion/expr/src/expr_fn.rs | 68 +-
datafusion/expr/src/planner.rs | 1 +
datafusion/expr/src/tree_node.rs | 12 +
datafusion/expr/src/udaf.rs | 42 +-
datafusion/expr/src/udf.rs | 33 +-
datafusion/expr/src/utils.rs | 182 +++-
datafusion/expr/src/window_state.rs | 10 +-
datafusion/ffi/src/udaf/mod.rs | 4 +
datafusion/ffi/src/udf/mod.rs | 66 +-
datafusion/functions-aggregate-common/src/order.rs | 15 +-
datafusion/functions-aggregate/src/array_agg.rs | 70 +-
datafusion/functions-aggregate/src/count.rs | 163 +++-
datafusion/functions-window/src/planner.rs | 15 +-
datafusion/functions/src/unicode/initcap.rs | 24 +-
datafusion/optimizer/src/analyzer/type_coercion.rs | 29 +-
datafusion/optimizer/src/push_down_filter.rs | 30 +-
.../optimizer/src/simplify_expressions/utils.rs | 88 ++
datafusion/physical-expr/src/aggregate.rs | 38 +-
.../physical-expr/src/expressions/literal.rs | 2 +-
datafusion/physical-expr/src/window/aggregate.rs | 6 +-
.../physical-expr/src/window/sliding_aggregate.rs | 6 +-
datafusion/physical-expr/src/window/standard.rs | 4 +
datafusion/physical-expr/src/window/window_expr.rs | 6 +
.../physical-optimizer/src/enforce_distribution.rs | 22 +-
.../physical-optimizer/src/output_requirements.rs | 45 +-
.../group_values/single_group_by/bytes.rs | 13 +-
datafusion/physical-plan/src/aggregates/mod.rs | 139 +--
datafusion/physical-plan/src/metrics/value.rs | 118 +++
datafusion/physical-plan/src/placeholder_row.rs | 14 +-
datafusion/physical-plan/src/sorts/partial_sort.rs | 159 +++-
datafusion/physical-plan/src/test.rs | 2 +-
.../src/windows/bounded_window_agg_exec.rs | 1 +
datafusion/physical-plan/src/windows/mod.rs | 42 +-
.../proto-common/proto/datafusion_common.proto | 2 +
datafusion/proto-common/src/generated/pbjson.rs | 71 ++
datafusion/proto-common/src/generated/prost.rs | 2 +
datafusion/proto/proto/datafusion.proto | 1 +
.../proto/src/generated/datafusion_proto_common.rs | 2 +
datafusion/proto/src/generated/pbjson.rs | 13 +
datafusion/proto/src/generated/prost.rs | 7 +-
datafusion/proto/src/lib.rs | 5 +-
datafusion/proto/src/logical_plan/mod.rs | 17 +-
datafusion/proto/src/logical_plan/to_proto.rs | 1 +
datafusion/proto/src/physical_plan/from_proto.rs | 1 +
datafusion/proto/tests/cases/mod.rs | 32 +-
.../proto/tests/cases/roundtrip_logical_plan.rs | 14 +
.../tests/testdata/test.arrow} | Bin
datafusion/spark/Cargo.toml | 1 +
datafusion/spark/src/function/datetime/last_day.rs | 125 +++
datafusion/spark/src/function/datetime/mod.rs | 17 +-
datafusion/spark/src/function/string/luhn_check.rs | 153 ++++
datafusion/spark/src/function/string/mod.rs | 9 +-
datafusion/sql/src/expr/function.rs | 12 +
datafusion/sql/src/unparser/expr.rs | 13 +-
datafusion/sql/tests/sql_integration.rs | 38 +-
datafusion/sqllogictest/test_files/aggregate.slt | 50 ++
datafusion/sqllogictest/test_files/group_by.slt | 6 +-
.../sqllogictest/test_files/push_down_filter.slt | 21 +-
.../test_files/spark/datetime/last_day.slt | 100 ++-
.../test_files/spark/string/luhn_check.slt | 162 +++-
datafusion/sqllogictest/test_files/window.slt | 79 ++
.../logical_plan/consumer/expr/window_function.rs | 1 +
.../src/logical_plan/consumer/rel/read_rel.rs | 30 +-
.../logical_plan/producer/expr/window_function.rs | 1 +
.../substrait/tests/cases/consumer_integration.rs | 15 +
.../virtual_table_with_expressions.substrait.json | 75 ++
dev/release/README.md | 1 +
docs/source/library-user-guide/upgrading.md | 37 +-
docs/source/user-guide/sql/special_functions.md | 13 +-
94 files changed, 4159 insertions(+), 1119 deletions(-)
delete mode 100644 datafusion/core/tests/integration_tests/schema_adapter_integration_tests.rs
copy datafusion/{expr/src/test => core/tests/schema_adapter}/mod.rs (95%)
create mode 100644 datafusion/core/tests/schema_adapter/schema_adapter_integration_tests.rs
copy datafusion/{core/tests/data/example.arrow => proto/tests/testdata/test.arrow} (100%)
create mode 100644 datafusion/spark/src/function/datetime/last_day.rs
create mode 100644 datafusion/spark/src/function/string/luhn_check.rs
create mode 100644 datafusion/substrait/tests/testdata/test_plans/virtual_table_with_expressions.substrait.json
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org