You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by al...@apache.org on 2025/01/29 16:36:48 UTC
(datafusion) branch dependabot/cargo/datafusion-cli/main/rustyline-15.0.0 updated (620b9b4093 -> 5346e78bec)
This is an automated email from the ASF dual-hosted git repository.
alamb pushed a change to branch dependabot/cargo/datafusion-cli/main/rustyline-15.0.0
in repository https://gitbox.apache.org/repos/asf/datafusion.git
from 620b9b4093 fix build
add 7ccd22bd57 chore(deps): bump clap from 4.5.26 to 4.5.27 in /datafusion-cli (#14264)
add f6b0cc5c20 chore(deps): bump rstest from 0.22.0 to 0.24.0 in /datafusion-cli (#14262)
add d12d01a069 consolidate physical_optimizer tests into core/tests/physical_optimizer (#14244)
add ab16fd5d77 chore(deps): bump dirs from 5.0.1 to 6.0.0 in /datafusion-cli (#14266)
add 774d3cb99c implement display for ColumnarValue (#14220)
add b9baa515ce chore(deps): bump indexmap from 2.7.0 to 2.7.1 in /datafusion-cli (#14260)
add 54e95b0b7f chore(deps): bump serde_json from 1.0.135 to 1.0.137 in /datafusion-cli (#14261)
add 633eef6b66 Add casting of `count` to `Int64` in `array_repeat` function to ensure consistent integer type handling (#14236)
add 144ebf9a50 Minor: Update documentations for memory pool (#14278)
add f9696b6a7a Extract useful methods from sqllogictest bin (#14267)
add 1dad545cab fix: add support for Decimal128 and Decimal256 types in interval arithmetic (#14126)
add 18f14abf3f Deprecate max statistics size properly (#14188)
add f77579108d move projection pushdown optimization logic to ExecutionPlan trait (#14235)
add d460bb434d consolidate tests and utils (#14298)
add f510800ca2 Add more tests showing coercing behavior with literals (#14270)
add 4dc97b2f9c bench: add array_agg benchmark (#14302)
add 7c07948358 Complete moving PhysicalOptimizer into `datafusion-physical-optimizer` (#14300)
add be56bd301e Minor: Update documentation about crate organization (#14304)
add 0eebc0c7c0 Export `datafusion_physical_optimizer`, only use `datafusion` crate in the examples (#14305)
add 3802adf685 doc: Add funnel.io to known users list (#14316)
add 329fb9127a add tests to check precision loss fix (#14284)
add 09a0844b56 Expose sqllogictest Error (#14313)
add c1ca005ddf fix: run sqllogictest with complete (#14254)
add eabbbaf4e7 refactor: switch BooleanBufferBuilder to NullBufferBuilder in unit tests of multi_group_by (#14325)
add e3db3592a8 minor: add unit tests for monotonicity.rs (#14307)
add 71996fba9b make AnalysisContext aware of empty sets to represent certainly false bounds (#14279)
add 1920771d80 Add relation to alias expr in schema display (#14311)
add 8d542ecc13 Improve deprecation message for MemoryExec (#14322)
add dc445a1509 fix: LogicalPlan::get_parameter_types fails to return all placeholders (#14312)
add ecc5694840 fix: FULL OUTER JOIN and LIMIT produces wrong results (#14338)
add 7f0c71b129 Customize window frame support for dialect (#14288)
add d051731181 refactor: switch BooleanBufferBuilder to NullBufferBuilder in a unit test of common_scalar (#14339)
add f8063e840e Add `ColumnStatistics::Sum` (#14074)
add 3a991e65f1 refactor: switch BooleanBufferBuilder to NullBufferBuilder in unit tests for unnest (#14321)
add a4917d44c8 Increase MSRV to 1.81.0 (#14330)
add 66b4da2c17 Fix build due to logical error (#14345)
add 8464f0ae7f chore(deps): bump serde_json from 1.0.137 to 1.0.138 in /datafusion-cli (#14351)
add 50ac43d6d2 chore(deps): bump tempfile from 3.15.0 to 3.16.0 in /datafusion-cli (#14350)
add 2a8b885be8 Update version in `datafusion-cli/Dockerfile` to 1.81 (#14344)
add 62000b4e16 perf(array-agg): add fast path for array agg for `merge_batch` (#14299)
add 1da5252c3c moving memory.rs out of datafusion/core (#14332)
add d18a1d378e refactor: switch `BooleanBufferBuilder` to `NullBufferBuilder` in binary_map (#14341)
add 58974386a3 Restore ability to run single SLT file (#14355)
add 3f4852008a chore(deps): bump home from 0.5.9 to 0.5.11 in /datafusion-cli (#14257)
add 5346e78bec Merge remote-tracking branch 'apache/main' into dependabot/cargo/datafusion-cli/main/rustyline-15.0.0
No new revisions were added by this update.
Summary of changes:
Cargo.toml | 4 +-
datafusion-cli/Cargo.lock | 278 +-
datafusion-cli/Cargo.toml | 10 +-
datafusion-cli/Dockerfile | 2 +-
datafusion-examples/Cargo.toml | 9 +-
.../examples/advanced_parquet_index.rs | 31 +-
datafusion-examples/examples/advanced_udaf.rs | 26 +-
datafusion-examples/examples/advanced_udf.rs | 8 +-
datafusion-examples/examples/advanced_udwf.rs | 22 +-
datafusion-examples/examples/analyzer_rule.rs | 10 +-
.../examples/composed_extension_codec.rs | 6 +-
datafusion-examples/examples/csv_json_opener.rs | 2 +-
datafusion-examples/examples/custom_file_format.rs | 7 +-
datafusion-examples/examples/dataframe.rs | 8 +-
.../examples/date_time_functions.rs | 2 +-
.../examples/deserialize_to_struct.rs | 2 +-
datafusion-examples/examples/expr_api.rs | 26 +-
.../examples/file_stream_provider.rs | 13 +-
.../examples/flight/flight_sql_server.rs | 2 +-
datafusion-examples/examples/function_factory.rs | 36 +-
datafusion-examples/examples/optimizer_rule.rs | 14 +-
.../examples/parquet_exec_visitor.rs | 3 +-
datafusion-examples/examples/parquet_index.rs | 26 +-
datafusion-examples/examples/parse_sql_expr.rs | 6 +-
datafusion-examples/examples/plan_to_sql.rs | 18 +-
datafusion-examples/examples/planner_api.rs | 2 +-
datafusion-examples/examples/pruning.rs | 5 +-
datafusion-examples/examples/regexp.rs | 2 +-
datafusion-examples/examples/remote_catalog.rs | 8 +-
datafusion-examples/examples/simple_udaf.rs | 2 +-
datafusion-examples/examples/simple_udf.rs | 4 +-
datafusion-examples/examples/simple_udtf.rs | 12 +-
datafusion-examples/examples/simple_udwf.rs | 7 +-
datafusion-examples/examples/sql_analysis.rs | 4 +-
datafusion-examples/examples/sql_dialect.rs | 2 +-
datafusion-examples/examples/sql_frontend.rs | 17 +-
datafusion-examples/examples/sql_query.rs | 4 +-
datafusion/catalog/Cargo.toml | 2 +
datafusion/catalog/src/lib.rs | 10 +
.../src/catalog_common => catalog/src}/memory.rs | 157 +-
datafusion/common/src/config.rs | 78 +-
.../common/src/file_options/parquet_writer.rs | 10 +-
datafusion/common/src/scalar/mod.rs | 11 +-
datafusion/common/src/stats.rs | 173 +-
datafusion/core/Cargo.toml | 1 -
datafusion/core/src/catalog_common/mod.rs | 6 -
.../core/src/datasource/physical_plan/csv.rs | 33 +
.../src/datasource/physical_plan/parquet/mod.rs | 35 +-
.../src/datasource/physical_plan/parquet/opener.rs | 7 +-
.../physical_plan/parquet/page_filter.rs | 9 +-
.../physical_plan/parquet/row_group_filter.rs | 12 +-
datafusion/core/src/datasource/statistics.rs | 6 +-
datafusion/core/src/execution/context/mod.rs | 4 +-
datafusion/core/src/execution/session_state.rs | 23 +-
.../core/src/execution/session_state_defaults.rs | 2 +-
datafusion/core/src/lib.rs | 40 +-
datafusion/core/src/physical_optimizer/mod.rs | 28 -
.../core/src/physical_optimizer/optimizer.rs | 124 -
.../src/physical_optimizer/projection_pushdown.rs | 2792 --------------------
datafusion/core/tests/catalog/memory.rs | 170 ++
.../{sql/tests/cases => core/tests/catalog}/mod.rs | 2 +-
datafusion/core/tests/core_integration.rs | 2 +
.../core/tests/custom_sources_cases/statistics.rs | 2 +
datafusion/core/tests/memory_limit/mod.rs | 40 +-
.../physical_optimizer/aggregate_statistics.rs | 321 +++
.../combine_partial_final_agg.rs | 5 +-
.../physical_optimizer/enforce_distribution.rs | 13 +-
.../tests/physical_optimizer/enforce_sorting.rs | 838 +++++-
.../tests/physical_optimizer/join_selection.rs | 1494 +++++++++++
.../tests/physical_optimizer/limit_pushdown.rs | 490 ++++
.../limited_distinct_aggregation.rs | 110 +-
datafusion/core/tests/physical_optimizer/mod.rs | 35 +-
.../physical_optimizer/projection_pushdown.rs | 1403 ++++++++++
.../replace_with_order_preserving_variants.rs | 5 +-
.../tests/physical_optimizer/sanity_checker.rs | 287 +-
.../tests/physical_optimizer}/test_utils.rs | 37 +-
datafusion/execution/src/memory_pool/mod.rs | 9 +-
datafusion/expr-common/Cargo.toml | 2 -
datafusion/expr-common/src/columnar_value.rs | 62 +-
datafusion/expr-common/src/interval_arithmetic.rs | 811 +++++-
datafusion/expr/src/expr.rs | 37 +-
datafusion/expr/src/logical_plan/plan.rs | 25 +-
datafusion/functions-aggregate/Cargo.toml | 4 +
.../functions-aggregate/benches/array_agg.rs | 186 ++
datafusion/functions-aggregate/src/array_agg.rs | 79 +-
datafusion/functions-nested/src/repeat.rs | 51 +-
datafusion/functions/src/math/monotonicity.rs | 402 +++
datafusion/optimizer/src/lib.rs | 4 +-
datafusion/optimizer/src/push_down_limit.rs | 1 -
datafusion/physical-expr-common/Cargo.toml | 1 +
datafusion/physical-expr-common/src/binary_map.rs | 16 +-
datafusion/physical-expr/src/analysis.rs | 185 +-
datafusion/physical-expr/src/expressions/cast.rs | 40 +
datafusion/physical-optimizer/Cargo.toml | 1 -
.../physical-optimizer/src/aggregate_statistics.rs | 312 +--
.../physical-optimizer/src/enforce_distribution.rs | 2 +
.../physical-optimizer/src/enforce_sorting/mod.rs | 2 +
.../physical-optimizer/src/join_selection.rs | 1550 +----------
datafusion/physical-optimizer/src/lib.rs | 7 +-
.../physical-optimizer/src/limit_pushdown.rs | 478 +---
.../src/limited_distinct_aggregation.rs | 2 +-
datafusion/physical-optimizer/src/optimizer.rs | 108 +-
.../physical-optimizer/src/output_requirements.rs | 68 +-
.../physical-optimizer/src/projection_pushdown.rs | 61 +
.../physical-optimizer/src/sanity_checker.rs | 2 +
.../physical-optimizer/tests/enforce_sorting.rs | 861 ------
.../tests/limited_distinct_aggregation.rs | 131 -
datafusion/physical-optimizer/tests/mod.rs | 20 -
.../physical-optimizer/tests/sanity_checker.rs | 308 ---
.../group_values/multi_group_by/bytes.rs | 19 +-
.../group_values/multi_group_by/bytes_view.rs | 31 +-
.../group_values/multi_group_by/primitive.rs | 21 +-
.../physical-plan/src/coalesce_partitions.rs | 20 +-
datafusion/physical-plan/src/common.rs | 3 +
datafusion/physical-plan/src/execution_plan.rs | 54 +-
datafusion/physical-plan/src/filter.rs | 68 +-
datafusion/physical-plan/src/joins/cross_join.rs | 102 +-
datafusion/physical-plan/src/joins/hash_join.rs | 57 +-
.../physical-plan/src/joins/nested_loop_join.rs | 50 +-
.../physical-plan/src/joins/sort_merge_join.rs | 89 +-
.../physical-plan/src/joins/symmetric_hash_join.rs | 81 +-
datafusion/physical-plan/src/joins/utils.rs | 1 +
datafusion/physical-plan/src/memory.rs | 30 +-
datafusion/physical-plan/src/projection.rs | 733 ++++-
datafusion/physical-plan/src/repartition/mod.rs | 43 +-
datafusion/physical-plan/src/sorts/sort.rs | 32 +
.../src/sorts/sort_preserving_merge.rs | 37 +-
datafusion/physical-plan/src/streaming.rs | 56 +-
datafusion/physical-plan/src/union.rs | 32 +
datafusion/physical-plan/src/unnest.rs | 34 +-
datafusion/physical-plan/src/values.rs | 17 +-
.../proto-common/proto/datafusion_common.proto | 1 +
datafusion/proto-common/src/from_proto/mod.rs | 7 +
datafusion/proto-common/src/generated/pbjson.rs | 18 +
datafusion/proto-common/src/generated/prost.rs | 2 +
datafusion/proto-common/src/to_proto/mod.rs | 3 +
.../proto/src/generated/datafusion_proto_common.rs | 2 +
datafusion/proto/src/logical_plan/file_formats.rs | 3 +
datafusion/sql/src/unparser/dialect.rs | 38 +-
datafusion/sql/src/unparser/expr.rs | 55 +-
datafusion/sqllogictest/Cargo.toml | 3 +-
datafusion/sqllogictest/bin/sqllogictests.rs | 109 +-
.../src/engines/datafusion_engine/normalize.rs | 2 +-
datafusion/sqllogictest/src/engines/mod.rs | 2 +
datafusion/sqllogictest/src/lib.rs | 5 +
datafusion/sqllogictest/src/test_context.rs | 4 +-
datafusion/sqllogictest/src/util.rs | 108 +
datafusion/sqllogictest/test_files/array.slt | 24 +
datafusion/sqllogictest/test_files/ddl.slt | 1 -
datafusion/sqllogictest/test_files/encoding.slt | 2 +-
datafusion/sqllogictest/test_files/expr.slt | 2 +-
.../sqllogictest/test_files/information_schema.slt | 2 +-
.../test_files/{join.slt => join.slt.part} | 0
.../test_files/join_disable_repartition_joins.slt | 2 +-
.../sqllogictest/test_files/join_only.slt | 6 +-
datafusion/sqllogictest/test_files/joins.slt | 159 +-
datafusion/sqllogictest/test_files/operator.slt | 250 ++
datafusion/sqllogictest/test_files/select.slt | 4 +
datafusion/sqllogictest/test_files/subquery.slt | 2 +-
.../sqllogictest/test_files/tpch/plans/q1.slt.part | 2 +-
.../test_files/tpch/plans/q11.slt.part | 1 -
.../test_files/tpch/plans/q16.slt.part | 1 -
.../test_files/tpch/plans/q17.slt.part | 1 -
.../test_files/tpch/plans/q20.slt.part | 1 -
datafusion/sqllogictest/test_files/tpch/tpch.slt | 1 -
datafusion/sqllogictest/test_files/window.slt | 2 +-
docs/source/user-guide/configs.md | 2 +-
docs/source/user-guide/introduction.md | 1 +
168 files changed, 10087 insertions(+), 7636 deletions(-)
rename datafusion/{core/src/catalog_common => catalog/src}/memory.rs (51%)
delete mode 100644 datafusion/core/src/physical_optimizer/mod.rs
delete mode 100644 datafusion/core/src/physical_optimizer/optimizer.rs
delete mode 100644 datafusion/core/src/physical_optimizer/projection_pushdown.rs
create mode 100644 datafusion/core/tests/catalog/memory.rs
copy datafusion/{sql/tests/cases => core/tests/catalog}/mod.rs (97%)
create mode 100644 datafusion/core/tests/physical_optimizer/aggregate_statistics.rs
create mode 100644 datafusion/core/tests/physical_optimizer/join_selection.rs
create mode 100644 datafusion/core/tests/physical_optimizer/limit_pushdown.rs
create mode 100644 datafusion/core/tests/physical_optimizer/projection_pushdown.rs
rename datafusion/{physical-optimizer/src => core/tests/physical_optimizer}/test_utils.rs (94%)
create mode 100644 datafusion/functions-aggregate/benches/array_agg.rs
create mode 100644 datafusion/physical-optimizer/src/projection_pushdown.rs
delete mode 100644 datafusion/physical-optimizer/tests/enforce_sorting.rs
delete mode 100644 datafusion/physical-optimizer/tests/limited_distinct_aggregation.rs
delete mode 100644 datafusion/physical-optimizer/tests/mod.rs
delete mode 100644 datafusion/physical-optimizer/tests/sanity_checker.rs
create mode 100644 datafusion/sqllogictest/src/util.rs
rename datafusion/sqllogictest/test_files/{join.slt => join.slt.part} (100%)
copy benchmarks/requirements.txt => datafusion/sqllogictest/test_files/join_only.slt (96%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org