(datafusion-comet) branch main updated (98a83ddc92 -> 22a07067bd)

[gi...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

github-merge-queue[bot] pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git


    from 98a83ddc92 fix: prevent libhdfs thread destructor use-after-free (#5036)
     add c59021b43d feat: support Spark HyperLogLog sketch functions (hll_sketch_agg, hll_union_agg, hll_sketch_estimate, hll_union) (#4802)
     add 22a07067bd docs: simplify the memory tuning page (#6343)

No new revisions were added by this update.

Summary of changes:
 docs/source/user-guide/latest/expressions.md       |   8 +-
 docs/source/user-guide/latest/migration-guide.md   |  12 +
 docs/source/user-guide/latest/tuning/memory.md     |  63 +--
 native/Cargo.lock                                  |   7 +
 native/Cargo.toml                                  |   6 +
 native/core/src/execution/planner.rs               |  17 +-
 native/proto/src/proto/expr.proto                  |  16 +
 native/spark-expr/Cargo.toml                       |   1 +
 native/spark-expr/src/agg_funcs/hll_sketch.rs      | 590 +++++++++++++++++++++
 native/spark-expr/src/agg_funcs/hll_sketch_agg.rs  | 324 +++++++++++
 native/spark-expr/src/agg_funcs/hll_union_agg.rs   | 354 +++++++++++++
 native/spark-expr/src/agg_funcs/mod.rs             |   6 +
 .../agg_funcs/testdata/hll_sketch_spark_lgk12.bin  | Bin 0 -> 4136 bytes
 native/spark-expr/src/comet_scalar_funcs.rs        |   9 +
 native/spark-expr/src/hll_scalar.rs                | 182 +++++++
 native/spark-expr/src/lib.rs                       |   3 +
 .../org/apache/comet/serde/CometHllSketchAgg.scala |  98 ++++
 .../comet/serde/CometHllSketchEstimate.scala       |  60 +++
 .../org/apache/comet/serde/CometHllUnion.scala     |  76 +++
 .../org/apache/comet/serde/CometHllUnionAgg.scala  |  88 +++
 .../apache/comet/shims/Spark4xCometExprShim.scala  |  14 +-
 .../org/apache/comet/CometExpressionSuite.scala    | 151 ++++++
 22 files changed, 2026 insertions(+), 59 deletions(-)
 create mode 100644 native/spark-expr/src/agg_funcs/hll_sketch.rs
 create mode 100644 native/spark-expr/src/agg_funcs/hll_sketch_agg.rs
 create mode 100644 native/spark-expr/src/agg_funcs/hll_union_agg.rs
 create mode 100644 native/spark-expr/src/agg_funcs/testdata/hll_sketch_spark_lgk12.bin
 create mode 100644 native/spark-expr/src/hll_scalar.rs
 create mode 100644 spark/src/main/spark-4.x/org/apache/comet/serde/CometHllSketchAgg.scala
 create mode 100644 spark/src/main/spark-4.x/org/apache/comet/serde/CometHllSketchEstimate.scala
 create mode 100644 spark/src/main/spark-4.x/org/apache/comet/serde/CometHllUnion.scala
 create mode 100644 spark/src/main/spark-4.x/org/apache/comet/serde/CometHllUnionAgg.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org