You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by ka...@apache.org on 2026/07/12 14:03:59 UTC
(datafusion) branch final-aggr-with-lazily-materialize-poc updated (64818210e0 -> e3ae29e214)
This is an automated email from the ASF dual-hosted git repository.
Rachelint pushed a change to branch final-aggr-with-lazily-materialize-poc
in repository https://gitbox.apache.org/repos/asf/datafusion.git
from 64818210e0 Reuse source columns across partition groups
add 611e4ff078 Make hash aggregate partition factor configurable
new e3ae29e214 test.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
datafusion/common/src/config.rs | 26 ++++++
.../physical-expr-common/src/binary_view_map.rs | 2 +-
.../ensure_requirements/enforce_distribution.rs | 16 ++--
.../physical-plan/src/aggregates/hash_aggregate.rs | 96 ++++++++++++++++++++--
docs/source/user-guide/configs.md | 1 +
5 files changed, 129 insertions(+), 12 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org
(datafusion) 01/01: test.
Posted by ka...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
Rachelint pushed a commit to branch final-aggr-with-lazily-materialize-poc
in repository https://gitbox.apache.org/repos/asf/datafusion.git
commit e3ae29e2148d1a4b703b0364970c2b4924ef2629
Author: kamille <ka...@apache.org>
AuthorDate: Sun Jul 12 22:03:46 2026 +0800
test.
---
datafusion/physical-expr-common/src/binary_view_map.rs | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/datafusion/physical-expr-common/src/binary_view_map.rs b/datafusion/physical-expr-common/src/binary_view_map.rs
index 1bebb3f421..b003f9a30d 100644
--- a/datafusion/physical-expr-common/src/binary_view_map.rs
+++ b/datafusion/physical-expr-common/src/binary_view_map.rs
@@ -115,7 +115,7 @@ impl ArrowBytesViewSet {
/// store the distinct values, and by the `GROUP BY` operator to store
/// group values when they are a single string array.
/// Max size of the in-progress buffer before flushing to completed buffers
-const BYTE_VIEW_MAX_BLOCK_SIZE: usize = 2 * 1024 * 1024;
+const BYTE_VIEW_MAX_BLOCK_SIZE: usize = 128 * 1024;
pub struct ArrowBytesViewMap<V>
where
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org