You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "gitmodimo (via GitHub)" <gi...@apache.org> on 2025/09/12 08:08:41 UTC
[PR] GH-35508: [arrow]
gitmodimo opened a new pull request, #47553:
URL: https://github.com/apache/arrow/pull/47553
### Rationale for this change
Tdigest algorithm enables merging multiple centroid sets that allow efficient map-reduce implementation. This PR enables user to make reduce step outside of aggregator and in result enables incremental tdigest calculation.
Also option to select different scaler function is added.
### What changes are included in this PR?
This change introduces 3 new aggregate functions:
`tdigest_map`- functionally the same as tdigest but instead of quantiles outputs centroids_vector as fixed_size_list of length delta (with nullable values) each element would be struct{double mean; double weight}
`tdigest_reduce` - function that takes vector of centroids_vectors and output merged centroids_vector
`tdigest_quantile` - function that takes centroids_vector and calculates quantiles as tdigest does
### Are these changes tested?
Yes
### Are there any user-facing changes?
No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-35508: [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #47553:
URL: https://github.com/apache/arrow/pull/47553#issuecomment-3284223822
:warning: GitHub issue #35508 **has been automatically assigned in GitHub** to PR creator.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-35508: [arrow]
Posted by "gitmodimo (via GitHub)" <gi...@apache.org>.
gitmodimo commented on PR #47553:
URL: https://github.com/apache/arrow/pull/47553#issuecomment-3284225542
Marking as draft due to missing python bindings
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-35508: [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed pull request #47553: GH-35508:
URL: https://github.com/apache/arrow/pull/47553
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-35508: [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #47553:
URL: https://github.com/apache/arrow/pull/47553#issuecomment-5813082016
Thank you for your contribution. Unfortunately, this pull request has been marked as stale because it has had no activity in the past 365 days. Please remove the stale label or comment below, or this PR will be closed in 14 days. Feel free to re-open this if it has been closed in error. If you do not have repository permissions to reopen the PR, please tag a maintainer.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org