You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/07/28 02:53:15 UTC
[GitHub] [arrow] infzo opened a new issue, #13730: Are there functional operators similar to CUDF's PARTITIONBYHASH in Arrow? Can data be grouped on the CPU, but not aggregated?
infzo opened a new issue, #13730:
URL: https://github.com/apache/arrow/issues/13730
Are there functional operators similar to cuDF's PartitionByHash in Arrow? Can ArrowTable be grouped on the CPU, but not aggregated?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] infzo closed issue #13730: Are there functional operators similar to cuDF's PartitionByHash in Arrow? Can ArrowTable be grouped on the CPU, but not aggregated?
Posted by GitBox <gi...@apache.org>.
infzo closed issue #13730: Are there functional operators similar to cuDF's PartitionByHash in Arrow? Can ArrowTable be grouped on the CPU, but not aggregated?
URL: https://github.com/apache/arrow/issues/13730
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] lidavidm commented on issue #13730: Are there functional operators similar to cuDF's PartitionByHash in Arrow? Can ArrowTable be grouped on the CPU, but not aggregated?
Posted by GitBox <gi...@apache.org>.
lidavidm commented on issue #13730:
URL: https://github.com/apache/arrow/issues/13730#issuecomment-1198356062
This sounds similar to another recent question: https://stackoverflow.com/questions/73118363/how-can-i-partition-an-arrow-table-by-value-in-one-pass/73125145#73125145
You can treat GroupBy/aggregations as a sort of partitioning with the `hash_list` "aggregation" (which just collects all values into a list), though you'll have to build an ExecPlan. Does this work for your use case? There's not currently something like partition_by_hash
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] infzo commented on issue #13730: Are there functional operators similar to cuDF's PartitionByHash in Arrow? Can ArrowTable be grouped on the CPU, but not aggregated?
Posted by GitBox <gi...@apache.org>.
infzo commented on issue #13730:
URL: https://github.com/apache/arrow/issues/13730#issuecomment-1198800628
It's been a great help to me. Thank you for your advice.
> This sounds similar to another recent question: https://stackoverflow.com/questions/73118363/how-can-i-partition-an-arrow-table-by-value-in-one-pass/73125145#73125145
>
> You can treat GroupBy/aggregations as a sort of partitioning with the `hash_list` "aggregation" (which just collects all values into a list), though you'll have to build an ExecPlan. Does this work for your use case? There's not currently something like partition_by_hash
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org