You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/12/06 14:59:12 UTC
[GitHub] [arrow-datafusion] Dandandan opened a new issue #1405: Do not send empty batches for Hash partitioning
Dandandan opened a new issue #1405:
URL: https://github.com/apache/arrow-datafusion/issues/1405
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
In https://github.com/apache/arrow-datafusion/issues/1404 an example is shown where we have batches with 0 values.
This seems easy to avoid.
**Describe the solution you'd like**
In `RepartitionExec` we can have an early check on empty batches and not issue them.
**Describe alternatives you've considered**
Keep it as is.
**Additional context**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] Ted-Jiang commented on issue #1405: Do not send empty batches for Hash partitioning
Posted by GitBox <gi...@apache.org>.
Ted-Jiang commented on issue #1405:
URL: https://github.com/apache/arrow-datafusion/issues/1405#issuecomment-995527830
@houqp Please assign this issue to me.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] Ted-Jiang commented on issue #1405: Do not send empty batches for Hash partitioning
Posted by GitBox <gi...@apache.org>.
Ted-Jiang commented on issue #1405:
URL: https://github.com/apache/arrow-datafusion/issues/1405#issuecomment-1019926539
@Dandandan Sorry for forgot add close tag in pr, please close this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] Dandandan closed issue #1405: Do not send empty batches for Hash partitioning
Posted by GitBox <gi...@apache.org>.
Dandandan closed issue #1405:
URL: https://github.com/apache/arrow-datafusion/issues/1405
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org