You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "andygrove (via GitHub)" <gi...@apache.org> on 2026/04/03 14:42:12 UTC
[I] Disable Comet if shuffle manager not registered [datafusion-comet]
andygrove opened a new issue, #3900:
URL: https://github.com/apache/datafusion-comet/issues/3900
### What is the problem the feature request solves?
I wonder if we should consider disabling Comet if the shuffle manager is not registered. I would not expect Comet to provide much benefit.
### Describe the potential solution
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Disable Comet if shuffle manager not registered [datafusion-comet]
Posted by "comphead (via GitHub)" <gi...@apache.org>.
comphead commented on issue #3900:
URL: https://github.com/apache/datafusion-comet/issues/3900#issuecomment-4208140107
We can probably refine the fallback message explaining benefits of having Comet shuffle. Disable Comet completely because of shuffle sounds too aggressive IMO: for example for scan testing sometimes I disable shuffle intentionally just to capture metrics before shuffle.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Disable Comet if shuffle manager not registered [datafusion-comet]
Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove closed issue #3900: Disable Comet if shuffle manager not registered
URL: https://github.com/apache/datafusion-comet/issues/3900
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Disable Comet if shuffle manager not registered [datafusion-comet]
Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove commented on issue #3900:
URL: https://github.com/apache/datafusion-comet/issues/3900#issuecomment-4389099815
> We can probably refine the fallback message explaining benefits of having Comet shuffle. Disable Comet completely because of shuffle sounds too aggressive IMO: for example for scan testing sometimes I disable shuffle intentionally just to capture metrics before shuffle.
For testing it makes sense to allow all the combinations. For end user use, I am not so sure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org