You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "viirya (via GitHub)" <gi...@apache.org> on 2024/08/28 19:58:20 UTC
[I] ShuffleQueryStageExec could be direct child node of CometBroadcastExchangeExec [datafusion-comet]
viirya opened a new issue, #879:
URL: https://github.com/apache/datafusion-comet/issues/879
### Describe the bug
We found an issue internally where `ShuffleQueryStageExec` becomes direct node of `CometBroadcastExchangeExec` but it doesn't allow for now:
```
- ShuffleQueryStageExec could be direct child node of CometBroadcastExchangeExec *** FAILED *** (6 seconds, 287 milliseconds)
org.apache.comet.CometRuntimeException: Child of CometBroadcastExchangeExec should be CometExec, but got: class org.apache.spark.sql.execution.adaptive.ShuffleQueryStageExec
at org.apache.spark.sql.comet.CometBroadcastExchangeExec.$anonfun$relationFuture$1(CometBroadcastExchangeExec.scala:149)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withThreadLocalCaptured$1(SQLExecution.scala:217)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
```
### Steps to reproduce
_No response_
### Expected behavior
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] ShuffleQueryStageExec could be direct child node of CometBroadcastExchangeExec [datafusion-comet]
Posted by "huaxingao (via GitHub)" <gi...@apache.org>.
huaxingao closed issue #879: ShuffleQueryStageExec could be direct child node of CometBroadcastExchangeExec
URL: https://github.com/apache/datafusion-comet/issues/879
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org