You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2024/05/08 07:48:30 UTC
[I] [CORE][VL] Subqueries are executed during explain phase for struct result type [incubator-gluten]
zhztheplayer opened a new issue, #5656:
URL: https://github.com/apache/incubator-gluten/issues/5656
We usually do a [tentative offload](https://github.com/apache/incubator-gluten/blob/c9018cdd884c5e93a171ba1561888e719026898c/gluten-core/src/main/scala/org/apache/gluten/execution/BasicPhysicalOperatorTransformer.scala#L121-L127) while validating query plans.
Given that in Gluten, offloading a subquery expression may cause `collect` to be called immediately for struct types ([example](https://github.com/apache/incubator-gluten/blob/c9018cdd884c5e93a171ba1561888e719026898c/gluten-core/src/main/scala/org/apache/gluten/expression/ScalarSubqueryTransformer.scala#L37)), thus in the case, plan validation always executes subqueries, so explaining always executes subqueries.
This is not a big issue as of now but can be considered something counter-intuitive. We may need to rework the validation procedure a little bit to fix this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [CORE][VL] Subqueries are executed during explain phase for complex result type [incubator-gluten]
Posted by "zhztheplayer (via GitHub)" <gi...@apache.org>.
zhztheplayer closed issue #5656: [CORE][VL] Subqueries are executed during explain phase for complex result type
URL: https://github.com/apache/incubator-gluten/issues/5656
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [CORE][VL] Subqueries may be executed during explain phase [incubator-gluten]
Posted by "zhztheplayer (via GitHub)" <gi...@apache.org>.
zhztheplayer closed issue #5656: [CORE][VL] Subqueries may be executed during explain phase
URL: https://github.com/apache/incubator-gluten/issues/5656
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org