You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "zml1206 (via GitHub)" <gi...@apache.org> on 2024/11/11 03:06:00 UTC
[I] [UI] Optimize cleanup gluten sql executions ui data [incubator-gluten]
zml1206 opened a new issue, #7890:
URL: https://github.com/apache/incubator-gluten/issues/7890
### Description
There is a phenomenon in our production environment. After running for a period of time, only a few gluten sql executions ui data will be retained. We are resident in spark, and there are some queries that disable gluten.
The reason is that the current cleanup of gluten sql executions ui data depends on SQLExecutionUIData. There is a problem here. When sql execution disables gluten, gluten sql executions ui data will not be generated, but cleanup will still be triggered.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [UI] Optimize cleanup gluten sql executions ui data [incubator-gluten]
Posted by "zml1206 (via GitHub)" <gi...@apache.org>.
zml1206 commented on issue #7890:
URL: https://github.com/apache/incubator-gluten/issues/7890#issuecomment-2469464392
> so i am just wondering does it possbile to let glutenPlugin do nothing (at least not register gluten listener) if gluten is been disabled by `spark.gluten.enabled` conf ?
AFAIK, this is inappropriate because `spark.gluten.enabled` is a dynamic configuration, while listener is static and cannot be changed after initialization.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [UI] Optimize cleanup gluten sql executions ui data [incubator-gluten]
Posted by "zml1206 (via GitHub)" <gi...@apache.org>.
zml1206 closed issue #7890: [UI] Optimize cleanup gluten sql executions ui data
URL: https://github.com/apache/incubator-gluten/issues/7890
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [UI] Optimize cleanup gluten sql executions ui data [incubator-gluten]
Posted by "gaoyangxiaozhu (via GitHub)" <gi...@apache.org>.
gaoyangxiaozhu commented on issue #7890:
URL: https://github.com/apache/incubator-gluten/issues/7890#issuecomment-2469443214
> > curious if we disable gluten， why the event of `GlutenSQLAppStatusListener` still be triggerred instead of been disabled also?
>
> `GlutenSQLAppStatusListener` is registered by `GlutenPlugin`, this is done by driver initialization.
thanks @zml1206 , so i am just wondering does it possbile to let glutenPlugin do nothing (at least not register gluten listener) if gluten is been disabled by `spark.gluten.enabled` conf ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [UI] Optimize cleanup gluten sql executions ui data [incubator-gluten]
Posted by "gaoyangxiaozhu (via GitHub)" <gi...@apache.org>.
gaoyangxiaozhu commented on issue #7890:
URL: https://github.com/apache/incubator-gluten/issues/7890#issuecomment-2467650853
curious if we disable gluten， why the event of `GlutenSQLAppStatusListener` still be triggerred ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [UI] Optimize cleanup gluten sql executions ui data [incubator-gluten]
Posted by "zml1206 (via GitHub)" <gi...@apache.org>.
zml1206 commented on issue #7890:
URL: https://github.com/apache/incubator-gluten/issues/7890#issuecomment-2467685671
> curious if we disable gluten， why the event of `GlutenSQLAppStatusListener` still be triggerred instead of been disabled also?
`GlutenSQLAppStatusListener` is registered by `GlutenPlugin`, this is done by driver initialization.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org