You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "rajatma1993 (via GitHub)" <gi...@apache.org> on 2025/01/07 10:31:20 UTC
[I] Usage of Gluten Functions At Query Level [incubator-gluten]
rajatma1993 opened a new issue, #8451:
URL: https://github.com/apache/incubator-gluten/issues/8451
### Backend
VL (Velox)
### Bug description
Hello Team,
I am currently testing Gluten to benchmark its performance against TPCH. In the process, I observed that in TPCH Query 16, In Flame Graph we see only 4.69% of the function usage of the overall seems to be utilized.
I would like to understand if this utilization level aligns with our expectations. Additionally, could we confirm if this level of utilization contributes significantly to the execution speedup?
Attached is the Flame Graph we have generated.
<img width="960" alt="gluten_snap_q16" src="https://github.com/user-attachments/assets/0b7737ac-a467-4d8f-af4c-e3eacdc1a44e" />
### Spark version
None
### Spark configurations
_No response_
### System information
_No response_
### Relevant logs
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] Usage of Gluten Functions At Query Level [incubator-gluten]
Posted by "FelixYBW (via GitHub)" <gi...@apache.org>.
FelixYBW commented on issue #8451:
URL: https://github.com/apache/incubator-gluten/issues/8451#issuecomment-2576178238
It depends on the partition data size of the stage. You may increase the TPCH SF or decrease the partition number to get larger partition in each task. The larger partition a task is processing the more time spending in native.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org