You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "Kontinuation (via GitHub)" <gi...@apache.org> on 2025/04/07 12:48:37 UTC

[I] Native shuffle write records and time are missing in task level metrics [datafusion-comet]

Kontinuation opened a new issue, #1616:
URL: https://github.com/apache/datafusion-comet/issues/1616

   ### Describe the bug
   
   Per-task metrics of shuffle map stages shows that shuffle write records are all 0, shuffle write time metrics is also missing.
   
   <img width="1791" alt="Image" src="https://github.com/user-attachments/assets/fd653bbc-cf31-42e9-b9ab-980edf8aa5cf" />
   
   ### Steps to reproduce
   
   Run any query involving Comet native shuffle operator (CometExchange) and check the per-task metrics on Spark UI.
   
   ### Expected behavior
   
   Shuffle write records and shuffle write time metrics should have correct values.
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org

Re: [I] Native shuffle write records and time are missing in task level metrics [datafusion-comet]

Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove closed issue #1616: Native shuffle write records and time are missing in task level metrics
URL: https://github.com/apache/datafusion-comet/issues/1616


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org