You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@uniffle.apache.org by "zuston (via GitHub)" <gi...@apache.org> on 2025/09/03 09:17:55 UTC

[I] [Bug] Incorrect shuffle read metric for spark [uniffle]

zuston opened a new issue, #2599:
URL: https://github.com/apache/uniffle/issues/2599

   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [x] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Describe the bug
   
   Currently, the shuffle read metrics for spark in uniffle don't involve the decompression and serialization time into the `shuffleReadMetrics.incFetchWaitTime(fetchDuration);` .
   
   But in the end-to-end performance improvement, we will calculate the shuffle speed by using the fetchWaitTime. From the current observation, the decompression time should be improved, so we'd better to correct this metric and then to evaluate the improvement after optimization
   
   ### Affects Version(s)
   
   master
   
   ### Uniffle Server Log Output
   
   ```logtalk
   
   ```
   
   ### Uniffle Engine Log Output
   
   ```logtalk
   
   ```
   
   ### Uniffle Server Configurations
   
   ```yaml
   
   ```
   
   ### Uniffle Engine Configurations
   
   ```yaml
   
   ```
   
   ### Additional context
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org