You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@uniffle.apache.org by "yl09099 (via GitHub)" <gi...@apache.org> on 2025/05/06 05:45:52 UTC
[PR] [#2474] feat(spark): Trigger the upstream retry during the shuffle read stage. [uniffle]
yl09099 opened a new pull request, #2476:
URL: https://github.com/apache/uniffle/pull/2476
### What changes were proposed in this pull request?
When the stage trigger condition is reached in shuffle read, the retry of stage is triggered.
### Why are the changes needed?
Fix: https://github.com/apache/uniffle/issues/2470
Fix: https://github.com/apache/uniffle/issues/2474
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
UT.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
Re: [PR] [#2474] feat(spark): Trigger the upstream retry during the shuffle read stage. [uniffle]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #2476:
URL: https://github.com/apache/uniffle/pull/2476#issuecomment-2853383797
## Test Results
2 852 files - 167 2 852 suites - 167 5h 45m 38s ⏱️ - 1h 0m 59s
1 128 tests - 50 1 125 ✅ - 52 1 💤 ±0 2 ❌ + 2
14 561 runs - 361 14 526 ✅ - 381 15 💤 ±0 20 ❌ +20
For more details on these failures, see [this check](https://github.com/apache/uniffle/runs/41699536784).
Results for commit 925670a2. ± Comparison against base commit 057dcd22.
<details>
<summary>This pull request <b>removes</b> 50 tests.</summary>
```
org.apache.hadoop.mapred.SortWriteBufferManagerTest ‑ testCombineBuffer
org.apache.hadoop.mapred.SortWriteBufferManagerTest ‑ testCommitBlocksWhenMemoryShuffleDisabled
org.apache.hadoop.mapred.SortWriteBufferManagerTest ‑ testOnePartition
org.apache.hadoop.mapred.SortWriteBufferManagerTest ‑ testWriteException
org.apache.hadoop.mapred.SortWriteBufferManagerTest ‑ testWriteNormal
org.apache.hadoop.mapred.SortWriteBufferManagerTest ‑ testWriteNormalWithRemoteMerge
org.apache.hadoop.mapred.SortWriteBufferManagerTest ‑ testWriteNormalWithRemoteMergeAndCombine
org.apache.spark.shuffle.DelegationRssShuffleManagerTest ‑ testCreateFallback
org.apache.spark.shuffle.DelegationRssShuffleManagerTest ‑ testCreateInDriver
org.apache.spark.shuffle.DelegationRssShuffleManagerTest ‑ testCreateInDriverDenied
…
```
</details>
[test-results]:data:application/gzip;base64,H4sIAPynGWgC/1XMyQ7CIBSF4VdpWLtgutD6MgYZEmJbDMPK+O6CFtTl+e7N/0DOrzah80RnoKcJpeLz7zYlquzD3gRLNleq99w+CKFjXlLR+mPwtZu/NxvglF9baICNMcQquEos+7vKQZBjjioHKoYdVejQqz3yV9Vh23yuAy0UhMSKWs4YN1fgeDaMKyBML0wqqRbtsBQSPV8QRKMZFQEAAA==
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
Re: [PR] [#2474] feat(spark): Trigger the upstream retry during the shuffle read stage. [uniffle]
Posted by "yl09099 (via GitHub)" <gi...@apache.org>.
yl09099 commented on PR #2476:
URL: https://github.com/apache/uniffle/pull/2476#issuecomment-2857315326
There is no need to reallocate the Shuffle Server. This PR is deprecated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
Re: [PR] [#2474] feat(spark): Trigger the upstream retry during the shuffle read stage. [uniffle]
Posted by "yl09099 (via GitHub)" <gi...@apache.org>.
yl09099 closed pull request #2476: [#2474] feat(spark): Trigger the upstream retry during the shuffle read stage.
URL: https://github.com/apache/uniffle/pull/2476
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org