[jira] [Created] (SPARK-31017) Test for shuffle requests packaging with different size and numBlocks limit

["wuyi (Jira)" <ji...@apache.org>]

wuyi created SPARK-31017:
----------------------------

             Summary: Test for shuffle requests packaging with different size and numBlocks limit
                 Key: SPARK-31017
                 URL: https://issues.apache.org/jira/browse/SPARK-31017
             Project: Spark
          Issue Type: Test
          Components: Spark Core, Tests
    Affects Versions: 3.0.0
            Reporter: wuyi


When packaging shuffle fetch requests in ShuffleBlockFetcherIterator, there are two limitations: maxBytesInFlight and maxBlocksInFlightPerAddress. However, we don’t have test cases to test them both, e.g. the size limitation is hit before the numBlocks limitation.

We should add test cases in ShuffleBlockFetcherIteratorSuite to test:
 # the size limitation is hit before the numBlocks limitation

 # the numBlocks limitation is hit before the size limitation



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org