You are viewing a plain text version of this content. The canonical link for it is here.
- Re: [PR] [#1757] feat(server): Add block number check on getting shuffle result [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/03 02:14:36 UTC, 1 replies.
- Re: [PR] [MINOR] fix(dashboard): Display the registration time in 24-hour format [incubator-uniffle] - posted by "yl09099 (via GitHub)" <gi...@apache.org> on 2024/06/03 02:36:44 UTC, 2 replies.
- Re: [PR] [#1711] feat(server): Make the health checker execution timeout reconfigurable [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/03 03:30:41 UTC, 0 replies.
- Re: [PR] [#1699][FOLLOWUP] fix(client): Add commons-collections4 dependencies in shaded clients [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/03 03:37:22 UTC, 1 replies.
- [PR] [#1755][FOLLOWUP] fix(server): Incorrect request info to output too much logs [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/03 06:48:51 UTC, 2 replies.
- Re: [PR] [#1751][0.9] improvement: support gluten [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/03 06:51:05 UTC, 16 replies.
- Re: [PR] [#1727] improvement(server): Introduce block num threshold for early buffer flush to mitigate GC issues [incubator-uniffle] - posted by "xianjingfeng (via GitHub)" <gi...@apache.org> on 2024/06/03 07:08:59 UTC, 37 replies.
- [PR] [#1608][part-6][FOLLOWUP] improvement(client): Check blockId num after blocks all sent [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/03 09:06:41 UTC, 5 replies.
- Re: [PR] [#1579][part-1] fix(spark): Adjust reassigned time to ensure that all previous data is cleared for stage retry [incubator-uniffle] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/03 09:17:52 UTC, 23 replies.
- Re: [PR] [#1717] improvement: Flush a part of partitions if the shuffle size too big [incubator-uniffle] - posted by "advancedxy (via GitHub)" <gi...@apache.org> on 2024/06/04 06:53:41 UTC, 14 replies.
- [PR] [#1708] feat(server): support use skip list to store shuffleBuffer in memory [incubator-uniffle] - posted by "xianjingfeng (via GitHub)" <gi...@apache.org> on 2024/06/04 07:33:24 UTC, 52 replies.
- Re: [PR] Fix: Improve shuffle unregister timeouts [incubator-uniffle] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/04 07:48:18 UTC, 1 replies.
- [I] [Bug] Unregister shuffles timeout unit mismath [incubator-uniffle] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/04 07:55:32 UTC, 0 replies.
- [I] [Improvement] Improve shuffle unregister timeouts [incubator-uniffle] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/04 08:01:02 UTC, 1 replies.
- [PR] [#1764] fix(client): Fix timeout time unit for unregister requests [incubator-uniffle] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/04 08:08:46 UTC, 4 replies.
- Re: [PR] [#1765] improvement(client): Improve shuffle unregister timeouts [incubator-uniffle] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/04 08:24:01 UTC, 21 replies.
- Re: [I] [Bug] Unregister shuffles timeout unit mismatch [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/04 08:53:20 UTC, 0 replies.
- Re: [I] [Bug] [dashboard] fix dashboard data display bug. [incubator-uniffle] - posted by "jerqi (via GitHub)" <gi...@apache.org> on 2024/06/05 06:18:03 UTC, 0 replies.
- Re: [I] [Improvement] Default value optimization for 0.8 [incubator-uniffle] - posted by "jerqi (via GitHub)" <gi...@apache.org> on 2024/06/05 06:19:23 UTC, 0 replies.
- Re: [I] [FEATURE] Dynamic allocation support for Spark 3.3 [incubator-uniffle] - posted by "jerqi (via GitHub)" <gi...@apache.org> on 2024/06/05 06:20:08 UTC, 0 replies.
- Re: [I] [Improvement] Can we support AE of SPARK2.4 [incubator-uniffle] - posted by "jerqi (via GitHub)" <gi...@apache.org> on 2024/06/05 06:20:46 UTC, 0 replies.
- Re: [I] [FEATURE] Support rack awareness [incubator-uniffle] - posted by "xianjingfeng (via GitHub)" <gi...@apache.org> on 2024/06/05 07:25:54 UTC, 1 replies.
- Re: [PR] [#1401][part-1] The dashboard supports multiple Coordinator links. [incubator-uniffle] - posted by "yl09099 (via GitHub)" <gi...@apache.org> on 2024/06/05 12:31:18 UTC, 21 replies.
- [I] [FEATURE] The client-side supports choosing Netty's ByteBufAllocator [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/05 14:31:35 UTC, 1 replies.
- Re: [I] [Improvement] pick partitions instead of shuffles for flushing [incubator-uniffle] - posted by "xianjingfeng (via GitHub)" <gi...@apache.org> on 2024/06/06 06:29:01 UTC, 0 replies.
- Re: [PR] Add release notes for v0.9.0 [incubator-uniffle-website] - posted by "jerqi (via GitHub)" <gi...@apache.org> on 2024/06/06 12:16:31 UTC, 2 replies.
- [PR] [#1767] feat(netty): The client-side supports choosing Netty's ByteBufAllocator [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/06 13:41:53 UTC, 6 replies.
- Re: [PR] [#1398] fix(mr,tez): Make attempId computable and move it to taskAttemptId in BlockId layout. [incubator-uniffle] - posted by "zhengchenyu (via GitHub)" <gi...@apache.org> on 2024/06/07 02:50:44 UTC, 2 replies.
- [I] [Bug] A more elegant way to delete files is needed [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/07 13:37:30 UTC, 4 replies.
- Re: [PR] [#1713] Improvement: Don't log some errors on exit [incubator-uniffle] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/10 12:58:39 UTC, 1 replies.
- Re: [PR] ShuffleWriteClientImpl: await all service's termination [incubator-uniffle] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/10 12:59:27 UTC, 1 replies.
- [I] [Improvement] Increase the IHOP value to avoid frequent garbage collection [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/11 03:30:03 UTC, 1 replies.
- [PR] [#1608] improvement(spark3): Output more task level infos in driver side when reassigning on block sent failure [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/11 03:47:02 UTC, 2 replies.
- [PR] [#1770] improvement(server): Increase the IHOP value to avoid frequent garbage collection [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/11 06:28:07 UTC, 1 replies.
- [I] [Improvement] Reduce the chunkSize of gRPC Netty's PooledByteBufAllocator to reduce memory usage [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/11 06:49:45 UTC, 1 replies.
- Re: [PR] [#973] improvement: Make shuffle manager client RPC timeout configurable [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/11 07:51:28 UTC, 0 replies.
- [I] [Bug] rss.rpc.client.type.grpc.timeout does not work as expected [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/11 07:56:20 UTC, 1 replies.
- [PR] [#1773] improvement(client): Reduce chunkSize of gRPC Netty's PooledByteBufAllocator to reduce memory usage [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/11 09:40:01 UTC, 5 replies.
- Re: [PR] [#1770] improvement(server): Increase the InitiatingHeapOccupancyPercent value of G1 option to avoid frequent garbage collection [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/11 11:45:46 UTC, 0 replies.
- [PR] [#1608] improvement(spark3): Output the reassign logs in client side [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/12 02:34:08 UTC, 3 replies.
- Re: [I] [Umbrella] Enhance dashboard capabilities. [incubator-uniffle] - posted by "xianjingfeng (via GitHub)" <gi...@apache.org> on 2024/06/12 07:54:48 UTC, 0 replies.
- [PR] [MINOR] fix(docs) Correct the example of decommission interface [incubator-uniffle] - posted by "xianjingfeng (via GitHub)" <gi...@apache.org> on 2024/06/12 10:07:18 UTC, 1 replies.
- [I] [Improvement] Dashboard adds the ability to automatically format code. [incubator-uniffle] - posted by "yl09099 (via GitHub)" <gi...@apache.org> on 2024/06/12 13:47:41 UTC, 2 replies.
- [PR] [#1778][Improvement] Dashboard adds the ability to automatically format code. [incubator-uniffle] - posted by "yl09099 (via GitHub)" <gi...@apache.org> on 2024/06/12 15:52:06 UTC, 8 replies.
- [PR] [#1773] improvement(server): Reduce chunkSize of gRPC Netty's PooledByteBufAllocator to reduce memory usage [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/12 16:52:33 UTC, 6 replies.
- Re: [I] [Bug] Occasionally encountering IllegalReferenceCountException when releasing ShuffleIndexResult [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/12 17:13:08 UTC, 1 replies.
- Re: [I] [Bug] previous data is not deleted when re-register shuffle after re-assignment for stage recomputing [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/13 01:31:32 UTC, 0 replies.
- Re: [PR] [MINOR] fix(docs): Correct the example of decommission interface [incubator-uniffle] - posted by "xianjingfeng (via GitHub)" <gi...@apache.org> on 2024/06/13 01:36:48 UTC, 0 replies.
- [I] [Flaky Test] Flaky Test for ShuffleServerGrpcTest [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/13 03:11:13 UTC, 0 replies.
- [I] [Bug] ConcurrentModificationException is thrown when calling Roaring64NavigableMap.getLongCardinality [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/13 03:15:06 UTC, 0 replies.
- [PR] [#1608] feat(spark3): Ensure the compatiblity of reassign and stageRetry [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/13 08:58:15 UTC, 10 replies.
- [I] [Improvement] Do not retry if the application directory in HDFS is not exists [incubator-uniffle] - posted by "xianjingfeng (via GitHub)" <gi...@apache.org> on 2024/06/13 09:20:21 UTC, 1 replies.
- [PR] [#1784] improvement: Skip retries for absent HDFS app directory to speed up resource removal [incubator-uniffle] - posted by "xianjingfeng (via GitHub)" <gi...@apache.org> on 2024/06/13 09:29:47 UTC, 2 replies.
- Re: [PR] [#1784] improvement(server): Skip retries for absent HDFS app directory to speed up resource removal [incubator-uniffle] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/13 10:01:00 UTC, 1 replies.
- [PR] [#1705] improvement(server): Bump Jetty from 9.3.24.v20180605 to 9.4.54.v20240208 [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/13 17:54:11 UTC, 3 replies.
- Re: [I] [Improvement] Skip retries for absent HDFS app directory to speed up resource removal [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/14 02:07:07 UTC, 1 replies.
- [I] [FEATURE] Independent switch for fetch and write failure of stage retry mechanism [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/14 03:27:18 UTC, 0 replies.
- [PR] [#1787] feat(spark): Fine grained stage retry switch for fetch/write failure [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/14 03:34:06 UTC, 3 replies.
- [PR] [MINOR] refactor: Reduce minor logs [incubator-uniffle] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/06/14 03:52:46 UTC, 9 replies.
- [I] [FEATURE] Introduce the max stage retry times [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/14 06:04:48 UTC, 0 replies.
- [I] [FEATURE] Add more request params when getting assignment to track the reassign/stageRetry apps [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/14 06:43:22 UTC, 0 replies.
- [PR] [#1791] feat(spark)(coordinator): Take more infos on get assignment to track app reassign/stageRetry [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/14 07:24:27 UTC, 4 replies.
- [PR] [MINOR] refactor: Check debug enabled [incubator-uniffle] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/06/14 08:35:39 UTC, 3 replies.
- [I] [Improvement] Backport SPARK-46506 [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/14 10:01:17 UTC, 1 replies.
- [PR] [#1794] improvement(netty): TransportClientFactory should check whether handler is null when creating client [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/14 10:07:56 UTC, 2 replies.
- Re: [PR] [#1778] improvement(dashboard): Dashboard adds the ability to automatically format code. [incubator-uniffle] - posted by "jerqi (via GitHub)" <gi...@apache.org> on 2024/06/15 16:19:42 UTC, 0 replies.
- [I] [Bug] Remaining map output when enable the stage retry on fetch failure [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/17 06:22:19 UTC, 0 replies.
- [PR] [#1796] fix(spark): Implicitly unregister map output on fetch failure [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/17 06:24:01 UTC, 9 replies.
- [I] [Bug] Incorrect stage retry condition for write failure [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/17 06:51:31 UTC, 0 replies.
- [I] [FEATURE] rename the rpc reassignShuffleServers to reassignOnStageResubmit [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/17 06:55:49 UTC, 1 replies.
- [PR] [#1799] improvement(spark): Rename shuffleManager rpc to reassignOnStageResubmit [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/17 07:03:02 UTC, 5 replies.
- Re: [I] [FEATURE] support use skip list to store shuffleBuffer in memory [incubator-uniffle] - posted by "xianjingfeng (via GitHub)" <gi...@apache.org> on 2024/06/17 07:17:44 UTC, 1 replies.
- [I] [Bug] Incorrect stage retry condition for fetch failure [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/17 07:19:12 UTC, 1 replies.
- [I] [Improvement] Uniffle should allow sharing Netty's memory pools [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/17 07:38:42 UTC, 1 replies.
- [PR] [#1802] improvement(netty): Allow sharing Netty's memory pool allocators [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/17 09:03:25 UTC, 2 replies.
- Re: [PR] [#1802] improvement(netty): Allow sharing Netty's memory allocators [incubator-uniffle] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/17 09:42:44 UTC, 8 replies.
- [PR] [#1668] fix: Replace assertions with exception-throwing codes [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/17 16:54:24 UTC, 5 replies.
- [I] [Improvement] Support Spark 4 [incubator-uniffle] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/17 20:05:41 UTC, 0 replies.
- [PR] [#1805][part-1] Support Scala 2.13 [incubator-uniffle] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/17 20:07:21 UTC, 4 replies.
- [I] [Improvement] avoid repeating judgment special partitionId is huge partition [incubator-uniffle] - posted by "xumanbu (via GitHub)" <gi...@apache.org> on 2024/06/18 03:03:43 UTC, 2 replies.
- [PR] [#1807] avoid repeating judgment special partitionId is huge partition [incubator-uniffle] - posted by "xumanbu (via GitHub)" <gi...@apache.org> on 2024/06/18 03:36:53 UTC, 1 replies.
- Re: [PR] [#1807] improvement(server): Avoid repeating judgment of partition whether is huge [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/18 07:49:16 UTC, 0 replies.
- [I] [Bug] Performance issues with the SKIP_LIST shuffle buffer [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/18 09:23:58 UTC, 1 replies.
- [PR] Fix sidebar position of 0.9.0 release notes [incubator-uniffle-website] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/18 10:30:35 UTC, 1 replies.
- [PR] Fix typo in project committers org [incubator-uniffle-website] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/18 10:55:03 UTC, 4 replies.
- [PR] Add new committers [incubator-uniffle-website] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2024/06/18 10:58:18 UTC, 8 replies.
- Re: [I] [FEATURE] Add block counter check in server side [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/18 13:26:08 UTC, 0 replies.
- Re: [I] [Improvement] Log message should indicate RPC error during after close / shutdown [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/18 13:26:33 UTC, 0 replies.
- [I] [Improvement] Unit tests support mocking the ShuffleServerNettyHandler class [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/18 15:32:10 UTC, 0 replies.
- Re: [I] [FEATURE] support generating larger block size during shuffle map task by spill partial partitions data [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/18 15:33:57 UTC, 0 replies.
- [I] [Flaky Test] Flaky test for RSSStageDynamicServerReWriteTest [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/23 06:29:17 UTC, 0 replies.
- Re: [PR] [#1818] Avoid calling RssShuffleDataIterator.cleanup multiple times [incubator-uniffle] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/23 06:29:18 UTC, 10 replies.
- Re: [I] [Bug] Assertions will not take effect during production runtime [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/24 03:07:11 UTC, 0 replies.
- [PR] [#1628] Avoid exception caused by calling release multiple times [incubator-uniffle] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/06/24 07:38:49 UTC, 4 replies.
- [I] [Flaky Test] Flaky test for ShuffleBufferManagerTest [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/24 08:15:45 UTC, 0 replies.
- Re: [PR] [#1735] fix(client): MultiException class not found when reassign or stag retry is enabled [incubator-uniffle] - posted by "zuston (via GitHub)" <gi...@apache.org> on 2024/06/24 09:23:29 UTC, 0 replies.
- [I] [FEATURE] Support map side combine of shuffle writer [incubator-uniffle] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/06/24 10:51:39 UTC, 0 replies.
- [PR] [#1824] Support map side combine of shuffle writer [incubator-uniffle] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2024/06/24 10:53:16 UTC, 1 replies.
- [I] [Bug] Fix build_distribution.sh [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/24 13:23:53 UTC, 0 replies.
- [PR] [#1826] fix(build): Fix multiple '--without' options and correct Hadoop profile usage [incubator-uniffle] - posted by "rickyma (via GitHub)" <gi...@apache.org> on 2024/06/24 13:41:37 UTC, 1 replies.