You are viewing a plain text version of this content. The canonical link for it is here.
- Podling Uniffle Report Reminder - January 2023 - posted by ki...@apache.org on 2023/01/03 01:13:57 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston closed issue #451: [Improvement] Read HDFS data files with random sequence to distribute pressure - posted by GitBox <gi...@apache.org> on 2023/01/03 08:26:25 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #448: [Subtask] Shuffle server shall report its local storage capability - posted by GitBox <gi...@apache.org> on 2023/01/04 06:46:40 UTC, 0 replies.
- [GitHub] [incubator-uniffle] xianjingfeng opened a new issue, #455: [Improvement] Lazily create `uncompressedData` - posted by GitBox <gi...@apache.org> on 2023/01/04 08:49:46 UTC, 0 replies.
- [GitHub] [incubator-uniffle] xianjingfeng commented on issue #455: [Improvement] Lazily create `uncompressedData` - posted by GitBox <gi...@apache.org> on 2023/01/04 08:50:07 UTC, 0 replies.
- [GitHub] [incubator-uniffle] xianjingfeng opened a new issue, #456: [Improvement] Avoid removeResources for multiple times - posted by GitBox <gi...@apache.org> on 2023/01/04 08:57:22 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #455: [Improvement] Lazily create `uncompressedData` - posted by GitBox <gi...@apache.org> on 2023/01/04 10:26:57 UTC, 0 replies.
- [GitHub] [incubator-uniffle] a-li commented on issue #313: [Improvement] Support ZSTD in the spark2.x version - posted by GitBox <gi...@apache.org> on 2023/01/05 00:31:27 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #313: [Improvement] Support ZSTD in the spark2.x version - posted by GitBox <gi...@apache.org> on 2023/01/05 10:02:34 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #456: [Improvement] Avoid removeResources for multiple times - posted by GitBox <gi...@apache.org> on 2023/01/06 10:02:49 UTC, 1 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #378: [Improvement] Introduce partition size based strategy to flush single huge partition data to HDFS - posted by GitBox <gi...@apache.org> on 2023/01/06 10:30:52 UTC, 0 replies.
- [GitHub] [incubator-uniffle] jerqi closed issue #455: [Improvement] Lazily create `uncompressedData` - posted by GitBox <gi...@apache.org> on 2023/01/06 10:43:03 UTC, 0 replies.
- [GitHub] [incubator-uniffle] jerqi commented on issue #455: [Improvement] Lazily create `uncompressedData` - posted by GitBox <gi...@apache.org> on 2023/01/06 10:43:03 UTC, 0 replies.
- [GitHub] [incubator-uniffle] jerqi commented on issue #378: [Improvement] Optimize data flushing and memory usage for huge partitions to improve stability - posted by GitBox <gi...@apache.org> on 2023/01/06 11:12:58 UTC, 0 replies.
- [GitHub] [incubator-uniffle] xianjingfeng opened a new issue, #460: [Improvement] Exit on OutOfMemoryError - posted by GitBox <gi...@apache.org> on 2023/01/09 03:30:05 UTC, 0 replies.
- [GitHub] [incubator-uniffle] xianjingfeng commented on issue #460: [Improvement] Exit on OutOfMemoryError - posted by GitBox <gi...@apache.org> on 2023/01/09 03:30:58 UTC, 1 replies.
- [GitHub] [incubator-uniffle] jerqi commented on issue #460: [Improvement] Exit on OutOfMemoryError - posted by GitBox <gi...@apache.org> on 2023/01/09 03:36:59 UTC, 0 replies.
- [GitHub] [incubator-uniffle] kaijchen opened a new issue, #461: [FEATURE] Spark 3.3 support - posted by GitBox <gi...@apache.org> on 2023/01/09 03:59:14 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #460: [Improvement] Exit on OutOfMemoryError - posted by GitBox <gi...@apache.org> on 2023/01/09 06:12:45 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #461: [FEATURE] Spark 3.3 support - posted by GitBox <gi...@apache.org> on 2023/01/09 09:08:42 UTC, 0 replies.
- [GitHub] [incubator-uniffle] kaijchen commented on issue #461: [FEATURE] Spark 3.3 support - posted by GitBox <gi...@apache.org> on 2023/01/09 09:11:22 UTC, 3 replies.
- [GitHub] [incubator-uniffle] xianjingfeng commented on issue #80: [Feature Request] Support shuffle server decommissioned - posted by GitBox <gi...@apache.org> on 2023/01/09 10:24:38 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #80: [Feature Request] Support shuffle server decommissioned - posted by GitBox <gi...@apache.org> on 2023/01/09 10:26:23 UTC, 1 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #461: [FEATURE] Spark 3.3 support - posted by GitBox <gi...@apache.org> on 2023/01/09 10:49:19 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #460: [Improvement] Exit on OutOfMemoryError - posted by GitBox <gi...@apache.org> on 2023/01/09 10:50:22 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy opened a new issue, #462: [Umbrella] Better K8S operator support - posted by GitBox <gi...@apache.org> on 2023/01/09 14:40:13 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #462: [Umbrella] Better K8S operator support - posted by GitBox <gi...@apache.org> on 2023/01/09 14:40:38 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #378: [Improvement] Optimize data flushing and memory usage for huge partitions to improve stability - posted by GitBox <gi...@apache.org> on 2023/01/10 02:06:43 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston closed issue #456: [Improvement] Avoid removeResources for multiple times - posted by GitBox <gi...@apache.org> on 2023/01/10 02:38:23 UTC, 0 replies.
- [GitHub] [incubator-uniffle] kaijchen closed issue #461: [FEATURE] Spark 3.3 support - posted by GitBox <gi...@apache.org> on 2023/01/10 11:04:15 UTC, 0 replies.
- [GitHub] [incubator-uniffle] kaijchen opened a new issue, #465: [FEATURE] Dynamic allocation support for Spark 3.3 - posted by GitBox <gi...@apache.org> on 2023/01/10 11:06:50 UTC, 0 replies.
- [GitHub] [incubator-uniffle] jerqi closed issue #448: [Subtask] Shuffle server shall report its local storage capability - posted by GitBox <gi...@apache.org> on 2023/01/11 02:45:48 UTC, 0 replies.
- [GitHub] [incubator-uniffle] xianjingfeng opened a new issue, #468: [Improvement] Put unavailable shuffle servers to the end of the server list when sending shuffle data - posted by GitBox <gi...@apache.org> on 2023/01/11 03:31:34 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #468: [Improvement] Put unavailable shuffle servers to the end of the server list when sending shuffle data - posted by GitBox <gi...@apache.org> on 2023/01/11 03:49:59 UTC, 0 replies.
- [GitHub] [incubator-uniffle] wangao1236 opened a new issue, #469: [FEATURE] Operator supports adding labels to rss pods. - posted by GitBox <gi...@apache.org> on 2023/01/11 04:44:16 UTC, 0 replies.
- [GitHub] [incubator-uniffle] xianjingfeng commented on issue #468: [Improvement] Put unavailable shuffle servers to the end of the server list when sending shuffle data - posted by GitBox <gi...@apache.org> on 2023/01/11 06:31:22 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston opened a new issue, #472: Flaky Test: LocalFileServerReadHandlerTest#testDataInconsistent - posted by GitBox <gi...@apache.org> on 2023/01/12 06:32:38 UTC, 0 replies.
- [GitHub] [incubator-uniffle] xianjingfeng commented on issue #108: [Improvement] Read shuffle data fail because read index file fail - posted by GitBox <gi...@apache.org> on 2023/01/12 07:09:39 UTC, 0 replies.
- [GitHub] [incubator-uniffle] xianjingfeng closed issue #108: [Improvement] Read shuffle data fail because read index file fail - posted by GitBox <gi...@apache.org> on 2023/01/12 07:09:40 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zjf2012 opened a new issue, #475: [Improvement] It's unnecessary to use ConcurrentHashMap for "partitionToBlockIds" in RssShuffleWriter - posted by GitBox <gi...@apache.org> on 2023/01/12 07:16:53 UTC, 0 replies.
- [GitHub] [incubator-uniffle] kaijchen commented on issue #472: Flaky Test: LocalFileServerReadHandlerTest#testDataInconsistent - posted by GitBox <gi...@apache.org> on 2023/01/12 07:41:48 UTC, 0 replies.
- [GitHub] [incubator-uniffle] kaijchen closed issue #472: Flaky Test: LocalFileServerReadHandlerTest#testDataInconsistent - posted by GitBox <gi...@apache.org> on 2023/01/12 07:50:02 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zjf2012 opened a new issue, #476: [FEATURE] Respect "spark.shuffle.compress" configuration in Uniffle - posted by GitBox <gi...@apache.org> on 2023/01/12 08:33:01 UTC, 0 replies.
- [GitHub] [incubator-uniffle] jerqi commented on issue #476: [FEATURE] Respect "spark.shuffle.compress" configuration in Uniffle - posted by GitBox <gi...@apache.org> on 2023/01/12 09:22:30 UTC, 1 replies.
- [GitHub] [incubator-uniffle] jerqi commented on issue #475: [Improvement] It's unnecessary to use ConcurrentHashMap for "partitionToBlockIds" in RssShuffleWriter - posted by GitBox <gi...@apache.org> on 2023/01/12 09:22:55 UTC, 1 replies.
- [GitHub] [incubator-uniffle] zjf2012 commented on issue #475: [Improvement] It's unnecessary to use ConcurrentHashMap for "partitionToBlockIds" in RssShuffleWriter - posted by GitBox <gi...@apache.org> on 2023/01/12 09:29:26 UTC, 3 replies.
- [GitHub] [incubator-uniffle] zjf2012 commented on issue #476: [FEATURE] Respect "spark.shuffle.compress" configuration in Uniffle - posted by GitBox <gi...@apache.org> on 2023/01/12 09:39:33 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #476: [FEATURE] Respect "spark.shuffle.compress" configuration in Uniffle - posted by GitBox <gi...@apache.org> on 2023/01/12 11:37:25 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #476: [FEATURE] Respect "spark.shuffle.compress" configuration in Uniffle - posted by GitBox <gi...@apache.org> on 2023/01/12 11:39:10 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #475: [Improvement] It's unnecessary to use ConcurrentHashMap for "partitionToBlockIds" in RssShuffleWriter - posted by GitBox <gi...@apache.org> on 2023/01/12 11:48:27 UTC, 1 replies.
- [GitHub] [incubator-uniffle] advancedxy opened a new issue, #477: [FEATURE] Support stage recompute for Spark clients - posted by GitBox <gi...@apache.org> on 2023/01/12 12:11:01 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy opened a new issue, #479: [Improvement] [Operator] better build system support - posted by GitBox <gi...@apache.org> on 2023/01/12 13:23:32 UTC, 0 replies.
- [GitHub] [incubator-uniffle] jerqi commented on issue #479: [Improvement] [Operator] better build system support - posted by GitBox <gi...@apache.org> on 2023/01/13 02:28:10 UTC, 1 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #479: [Improvement] [Operator] better build system support - posted by GitBox <gi...@apache.org> on 2023/01/13 02:40:06 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston opened a new issue, #483: Flaky Test: ShuffleServerFaultToleranceTest#testReadFaultTolerance - posted by GitBox <gi...@apache.org> on 2023/01/13 05:36:35 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston opened a new issue, #484: [Bug] HdfsStorageManager#appIdToStorages data lost when removing resources for partial shuffleIds - posted by GitBox <gi...@apache.org> on 2023/01/13 08:25:23 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #391: [FEATURE] Expect to support the filesystem not implementing the append-mode. - posted by GitBox <gi...@apache.org> on 2023/01/16 06:36:27 UTC, 0 replies.
- [GitHub] [incubator-uniffle] iwangjie opened a new issue, #487: [Improvement] Java 8 syntax helps with code readability improvements - posted by GitBox <gi...@apache.org> on 2023/01/16 06:41:00 UTC, 0 replies.
- [GitHub] [incubator-uniffle] iwangjie opened a new issue, #489: [Improvement] 我们可以简化和规范一些代码 - posted by GitBox <gi...@apache.org> on 2023/01/16 07:59:09 UTC, 0 replies.
- [GitHub] [incubator-uniffle] kaijchen closed issue #487: [Improvement] Java 8 syntax helps with code readability improvements - posted by GitBox <gi...@apache.org> on 2023/01/16 08:45:06 UTC, 0 replies.
- [GitHub] [incubator-uniffle] kaijchen commented on issue #483: Flaky Test: ShuffleServerFaultToleranceTest#testReadFaultTolerance - posted by GitBox <gi...@apache.org> on 2023/01/16 09:14:09 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #483: Flaky Test: ShuffleServerFaultToleranceTest#testReadFaultTolerance - posted by GitBox <gi...@apache.org> on 2023/01/16 09:25:15 UTC, 0 replies.
- [GitHub] [incubator-uniffle] kaijchen closed issue #489: [Improvement] We can simplify and standardize some of the code - posted by GitBox <gi...@apache.org> on 2023/01/16 09:38:10 UTC, 0 replies.
- [GitHub] [incubator-uniffle] jerqi closed issue #475: [Improvement] It's unnecessary to use ConcurrentHashMap for "partitionToBlockIds" in RssShuffleWriter - posted by GitBox <gi...@apache.org> on 2023/01/16 15:06:12 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston closed issue #484: [Bug] HdfsStorageManager#appIdToStorages data lost when removing resources for partial shuffleIds - posted by GitBox <gi...@apache.org> on 2023/01/17 02:03:33 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston opened a new issue, #493: [Improvement] Replace putIfAbsent with computeIfAbsent in some critical paths - posted by GitBox <gi...@apache.org> on 2023/01/17 02:26:18 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy closed issue #418: [Improvement] Add until.CreateTempDir - posted by GitBox <gi...@apache.org> on 2023/01/17 08:48:23 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #483: Flaky Test: ShuffleServerFaultToleranceTest#testReadFaultTolerance - posted by GitBox <gi...@apache.org> on 2023/01/17 09:25:11 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy opened a new issue, #496: [Subtask][operator] set init-container's resource request - posted by GitBox <gi...@apache.org> on 2023/01/18 06:56:56 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #496: [Subtask][operator] set init-container's resource request - posted by GitBox <gi...@apache.org> on 2023/01/18 09:02:12 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston opened a new issue, #497: [Improvement] Rethink the metric of 'rss.server.write.slow.threshold' - posted by GitBox <gi...@apache.org> on 2023/01/18 09:20:29 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston opened a new issue, #498: [Improvement] Extend event size threshold metric configuration to any number of levels - posted by GitBox <gi...@apache.org> on 2023/01/18 09:37:37 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #496: [Subtask][operator] set init-container's resource request - posted by GitBox <gi...@apache.org> on 2023/01/18 10:11:07 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #498: [Improvement] Extend event size threshold metric configuration to any number of levels - posted by GitBox <gi...@apache.org> on 2023/01/19 02:39:16 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #498: [Improvement] Extend event size threshold metric configuration to any number of levels - posted by GitBox <gi...@apache.org> on 2023/01/19 02:41:55 UTC, 0 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #497: [Improvement] Rethink the config of 'rss.server.write.slow.threshold' - posted by GitBox <gi...@apache.org> on 2023/01/19 02:44:40 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #497: [Improvement] Rethink the config of 'rss.server.write.slow.threshold' - posted by GitBox <gi...@apache.org> on 2023/01/19 03:11:50 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston opened a new issue, #502: Flaky Test: QuorumTest#case5 - posted by GitBox <gi...@apache.org> on 2023/01/19 03:16:37 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #502: Flaky Test: QuorumTest#case5 - posted by GitBox <gi...@apache.org> on 2023/01/19 03:17:11 UTC, 0 replies.
- [GitHub] [incubator-uniffle] kaijchen commented on issue #502: Flaky Test: QuorumTest#case5 - posted by GitBox <gi...@apache.org> on 2023/01/19 03:34:29 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston opened a new issue, #503: [Bug] Frequent and long lasting full GCs when there are too many partitions on a shuffle server - posted by GitBox <gi...@apache.org> on 2023/01/19 06:35:41 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston commented on issue #503: [Bug] Frequent and long lasting full GCs when there are too many partitions on a shuffle server - posted by GitBox <gi...@apache.org> on 2023/01/19 06:36:35 UTC, 1 replies.
- [GitHub] [incubator-uniffle] advancedxy commented on issue #503: [Bug] Frequent and long lasting full GCs when there are too many partitions on a shuffle server - posted by GitBox <gi...@apache.org> on 2023/01/19 07:15:23 UTC, 1 replies.
- [GitHub] [incubator-uniffle] zuston closed issue #198: [Problem] Inconsistent blocks when reading shuffle data - posted by GitBox <gi...@apache.org> on 2023/01/19 08:22:18 UTC, 0 replies.
- [GitHub] [incubator-uniffle] zuston closed issue #95: [Performance Optimization] Multiple channels when getting shuffle data in client side - posted by GitBox <gi...@apache.org> on 2023/01/19 08:22:44 UTC, 0 replies.
- [GitHub] [incubator-uniffle] kaijchen opened a new issue, #507: Flaky Test: ShuffleBufferManagerTest#cacheShuffleDataTest - posted by GitBox <gi...@apache.org> on 2023/01/20 08:37:11 UTC, 0 replies.
- [GitHub] [incubator-uniffle] kaijchen opened a new issue, #509: Flaky Test: ShuffleBufferManagerTest#shuffleFlushThreshold - posted by "kaijchen (via GitHub)" <gi...@apache.org> on 2023/01/25 11:47:38 UTC, 0 replies.