You are viewing a plain text version of this content. The canonical link for it is here.
- Re: [PR] [CELEBORN-2090] Support Lz4 Decompression in CppClient [celeborn] - posted by "HolyLow (via GitHub)" <gi...@apache.org> on 2025/08/01 02:29:11 UTC, 11 replies.
- [PR] [CELEBORN-2093] Support Flink 2.1 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/08/01 03:08:52 UTC, 2 replies.
- Re: [PR] [CELEBORN-2085] Use a fixed buffer for flush copying to reduce GC [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/08/01 04:10:29 UTC, 2 replies.
- Re: [PR] [CELEBORN-2092] Inc COMMIT_FILES_FAIL_COUNT when TimerWriter::close timeout [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/08/01 04:12:01 UTC, 1 replies.
- Re: [PR] [CELEBORN-2088] Fix NPE if `celeborn.client.spark.fetch.cleanFailedShuffle` enabled [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/08/01 04:15:39 UTC, 1 replies.
- [PR] log [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/08/01 05:01:03 UTC, 1 replies.
- [PR] Worker produce speed [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/08/01 05:13:24 UTC, 0 replies.
- Re: [PR] [CELEBORN-2094] Add WorkerProduceSpeed for worker congestion control [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/08/01 05:16:58 UTC, 3 replies.
- Re: [PR] [CELEBORN-2044] Proactively cleanup stream state from ChunkStreamManager when the stream ends [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/08/01 05:32:49 UTC, 1 replies.
- Re: [PR] [CELEBORN-2064] Fix the issue where reading replica partition that returns zero chunk causes tasks to hang [celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2025/08/01 08:10:26 UTC, 2 replies.
- Re: [PR] [CELEBORN-1984] Merge ResourceRequest to transportMessageProtobuf [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/08/01 15:27:55 UTC, 1 replies.
- Re: [PR] [CELEBORN-2058] Add retry to avoid commtting failed with HDFS storage [celeborn] - posted by "taowenjun (via GitHub)" <gi...@apache.org> on 2025/08/03 14:45:27 UTC, 2 replies.
- [PR] [CELEBORN-1792][FOLLOWUP] Add missing break in resumeByPinnedMemory [celeborn] - posted by "Flyangz (via GitHub)" <gi...@apache.org> on 2025/08/04 06:42:45 UTC, 2 replies.
- Re: [PR] [CELEBORN-2063] Parallelize the create partition writer in handleReserveSlots to speed up the reserveSlots RPC process time [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/08/05 13:07:14 UTC, 8 replies.
- [PR] [CELEBORN-1844][FOLLOWUP] Fix the condition of StoragePolicy that worker uses memory storage [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/08/05 22:11:34 UTC, 2 replies.
- Re: [PR] [CELEBORN-1971] Use synchronization as opposed to Thread.sleep for InFlightRequestTracker limit [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/08/06 15:29:58 UTC, 1 replies.
- [PR] Adjust `celeborn.client.push.slowStart.initialSleepTime` default value from `500ms` to `0` [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/08/07 23:27:03 UTC, 1 replies.
- [PR] [CELEBORN-2095][CIP-14] Support RegisterShuffle/Response in cppClient [celeborn] - posted by "HolyLow (via GitHub)" <gi...@apache.org> on 2025/08/08 09:57:49 UTC, 6 replies.
- [PR] [CELEBORN-2091]Support Zstd Decompression in CppClient [celeborn] - posted by "Jraaay (via GitHub)" <gi...@apache.org> on 2025/08/11 01:55:20 UTC, 2 replies.
- Re: [PR] [CELEBORN-2074] Create hdfs shuffle directory by master to reduce Namenode call [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/11 08:40:17 UTC, 1 replies.
- Re: [PR] [CELEBORN-2066] Release workers only with high workload when the number of excluded worker set is too large. [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/11 08:40:20 UTC, 6 replies.
- Re: [PR] [CELEBORN-2060] Refactor `SlotsAlloctor` for better scalability [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/11 08:40:21 UTC, 2 replies.
- Re: [PR] [CIP-19][CELEBORN-1939] CongestionController should not limit user push speed when worker load is low [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/11 08:40:23 UTC, 2 replies.
- Re: [PR] [CELEBORN-2032] Create reader should change to peer by taskAttemptId [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/11 08:40:25 UTC, 3 replies.
- Re: [PR] [WIP] Dynamically adjust partition write parallelism [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/11 08:40:26 UTC, 3 replies.
- [PR] [CELEBORN-2096]Support Lz4 Compression in CppClient [celeborn] - posted by "Jraaay (via GitHub)" <gi...@apache.org> on 2025/08/11 09:16:11 UTC, 3 replies.
- Re: [PR] [CELEBORN-2076] Add `FetchChunkSize` metrics [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/12 08:38:14 UTC, 2 replies.
- Re: [PR] [CELEBORN-2062] Introduce splitNum to optimize shuffle write [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/12 08:38:17 UTC, 0 replies.
- [PR] [CELEBORN-2098][CIP-14] Support Revive/Response in cppClient [celeborn] - posted by "HolyLow (via GitHub)" <gi...@apache.org> on 2025/08/13 02:51:45 UTC, 4 replies.
- [PR] Support spark shuffle fallback policy based on map partitions [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/08/14 00:21:29 UTC, 0 replies.
- Re: [PR] [CELEBORN-2099] Support spark shuffle fallback policy based on map partitions number [celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2025/08/14 05:04:41 UTC, 3 replies.
- [PR] [CELEBORN-2100] Fix performance issue on readToReadOnlyBuffer [celeborn] - posted by "Jraaay (via GitHub)" <gi...@apache.org> on 2025/08/14 05:34:14 UTC, 2 replies.
- Re: [PR] [CELEBORN-2059] Support reusing hdfs output stream with HDFS storage [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/08/14 08:56:18 UTC, 0 replies.
- Re: [PR] [CELEBORN-2079] Fix netty grafana dashboard [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/15 08:37:44 UTC, 2 replies.
- Re: [PR] [CELEBORN-1787] Fix netty memory metrics was not registered when enable memory allocator share [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/15 08:37:48 UTC, 2 replies.
- [PR] [CELEBORN-2102] Add CacheHitRate metrics [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/15 12:04:45 UTC, 12 replies.
- [PR] [CELEBORN-2103] Check disk full before creating LocalTierWriter [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/15 12:21:36 UTC, 2 replies.
- [PR] [CELEBORN-2104] Fix NettyRpcEnv RpcSource thread leak [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/16 02:25:07 UTC, 2 replies.
- [PR] [CELEBORN-2105] When Inbox stopped, clean the RpcMetricsTracker [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/16 02:47:09 UTC, 0 replies.
- [PR] [CELEBORN-2106] CommitFile/Reserved location shows detail primary loc… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/16 03:26:33 UTC, 0 replies.
- [PR] [CELEBORN-2107] When loadFileGroup failed, retry send GetReducerFileG… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/16 13:15:19 UTC, 2 replies.
- [PR] [CELEBORN-2108] Remove redundant PartitionType [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/16 23:41:02 UTC, 5 replies.
- [PR] [CELEBORN-2109] Add EvictedLocalFileCount and EvictedDfsFileCount met… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/16 23:42:59 UTC, 2 replies.
- [PR] [CELEBORN-2110] Add MetaSource for master ha [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/17 00:38:38 UTC, 2 replies.
- [PR] [CELEBORN-2111] Introduce metrics to flush time for different storage… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/17 01:41:17 UTC, 1 replies.
- [PR] [CELEBORN-2112] Introduce PausePushDataStatus metric to record status… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/17 02:18:51 UTC, 2 replies.
- [PR] [CELEBORN-2114] Add max partition number threshold when allocates shu… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/17 07:08:52 UTC, 6 replies.
- [PR] App info uid [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/08/18 05:05:22 UTC, 0 replies.
- Re: [PR] [CELEBORN-1258] Support to register application info with user identifier [celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2025/08/18 05:31:39 UTC, 2 replies.
- Re: [PR] [CELEBORN-2084] /api/v1/workers adds tagged workers to list tagged workers information [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/08/18 08:39:25 UTC, 1 replies.
- [PR] [CELEBORN-2116] Fallback to getAbsolutePath when getCanonicalPath fails [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/08/18 08:53:58 UTC, 1 replies.
- [PR] [CELEBORN-2113] Client define createFileOrder and evictFileOrder policy [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/18 09:03:46 UTC, 2 replies.
- [PR] chart-testing-action [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/08/18 09:22:19 UTC, 0 replies.
- Re: [PR] [CELEBORN-2104] Clean up the Source at the end of NettyRpcEnv, Master and Worker to avoid thread leaks [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/08/18 09:29:11 UTC, 3 replies.
- [PR] [CELEBORN-2118] Introduce IsHighWorkload metric indicates worker over… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/18 12:06:28 UTC, 4 replies.
- [PR] [CELEBORN-2119] DfsTierWriter should close s3MultipartUploadHandler and ossMultipartUploadHandler for close resource [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/08/18 13:44:46 UTC, 5 replies.
- Re: [PR] [CELEBORN-1258] Support to register application info with user identifier and extra info [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/08/18 20:35:25 UTC, 8 replies.
- Re: [PR] [CELEBORN-2117] Use git submodules for Chart Actions [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/08/19 06:25:56 UTC, 1 replies.
- [PR] [CELEBORN-2115][CIP-14] Support PushData in cppClient [celeborn] - posted by "HolyLow (via GitHub)" <gi...@apache.org> on 2025/08/20 02:20:03 UTC, 5 replies.
- Re: [PR] [CELEBORN-2102] Introduce CacheHitRate metric to monitor the hit reate of index cache for sorter [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/08/20 02:28:56 UTC, 0 replies.
- Re: [PR] [CELEBORN-2102] Introduce SorterCacheHitRate metric to monitor the hit reate of index cache for sorter [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/08/20 02:47:46 UTC, 1 replies.
- Re: [PR] [CELEBORN-2106] CommitFile/Reserved location shows detail primary location UniqueId [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/08/21 02:45:38 UTC, 1 replies.
- Re: [PR] [CELEBORN-2112] Introduce PausePushDataStatus and PausePushDataAndReplicateStatus metric to record status of pause push data [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/08/21 03:17:51 UTC, 1 replies.
- [PR] [CELEBORN-2121] Support Zstd Compression in CppClient [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/21 05:14:19 UTC, 2 replies.
- [I] [BUG] Wrong helm chart version in 0.6.0 release [celeborn] - posted by "grihabor (via GitHub)" <gi...@apache.org> on 2025/08/21 17:48:34 UTC, 1 replies.
- [PR] [MINOR] Fix appVersion in Chart.yaml [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/08/22 02:42:42 UTC, 9 replies.
- [PR] [MINOR] Fix migration doc style [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/08/22 08:00:01 UTC, 2 replies.
- [PR] [MINOR] Fix doc about PushMergedData split [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/08/22 09:37:35 UTC, 2 replies.
- [PR] [CELEBORN-2122] Avoiding multiple accesses to HDFS when retrieving in… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/23 12:18:30 UTC, 5 replies.
- [PR] [CELEBORN-2123] Add log for commit file size [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/23 13:40:53 UTC, 9 replies.
- Re: [PR] [CELEBORN-2118] Introduce IsHighWorkload metric to monitor worker overload status [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/23 14:06:49 UTC, 2 replies.
- [PR] [CELEBORN-2047] Reuse FileChannel/FSDataInputStream in PartitionDataR… [celeborn] - posted by "Alibaba-HZY (via GitHub)" <gi...@apache.org> on 2025/08/25 03:05:20 UTC, 1 replies.
- [PR] [CELEBORN-2125] Imporve PartitionFilesSorter sort timeout log [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/08/25 10:11:47 UTC, 3 replies.
- [PR] [CELEBORN-2126] Enhance decommissionWorker to wait until workerDecomm… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/25 11:01:10 UTC, 1 replies.
- [PR] [CELEBORN-2127] When fileWriter is closed, it should return HARD_SPLI… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/25 11:22:25 UTC, 0 replies.
- [PR] [CELEBORN-2128] Close hadoopFs FileSystem when Worker is closed [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/25 13:02:28 UTC, 0 replies.
- [PR] [CELEBORN-2129] CelebornBufferStream should invoke openStreamInternal in moveToNextPartitionIfPossible to avoid client creation timeout [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/08/26 02:39:06 UTC, 5 replies.
- [PR] [CELEBORN-2131] Add sorting duration logs in FileSorter [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/08/26 07:22:45 UTC, 3 replies.
- [PR] [CELEBORN-2132] Enhance ratis peer add operation to support clientAddress & adminAddress [celeborn] - posted by "gaoyajun02 (via GitHub)" <gi...@apache.org> on 2025/08/26 08:49:40 UTC, 3 replies.
- Re: [PR] [CELEBORN-2127] When fileWriter is closed, it should return HARD_SPLIT StatusCode [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/26 09:33:36 UTC, 1 replies.
- [PR] [CELEBORN-2133] LifecycleManager should log stack trace of Throwable for invoking appShuffleTrackerCallback [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/08/26 12:02:49 UTC, 3 replies.
- Re: [PR] [CELEBORN-2128] Close hadoopFs FileSystem when worker is closed [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/26 13:08:00 UTC, 1 replies.
- [PR] [CELEBORN-2097]Support Zstd Compression in CppClient [celeborn] - posted by "Jraaay (via GitHub)" <gi...@apache.org> on 2025/08/27 03:32:33 UTC, 4 replies.
- [PR] CELEBORN-2130: Add support for redirection application registration to the leader [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2025/08/27 04:25:41 UTC, 2 replies.
- [PR] [CELEBORN-2134] When creating a DiskFile, retrieve the storage type b… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/27 13:32:46 UTC, 4 replies.
- [PR] [CELEBORN-2135] Rename Blaze to Auron [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/08/28 08:15:45 UTC, 5 replies.
- Re: [PR] [CELEBORN-2104] Clean up sources of NettyRpcEnv, Master and Worker to avoid thread leaks [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/08/29 11:04:27 UTC, 1 replies.
- [PR] [CELEBORN-2136] Flush the DFS file writer on trim only when the size… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/08/30 00:29:55 UTC, 5 replies.
- [PR] [CELEBORN-2137] Remove unused MAPGROUP PartitionType [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/08/30 14:53:10 UTC, 2 replies.
- [PR] [CELEBORN-2138] Avoiding multiple accesses to HDFS When writting index file. [celeborn] - posted by "taowenjun (via GitHub)" <gi...@apache.org> on 2025/08/31 15:26:29 UTC, 0 replies.