You are viewing a plain text version of this content. The canonical link for it is here.
- [PR] [CELEBORN-2124][CIP-14] Support PushData network interfaces in cppClient [celeborn] - posted by "HolyLow (via GitHub)" <gi...@apache.org> on 2025/09/01 02:08:11 UTC, 6 replies.
- Re: [PR] [CELEBORN-1258] Support to register application info with user identifier and extra info [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/09/01 03:15:49 UTC, 1 replies.
- Re: [PR] [CELEBORN-2136] Flush the DFS file writer on trim only when the size… [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/09/01 07:51:07 UTC, 1 replies.
- Re: [PR] [CELEBORN-2131] Add sorting duration logs in FileSorter [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/09/01 08:29:43 UTC, 10 replies.
- [PR] Avoiding multiple accesses to HDFS When writting index file in Flink [celeborn] - posted by "Alibaba-HZY (via GitHub)" <gi...@apache.org> on 2025/09/01 08:59:03 UTC, 1 replies.
- Re: [PR] [CELEBORN-2138] Avoiding multiple accesses to HDFS When writting index file. [celeborn] - posted by "Alibaba-HZY (via GitHub)" <gi...@apache.org> on 2025/09/01 08:59:37 UTC, 2 replies.
- [PR] [CELEBORN-2139] Fix the condition for using OSS storage [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/01 14:37:15 UTC, 2 replies.
- [PR] [CELEBORN-2140] Add logs for track unfinished maptasks [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/02 02:55:02 UTC, 1 replies.
- [PR] [MINOR] Fix ReducePartitionMetaHandler logger [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/02 04:30:58 UTC, 2 replies.
- [PR] [CLOUD DISK] Add cloud disk mounted mode for local shuffle reading [celeborn] - posted by "liugs0213 (via GitHub)" <gi...@apache.org> on 2025/09/02 13:24:00 UTC, 6 replies.
- Re: [PR] [CELEBORN-2113] Client define createFileOrder and evictFileOrder policy [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/09/02 14:10:34 UTC, 1 replies.
- Re: [PR] [CELEBORN-2137] Remove unused MAPGROUP PartitionType [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/09/03 01:50:42 UTC, 1 replies.
- Re: [PR] [CELEBORN-2127] When fileWriter is closed, it should return HARD_SPLIT StatusCode [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/09/03 08:04:45 UTC, 0 replies.
- Re: [PR] [CELEBORN-2047] Reuse FileChannel/FSDataInputStream in PartitionDataReader [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/09/03 08:14:34 UTC, 1 replies.
- Re: [PR] [CELEBORN-2074] Create hdfs shuffle directory by master to reduce Namenode call [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/03 08:35:26 UTC, 1 replies.
- Re: [PR] [CELEBORN-2059] Support reusing dfs output stream with DFS storage [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/09/03 09:15:52 UTC, 3 replies.
- [PR] [CELEBORN-2142] When no disk is available,DfsTierWriter should be cre… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/04 15:25:51 UTC, 0 replies.
- Re: [PR] [CELEBORN-2130] Add support for redirection application registration to the leader [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2025/09/04 16:43:40 UTC, 16 replies.
- [PR] [CELEBORN-2142] In StoragePolicy, StorageManager create disk file thr… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/05 03:20:13 UTC, 0 replies.
- Re: [PR] [CELEBORN-2105] When Inbox stopped, clean the RpcMetricsTracker [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/07 08:33:25 UTC, 1 replies.
- Re: [PR] [CELEBORN-2103] Check disk full before creating LocalTierWriter [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/07 08:33:27 UTC, 2 replies.
- Re: [PR] [CELEBORN-2099] Support spark shuffle fallback policy based on map partitions number [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/07 08:33:29 UTC, 2 replies.
- [PR] Bump spark 4.0.1 [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/09/08 02:05:38 UTC, 0 replies.
- Re: [PR] [CELEBORN-2144] Bump spark 4.0.1 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/09/08 03:53:32 UTC, 1 replies.
- Re: [PR] [CELEBORN-2141] Avoid multiple accesses to HDFS for writting index file in Flink [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/09/08 06:34:43 UTC, 0 replies.
- [PR] [CELEBORN-2145] QuotaManager should respect celeborn.quota.interruptShuffle.enabled of client config [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/09/08 08:05:38 UTC, 17 replies.
- Re: [PR] [CELEBORN-2116] Fallback to getAbsolutePath when getCanonicalPath fails [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/09 08:36:39 UTC, 2 replies.
- [PR] [CELEBORN-2146] Setting the DFS replication factor for balanced fault tol… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/09 15:25:10 UTC, 0 replies.
- [PR] [CELEBORN-2147] Introduce CommitWorkingQueueSize to monitor the size of commit working queue [celeborn] - posted by "taowenjun (via GitHub)" <gi...@apache.org> on 2025/09/09 18:20:29 UTC, 1 replies.
- Re: [PR] [CELEBORN-2109] Add EvictedLocalFileCount and EvictedDfsFileCount met… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/10 12:12:49 UTC, 2 replies.
- Re: [PR] [CELEBORN-2058] Add retry to avoid commtting failed with HDFS storage [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/09/10 12:26:48 UTC, 10 replies.
- [PR] [CELEBORN-935][FOLLOWUP] Remove WorkerRemove in MetaHandler [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/11 06:02:34 UTC, 6 replies.
- Re: [PR] [CELEBORN-2062] Introduce splitNum to optimize shuffle write [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/11 08:35:27 UTC, 0 replies.
- [PR] [CELEBORN-2148] RemoteShuffleMaster computes number of bytes for input with memory reserved for input channels [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/09/11 12:28:20 UTC, 2 replies.
- Re: [PR] [CELEBORN-2142] When no disk is available,DfsTierWriter should be created [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/12 02:30:35 UTC, 1 replies.
- Re: [PR] [CELEBORN-2032] Create reader should change to peer by taskAttemptId [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/12 08:35:25 UTC, 4 replies.
- [PR] [CELEBORN-2111] Introduce metrics to flush time for different storage… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/13 05:18:37 UTC, 1 replies.
- [PR] [CELEBORN-2149] Remove the deprecated ReleaseSlots [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/13 06:02:57 UTC, 5 replies.
- [PR] [CELEBORN-2150] Fix the match condition in checkIfWorkingDirCleaned [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/13 09:18:00 UTC, 5 replies.
- Re: [PR] [CELEBORN-2076] Add `FetchChunkSize` metrics [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/14 08:33:27 UTC, 2 replies.
- Re: [PR] [CELEBORN-2141] Avoid multiple accesses to HDFS for writing index file in Flink [celeborn] - posted by "Alibaba-HZY (via GitHub)" <gi...@apache.org> on 2025/09/14 10:07:51 UTC, 0 replies.
- Re: [PR] [CELEBORN-2143] In StoragePolicy, StorageManager create disk file through storage type [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/15 11:48:20 UTC, 0 replies.
- Re: [PR] [CELEBORN-2058] Add retry to avoid committing failed with HDFS storage [celeborn] - posted by "taowenjun (via GitHub)" <gi...@apache.org> on 2025/09/15 17:20:45 UTC, 12 replies.
- [PR] [CELEBORN-2152] Support merge buffers on the worker side to improve memory utilization [celeborn] - posted by "TheodoreLx (via GitHub)" <gi...@apache.org> on 2025/09/17 09:22:41 UTC, 2 replies.
- [PR] [CELEBORN-2153] Fix NPE problem that occurs during concurrent merge [celeborn] - posted by "TheodoreLx (via GitHub)" <gi...@apache.org> on 2025/09/17 11:42:57 UTC, 2 replies.
- [PR] [CELEBORN-2151] Support multiple dfs mount point [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/18 02:29:55 UTC, 0 replies.
- [PR] [CELEBORN-2154] Optimize the exception handling of DFS read to avoid … [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/18 02:32:38 UTC, 2 replies.
- [PR] [CELEBORN-2155] Avoid using duplicate diskFileInfoMap Functions [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/18 02:33:00 UTC, 0 replies.
- [PR] [CELEBORN-2157][CIP-14] Support sending RegisterShuffle/Revive/MapperEnd messages for NettyRpcEndpointRef in cppClient [celeborn] - posted by "HolyLow (via GitHub)" <gi...@apache.org> on 2025/09/19 07:31:18 UTC, 5 replies.
- Re: [PR] [CELEBORN-2155] Avoid using duplicate diskFileInfoMap functions [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/09/20 07:08:28 UTC, 1 replies.
- Re: [PR] [CELEBORN-2154] Optimize the exception handling of DFS read to avoid tasks from getting stuck [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/09/20 07:11:38 UTC, 1 replies.
- Re: [PR] [CELEBORN-2146] Setting the DFS replication factor for balanced fault tolerance and storage efficiency [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/09/20 07:21:11 UTC, 0 replies.
- [PR] [CELEBORN-2158] Optimize asynchronous reading of HDFS chunk offset da… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/20 09:50:28 UTC, 3 replies.
- [PR] [CELEBORN-2159] Fix dfs storage type check error in cleanupExpiredShu… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/21 01:32:23 UTC, 1 replies.
- Re: [PR] [CELEBORN-2107] When loadFileGroup failed, retry send GetReducerFileG… [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/21 08:33:09 UTC, 0 replies.
- [PR] [CELEBORN-2160] Speedup CommitHandler.finishMapperAttempt [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/09/21 20:06:23 UTC, 10 replies.
- Re: [PR] [WIP] [CIP-20] Dynamically adjust partition write parallelism [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/22 08:37:14 UTC, 0 replies.
- [PR] [CELEBORN-2161] Support DB delete failure policy [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/09/22 13:05:39 UTC, 9 replies.
- [PR] [MINOR] Fix config doc about DB description [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/09/22 13:15:36 UTC, 2 replies.
- Re: [PR] [CELEBORN-2142] DfsTierWriter should create for unavailable disks [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/09/24 08:34:56 UTC, 3 replies.
- Re: [PR] [CELEBORN-2063] Parallelize the create partition writer in handleReserveSlots to speed up the reserveSlots RPC process time [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/24 08:36:46 UTC, 0 replies.
- [PR] [CELEBORN-2162] Supress client side connection error logging [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2025/09/26 19:03:16 UTC, 4 replies.
- [PR] [CELEBORN-2163] PushDataHandler should increment WriteDataFailCount for file writer exception of MapPartition PushData [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/09/29 09:29:50 UTC, 0 replies.
- [PR] [CELEBORN-2142][FOLLOWUP][0.6] Fix Compile [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/09/29 14:16:29 UTC, 0 replies.
- Re: [PR] [CELEBORN-2142][FOLLOWUP][0.6] Fix failure of compilation [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/09/30 02:36:49 UTC, 1 replies.
- Re: [PR] [CELEBORN-2110] Add MetaSource for master ha [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/09/30 08:37:38 UTC, 0 replies.