You are viewing a plain text version of this content. The canonical link for it is here.
- Re: [PR] [CELEBORN-2136] Flush the DFS file writer on trim only when the size… [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/01 08:36:34 UTC, 1 replies.
- Re: [PR] [CELEBORN-2107] When loadFileGroup failed, retry send GetReducerFileG… [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/01 08:37:22 UTC, 1 replies.
- Re: [PR] [CELEBORN-2105] When Inbox stopped, clean the RpcMetricsTracker [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/01 08:38:04 UTC, 4 replies.
- [PR] [CELEBORN-2164] Fix incorrect filtering conditions in updateDiskInfos [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/10/01 08:47:41 UTC, 2 replies.
- Re: [PR] [CELEBORN-2160] Speedup CommitHandler.finishMapperAttempt [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/10/01 12:11:05 UTC, 2 replies.
- Re: [PR] [CELEBORN-2162] Supress client side connection error logging [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2025/10/01 22:07:11 UTC, 3 replies.
- [PR] Fix endless swagger openapi.json security items [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/10/03 01:43:07 UTC, 0 replies.
- Re: [PR] [WIP] [CIP-20] Dynamically adjust partition write parallelism [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/03 08:35:18 UTC, 1 replies.
- Re: [PR] [CELEBORN-2062] Introduce splitNum to optimize shuffle write [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/05 08:33:26 UTC, 2 replies.
- Re: [PR] [CELEBORN-2143] In StoragePolicy, StorageManager create disk file through storage type [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/06 08:36:13 UTC, 8 replies.
- Re: [PR] [CELEBORN-2111] Introduce metrics to flush time for different storage… [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/06 08:36:16 UTC, 4 replies.
- Re: [PR] [CELEBORN-2141] Avoid multiple accesses to HDFS for writing index file in Flink [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/07 08:36:09 UTC, 3 replies.
- [PR] [CELEBORN-2166] Fastfail reduce stage if shuffle data is lost because of worker lost [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2025/10/07 18:05:33 UTC, 5 replies.
- [PR] [CELEBORN-2167] Bump Spark from 3.5.6 to 3.5.7 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/09 02:43:28 UTC, 2 replies.
- [PR] [CELEBORN-2168] Bump Flink from 1.20.2 to 1.20.3 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/09 02:51:13 UTC, 2 replies.
- Re: [PR] [CELEBORN-2165] Fix endless swagger openapi.json security items [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/09 13:22:13 UTC, 1 replies.
- Re: [PR] [CELEBORN-2157][CIP-14] Support sending RegisterShuffle/Revive/MapperEnd messages for NettyRpcEndpointRef in cppClient [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/10 07:47:36 UTC, 1 replies.
- Re: [PR] [CELEBORN-2147] Introduce CommitWorkingQueueSize to monitor the size of commit working queue [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/10 08:36:00 UTC, 2 replies.
- [PR] [CELEBORN-2169][CIP-14] Support ConcurrentHashMap and refactor reducerFileGroupInfos [celeborn] - posted by "HolyLow (via GitHub)" <gi...@apache.org> on 2025/10/10 09:17:57 UTC, 5 replies.
- Re: [PR] [CELEBORN-2140] Add logs for track unfinished maptasks [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/11 08:33:53 UTC, 1 replies.
- Re: [PR] [CELEBORN-2110] Add MetaSource for master ha [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/11 08:33:57 UTC, 1 replies.
- [PR] [CELEBORN-2170] Refactor ByteBuffer's readToReadOnlyuffer interface [celeborn] - posted by "HolyLow (via GitHub)" <gi...@apache.org> on 2025/10/11 09:10:20 UTC, 3 replies.
- Re: [PR] [CELEBORN-2032] Create reader should change to peer by taskAttemptId [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2025/10/11 11:14:03 UTC, 6 replies.
- [PR] [CELEBORN-2171] Fix array index error in submitRetryPushMergedData [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/10/12 03:09:31 UTC, 2 replies.
- [PR] [CELEBORN-2172] S3 and OSS storage select appropriate fileMeta type b… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/10/12 07:25:30 UTC, 3 replies.
- Re: [PR] [CELEBORN-2059] Support reusing dfs output stream with DFS storage [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/12 08:33:55 UTC, 2 replies.
- [PR] [CELEBORN-2173] jersey-test-framework-core dependency should exclude junit5 dependencies to execute java test cases for CI [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/13 02:43:37 UTC, 5 replies.
- Re: [PR] [CELEBORN-2159] Fix dfs storage type check error in cleanupExpiredShu… [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/13 06:12:10 UTC, 1 replies.
- [PR] [CELEBORN-2141] MapPartitionMetaHandler should avoid multiple accesses to HDFS for writting index file [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/13 06:59:43 UTC, 9 replies.
- Re: [PR] [CELEBORN-2158] Optimize asynchronous reading of HDFS chunk offset da… [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/13 08:38:20 UTC, 2 replies.
- Re: [PR] [CELEBORN-2163] PushDataHandler should increment WriteDataFailCount for file writer exception of MapPartition PushData [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/10/13 14:56:06 UTC, 5 replies.
- Re: [PR] [CELEBORN-2159] Fix dfs storage type check in StorageManager#cleanupExpiredShuffleKey [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/14 02:23:42 UTC, 1 replies.
- [PR] [CELEBORN-2174] Remove partitionSplitEnabled of ReserveSlots and FileInfo [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/14 03:55:41 UTC, 1 replies.
- [PR] [CELEBORN-2175] Fix file path error in PartitionDataWriter#getStorage… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/10/14 08:24:51 UTC, 1 replies.
- Re: [PR] [CELEBORN-2152] Support merge buffers on the worker side to improve memory utilization [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/15 08:37:53 UTC, 2 replies.
- Re: [PR] [CELEBORN-2063] Parallelize the create partition writer in handleReserveSlots to speed up the reserveSlots RPC process time [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/15 08:37:56 UTC, 0 replies.
- Re: [PR] [CLOUD DISK] Add cloud disk mounted mode for local shuffle reading [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/10/16 08:37:59 UTC, 2 replies.
- [PR] [CELEBORN-2176] Fix uncaught exception in DataPusher [celeborn] - posted by "buska88 (via GitHub)" <gi...@apache.org> on 2025/10/16 09:05:38 UTC, 7 replies.
- [PR] App regi [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/10/16 21:05:54 UTC, 0 replies.
- [PR] [CELEBORN-2178] Close hadoopFs FileSystem when Master is stopped [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/10/17 08:53:10 UTC, 4 replies.
- [PR] [CELEBORN-2179] Addea patch file for spark 3.5.6 [celeborn] - posted by "aagumin (via GitHub)" <gi...@apache.org> on 2025/10/18 09:47:19 UTC, 0 replies.
- [I] Client always tries to start a connection with excluded workers [celeborn] - posted by "mahmoudyusofi (via GitHub)" <gi...@apache.org> on 2025/10/19 11:07:54 UTC, 6 replies.
- [PR] [CELEBORN-2180] Fix Invalid RequestId during RegisterApplicationInfo [celeborn] - posted by "JuniverseCoder (via GitHub)" <gi...@apache.org> on 2025/10/20 01:57:35 UTC, 3 replies.
- Re: [PR] [CELEBORN-2177] Fix invalid request id when handleRegisterApplicationInfo [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/10/20 02:10:27 UTC, 0 replies.
- Re: [PR] [CELEBORN-2179] Add patch of columnar shuffle for Spark 3.5.6 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/20 02:19:42 UTC, 4 replies.
- [PR] [CELEBORN-2181] Modify the shuffleAllocations order in the disk info log [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/10/20 07:06:09 UTC, 3 replies.
- Re: [PR] [CELEBORN-2143] StorageManager should create disk file via storage type for StoragePolicy [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/22 02:45:30 UTC, 2 replies.
- [I] Does Celeborn offer any performance optimizations in terms of reducing TCL or disk IOPS? [celeborn] - posted by "liangrui198 (via GitHub)" <gi...@apache.org> on 2025/10/22 07:56:32 UTC, 1 replies.
- [PR] [CELEBORN-2182][CIP-14] Support PushState and PushStrategy in CppClient [celeborn] - posted by "HolyLow (via GitHub)" <gi...@apache.org> on 2025/10/22 09:22:13 UTC, 13 replies.
- [PR] [CELEBORN-2184] Introduce AvailableReadBuffer metric to monitor available memory for credit stream read buffer [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/23 02:55:09 UTC, 3 replies.
- [PR] [CELEBORN-2183]Client always tries to start a connection with exclude… [celeborn] - posted by "r7raul1984 (via GitHub)" <gi...@apache.org> on 2025/10/23 03:03:36 UTC, 0 replies.
- Re: [PR] [CELEBORN-2183] Client always tries to start a connection with exclude wrokers [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/23 03:21:20 UTC, 1 replies.
- Re: [PR] [CELEBORN-2183] Fix client tries to start a connection with excluded workers [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/10/23 09:26:24 UTC, 3 replies.
- Re: [I] Who is using Apache Celeborn? [celeborn] - posted by "tiandaochou (via GitHub)" <gi...@apache.org> on 2025/10/24 09:20:01 UTC, 1 replies.
- Re: [PR] [CELEBORN-2178] Close hadoopFs FileSystem for stopping master [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/28 02:35:55 UTC, 1 replies.
- Re: [PR] [CELEBORN-2111] Introduce metrics to flush time for different storage types [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/10/28 02:43:56 UTC, 4 replies.
- [PR] [CELEBORN-2185] Support native kqueue transport on BSD/MacOS [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/28 08:16:41 UTC, 15 replies.
- [PR] [CELEBORN-2186] Add correctness related section to bug report and PR templates [celeborn] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2025/10/28 09:28:18 UTC, 14 replies.
- Re: [PR] [CELEBORN-2166] Fast fail reduce stage if shuffle data is lost because of worker lost [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/29 02:04:11 UTC, 1 replies.
- Re: [PR] [CELEBORN-1496] Differentiate map results with only different stageAttemptId [celeborn] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2025/10/29 09:47:31 UTC, 0 replies.
- Re: [PR] [CELEBORN-1496][0.4] Differentiate map results with only different stageAttemptId [celeborn] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2025/10/29 09:47:57 UTC, 0 replies.
- Re: [PR] [CELEBORN-1439] Use finer grained locks in changePartitionManager [celeborn] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2025/10/29 09:48:33 UTC, 0 replies.
- [I] [BUG] StorageManager: Skip flushOnMemoryPressure because LocalFlusher@1677590477-/data1 has error: Wait pending actions timeout after 120000 ms. [celeborn] - posted by "zyclove (via GitHub)" <gi...@apache.org> on 2025/10/30 08:43:38 UTC, 3 replies.
- [PR] [CELEBORN-2047][FOLLOWUP] MapPartitionData should close dataChannel, indexChannel, dataInputStream and indexInputStream [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/30 12:25:47 UTC, 1 replies.
- [PR] [CELEBORN-2188] When S3 and OSS handle exceptions, abort the multipar… [celeborn] - posted by "xy2953396112 (via GitHub)" <gi...@apache.org> on 2025/10/30 13:20:14 UTC, 0 replies.
- [PR] Added factor of number of disks per group when calculating allocation ratio [celeborn] - posted by "AmandeepSingh285 (via GitHub)" <gi...@apache.org> on 2025/10/31 09:27:33 UTC, 0 replies.
- Re: [PR] Added factor of number of disks per group when calculating allocation ratio in LoadAwareSlot allocation [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/10/31 09:33:46 UTC, 0 replies.