You are viewing a plain text version of this content. The canonical link for it is here.
- [PR] [CELEBORN-2292] Fix ArithmeticException when PUSH_DATA_HAND_SHAKE fails before any data written [celeborn] - posted by "pltbkd (via GitHub)" <gi...@apache.org> on 2026/04/01 02:22:41 UTC, 4 replies.
- Re: [PR] [CELEBORN-2294] The shuffle fetch failed report from the zombie stage should be ignored [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/01 07:28:33 UTC, 5 replies.
- Re: [PR] CELEBORN-2293: Fix ConcurrentModificationException in WorkerStatusTracker.shuttingWorkers [celeborn] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/04/01 08:03:30 UTC, 5 replies.
- Re: [PR] [CELEBORN-2275][CIP-14] Add C++ merge-write and Java-read hybrid integration test [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/01 08:47:55 UTC, 10 replies.
- Re: [PR] [WIP] add hdfs minit cluster for spark-it [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/01 08:47:56 UTC, 2 replies.
- Re: [PR] [CELEBORN-2257] Add reporting of remote disks during registration. [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/01 08:47:58 UTC, 3 replies.
- Re: [PR] [CELEBORN-2143] Create DiskFile sequentially based on createFileOrder [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/01 08:48:00 UTC, 2 replies.
- Re: [PR] [WIP] Support async response to open stream calls to avoid blocking netty threads [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/01 08:48:02 UTC, 4 replies.
- Re: [PR] [CELEBORN-2241] Memory swap instead of memory copy [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/01 08:48:04 UTC, 2 replies.
- Re: [PR] [CELEBORN-2244] shuffle early delete feature for Spark [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/01 08:48:06 UTC, 2 replies.
- Re: [PR] [CELEBORN-2062] Introduce splitNum to optimize shuffle write [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/01 08:48:08 UTC, 2 replies.
- [PR] [CELEBORN-2295] CommitHandler should support retry interval [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/01 10:50:20 UTC, 11 replies.
- [PR] [CELEBORN-2296] Fix race condition in MemoryManager singleton initialization [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/04/01 12:01:33 UTC, 5 replies.
- Re: [PR] [CELEBORN-2293] Fix ConcurrentModificationException in WorkerStatusTracker.shuttingWorkers [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/04/02 02:50:17 UTC, 1 replies.
- Re: [PR] [CELEBORN-2297] Update workflow to manually install Helm and chart-testing [celeborn] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/04/02 06:22:15 UTC, 2 replies.
- Re: [PR] ignore CelebornHashCheckDiskSuite [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/04/02 06:47:02 UTC, 17 replies.
- Re: [PR] [WIP] [CIP-20] Dynamically adjust partition write parallelism [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/02 08:44:40 UTC, 2 replies.
- [PR] Realtime usage update oss [celeborn] - posted by "saurabhd336 (via GitHub)" <gi...@apache.org> on 2026/04/02 12:24:43 UTC, 0 replies.
- [PR] [MR] Fix memory leak and severe FGC in CelebornSortBasedPusher for high-volume workloads [celeborn] - posted by "Lobo2008 (via GitHub)" <gi...@apache.org> on 2026/04/02 13:56:51 UTC, 2 replies.
- [PR] [MR] Fix memory leak and severe FGC in CelebornSortBasedPusher for hi… [celeborn] - posted by "Lobo2008 (via GitHub)" <gi...@apache.org> on 2026/04/02 14:09:08 UTC, 1 replies.
- [PR] [CELEBORN-2298] Introduce NettyTransportBenchmark for Netty transport layer performance evaluation [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/04/03 04:48:00 UTC, 8 replies.
- [PR] [CELEBORN-2300] Change the default value of celeborn.port.maxRetries from 1 to 16 [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/04/03 10:18:08 UTC, 2 replies.
- [PR] [CELEBORN-2301] MessageEncoder enables zero-copy sendfile for FileRegion in Netty native transports [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/04/06 03:04:09 UTC, 5 replies.
- [PR] [CELEBORN-2230] SparkUtils#shouldReportShuffleFetchFailure method should retrieve the number of task failures from TaskSetManager [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/07 06:58:27 UTC, 8 replies.
- Re: [PR] [CIP-19][CELEBORN-1937] QuotaManager should support app threshold [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/07 07:23:45 UTC, 5 replies.
- [PR] [WIP][CELEBORN-2065] Worker should support wait partition sort asynchronously [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/07 08:06:34 UTC, 0 replies.
- Re: [PR] [WIP] Realtime usage update oss [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/04/07 11:38:43 UTC, 0 replies.
- [PR] [CELEBORN-2287] Split mode should be hard when diskFull [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/04/07 11:52:17 UTC, 3 replies.
- [PR] [CELEBORN-2302] Fix NPE in MemoryManager.close() when readBufferDispatcher is not initialized [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/04/07 13:20:09 UTC, 2 replies.
- Re: [PR] [CELEBORN-2299] Fix memory leak and severe FGC in CelebornSortBasedPusher for hi… [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2026/04/07 15:31:00 UTC, 2 replies.
- Re: [PR] [CELEBORN-2219][CIP-14] Support PushMergedData in CppClient [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/04/08 03:04:41 UTC, 1 replies.
- [PR] FOLLOW CELEBORN-2294. Fix SparkUtilsSuite. [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/08 06:46:42 UTC, 0 replies.
- Re: [PR] FOLLOW CELEBORN-2294. Fix flaky test SparkUtilsSuite. [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/08 07:24:52 UTC, 0 replies.
- [PR] [CELEBORN-2304] Fix timeout unit mismatch in disk monitor check [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/04/08 07:34:46 UTC, 1 replies.
- Re: [PR] [CELEBORN-2264] Support cancel shuffle when write bytes exceeds threshold [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/08 08:46:09 UTC, 2 replies.
- Re: [PR] [CELEBORN-2294][FOLLOWUP] Fix flaky test SparkUtilsSuite. [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/09 04:07:44 UTC, 2 replies.
- Re: [PR] [CELEBORN-2065] Worker should support wait partition sort asynchronously [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/04/09 07:07:02 UTC, 3 replies.
- Re: [PR] [CELEBORN-2287] Split mode should be HARD_SPLIT when disk is full [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/04/09 11:59:22 UTC, 9 replies.
- [PR] [CELEBORN-2063][FOLLOWUP] Fix timeout unit for parallel creation of partition writer [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/04/09 12:16:49 UTC, 3 replies.
- [PR] [CELEBORN-2305] Bump Ratis version from 3.2.1 to 3.2.2 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/04/10 01:52:47 UTC, 3 replies.
- Re: [PR] [CELEBORN-1577][Phase2] QuotaManager should support interrupt shuffle. [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2026/04/10 09:28:51 UTC, 3 replies.
- Re: [D] Deploying Apache Celebron for Large-Scale Spark SQL Workloads [celeborn] - posted by "jakubfijolek (via GitHub)" <gi...@apache.org> on 2026/04/10 09:35:41 UTC, 1 replies.
- [PR] Master should call shutdown hooks and transfer raft leadership gracefully [celeborn] - posted by "kaybhutani (via GitHub)" <gi...@apache.org> on 2026/04/12 21:34:32 UTC, 0 replies.
- Re: [PR] [CELEBORN-2306] Master shutdown hook and Raft stepdown [celeborn] - posted by "kaybhutani (via GitHub)" <gi...@apache.org> on 2026/04/12 21:41:08 UTC, 6 replies.
- Re: [PR] [CELEBORN-2307] Support accurate disk usage accounting to HARD_SPLIT accurately. [celeborn] - posted by "saurabhd336 (via GitHub)" <gi...@apache.org> on 2026/04/13 06:06:28 UTC, 2 replies.
- [PR] [CELEBORN-1660][FOLLOWUP] Improving the unknown worker check [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2026/04/13 07:42:48 UTC, 3 replies.
- [PR] [CELEBORN-1577][BUG] Quota cancel shuffle should use app shuffle id [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2026/04/13 10:51:44 UTC, 7 replies.
- [PR] [CELEBORN-2308] Bump commons-lang3 version from 3.17.0 to 3.20.0 [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/04/13 10:54:46 UTC, 2 replies.
- [PR] [CELEBORN-2309] Introduce JavaDeserializerFilter to prevent deserialization attacks of CWE-502 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/04/13 11:13:17 UTC, 0 replies.
- Re: [PR] [CELEBORN-2174] Remove partitionSplitEnabled from ReserveSlots and FileInfo [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/14 08:58:53 UTC, 2 replies.
- Re: [PR] fix flaky ci test [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/15 08:59:10 UTC, 2 replies.
- Re: [PR] [CELEBORN-1686] Avoid return the same pushTaskQueue [celeborn] - posted by "byteroll (via GitHub)" <gi...@apache.org> on 2026/04/15 13:35:51 UTC, 2 replies.
- [PR] [MINOR] Update DingTalk Contact Info [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2026/04/16 03:14:43 UTC, 3 replies.
- [PR] Reject RESERVE_SLOTS when disks are full [celeborn] - posted by "saurabhd336 (via GitHub)" <gi...@apache.org> on 2026/04/16 06:44:09 UTC, 0 replies.
- Re: [PR] [CELEBORN-2303] Ignore some flaky test [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/04/17 08:10:02 UTC, 1 replies.
- Re: [PR] [CELEBORN-1439] Use finer grained locks in changePartitionManager [celeborn] - posted by "byteroll (via GitHub)" <gi...@apache.org> on 2026/04/17 09:13:07 UTC, 0 replies.
- Re: [PR] [CELEBORN-894] End to End Integrity Checks [celeborn] - posted by "byteroll (via GitHub)" <gi...@apache.org> on 2026/04/17 09:28:29 UTC, 16 replies.
- Re: [PR] [CELEBORN-2310] Reject RESERVE_SLOTS when disks are full [celeborn] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/04/17 11:54:32 UTC, 8 replies.
- Re: [PR] [CELEBORN-2176] Fix uncaught exception in DataPusher [celeborn] - posted by "gauravkm (via GitHub)" <gi...@apache.org> on 2026/04/17 21:04:07 UTC, 1 replies.
- Re: [PR] [CELEBORN-2252] Skip writing data from other attempts [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/04/19 08:44:24 UTC, 2 replies.
- Re: [PR] [CELEBORN-2309] Introduce JavaDeserializerFilter to support deserialization filter [celeborn] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/04/20 06:50:19 UTC, 10 replies.
- [PR] Support streamState restore to avoid unnecessary read retries during worker restarts [celeborn] - posted by "saurabhd336 (via GitHub)" <gi...@apache.org> on 2026/04/20 11:10:43 UTC, 1 replies.
- [PR] [CELEBORN-2312] Support committing uncommitted partitions for graceful shutdown [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/04/20 19:11:13 UTC, 9 replies.
- Re: [PR] [CELEBORN-296] fix map partition commit using wrong partitionId and result [celeborn] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/04/21 05:48:11 UTC, 1 replies.
- Re: [PR] [CELEBORN-68] Client might fetch incorrect data chunk [celeborn] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/04/21 05:48:31 UTC, 1 replies.
- Re: [PR] [CELEBORN-1506][BUG] Revert "[CELEBORN-1036][FOLLOWUP] totalInflightReqs should decrement when batchIdSet contains the batchId to avoid duplicate caller of removeBatch" [celeborn] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/04/21 07:38:44 UTC, 0 replies.
- Re: [PR] [CELEBORN-1272] Do not increment epoch when retry commit [celeborn] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/04/21 07:39:01 UTC, 0 replies.
- [PR] [CELEBORN-2258][FOLLOWUP] Use IoHandlerFactories for EventLoopGroups to replace deprecated transport-specific event loop groups [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/04/21 10:10:53 UTC, 4 replies.
- Re: [PR] [CELEBORN-2306] Master adds shutdown hook for ratis stepdown [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/04/22 04:05:24 UTC, 3 replies.
- [PR] [CELEBORN-2313] Extend E2E checked zone to batch assembly point [celeborn] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/04/22 12:38:10 UTC, 18 replies.
- [PR] [CELEBORN-2314] Optimize the performance of DataBatches.requireBatches [celeborn] - posted by "afterincomparableyum (via GitHub)" <gi...@apache.org> on 2026/04/23 04:39:27 UTC, 7 replies.
- [PR] [CELEBORN-2315] Add iterator fully-consumed validation after shuffle write [celeborn] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/04/23 10:19:10 UTC, 3 replies.
- [PR] [CELEBORN-2316] Added metrics for metadata operations [celeborn] - posted by "AmandeepSingh285 (via GitHub)" <gi...@apache.org> on 2026/04/29 17:43:22 UTC, 0 replies.
- Re: [PR] [CELEBORN-2316] Introduce metadata operation metrics [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/04/30 02:43:23 UTC, 5 replies.
- [PR] [CELEBORN-2317] Validate applicationId to prevent worker path traversal [celeborn] - posted by "afterincomparableyum (via GitHub)" <gi...@apache.org> on 2026/04/30 05:38:39 UTC, 1 replies.