You are viewing a plain text version of this content. The canonical link for it is here.
- Re: [PR] [CELEBORN-XXXX] Add backoff with jitter to push retries and log hard split once per file [celeborn] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/10/01 05:25:14 UTC, 1 replies.
- Re: [PR] [CELEBORN-2415] Add Celeborn Spark UI extension [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/01 06:00:10 UTC, 3 replies.
- Re: [PR] [CELEBORN-XXXX][WIP] Mark CelebornShuffleHandle as reliably stored for per-shuffle DRA safety [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/01 08:43:41 UTC, 1 replies.
- Re: [PR] [CELEBORN-2441] Add drainIncompleteFrame mechanism to recover from backpressure deadlock [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/01 08:43:44 UTC, 1 replies.
- Re: [PR] [CELEBORN-2349] Support worker supplied tags and TagsManager hardening [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2026/10/01 09:36:34 UTC, 3 replies.
- Re: [PR] [CELEBORN-2470] Add backoff with jitter to push retries and log hard split once per file [celeborn] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/10/01 21:27:56 UTC, 7 replies.
- Re: [PR] [CELEBORN-2468] Support pluggable transport authentication and authorization [celeborn] - posted by "gauravkm (via GitHub)" <gi...@apache.org> on 2026/10/02 02:28:22 UTC, 3 replies.
- Re: [PR] [CELEBORN-2403] Add worker metrics for disk status and unhealthy disk count [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/02 08:40:18 UTC, 7 replies.
- Re: [PR] [CELEBORN-2466] Support per-zone worker StatefulSets and autoscaling in the Helm chart [celeborn] - posted by "canvascloudai (via GitHub)" <gi...@apache.org> on 2026/10/02 16:33:58 UTC, 9 replies.
- Re: [PR] [CELEBORN-2446] Support topologySpreadConstraints for master and worker pods in Helm chart [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/03 08:38:36 UTC, 2 replies.
- Re: [PR] [CELEBORN-2456] Fix wrong isAssignableFrom direction in Basic/Bearer authenticationSupported [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/04 10:30:46 UTC, 3 replies.
- Re: [PR] [CELEBORN-2455] Remove redundant synchronized in Dispatcher.postMessage [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/04 10:30:48 UTC, 2 replies.
- Re: [PR] [CELEBORN-2390] Add celeborn-web service to docker-compose [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/04 10:30:52 UTC, 1 replies.
- Re: [PR] [CELEBORN-2391] Eliminate intermediate byte[] allocation in Encoders.Strings via Netty ByteBufUtil [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/04 10:30:54 UTC, 3 replies.
- Re: [PR] [CELEBORN-2361] Unblock stage-end when CommitFilesResponse carries an empty map-id bitmap [celeborn] - posted by "strelok89 (via GitHub)" <gi...@apache.org> on 2026/10/05 07:23:10 UTC, 7 replies.
- Re: [PR] [CELEBORN-2462][WORKER] Reduce misleading WARN/ERROR logs during decommission shutdown [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/05 08:53:30 UTC, 5 replies.
- Re: [PR] [CELEBORN-2457][CIP-24] Adaptive partition write parallelism [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/05 08:53:32 UTC, 0 replies.
- Re: [PR] [CELEBORN-2452] Prevent device error broadcast from deleting committed shuffle files [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/05 08:53:37 UTC, 2 replies.
- Re: [PR] [CELEBORN-2445] Support overriding decommission forceExitTimeout via the worker exit API [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/05 08:53:40 UTC, 1 replies.
- [PR] [CELEBORN-XXXX] Fix memory leak of committedFileInfos when graceful shutdown is disabled [celeborn] - posted by "SoulKyu (via GitHub)" <gi...@apache.org> on 2026/10/05 16:23:58 UTC, 2 replies.
- Re: [PR] [CELEBORN-2465][SPARK] Proactively unregister shuffles on SQL query completion [celeborn] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/10/05 17:38:31 UTC, 4 replies.
- Re: [PR] [CELEBORN-2459] Fix race causing DataPusher to accept data during termination and drop it [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/06 08:41:46 UTC, 2 replies.
- [PR] [FLINK] Fix Flink uncompressed shuffle failing to load codec NONE [celeborn] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2026/10/06 10:29:28 UTC, 0 replies.
- Re: [PR] [CELEBORN-2359] Deduplicate # HELP/# TYPE lines in PrometheusServlet output [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/07 08:43:50 UTC, 8 replies.
- Re: [PR] [CELEBORN-2463] Add ManuallyExcludedWorkerCount metric to distinguish manually excluded workers [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/07 08:43:53 UTC, 6 replies.
- Re: [PR] [CELEBORN-2471] Fix Flink uncompressed shuffle failing to load codec NONE [celeborn] - posted by "yew1eb (via GitHub)" <gi...@apache.org> on 2026/10/08 07:23:57 UTC, 3 replies.
- [PR] [MINOR] Update pnpm/action-setup to specific version v6.1.0 in web_lint.yml [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/10/09 03:58:04 UTC, 3 replies.
- Re: [PR] [CIP-14][CELEBORN-2220] Support Slow Start Push in C++ Client [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/09 08:48:18 UTC, 5 replies.
- Re: [PR] [CELEBORN-2065] Worker should support wait partition sort asynchronously [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/09 08:48:20 UTC, 2 replies.
- [PR] CELEBORN-9999: Send WWW-Authenticate challenge when no auth header present [celeborn] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2026/10/09 10:47:42 UTC, 0 replies.
- [PR] [CELEBORN-2472] Unregister Celeborn application from MR AppMaster on shutdown [celeborn] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2026/10/09 10:48:04 UTC, 2 replies.
- [PR] [CELEBORN-2473] Do not relocate zstd-jni in the Tez shaded jar [celeborn] - posted by "senthh (via GitHub)" <gi...@apache.org> on 2026/10/09 10:48:17 UTC, 4 replies.
- Re: [PR] [CELEBORN-2453] Master should fail fast when the Ratis server is closed unexpectedly [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/10 03:44:26 UTC, 5 replies.
- Re: [PR] [CELEBORN-2454] Add config celeborn.master.ha.ratis.raft.server.close.threshold and docs for Ratis JvmPauseMonitor [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/10 04:00:05 UTC, 4 replies.
- Re: [PR] [CELEBORN-2434] Clamp endMapIndex in sliceSortedBufferByMapRange [celeborn] - posted by "yew1eb (via GitHub)" <gi...@apache.org> on 2026/10/10 07:10:18 UTC, 5 replies.
- Re: [PR] [CELEBORN-2464] Wire Kubernetes health probes into the Helm chart [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/10 08:39:12 UTC, 3 replies.
- Re: [PR] [CELEBORN-2469] Add worker stats collection and reporting for autoscaling [celeborn] - posted by "Kalvin2077 (via GitHub)" <gi...@apache.org> on 2026/10/10 08:48:03 UTC, 2 replies.
- Re: [PR] [CELEBORN-2474] Send WWW-Authenticate challenge when no auth header present [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2026/10/12 02:35:04 UTC, 6 replies.
- Re: [PR] [CELEBORN-2357] Add Metrics Prefix [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/12 04:17:16 UTC, 3 replies.
- Re: [PR] [CELEBORN-2356] Fix NPE before null-check in handleChunkFetchRequest [celeborn] - posted by "afterincomparableyum (via GitHub)" <gi...@apache.org> on 2026/10/12 05:39:40 UTC, 3 replies.
- [PR] [CELEBORN-2475] Fix stale HA configuration documentation that breaks CI [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/12 07:18:31 UTC, 6 replies.
- Re: [PR] [CELEBORN-2387] Add ReserveSlotsFailCount worker metric [celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2026/10/12 08:38:51 UTC, 3 replies.
- Re: [PR] [CELEBORN-2388] Decouple inter-master Ratis TLS into its own SSL module [celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2026/10/12 08:38:53 UTC, 1 replies.
- Re: [PR] [CELEBORN-2458] Invalidate transport client after push timeout [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/10/12 08:59:58 UTC, 2 replies.
- Re: [I] Does Celeborn offer any performance optimizations in terms of reducing TCL or disk IOPS? [celeborn] - posted by "a7i (via GitHub)" <gi...@apache.org> on 2026/10/12 16:10:07 UTC, 0 replies.
- [I] Question: what to do when workers are disk-bound on fast instance-store NVMe? [celeborn] - posted by "a7i (via GitHub)" <gi...@apache.org> on 2026/10/12 16:22:07 UTC, 0 replies.
- [PR] [CELEBORN-2476] Fix initial storage fallback for MEMORY locations [celeborn] - posted by "SparksFyz (via GitHub)" <gi...@apache.org> on 2026/10/13 07:34:28 UTC, 2 replies.
- Re: [PR] [CELEBORN-2386] Pass peer hostname to SSLEngine for SNI support [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/13 07:49:32 UTC, 0 replies.
- [PR] [CELEBORN-2477] Enhance Celeborn Spark UI extension with detailed shuffle metrics [celeborn] - posted by "yew1eb (via GitHub)" <gi...@apache.org> on 2026/10/13 11:27:44 UTC, 1 replies.
- [PR] [CELEBORN-2478] Add celeborn-client build information to Spark UI Celeborn tab [celeborn] - posted by "yew1eb (via GitHub)" <gi...@apache.org> on 2026/10/13 11:37:01 UTC, 6 replies.
- Re: [PR] [CELEBORN-194] Introduce client side metrics for celeborn [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/10/13 12:03:47 UTC, 3 replies.
- [PR] [CELEBORN-2477] Read Spark UI extension configs via CelebornConf entries [celeborn] - posted by "yew1eb (via GitHub)" <gi...@apache.org> on 2026/10/13 12:15:57 UTC, 4 replies.
- Re: [PR] [CELEBORN-2451] Make DRA safe under AUTO fallback by tying supportsReliableStorage to fallback policy [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/10/13 12:39:31 UTC, 9 replies.
- Re: [PR] [CELEBORN-2460] Reply SHUFFLE_EXPIRED for a released shuffle instead of an empty file group [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/10/13 12:40:29 UTC, 2 replies.
- [PR] [CELEBORN-2479] Show shuffle compression ratio in Spark UI [celeborn] - posted by "yew1eb (via GitHub)" <gi...@apache.org> on 2026/10/13 15:43:13 UTC, 16 replies.
- [PR] [CELEBORN-XXXX] Push columnar shuffle batches by estimated size in bytes [celeborn] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/14 03:47:26 UTC, 0 replies.
- [PR] [MINOR] Fix NPE when persisting MapFileMeta without segment granularity [celeborn] - posted by "attiasr (via GitHub)" <gi...@apache.org> on 2026/10/14 16:48:17 UTC, 1 replies.
- Re: [PR] [CELEBORN-2480] Push columnar shuffle batches by estimated size in bytes [celeborn] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/14 21:18:39 UTC, 5 replies.
- Re: [PR] [CELEBORN-2481] Fix NPE when persisting MapFileMeta without segment granularity [celeborn] - posted by "attiasr (via GitHub)" <gi...@apache.org> on 2026/10/17 01:23:08 UTC, 4 replies.
- [PR] [CELEBORN-2483] Fix flaky RemoteShuffleMasterSuiteJ shuffleCount assertions racing with the initial app heartbeat [celeborn] - posted by "afterincomparableyum (via GitHub)" <gi...@apache.org> on 2026/10/17 03:38:50 UTC, 3 replies.
- [PR] [CELEBORN-2482] Report pushes failed by push-timeout channel close as push timeout instead of connection exception [celeborn] - posted by "afterincomparableyum (via GitHub)" <gi...@apache.org> on 2026/10/17 03:41:12 UTC, 5 replies.
- [PR] [CELEBORN-2484][BUILD] Make sbt downloads resilient to transient Maven Central failures [celeborn] - posted by "afterincomparableyum (via GitHub)" <gi...@apache.org> on 2026/10/17 03:58:42 UTC, 5 replies.
- [PR] [CELEBORN-2467] Move DFS replica dedup from worker close to the driver after commit [celeborn] - posted by "ewoodbury (via GitHub)" <gi...@apache.org> on 2026/10/19 01:12:26 UTC, 0 replies.
- Re: [PR] [CELEBORN-2467] Fix silent shuffle data loss when a replica's commit times out on OSS and HDFS storage [celeborn] - posted by "ewoodbury (via GitHub)" <gi...@apache.org> on 2026/10/19 03:45:19 UTC, 9 replies.
- [PR] [CELEBORN-2488] Cache Maven distribution in CI workflows [celeborn] - posted by "yew1eb (via GitHub)" <gi...@apache.org> on 2026/10/19 09:57:54 UTC, 8 replies.
- Re: [PR] [CELEBORN-2429][CIP-23] Batch worker/application heartbeats into aggregated raft log entries [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/19 10:54:02 UTC, 4 replies.
- [PR] [CELEBORN-2489] Fix unknown worker lookup in shuffle data loss detection [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/19 10:55:08 UTC, 4 replies.
- [PR] [CELEBORN-2487] Fix leaked LifecycleManager in spark-it client suites [celeborn] - posted by "yew1eb (via GitHub)" <gi...@apache.org> on 2026/10/19 11:29:59 UTC, 3 replies.
- [PR] [CELEBORN-2491] Fix mapper completion racing with shuffle integrity metadata aggregation [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/20 04:04:13 UTC, 3 replies.
- [PR] [CELEBORN-2492] Allow AQE integrity validation to recover on retry [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/20 06:23:39 UTC, 1 replies.
- Re: [PR] [CELEBORN-2490] Make memory file storage configurable for replica partitions [celeborn] - posted by "venkata91 (via GitHub)" <gi...@apache.org> on 2026/10/20 06:31:57 UTC, 5 replies.
- [PR] [CELEBORN-2493] Validate empty reads for requested reducer partitions [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/20 07:33:10 UTC, 1 replies.
- [PR] [CELEBORN-2494][TEST] Fix flaky PushDataTimeoutTest after replica timeout [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/20 09:27:25 UTC, 3 replies.
- [PR] [CELEBORN-2480][FOLLOWUP] Test columnar batch limits and round trips [celeborn] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/20 19:55:12 UTC, 3 replies.
- Re: [PR] [CELEBORN-2495] Fix memory leak of committedFileInfos when graceful shutdown is disabled [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/21 04:24:25 UTC, 3 replies.
- [PR] [CELEBORN-2496][TEST] Fix mtime granularity race in ReloadingX509TrustManagerSuiteJ.testReloadSymlink [celeborn] - posted by "yew1eb (via GitHub)" <gi...@apache.org> on 2026/10/21 05:43:32 UTC, 6 replies.
- [PR] [CELEBORN-2497] Fix gauge snapshot race in Master metrics tests [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2026/10/21 06:07:22 UTC, 0 replies.
- [PR] [CELEBORN-2498][TEST] Fix testDataPushQueue starvation on fast machines [celeborn] - posted by "yew1eb (via GitHub)" <gi...@apache.org> on 2026/10/21 07:15:43 UTC, 3 replies.
- [PR] [CELEBORN-XXXX] Add shuffle slot assignments to the Spark UI Celeborn tab [celeborn] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/22 05:37:53 UTC, 0 replies.
- [PR] [CELEBORN-XXXX] Swap DataPusher buffers instead of copying pushed data [celeborn] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/22 08:52:35 UTC, 1 replies.
- Re: [PR] [CELEBORN-2497][TEST] Fix gauge snapshot race in Master metrics tests [celeborn] - posted by "yew1eb (via GitHub)" <gi...@apache.org> on 2026/10/22 11:38:37 UTC, 2 replies.
- [PR] [CELEBORN-2500] Use ArrayDeque instead of LinkedList in TransportFrameDecoder [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/10/22 12:59:58 UTC, 3 replies.
- [PR] [CELEBORN-2468] Add module-specific transport bootstrap configuration [celeborn] - posted by "Kalvin2077 (via GitHub)" <gi...@apache.org> on 2026/10/22 16:33:02 UTC, 1 replies.
- Re: [PR] [CELEBORN-2499] Show shuffle slot assignments in the Spark UI Celeborn tab [celeborn] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/22 18:00:44 UTC, 0 replies.
- [PR] [CELEBORN-XXXX] Fix DataPushQueue dropping tasks when there is no partition location map [celeborn] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/22 18:09:34 UTC, 0 replies.
- Re: [PR] [CELEBORN-2501] Fix DataPushQueue dropping tasks when there is no partition location map [celeborn] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/22 22:35:50 UTC, 2 replies.
- [PR] [CELEBORN-2485] Fix disk file cleanup for mixed-storage shuffles [celeborn] - posted by "wayne-x-wang (via GitHub)" <gi...@apache.org> on 2026/10/23 02:11:27 UTC, 4 replies.
- Re: [PR] [CELEBORN-2502] Swap DataPusher buffers instead of copying pushed data [celeborn] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/10/23 05:25:29 UTC, 0 replies.
- Re: [PR] [CELEBORN-2469][CIP-13] Autoscaling: add worker stats collection [celeborn] - posted by "Kalvin2077 (via GitHub)" <gi...@apache.org> on 2026/10/23 06:04:14 UTC, 0 replies.