issues@celeborn.apache.org, 2026-05

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [CELEBORN-2306] Master adds shutdown hook for ratis stepdown [celeborn] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/05/04 02:13:03 UTC, 7 replies.
- Re: [PR] [CELEBORN-2308] Bump commons-lang3 version from 3.17.0 to 3.20.0 [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/04 09:13:52 UTC, 3 replies.
- Re: [PR] [CELEBORN-2065] Worker should support wait partition sort asynchronously [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/04 09:13:55 UTC, 0 replies.
- Re: [PR] [CELEBORN-2257] Add reporting of remote disks during registration. [celeborn] - posted by "eolivelli (via GitHub)" <gi...@apache.org> on 2026/05/04 13:42:04 UTC, 6 replies.
- Re: [PR] [WIP] Support async response to open stream calls to avoid blocking netty threads [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/05 09:11:37 UTC, 2 replies.
- Re: [D] Deploying Apache Celebron for Large-Scale Spark SQL Workloads [celeborn] - posted by "jakubfijolek (via GitHub)" <gi...@apache.org> on 2026/05/05 11:34:56 UTC, 1 replies.
- [PR] [CELEBORN-1577][FOLLOWUP] Fix backward compatiblity issue with interrupt shuffle [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2026/05/06 09:18:51 UTC, 6 replies.
- Re: [PR] [CELEBORN-2314] Optimize the performance of DataBatches.requireBatches [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2026/05/07 01:45:51 UTC, 4 replies.
- Re: [PR] [CIP-19][CELEBORN-1937] QuotaManager should support app threshold [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2026/05/07 02:35:28 UTC, 0 replies.
- Re: [PR] [CELEBORN-2303] Ignore some flaky test [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/07 09:17:32 UTC, 6 replies.
- [PR] add missing metric [celeborn] - posted by "kaybhutani (via GitHub)" <gi...@apache.org> on 2026/05/07 11:08:15 UTC, 0 replies.
- [PR] [CELEBORN-2319] Standalone LifecycleManager && rust sdk [celeborn] - posted by "gavin9402 (via GitHub)" <gi...@apache.org> on 2026/05/07 12:14:57 UTC, 9 replies.
- [I] v0.6.3 image missing in Dockerhub [celeborn] - posted by "ftong2020 (via GitHub)" <gi...@apache.org> on 2026/05/08 03:13:32 UTC, 3 replies.
- Re: [PR] [CELEBORN-2318] Miss increment to WRITE_DATA_HARD_SPLIT_COUNT on returning HARD_SPLIT in handlePushData [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/05/08 07:00:43 UTC, 2 replies.
- [PR] [CELEBORN-2320] Grafana dashboard linter should build from a checkout instead [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/05/08 07:26:45 UTC, 2 replies.
- Re: [PR] [CELEBORN-2316] Introduce metadata operation metrics [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/05/08 08:01:54 UTC, 12 replies.
- [PR] Avoid locking disk writers for memory split checks [celeborn] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/08 21:36:14 UTC, 0 replies.
- Re: [PR] [CELEBORN-2275][CIP-14] Add C++ merge-write and Java-read hybrid integration test [celeborn] - posted by "afterincomparableyum (via GitHub)" <gi...@apache.org> on 2026/05/09 22:00:39 UTC, 5 replies.
- Re: [PR] [CELEBORN-2321] Avoid locking disk writers during memory split checks [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/05/10 04:35:58 UTC, 2 replies.
- [PR] [CELEBORN-2322] Upgrade version of docker/login-action for Login to Docker Hub [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/05/10 07:59:52 UTC, 3 replies.
- Re: [PR] [CELEBORN-2310] Reject RESERVE_SLOTS when disks are full [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/10 09:03:28 UTC, 5 replies.
- Re: [PR] [CELEBORN-2307] Support accurate disk usage accounting to HARD_SPLIT accurately [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/10 09:03:29 UTC, 2 replies.
- Re: [PR] Support streamState restore to avoid unnecessary read retries during worker restarts [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/11 09:56:49 UTC, 2 replies.
- Re: [PR] [CELEBORN-2230] SparkUtils#shouldReportShuffleFetchFailure method should retrieve the number of task failures from TaskSetManager [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/11 09:56:53 UTC, 2 replies.
- Re: [PR] [CELEBORN-2315] Add iterator fully-consumed validation after shuffle write [celeborn] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/05/12 02:32:56 UTC, 7 replies.
- [PR] [CELEBORN-2324] Fix JVMQuake threshold and JVMStat timer unit conversion [celeborn] - posted by "pithecuse527 (via GitHub)" <gi...@apache.org> on 2026/05/12 07:51:58 UTC, 3 replies.
- [PR] [CELEBORN-2253] Fix IndexOutOfBoundsException reading shuffle data from HDFS [celeborn] - posted by "1fanwang (via GitHub)" <gi...@apache.org> on 2026/05/12 08:00:13 UTC, 4 replies.
- Re: [PR] [CELEBORN-2313] Extend E2E checked zone to batch assembly point [celeborn] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/05/13 07:45:11 UTC, 10 replies.
- [PR] [CELEBORN-2326] Bump log4j-core version up to 2.25.4 [celeborn] - posted by "yuriymalygin (via GitHub)" <gi...@apache.org> on 2026/05/13 16:45:25 UTC, 9 replies.
- [PR] [CELEBORN-2327] Add active-slot weight to load-aware placement [celeborn] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/13 19:31:48 UTC, 11 replies.
- Re: [PR] [CELEBORN-2317] Validate applicationId to prevent worker path traversal [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2026/05/14 01:15:23 UTC, 2 replies.
- [PR] [CELEBORN-2323] Optimize RegisterShuffle for large partition counts [celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2026/05/14 04:45:00 UTC, 1 replies.
- [PR] Avoid reducer file group load convoys [celeborn] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/14 05:54:34 UTC, 1 replies.
- Re: [PR] [CELEBORN-2312] Support committing uncommitted partitions for graceful shutdown [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/14 09:19:14 UTC, 2 replies.
- [PR] ci: auto-apply correctness label from PR template checkbox [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2026/05/15 16:54:46 UTC, 1 replies.
- [PR] [CELEBORN-2328] auto-apply correctness label from PR template checkbox [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2026/05/15 17:37:00 UTC, 0 replies.
- [PR] [CELEBORN-2329][CIP22] Encryption at Rest Spark Impl [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2026/05/15 19:22:34 UTC, 5 replies.
- [PR] [INFRA] Set up default rulesets for default and release branches [celeborn] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/05/15 19:24:00 UTC, 2 replies.
- [PR] Fix HA master bootstrap redirect handling [celeborn] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/17 02:42:08 UTC, 0 replies.
- [PR] [CELEBORN-2331] Parallelize batch open stream client creation [celeborn] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/17 03:22:37 UTC, 9 replies.
- Re: [PR] [CELEBORN-2328] Auto-apply correctness label from PR template checkbox [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/05/18 02:59:14 UTC, 3 replies.
- [PR] [CELEBORN-2332] Fix self join deadlock in C++ WorkerPartitionReader f… [celeborn] - posted by "afterincomparableyum (via GitHub)" <gi...@apache.org> on 2026/05/18 05:45:38 UTC, 1 replies.
- [PR] [CELEBORN-2333] Bump Flink from 2.2.0 to 2.2.1 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/05/18 06:38:32 UTC, 2 replies.
- [PR] [CELEBORN-2334] Auto-recover rocks db in case of failures [celeborn] - posted by "AmandeepSingh285 (via GitHub)" <gi...@apache.org> on 2026/05/18 13:40:27 UTC, 0 replies.
- Re: [PR] [CELEBORN-2334] Automatically restore RocksDB in case of failures [celeborn] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/05/19 03:43:25 UTC, 29 replies.
- [PR] Explicitly trim Flusher thread pool cache when flusher queue is empty [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2026/05/19 09:15:17 UTC, 1 replies.
- Re: [PR] [CELEBORN-2330] Fix HA master bootstrap redirect handling [celeborn] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/05/21 02:34:53 UTC, 6 replies.
- [PR] [CELEBORN-2253][0.6] Fix IndexOutOfBoundsException reading shuffle data from HDFS [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/21 07:43:44 UTC, 2 replies.
- Re: [PR] [CELEBORN-2299] Fix memory leak and severe FGC in CelebornSortBasedPusher for hi… [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/05/21 09:42:49 UTC, 0 replies.
- [PR] [CELEBORN-xxxx] Support decommission shutdown for worker scale-down scenarios [celeborn] - posted by "chenghuichen (via GitHub)" <gi...@apache.org> on 2026/05/22 03:47:26 UTC, 2 replies.
- [PR] [FEATURE] [WIP] Support chunk level compression to optimize storage [celeborn] - posted by "saurabhd336 (via GitHub)" <gi...@apache.org> on 2026/05/23 16:44:47 UTC, 0 replies.
- [PR] [CELEBORN-2335] Bump Spark from 4.1.1 to 4.1.2 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2026/05/24 04:49:49 UTC, 2 replies.
- Re: [PR] [CELEBORN-xxxx] Explicitly trim Flusher thread pool cache when flusher queue is empty [celeborn] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/05/25 06:23:31 UTC, 0 replies.
- Re: [PR] [CELEBORN-2336] Support decommission shutdown for worker scale-down scenarios [celeborn] - posted by "chenghuichen (via GitHub)" <gi...@apache.org> on 2026/05/25 09:50:02 UTC, 18 replies.
- Re: [PR] [CELEBORN-XXXX] [FEATURE] [WIP] Support chunk level compression to optimize storage [celeborn] - posted by "saurabhd336 (via GitHub)" <gi...@apache.org> on 2026/05/25 11:32:24 UTC, 1 replies.
- Re: [PR] [CELEBORN-1682] Add java tools.jar into classpath for JVM quake [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/26 08:29:41 UTC, 0 replies.
- [PR] [CELEBORN-2337] Celeborn OpenAPI client should not shade slf4j-api [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/26 09:28:39 UTC, 2 replies.
- [PR] [CELEBORN-2338] Remove hardcoded CELEBORN_PRINT_LAUNCH_COMMAND=0 [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/26 09:33:33 UTC, 2 replies.
- [PR] [CELEBORN-2339] Add tools.jar into classpath only for Java 8 [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/26 09:56:21 UTC, 2 replies.
- [PR] [CELEBORN-XXXX] Fix flaky CelebornHashCheckDiskSuite [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/05/26 13:02:29 UTC, 0 replies.
- Re: [PR] [CELEBORN-2332] Fix self join deadlock in C++ WorkerPartitionReader fetch callbacks [celeborn] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/05/27 05:11:41 UTC, 1 replies.
- Re: [PR] [CELEBORN-2340] Explicitly trim Flusher thread pool cache when flusher queue is empty [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2026/05/27 10:59:20 UTC, 0 replies.
- [PR] [WORKER] Preserve partially-committed partitions on CommitFiles timeout [celeborn] - posted by "shlomitubul (via GitHub)" <gi...@apache.org> on 2026/05/27 16:43:58 UTC, 2 replies.
- [PR] [0.6][WORKER] Preserve partially-committed partitions on CommitFiles timeout [celeborn] - posted by "shlomitubul (via GitHub)" <gi...@apache.org> on 2026/05/27 16:47:54 UTC, 1 replies.
- [PR] [MINOR] Fix broken image links in docs [celeborn] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2026/05/28 01:49:12 UTC, 0 replies.
- [PR] [CELEBORN-2342] Fix object aliasing in LegacySkewHandlingPartitionValidator corrupting sub-range metadata [celeborn] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/05/28 03:09:48 UTC, 1 replies.
- [PR] [CELEBORN-2343] Fix timer leak in handlePushData [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2026/05/28 10:38:30 UTC, 0 replies.
- [PR] [CELEBORN-2344] Support to force set serving state via HTTP APIs [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2026/05/28 11:25:05 UTC, 0 replies.
- [PR] Update drainagent environment mappings [celeborn] - posted by "wudanzy (via GitHub)" <gi...@apache.org> on 2026/05/29 04:34:39 UTC, 1 replies.
- [PR] [CELEBORN-2345] Fix heavy allocation for rpcAskTimeout [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2026/05/29 09:59:26 UTC, 0 replies.
- [PR] [CELEBORN-2342] Fix CI test failures: JVMQuakeSuite hang and LifecycleManagerUnregisterShuffleSuite slowness [celeborn] - posted by "xumingming (via GitHub)" <gi...@apache.org> on 2026/05/29 15:28:12 UTC, 0 replies.
- [PR] [CELEBORN-2346] Add RequestSlots failure metrics [celeborn] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/05/30 19:01:05 UTC, 0 replies.