You are viewing a plain text version of this content. The canonical link for it is here.
- Re: [PR] [CELEBORN-2014] updateInterruptionNotice REST API [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/01 06:19:41 UTC, 10 replies.
- Re: [PR] [CELEBORN-2018] Support min number of workers selected for shuffle [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/01 15:09:44 UTC, 4 replies.
- Re: [PR] FlakyTest - check if fetch failure task another attempt is running or successful [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/01 16:10:49 UTC, 0 replies.
- Re: [PR] [CELEBORN-1720][FOLLOWUP] Fix flakyTest - check if fetch failure task another attempt is running or successful [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/02 02:48:09 UTC, 12 replies.
- Re: [PR] [CELEBORN-1917] supports celeborn.client.push.maxBytesSizeInFlight [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/02 11:15:32 UTC, 1 replies.
- [PR] [CELEBORN-2020][FOLLOWUP] Fix master commands authentication testing [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/02 14:38:56 UTC, 0 replies.
- Re: [PR] [CELEBORN-2003] Add retry mechanism when completing S3 multipart upload [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/06/03 02:34:41 UTC, 2 replies.
- Re: [PR] [CELEBORN-894] End to End Integrity Checks [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/06/03 06:31:36 UTC, 76 replies.
- [PR] [CELEBORN-2022] Spark4 Client should package commons-io [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/06/03 09:36:58 UTC, 4 replies.
- [PR] [CELEBORN-2023] Spark4 Client incompatible with isLocalMaster method [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/06/03 09:43:10 UTC, 3 replies.
- Re: [PR] [CELEBORN-1768][WRITER] Refactoring Shuffle Writer to extract common methods [celeborn] - posted by "zwangsheng (via GitHub)" <gi...@apache.org> on 2025/06/03 12:18:41 UTC, 2 replies.
- Re: [PR] [CELEBORN-1768][SPARK-3][WRITER] Refactoring Shuffle Writer to extract common methods [celeborn] - posted by "zwangsheng (via GitHub)" <gi...@apache.org> on 2025/06/03 12:23:22 UTC, 5 replies.
- Re: [PR] [CELEBORN-2020][FOLLOWUP] Fix CLI master commands authentication testing [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/03 12:32:50 UTC, 1 replies.
- Re: [PR] [CELEBORN-2021] Fix issues on regression HDFS and OSS before release 0.6 [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/06/04 01:51:39 UTC, 1 replies.
- [PR] [CELEBORN-2024] Publish commit files fail count metrics [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2025/06/04 04:38:28 UTC, 3 replies.
- [PR] [CELEBORN-1892] Adding register with master fail count metric for worker [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2025/06/04 05:26:28 UTC, 2 replies.
- [PR] [CELEBORN-2025] RpcFailure Scala 2.13 serialization is incompatible [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/06/04 06:39:51 UTC, 3 replies.
- Re: [PR] [CELEBORN-2016] Add cooldown time in worker shutdown [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/06/04 07:35:56 UTC, 5 replies.
- [PR] [MINOR] Fixed some of the maven warnings [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2025/06/04 09:35:22 UTC, 3 replies.
- [PR] [CELEBORN-2020][FOLLOWUP] Add --auth-header option to usage of CLI commands [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/04 09:56:34 UTC, 3 replies.
- Re: [PR] [CELEBORN-3288] Fix Deserialization Vulnerability [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/04 09:58:36 UTC, 0 replies.
- [PR] [CELEBORN-2026] Skip build tez client [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/06/04 11:50:04 UTC, 2 replies.
- [PR] [MINOR] Batch few celeborn client logs [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2025/06/04 12:04:33 UTC, 3 replies.
- Re: [PR] [CELEBORN-1903] Enable connection heartbeat and close idle connection [celeborn] - posted by "Austinfjq (via GitHub)" <gi...@apache.org> on 2025/06/04 17:21:18 UTC, 1 replies.
- Re: [PR] CELEBORN-1334 [CIP-12] Support HARD_SPLIT in PushMergedData should not support new version client with old version worker [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/06/05 14:02:40 UTC, 1 replies.
- Re: [PR] [CELEBORN-2017][HELM] Add namespace to the metadata [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/06/05 14:10:11 UTC, 1 replies.
- [PR] [CELEBORN-1673][FOLLOWUP] Shouldn't ignore InterruptedException when client retry [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/06/06 02:08:05 UTC, 4 replies.
- [PR] [CELEBORN-2015][FOLLOWUP] Retry IOException failures for RPC requests [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2025/06/06 08:19:20 UTC, 6 replies.
- [PR] grafana ga [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/08 17:25:34 UTC, 0 replies.
- Re: [PR] [CELEBORN-2028] Setup GA for grafana dashboard [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/06/09 02:08:05 UTC, 6 replies.
- [PR] [CELEBORN-2027] Allow CelebornShuffleReader to decompress data on demand [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/06/09 02:59:51 UTC, 3 replies.
- [PR] [CELEBORN-2029][FLINK] Some minor optimizations in the Flink integration [celeborn] - posted by "codenohup (via GitHub)" <gi...@apache.org> on 2025/06/09 06:47:24 UTC, 5 replies.
- [PR] [CELEBORN-2030] Bump Spark from 3.5.5 to 3.5.6 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/09 07:09:51 UTC, 3 replies.
- [PR] CELEBORN-2032. Create reader should change to peer by taskAttemptId [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2025/06/10 06:57:00 UTC, 2 replies.
- [PR] [CELEBORN-1572][FOLLOWUP] Show Celeborn CLI version for sub command [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/10 14:33:52 UTC, 0 replies.
- Re: [PR] [CELEBORN-1572][FOLLOWUP] Support to show Celeborn CLI version for sub command [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/10 14:37:26 UTC, 6 replies.
- [PR] updateProduceBytes should be called even if updateProduceBytes throws exception [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2025/06/11 02:23:44 UTC, 1 replies.
- [PR] [CELEBORN-1056][FOLLOWUP] Support upsert and delete of dynamic configuration management [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/11 07:31:20 UTC, 14 replies.
- [PR] [CELEBORN-1719][FOLLOWUP] Rename throwsFetchFailure to stageRerunEnabled [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2025/06/11 09:07:47 UTC, 3 replies.
- Re: [PR] [CELEBORN-2033] updateProduceBytes should be called even if updateProduceBytes throws exception [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/11 17:54:11 UTC, 1 replies.
- [PR] regenrate [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/11 19:23:26 UTC, 1 replies.
- [PR] sort order [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/11 20:26:52 UTC, 0 replies.
- Re: [PR] [CELEBORN-2011][FOLLOWUP][INFRA] Write sorted authors [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/11 20:33:49 UTC, 1 replies.
- [PR] [CELEBORN-1577][FOLLOWUP] Improve check quota message. [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2025/06/12 02:37:48 UTC, 5 replies.
- [PR] [CELEBORN-1319][FOLLOWUP] Support celeborn optimize skew partitions patch for Spark v3.5.6 and v4.0.0 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/12 07:00:50 UTC, 3 replies.
- [PR] [CELEBORN-2036]Fix NPE when TransportMessage has null payload [celeborn] - posted by "Jraaay (via GitHub)" <gi...@apache.org> on 2025/06/13 01:38:31 UTC, 7 replies.
- Re: [PR] [CELEBORN-2011][FOLLOWUP][INFRA] Write sorted authors for release contributors [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/13 18:45:03 UTC, 1 replies.
- Re: [PR] [CELEBORN-1413][FOLLOWUP] Bump spark 4.0 version to 4.0.0 [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/06/16 06:32:22 UTC, 1 replies.
- Re: [PR] [DRAFT] [FEATURE] Inverted index based reduce partition data writer / reader [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/06/16 08:38:37 UTC, 0 replies.
- [PR] [CELEBORN-1413][FOLLOWUP] Check JAVA_HOME variables for release mode [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/16 23:19:48 UTC, 0 replies.
- [PR] [CELEBORN-2037] Use JEP 223 API to process Java version [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/17 02:42:48 UTC, 1 replies.
- [PR] [CELEBORN-1817][FOLLOWUP] Correct the problematic metrics [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/06/17 03:16:28 UTC, 4 replies.
- Re: [PR] [CELEBORN-1413][FOLLOWUP] Check JAVA_HOME variables for release [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/17 04:10:34 UTC, 1 replies.
- [PR] [CELEBORN-1166][FOLLOWUP] Avoid calling parmap when setup endpoint [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/17 08:00:50 UTC, 1 replies.
- Re: [PR] [CELEBORN-2032] Create reader should change to peer by taskAttemptId [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/06/17 09:14:45 UTC, 2 replies.
- [PR] [CELEBORN-1931][0.5] use gather API for local flusher to optimize write io pattern [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2025/06/17 09:20:29 UTC, 6 replies.
- [PR] [CIP-19][CELEBORN-1937] QuotaManager should support app threshold [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2025/06/17 10:08:26 UTC, 0 replies.
- [PR] [CIP-19][CELEBORN-1939] CongestionController should not limit user push speed when worker load is low [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2025/06/17 11:13:26 UTC, 1 replies.
- [PR] [CELEBORN-1931][FOLLOWUP] Update config version for worker local flusher gather api [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/17 18:41:17 UTC, 1 replies.
- [PR] [CELEBORN-2042] Fix FetchFailure handling when TaskSetManager is not found [celeborn] - posted by "gaoyajun02 (via GitHub)" <gi...@apache.org> on 2025/06/18 04:28:19 UTC, 2 replies.
- [PR] [CELEBORN-1056][FOLLOWUP] Support testing of dynamic configuration management cli [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/20 07:36:49 UTC, 4 replies.
- Re: [I] Who is using Apache Celeborn? [celeborn] - posted by "akashd11 (via GitHub)" <gi...@apache.org> on 2025/06/20 08:22:45 UTC, 0 replies.
- [PR] [CELEBORN-2040] Avoid throw FetchFailedException when GetReducerFileGroupResponse failed via broadcast [celeborn] - posted by "vastian180 (via GitHub)" <gi...@apache.org> on 2025/06/20 11:53:16 UTC, 7 replies.
- [PR] [CELEBORN-1721][FOLLOWUP] Return softsplit if there is no hardsplit for pushMergeData [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/06/20 22:51:46 UTC, 6 replies.
- Re: [PR] [WIP] Dynamically adjust partition write parallelism [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/06/22 08:35:39 UTC, 1 replies.
- Re: [PR] CELEBORN-1991: add retries for registerShuffle on the lifecycleManager [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/06/22 08:35:40 UTC, 0 replies.
- Re: [PR] [CELEBORN-1984] Merge ResourceRequest to transportMessageProtobuf [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/06/22 08:35:41 UTC, 1 replies.
- Re: [PR] [CELEBORN-1841][FOLLOWUP] Support custom implementation of EventExecutorChooser to avoid deadlock when calling await in EventLoop thread for EpollEventLoopGroup [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/06/22 08:35:43 UTC, 0 replies.
- Re: [PR] [RFT] Enable run java UT (not a formal PR, just for discussion purposes) [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/06/22 08:35:45 UTC, 0 replies.
- Re: [PR] Set max memory of SortBasedPusher based off Spark configs [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/06/22 08:35:45 UTC, 0 replies.
- Re: [PR] [CELEBORN-894] Add checksum for shuffle data [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/06/22 08:35:47 UTC, 0 replies.
- [PR] [CELEBORN-2044] Proactively cleanup stream state from ChunkStreamManager when the stream ends [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2025/06/23 03:13:52 UTC, 5 replies.
- [PR] [CELEBORN-2043] Fix IndexOutOfBoundsException exception in getEvictedFileWriter [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/06/23 06:25:39 UTC, 4 replies.
- [PR] [CELEBORN-2046] Specify extractionDir of AsyncProfilerLoader with celeborn.worker.storage.workingDir [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/24 02:57:39 UTC, 22 replies.
- [PR] [CELEBORN-2045] Fix OOM caused by worker source if the worker's metrics is not captured for a long time [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/06/24 06:45:43 UTC, 6 replies.
- [PR] [CELEBORN-2031] Interruption Aware Slot Selection [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2025/06/24 07:23:29 UTC, 5 replies.
- Re: [PR] [CELEBORN-2045] Add user sinks to allow persist metrics data and avoid possible worker OOM [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/06/25 08:59:51 UTC, 0 replies.
- Re: [PR] [CELEBORN-2046] Specify extractionDir of AsyncProfilerLoader with celeborn.worker.jvmProfiler.localDir [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/25 09:29:36 UTC, 2 replies.
- Re: [PR] [CELEBORN-2045] Add logger sinks to allow persist metrics data and avoid possible worker OOM [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/06/25 09:40:45 UTC, 18 replies.
- [PR] [CELEBORN-2049] Bump Ratis version from 3.1.3 to 3.2.0 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/26 02:41:33 UTC, 2 replies.
- Re: [D] Deploying Apache Celebron for Large-Scale Spark SQL Workloads [celeborn] - posted by "swapneshkumar-d11 (via GitHub)" <gi...@apache.org> on 2025/06/30 09:02:46 UTC, 0 replies.
- [PR] [CELEBORN-2047] Support MapPartitionData on DFS [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/06/30 09:44:11 UTC, 1 replies.
- [PR] Fix flink write DFS failed [celeborn] - posted by "Alibaba-HZY (via GitHub)" <gi...@apache.org> on 2025/06/30 10:41:37 UTC, 0 replies.
- [PR] [CELEBORN-894][FOLLOWUP] update commitMeta before update subPartition… [celeborn] - posted by "buska88 (via GitHub)" <gi...@apache.org> on 2025/06/30 11:47:39 UTC, 1 replies.