You are viewing a plain text version of this content. The canonical link for it is here.
- Re: [PR] [CELEBORN-1776] Add UT when replica enable and workers randomly shutdown [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/03 08:34:01 UTC, 1 replies.
- Re: [PR] [CELEBORN-1577][Phase2] QuotaManager should support interrupt shuffle. [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/03 08:34:02 UTC, 1 replies.
- Re: [PR] [RFC][CELEBORN-894] Add support for end to end Integrity Checks [celeborn] - posted by "gauravkm (via GitHub)" <gi...@apache.org> on 2025/02/03 17:24:35 UTC, 4 replies.
- [PR] [CELEBORN-1792][FOLLOWUP] Skip unnecessary checks when there is no memory pressure [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/02/05 06:29:58 UTC, 3 replies.
- Re: [PR] [WIP][CELEBORN-1720][FOLLOWUP] Align the SparkUtils logger name between spark 2 and 3-4 [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/05 08:33:00 UTC, 2 replies.
- Re: [PR] [CELEBORN-1743] [FOLLOWUP]Introduces a configuration option to determine whether application metrics should be included [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/05 08:33:02 UTC, 2 replies.
- [PR] 1844 [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/02/05 11:50:11 UTC, 0 replies.
- [PR] [CELEBORN-1850] Setup worker endpoint after initalizing controller [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2025/02/05 18:34:22 UTC, 4 replies.
- [PR] [CELEBORN-1851] Disable spark ui when run celeborn spark-it [celeborn] - posted by "zwangsheng (via GitHub)" <gi...@apache.org> on 2025/02/06 02:58:15 UTC, 3 replies.
- [PR] [CELEBORN-1853] Remove idle executors when DRA enable and using Celeborn [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2025/02/06 09:07:44 UTC, 4 replies.
- [PR] [CELEBORN-1854] Change receive revive request log level to debug [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2025/02/06 20:34:07 UTC, 7 replies.
- [PR] [CELEBORN-1855] LifecycleManager return appshuffleId for non barrier … [celeborn] - posted by "buska88 (via GitHub)" <gi...@apache.org> on 2025/02/07 06:51:54 UTC, 0 replies.
- [PR] [CELEBORN-1492] Introduce Celeborn Chaos Testing Framework [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/07 07:56:19 UTC, 4 replies.
- Re: [I] [BUG] title Worker not getting resources (Slots) [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/07 08:02:01 UTC, 1 replies.
- Re: [PR] [CELEBORN-1721][CIP-12] Support HARD_SPLIT in PushMergedData [celeborn] - posted by "littlexyw (via GitHub)" <gi...@apache.org> on 2025/02/07 08:17:34 UTC, 4 replies.
- Re: [PR] [CELEBORN-1215][FOLLOWUP] Improve PausePushDataTime and PausePushDataAndReplicateTime metric calculation logic [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/07 08:33:31 UTC, 4 replies.
- Re: [PR] [CELEBORN-1768][WRITER] Refactoring Shuffle Writer to extract common methods [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/07 08:33:34 UTC, 3 replies.
- [PR] [CELEBORN-1721][FOLLOWUP] Fix the problem of getting partition location in ShuffleClientImpl during soft split. [celeborn] - posted by "littlexyw (via GitHub)" <gi...@apache.org> on 2025/02/07 09:13:14 UTC, 2 replies.
- Re: [PR] [CELEBORN-1839] PartitionsSorter.getSortedFileInfo should not block the handleOpenStream thread [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2025/02/07 10:08:41 UTC, 0 replies.
- Re: [PR] [CELEBORN-1792][FOLLOWUP] Suppress noisy logs when there is no memory pressure [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/02/08 01:44:16 UTC, 0 replies.
- [PR] [CELEBORN-1859] DfsPartitionReader and LocalPartitionReader should reuse pbStreamHandlers get from BatchOpenStream request [celeborn] - posted by "Z1Wu (via GitHub)" <gi...@apache.org> on 2025/02/08 09:31:49 UTC, 11 replies.
- Re: [PR] [MINOR] Change some config version [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2025/02/08 09:56:07 UTC, 1 replies.
- Re: [PR] [CELEBORN-1847][CIP-8] Introduce local and DFS tier writer [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/02/10 05:55:25 UTC, 1 replies.
- Re: [PR] [CELEBORN-1792] MemoryManager resume should use pinnedDirectMemory instead of usedDirectMemory [celeborn] - posted by "onyourhead (via GitHub)" <gi...@apache.org> on 2025/02/10 11:59:07 UTC, 0 replies.
- Re: [PR] [CELEBORN-1841] Support custom implementation of EventExecutorChooser to avoid deadlock when calling await in EventLoop thread [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/02/10 14:26:04 UTC, 1 replies.
- Re: [PR] [CELEBORN-1319] Optimize skew partition logic for Reduce Mode to avoid sorting shuffle files [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/02/11 07:49:57 UTC, 14 replies.
- [PR] [CELEBORN-1860] Remove unused celeborn..io.enableVerboseMetrics option [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/11 08:08:19 UTC, 1 replies.
- Re: [PR] [CELEBORN-1855] LifecycleManager return appshuffleId for non barrier stage when fetch fail has been reported [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/02/11 08:30:33 UTC, 8 replies.
- Re: [PR] [CELEBORN-1843] Optimize roundrobin for more balanced disk slot allocation [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/11 08:34:01 UTC, 2 replies.
- [PR] Bump Ratis version from 3.1.2 to 3.1.3 [celeborn] - posted by "Madhukar525722 (via GitHub)" <gi...@apache.org> on 2025/02/12 00:24:37 UTC, 0 replies.
- Re: [PR] [CELEBORN-1846] Fix the StreamHandler usage in fetching chunk when task attempt is odd [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/02/12 06:22:40 UTC, 2 replies.
- [PR] [CELEBORN-1861] Support celeborn.worker.storage.baseDir.diskType option to specify disk type of base directory for worker [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/12 09:33:50 UTC, 3 replies.
- Re: [PR] [CELEBORN-1862] Bump Ratis version from 3.1.2 to 3.1.3 [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/02/12 09:47:11 UTC, 0 replies.
- [PR] [CELEBORN-1863][CIP-14] Add TransportClient to cppClient [celeborn] - posted by "HolyLow (via GitHub)" <gi...@apache.org> on 2025/02/12 10:22:20 UTC, 4 replies.
- Re: [PR] [CELEBORN-894] Add checksum for shuffle data [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/02/12 22:55:04 UTC, 3 replies.
- [PR] [CELEBORN-1864] Bump Netty version from 4.1.115.Final to 4.1.118.Final [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/14 02:47:04 UTC, 1 replies.
- [PR] [CELEBORN-1792][FOLLOWUP] Keep resume for a while after resumeByPinnedMemory [celeborn] - posted by "TheodoreLx (via GitHub)" <gi...@apache.org> on 2025/02/14 03:45:02 UTC, 20 replies.
- Re: [PR] [CELEBORN-1757] Add retry when sending RPC to LifecycleManager [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2025/02/14 08:33:54 UTC, 3 replies.
- [PR] Replace HashSet with ConcurrentHashMap.newKeySet [celeborn] - posted by "aidar-stripe (via GitHub)" <gi...@apache.org> on 2025/02/15 01:25:06 UTC, 6 replies.
- [PR] [CELEBORN-1865] Update master endpointRef when master leader is abnormal [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2025/02/17 07:28:20 UTC, 2 replies.
- [PR] [CELEBORN-1866][Flink] Fix CelebornChannelBufferReader request more buffers than needed [celeborn] - posted by "codenohup (via GitHub)" <gi...@apache.org> on 2025/02/17 10:00:54 UTC, 3 replies.
- [PR] [CELEBORN-1867][Flink] Fix flink client memory leak due to incorrect handing addCredit and notifyRequiredSegment RPCs [celeborn] - posted by "codenohup (via GitHub)" <gi...@apache.org> on 2025/02/17 17:20:25 UTC, 2 replies.
- [PR] [CELEBORN-1868] Fix bug in the presentation of master ui [celeborn] - posted by "taowenjun (via GitHub)" <gi...@apache.org> on 2025/02/17 20:02:03 UTC, 3 replies.
- [PR] Optimize skew partition [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/02/17 21:56:56 UTC, 1 replies.
- [PR] Optimize skew partition conflicts [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/02/17 22:08:35 UTC, 1 replies.
- [PR] [CELEBORN-1872] Bump Flink from 1.19.1, 1.20.0 to 1.19.2, 1.20.1 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/18 09:19:28 UTC, 1 replies.
- [PR] [CELEBORN-1870] Fix typos in in 'Developer' documents [celeborn] - posted by "bgeng777 (via GitHub)" <gi...@apache.org> on 2025/02/18 15:48:22 UTC, 3 replies.
- [PR] [WIP] clean failed shuffle disk [celeborn] - posted by "CodingCat (via GitHub)" <gi...@apache.org> on 2025/02/19 00:42:57 UTC, 0 replies.
- Re: [PR] [CELEBORN-1867][Flink] Fix flink client memory leak of TransportResponseHandler#outstandingRpcs for handling addCredit and notifyRequiredSegment response [celeborn] - posted by "codenohup (via GitHub)" <gi...@apache.org> on 2025/02/19 02:54:03 UTC, 2 replies.
- Re: [PR] [CELEBORN-1800] Introduce ApplicationTotalCount and ApplicationFallbackCount metric to record the total and fallback count of application [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/19 09:25:07 UTC, 0 replies.
- [PR] [CELEBORN-1871][CIP-14] Add NettyRpcEndpointRef to cppClient [celeborn] - posted by "HolyLow (via GitHub)" <gi...@apache.org> on 2025/02/19 12:12:49 UTC, 3 replies.
- Re: [PR] [CELEBORN-1844][CIP-8] introduce tier writer proxy and simplify partition data writer [celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2025/02/20 02:41:29 UTC, 2 replies.
- [PR] [CELEBORN-1793] Add netty pinned memory metrics [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2025/02/20 12:36:41 UTC, 0 replies.
- [PR] [CELEBORN-1857] Support LocalPartitionReader read partition by chunkOffsets when enable optimize skew partition read [celeborn] - posted by "wangshengjie123 (via GitHub)" <gi...@apache.org> on 2025/02/21 06:18:11 UTC, 3 replies.
- [PR] Topology [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/02/24 00:17:39 UTC, 0 replies.
- [PR] [CELEBORN-1876] Log remote address on RPC exception for TransportRequestHandler [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/24 08:30:18 UTC, 2 replies.
- [PR] [CELEBORN-1877] Bump zstd-jni version from 1.5.2-1 to 1.5.7-1 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/24 09:38:49 UTC, 4 replies.
- [PR] [CELEBORN-1319] Support DfsPartitionReader read partition by chunkOffsets when enable optimize skew partition read [celeborn] - posted by "Z1Wu (via GitHub)" <gi...@apache.org> on 2025/02/24 14:48:01 UTC, 0 replies.
- [PR] [CELEBORN-1878] Shuffle the available workers to randomize the order for rack awareness during slot offering [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/02/24 23:49:17 UTC, 1 replies.
- Re: [PR] [CELEBORN-1878] Support to shuffle the available workers to randomize the order for rack awareness during slot assign [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/02/25 02:31:53 UTC, 2 replies.
- [PR] [CELEBORN-1879] Ignore invalid chunk range generated by splitSkewedPartitionLocations [celeborn] - posted by "Z1Wu (via GitHub)" <gi...@apache.org> on 2025/02/25 03:53:33 UTC, 5 replies.
- Re: [PR] [CELEBORN-1858] Support DfsPartitionReader read partition by chunkOffsets when enable optimize skew partition read [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2025/02/25 07:46:58 UTC, 9 replies.
- [PR] [WIP]Support stage-rerun when read partition by chunkOffsets when enable optimize skew partition read [celeborn] - posted by "wangshengjie123 (via GitHub)" <gi...@apache.org> on 2025/02/25 08:46:51 UTC, 1 replies.
- [PR] [CELEBORN-1764][CIP-11] Adding support for TagsQL for filtering workers tags [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2025/02/26 06:43:58 UTC, 1 replies.
- Re: [PR] [CELEBORN-1875] Support to get workers topology information with RESTful api [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/26 08:27:40 UTC, 1 replies.
- [PR] [CELEBORN-1875][FOLLOWUP] Support master --show-workers-topology command to show registered workers topology [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/26 09:31:33 UTC, 3 replies.
- [PR] [CELEBORN-1882] Support configuring the SSL handshake timeout for SSLHandler [celeborn] - posted by "rmcyang (via GitHub)" <gi...@apache.org> on 2025/02/26 23:30:55 UTC, 30 replies.
- Re: [PR] [CELEBORN-1883] Replace HashSet with ConcurrentHashMap.newKeySet for ShuffleFileGroups [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2025/02/27 02:27:43 UTC, 1 replies.
- [PR] [CELEBORN-1884] Bump rocksdbjni version from 9.5.2 to 9.10.0 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/27 03:45:23 UTC, 1 replies.
- [PR] [CELEBORN-1683] Support to check worker versions [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/02/27 05:12:32 UTC, 1 replies.
- Re: [PR] [CELEBORN-1683] Support to get worker versions with RESTful api [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/02/27 07:33:51 UTC, 5 replies.
- [PR] [CELEBORN-1319][FOLLOWUP] Fix IndexOutOfBoundsException when using old celeborn client [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2025/02/27 22:06:49 UTC, 2 replies.
- [PR] [CELEBORN-1867][0.5] Fix flink client memory leak of TransportResponseHandler#outstandingRpcs for handling addCredit response [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2025/02/28 00:07:01 UTC, 2 replies.
- [PR] Improve the state reconciliation on worker restart [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2025/02/28 02:24:35 UTC, 0 replies.
- [PR] [CELEBORN-1886]Enable read from replicated partitionLocation in sort-free skew optimization when replicated partitionLocation and primaryLocation have same chunk range [celeborn] - posted by "Z1Wu (via GitHub)" <gi...@apache.org> on 2025/02/28 14:48:21 UTC, 0 replies.
- Re: [PR] [CELEBORN-1886]Enable read from replicated partitionLocation in sort-free skew optimization when replicated partitionLocation and primary partitionLocation have same chunk range [celeborn] - posted by "Z1Wu (via GitHub)" <gi...@apache.org> on 2025/02/28 14:50:44 UTC, 0 replies.