You are viewing a plain text version of this content. The canonical link for it is here.
- [PR] [CELEBORN-1443] Remove ratis dependencies from common module [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/01 10:15:02 UTC, 2 replies.
- Re: [PR] [CELEBORN-1445] handle NPE when open stream [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/06/03 01:43:17 UTC, 4 replies.
- Re: [PR] [CELEBORN-1444] Introduce worker decommission metrics [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/06/03 02:03:20 UTC, 25 replies.
- Re: [PR] [CELEBORN-1439] Fix revive logic bug which will casue data correctness issue and job failiure [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/06/03 03:10:03 UTC, 7 replies.
- [PR] [CELEBORN-1447] Support configuring thread number of worker to wait for commit shuffle data files to finish [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/03 03:52:59 UTC, 2 replies.
- [PR] [CELEBORN-1389] Bump Dropwizard version from 3.2.6 to 4.2.25 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/03 08:09:05 UTC, 4 replies.
- [PR] [CELEBORN-1448] Use static regex Pattern instances in JavaUtils.timeStringAs and JavaUtils.byteStringAs [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/06/03 10:37:39 UTC, 2 replies.
- [PR] [CELEBORN-1182][FOLLOWUP] Fix WorkerSource record application active connection for application dimension ActiveConnectionCount metric [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/03 12:40:48 UTC, 1 replies.
- [PR] [CELEBORN-1449] Fix JavaUtils#deleteRecursivelyUsingJavaIO to skip non-existing file input [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/03 17:30:32 UTC, 2 replies.
- [PR] [CELEBORN-1327][FOLLOWUP] Simplify DirectByteBuffer constructor lookup logic [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/04 03:58:42 UTC, 8 replies.
- [PR] [CELEBORN-1450] MRAppMasterWithCeleborn should get FileSystem via mapreduce.job.dir for HDFS federation [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/04 12:40:41 UTC, 1 replies.
- Re: [I] [FEATURE] Support HPA settings for worker nodes [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/05 08:45:26 UTC, 2 replies.
- [PR] [CELEBORN-1182][FOLLOWUP] WorkerSource should use Counter to support application dimension ActiveConnectionCount metric [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/05 11:53:14 UTC, 2 replies.
- Re: [PR] [CELEBORN-1444] Introduce worker decommission metrics and corresponding REST API [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2024/06/06 06:25:36 UTC, 26 replies.
- [PR] [CELEBORN-1452] Master follower node metadata is out of sync after installing snapshot [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2024/06/07 05:12:21 UTC, 17 replies.
- [PR] [CELEBORN-1453] Fix the thread safety bug in getMetrics [celeborn] - posted by "littlexyw (via GitHub)" <gi...@apache.org> on 2024/06/07 05:25:18 UTC, 3 replies.
- Re: [PR] [CELEBORN-1337] Optimize WorkerInfo in WorkerStatusTracker by removing unused fields [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/06/07 08:28:32 UTC, 1 replies.
- [PR] [CELEBORN-1446] Enable chunk prefetch when initialize CelebornInputStream [celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2024/06/09 11:55:37 UTC, 3 replies.
- [PR] [CELEBORN-1200][CORE][WIP] Scheduler Spark Reduce Task Locality with Celeborn Worker [celeborn] - posted by "zwangsheng (via GitHub)" <gi...@apache.org> on 2024/06/10 01:53:53 UTC, 1 replies.
- [PR] [CELEBORN-1455] Remove improper configs from config template [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/06/11 03:15:02 UTC, 5 replies.
- [PR] [CELEBORN-1456] Fix LICENSE dependencies in LICENSE-binary [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/11 04:31:03 UTC, 1 replies.
- [PR] [CELEBORN-1403] Update celeborn configuration about offheap memory [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/06/11 05:41:09 UTC, 1 replies.
- [PR] [CELEBORN-1457] Avoid NPE during shuffle data cleanup [celeborn] - posted by "jiang13021 (via GitHub)" <gi...@apache.org> on 2024/06/11 06:42:22 UTC, 6 replies.
- [PR] [CELEBORN-1458][DOC] Add doc for decommission [celeborn] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/06/11 10:05:42 UTC, 8 replies.
- [PR] [CELEBORN-1190][FOLLOWUP] Fix WARNING of error prone [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/11 10:17:46 UTC, 7 replies.
- [PR] [CELEBORN-1456][FOLLOWUP] Fix license issue [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/06/11 12:52:33 UTC, 4 replies.
- Re: [PR] [CELEBORN-1458][DOC] Introduce worker decommission document [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/12 04:00:06 UTC, 6 replies.
- [PR] [CELEBORN-1459] Introduce CleanTaskQueueSize and CleanExpiredShuffleKeysTime to record situation of cleaning up expired shuffle keys [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/12 07:58:16 UTC, 8 replies.
- Re: [PR] [CELEBORN-1458][DOC] Introduce decommissioning document [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/12 08:31:24 UTC, 17 replies.
- [PR] [CELEBORN-1460] MRAppMasterWithCeleborn supports setting mapreduce.celeborn.master.endpoints via environment variable CELEBORN_MASTER_ENDPOINTS [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/12 12:09:24 UTC, 5 replies.
- Re: [PR] [CELEBORN-1337] Remove unused fields from HeartbeatFromApplicationResponse [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/06/13 02:15:10 UTC, 1 replies.
- [PR] [CELEBORN-1337][FOLLOWUP] Fix compile problem [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/06/13 03:16:51 UTC, 1 replies.
- [PR] [MINOR] Bump minikube and kubernetes version to fix integration test [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/13 05:11:07 UTC, 0 replies.
- Re: [PR] [MINOR] Bump minikube and kubernetes version of integration test [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/06/13 05:37:19 UTC, 1 replies.
- Re: [PR] [CELEBORN-1258] Add UserIdentifier to the master application meta [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/13 06:18:37 UTC, 0 replies.
- [PR] [CELEBORN-1182][FOLLOWUP] Worker should remove application active connection via clean thread pool [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/13 08:15:31 UTC, 6 replies.
- [PR] [CELEBORN-775][FOLLOWUP] Fix executorCores calculation in SparkShuffleManager for Spark2 local mode [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/06/13 09:13:33 UTC, 3 replies.
- [PR] [CELEBORN-1452][0.4] Master follower node metadata is out of sync after installing snapshot [celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2024/06/13 13:51:22 UTC, 2 replies.
- [PR] CELEBORN-1461: Fix Celeborn ipv6 local hostname resolution [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2024/06/13 18:12:35 UTC, 2 replies.
- [PR] [CELEBORN-1457][0.4] Avoid NPE during shuffle data cleanup [celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2024/06/14 02:49:54 UTC, 2 replies.
- [PR] [CELEBORN-1453][0.4] Fix the thread safety bug in getMetrics [celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2024/06/14 02:56:07 UTC, 1 replies.
- [PR] [CELEBORN-1432][0.4] ShuffleClientImpl should invoke loadFileGroupInternal only once when using the reduce partition mode [celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2024/06/14 03:03:07 UTC, 1 replies.
- [PR] [MINOR][0.4] Bump minikube and kubernetes version of integration test [celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2024/06/14 03:41:46 UTC, 2 replies.
- Re: [PR] [CELEBORN-1461] Fix Celeborn ipv6 local hostname resolution [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2024/06/14 04:13:49 UTC, 19 replies.
- [PR] [CELEBORN-1462] Fix layout of DeviceCelebornTotalBytes, DeviceCelebornFreeBytes, RunningApplicationCount and DecommissionWorkerCount in celeborn-dashboard.json [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/14 04:37:29 UTC, 2 replies.
- Re: [PR] [CELEBORN-1318] Support celeborn http authentication [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/06/14 22:00:59 UTC, 5 replies.
- [PR] [CELEBORN-1463] Create network memory allocator with celeborn.network.memory.allocator.numArenas [celeborn] - posted by "zwangsheng (via GitHub)" <gi...@apache.org> on 2024/06/16 08:50:48 UTC, 5 replies.
- [PR] [CELEBORN-1463][FOLLOWUP] Respeact client/server threads num to avoid competitiveness [celeborn] - posted by "zwangsheng (via GitHub)" <gi...@apache.org> on 2024/06/17 07:02:59 UTC, 6 replies.
- [PR] [CELEBORN-1460][FOLLOWUP] MRAppMasterWithCeleborn support uri of absolute conf path for mapreduce.job.cache.files [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/18 07:04:21 UTC, 1 replies.
- [PR] [Doc]Update HA doc [celeborn] - posted by "zhaohehuhu (via GitHub)" <gi...@apache.org> on 2024/06/18 10:01:16 UTC, 1 replies.
- Re: [PR] [CELEBORN-1465] Update docs remove unused node id [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/06/18 10:25:29 UTC, 0 replies.
- [PR] [CELEBORN-1402][FOLLOWUP] Correct document of setting spark.executor.userClassPathFirst to false [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/18 11:15:48 UTC, 1 replies.
- [PR] [CELEBORN-1466] Add local command in celeborn_ratis_shell.md [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/18 12:42:07 UTC, 1 replies.
- [PR] [CELEBORN-1467] celeborn.worker.storage.dirs should support soft link [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2024/06/21 14:25:42 UTC, 2 replies.
- [PR] [CELEBORN-1468] update dashboard layout for Celeborn 0.5 [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/06/21 14:25:59 UTC, 0 replies.
- [PR] [CELEBORN-1473] TransportClientFactory should register netty memory metric with source for shared pooled ByteBuf allocator [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/23 06:29:30 UTC, 1 replies.
- Re: [PR] [CELEBORN-1475] Fix unknownExcludedWorkers filter for /exclude request [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/23 06:32:22 UTC, 1 replies.
- Re: [PR] [WIP][CELEBORN-1319] Optimize skew partition logic for Reduce Mode to avoid sorting shuffle files [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/06/23 08:30:25 UTC, 0 replies.
- Re: [PR] Api v1 [celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2024/06/23 16:52:38 UTC, 0 replies.
- Re: [PR] [CELEBORN-1476] Enhance the RESTful response error msg [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/23 19:24:42 UTC, 1 replies.
- Re: [PR] [CELEBORN-1477] Refine the master/worker RESTful APIs [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/06/23 21:16:19 UTC, 4 replies.
- [PR] [CELEBORN-INNER] Fix wrong use partitionId as shuffleId when readPartition [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/06/24 01:07:29 UTC, 0 replies.
- Re: [PR] [CELEBORN-1472] Reduce CongestionController#userBufferStatuses call times. [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2024/06/24 02:24:53 UTC, 2 replies.
- Re: [PR] [CELEBORN-1478] Fix wrong use partitionId as shuffleId when readPartition [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/06/24 03:44:19 UTC, 0 replies.
- [PR] [CELEBORN-1479] Report register shuffle failed reason in exception [celeborn] - posted by "jiang13021 (via GitHub)" <gi...@apache.org> on 2024/06/24 07:20:06 UTC, 0 replies.