You are viewing a plain text version of this content. The canonical link for it is here.
- Re: [PR] [CELEBORN-1318] Support celeborn http authentication [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/05/01 04:48:05 UTC, 8 replies.
- Re: [PR] [CELEBORN-1317][FOLLOWUP] Fix threadDump UT stuck issue [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/05/01 16:06:19 UTC, 5 replies.
- Re: [PR] [CELEBORN-1369] Support for disable fallback to Spark's default shuffle [celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2024/05/03 06:32:48 UTC, 0 replies.
- [PR] [CELEBORN-1406] Use Files.readAttributes to find last modified time instead of file.lastModified [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/05/04 10:34:01 UTC, 6 replies.
- Re: [PR] [CELEBORN-1404][BUILD] Disable SBT ANSI color on extracting info from output [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/05 11:38:54 UTC, 0 replies.
- Re: [PR] [CELEBORN-1405][BUILD] SBT allows using credential without a realm [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/05 11:46:39 UTC, 0 replies.
- Re: [PR] [CELEBORN-1402] SparkShuffleManager print warning log for spark.executor.userClassPathFirst=true with ShuffleManager defined in user jar [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/05 12:00:30 UTC, 41 replies.
- Re: [PR] [CELEBORN-1270] Introduce PbPackedPartitionLocations to (de-)serialize PartitionLocations more efficiently [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/05/06 01:46:32 UTC, 11 replies.
- [PR] [CELEBORN-1470] Rotate redirected stdout logs [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/05/06 03:36:17 UTC, 0 replies.
- [PR] [CELEBORN-1408] workerShuffleCommitTimeout should use millisecond units [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/05/06 04:51:48 UTC, 2 replies.
- [PR] [CELEBORN-1409] CommitHandler commitFiles RPC supports separate timeout configuration [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/05/06 05:05:21 UTC, 8 replies.
- [PR] [CELEBORN-1398] Support return leader ip to client. [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/05/06 06:00:04 UTC, 2 replies.
- Re: [PR] [CELEBORN-1407] Rotate redirected stdout logs [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/06 07:22:43 UTC, 4 replies.
- [PR] [CELEBORN-1411] Change default log level to INFO when there is no log4j2 config file [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/05/06 07:52:36 UTC, 1 replies.
- Re: [PR] [CELEBORN-1407] Change log4j2 template appender to file [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/05/06 08:12:57 UTC, 0 replies.
- Re: [PR] [CELEBORN-914] Support memory file storage [celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2024/05/06 10:03:18 UTC, 11 replies.
- Re: [PR] [WIP][CELEBORN-1319] Optimize skew partition logic for Reduce Mode to avoid sorting shuffle files [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/05/06 11:38:20 UTC, 3 replies.
- [PR] [CELEBORN-1412] celeborn.client.rpc.*.askTimeout should fallback to celeborn.rpc.askTimeout [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/06 12:11:49 UTC, 4 replies.
- Re: [PR] [CELEBORN-1398] Support return leader ip to client [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/06 13:05:15 UTC, 5 replies.
- Re: [PR] [CELEBORN-1406] Use Files. getLastModifiedTime to find last modified time instead of file.lastModified [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/05/07 04:15:09 UTC, 2 replies.
- [PR] [CELEBORN-1245][FOLLOWUP] Fix SendWorkerEvent in HA mode. [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/05/07 05:27:39 UTC, 1 replies.
- Re: [PR] [CELEBORN-1245][FOLLOWUP] Fix SendWorkerEvent in HA mode [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/07 07:16:57 UTC, 0 replies.
- [PR] [CELEBORN-1369][FOLLOWUP] Improve docs for shuffle fallback policy [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/07 09:17:49 UTC, 10 replies.
- [PR] [CELEBORN-1317][FOLLOWUP] Improve parameters, description and document of REST API [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/08 07:36:26 UTC, 14 replies.
- [PR] [CELEBORN-1006][FOLLOWUP] Dependency hadoop-client should exclude hadoop-mapreduce-client dependencies for Hadoop 2 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/09 07:00:52 UTC, 3 replies.
- [PR] [CELEBORN-1414] PartitionFilesSorter resolve DiskFileInfo without sorting lock [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/09 11:03:12 UTC, 5 replies.
- [PR] [CELEBORN-1415][HELM] Refactor the charts to achieve better robustness and availability [celeborn] - posted by "ChenYi015 (via GitHub)" <gi...@apache.org> on 2024/05/10 06:20:56 UTC, 44 replies.
- Re: [PR] [CELEBORN-1400] Bump Ratis version from 2.5.1 to 3.0.1 [celeborn] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2024/05/10 07:43:40 UTC, 10 replies.
- [PR] [CELEBORN-1418] MapReduce client support Hadoop 2 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/10 08:56:22 UTC, 12 replies.
- [PR] [CELEBORN-1419] Avoid adding shuffle id repeatedly [celeborn] - posted by "huangxiaopingRD (via GitHub)" <gi...@apache.org> on 2024/05/11 08:54:16 UTC, 2 replies.
- [PR] [CELEBORN-1310][FOLLOWUP] License check add flink-1.19 profile [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/12 20:31:19 UTC, 2 replies.
- [PR] [CELEBORN-1420] Fix mapreduce job will throw an exit exception after it succeeded [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/05/13 09:38:00 UTC, 1 replies.
- [PR] [CELEBORN-1421] Refine code in master to reduce unnecessary sync to get workers/lostworkers/shutdownWorkers. [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/05/14 03:46:20 UTC, 2 replies.
- [PR] [CELEBORN-1422] Remove tmpRecords array when collecting written count metrics [celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2024/05/14 03:53:07 UTC, 1 replies.
- Re: [PR] [CELEBORN-1415][HELM] Move all the master and worker resource manifests to dedicated directories respectively [celeborn] - posted by "ChenYi015 (via GitHub)" <gi...@apache.org> on 2024/05/14 04:03:10 UTC, 2 replies.
- [PR] [CELEBORN-1415][HELM] Refactor chart templates and update readme docs [celeborn] - posted by "ChenYi015 (via GitHub)" <gi...@apache.org> on 2024/05/14 06:22:12 UTC, 1 replies.
- Re: [PR] [CELEBORN-1415][FOLLOWUP][HELM] Refactor chart templates and update readme docs [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/14 07:54:42 UTC, 0 replies.
- Re: [PR] [CELEBORN-1423][HELM] Refactor chart templates and update readme docs [celeborn] - posted by "ChenYi015 (via GitHub)" <gi...@apache.org> on 2024/05/14 08:29:45 UTC, 19 replies.
- [PR] [CELEBORN-1424] Fix getChunk NPE when enable local read [celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2024/05/14 10:02:25 UTC, 2 replies.
- Re: [PR] [CELEBORN-1425][HELM] Add helm chart unit tests to ensure manifests are rendered as expected Edit Add comment [celeborn] - posted by "ChenYi015 (via GitHub)" <gi...@apache.org> on 2024/05/15 02:50:45 UTC, 1 replies.
- [PR] [CELEBORN-1425][HELM] Add helm chart unit tests to ensure manifests are rendered as expected [celeborn] - posted by "ChenYi015 (via GitHub)" <gi...@apache.org> on 2024/05/15 02:58:41 UTC, 12 replies.
- Re: [PR] [CELEBORN-1378] Call PartitionDataWriter#flush() before submitting to commitThreadPool [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/15 08:31:39 UTC, 2 replies.
- Re: [PR] [CELEBORN-1361] MaxInFlightPerWorker should use the value provided by PushStrategy [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/15 08:31:41 UTC, 3 replies.
- Re: [PR] [CELEBORN-1340] Congestion control slow start logic should make all interval can be customized and make it smaller [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/15 08:31:42 UTC, 2 replies.
- Re: [PR] [CELEBORN-1337] Optimize WorkerInfo in WorkerStatusTracker by removing unused fields [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/05/15 08:31:44 UTC, 1 replies.
- [PR] [CELEBORN-1416] Add CI for helm charts lint and test [celeborn] - posted by "ChenYi015 (via GitHub)" <gi...@apache.org> on 2024/05/16 03:46:12 UTC, 12 replies.
- [PR] [CELEBORN-1428] WrappedRpcResponseCallback should stop timer of PrimaryPushDataTime and ReplicaPushDataTime for failure [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/16 07:05:41 UTC, 1 replies.
- [PR] CELEBORN-1401: Add SSL support for raft comms using ratis [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/05/16 07:32:11 UTC, 0 replies.
- Re: [PR] [CELEBORN-1401] Add SSL support for ratis communication [celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2024/05/16 07:34:51 UTC, 5 replies.
- [PR] [CELEBORN-1429] Use log level DEBUG instead of TRACE to avoid revent excessive CPU consumption [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/16 07:34:53 UTC, 1 replies.
- [PR] [CELEBORN-1430] TransportClientFactory should check whether handler is null when creating client [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/16 09:52:37 UTC, 2 replies.
- [PR] [CELEBORN-1431][HELM] Expose release_name in PodMonitor [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/16 12:57:50 UTC, 7 replies.
- [I] Performance is not improved for more than 10 tables join [celeborn] - posted by "njalan (via GitHub)" <gi...@apache.org> on 2024/05/17 06:38:08 UTC, 0 replies.
- Re: [I] Performance is not improved for too complex query [celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2024/05/17 06:39:42 UTC, 0 replies.
- [PR] [CELEBORN-1427] Add TotalCapacity/TotalFreeCapacity metrics for Celeborn [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/05/17 07:45:32 UTC, 6 replies.
- [I] [FEATURE] why celeborn not support flink 1.16 [celeborn] - posted by "y0908105023 (via GitHub)" <gi...@apache.org> on 2024/05/20 02:27:10 UTC, 1 replies.
- [PR] [CELEBORN-1410] combine multiple ShuffleBlockInfo into a single ShuffleBlockInfo [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/05/21 14:21:10 UTC, 11 replies.
- [PR] [CELEBORN-1434] Support MRAppMasterWithCeleborn to disable job recovery and job reduce slow start by default [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/22 06:41:05 UTC, 1 replies.
- Re: [PR] [CELEBORN-1410] Combine multiple ShuffleBlockInfo into a single ShuffleBlockInfo [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/05/22 07:10:19 UTC, 16 replies.
- [PR] [CELEBORN-1380][FOLLOWUP] Add org.openlabtesting.leveldbjni in BSD 3-clause of LICENSE-binary [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/22 07:29:18 UTC, 2 replies.
- Re: [PR] [CELEBORN-1427] Add Capacity metrics for Celeborn [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/05/23 03:58:12 UTC, 4 replies.
- [PR] [CELEBORN-1438] Exclude celeborn-service_xx-test jar. [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/05/23 06:36:50 UTC, 1 replies.
- [PR] [MINOR] Remove incubator in vcs.xml [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/05/24 10:43:03 UTC, 3 replies.
- [PR] [CELEBORN-1337] remove unused fields from HeartbeatFromApplicationResponse [celeborn] - posted by "ErikFang (via GitHub)" <gi...@apache.org> on 2024/05/25 14:48:54 UTC, 2 replies.
- Re: [PR] [CELEBORN-1144] Batch OpenStream RPCs [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/05/26 06:24:24 UTC, 3 replies.
- [PR] [CELEBORN-1380][FOLLOWUP] leveldbjni uses org.openlabtesting.leveldbjni to support linux aarch64 platform for leveldb via aarch64 profile [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/26 10:02:45 UTC, 4 replies.
- [PR] [CELEBORN-1432] ShuffleClientImpl should invoke loadFileGroupInternal only once when using the reduce partition mode [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/27 13:05:09 UTC, 2 replies.
- [PR] [CELEBORN-1439] Fix revive logic bug which will casue data correctness issue and job failiure [celeborn] - posted by "wangshengjie123 (via GitHub)" <gi...@apache.org> on 2024/05/28 03:11:29 UTC, 1 replies.
- Re: [PR] [CELEBORN-1335] RpcTimeoutException should inherit from CelebornIOException [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/28 12:55:30 UTC, 0 replies.
- Re: [PR] [CELEBORN-1334][BUILD] Client side should not import unnecessary deps [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/28 12:56:25 UTC, 0 replies.
- [PR] [CELEBORN-1441] RocksDBLogger uses Logger#Logger(InfoLogLevel) instead of deprecated constructor of o.rocksdb.Logger [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/05/29 00:55:45 UTC, 1 replies.
- [PR] [CELEBORN-1388][FOLLOWUP] Prevent subsequent changePartition from being processed when a previous request exists and batchHandleChangePartitionEnabled is false [celeborn] - posted by "onyourhead (via GitHub)" <gi...@apache.org> on 2024/05/29 06:44:44 UTC, 2 replies.
- Re: [PR] [WIP][CELEBORN-1439] Fix revive logic bug which will casue data correctness issue and job failiure [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/05/30 03:44:01 UTC, 0 replies.
- [PR] [CELEBORN-1444] Introduce worker decommission metrics [celeborn] - posted by "leixm (via GitHub)" <gi...@apache.org> on 2024/05/31 08:06:55 UTC, 2 replies.
- [PR] [CELEBORN-1445] handle NPE when open stream [celeborn] - posted by "zwangsheng (via GitHub)" <gi...@apache.org> on 2024/05/31 12:41:23 UTC, 0 replies.
- [I] [FEATURE] Support HPA settings for worker nodes [celeborn] - posted by "tcodehuber (via GitHub)" <gi...@apache.org> on 2024/05/31 15:52:14 UTC, 0 replies.