You are viewing a plain text version of this content. The canonical link for it is here.
- [GitHub] [incubator-celeborn] d3kum1d0r1y4 opened a new pull request, #1952: Test - posted by "d3kum1d0r1y4 (via GitHub)" <gi...@apache.org> on 2023/10/02 01:28:04 UTC, 0 replies.
- [GitHub] [incubator-celeborn] d3kum1d0r1y4 closed pull request #1952: Test - posted by "d3kum1d0r1y4 (via GitHub)" <gi...@apache.org> on 2023/10/02 01:28:11 UTC, 0 replies.
- Re: [PR] [CELEBORN-1002] Add SBT MRClientProject [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/06 03:29:01 UTC, 4 replies.
- [PR] [CELEBORN-1003][0.3][FOLLOWUP] Add missing protobuf license file into spark shaded client jars [incubator-celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/07 02:32:20 UTC, 3 replies.
- [PR] [CELEBORN-1017] Make checkPushTimeout and checkFetchTimeout conditions independent [incubator-celeborn] - posted by "jiaoqingbo (via GitHub)" <gi...@apache.org> on 2023/10/07 03:12:04 UTC, 7 replies.
- [PR] [CELEBORN-1010] Update docs about `spark.shuffle.service.enabled` [incubator-celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2023/10/07 07:30:04 UTC, 6 replies.
- Re: [PR] [CELEBORN-980] Asynchronously delete original files to fix `ReusedExchange` bug [incubator-celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2023/10/07 07:51:57 UTC, 9 replies.
- [PR] [CELEBORN-1018] Fix throw exception when exec create-package.sh script [incubator-celeborn] - posted by "xleoken (via GitHub)" <gi...@apache.org> on 2023/10/08 03:12:26 UTC, 5 replies.
- Re: [PR] [CELEBORN-983] Rename PrometheusMetric configuration [incubator-celeborn] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2023/10/08 08:15:34 UTC, 3 replies.
- [PR] [CELEBORN-1020] Remove outdated info in README.md file [incubator-celeborn] - posted by "zgzzbws (via GitHub)" <gi...@apache.org> on 2023/10/08 16:04:53 UTC, 1 replies.
- [PR] [CELEBORN-1022][TEST] Update log level from `FATAL` to `ERROR` for console output in unit tests [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/09 02:56:25 UTC, 5 replies.
- [PR] [CELEBORN-817] PushMergedData should also check disk usage and trigger Split [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/09 03:16:01 UTC, 3 replies.
- [PR] [CELEBORN-1023] The notifyBacklog method should send PbBacklogAnnouncement instead of BacklogAnnouncement [incubator-celeborn] - posted by "jiaoqingbo (via GitHub)" <gi...@apache.org> on 2023/10/09 03:17:15 UTC, 5 replies.
- Re: [PR] [CELEBORN-999] MR deps check [incubator-celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/09 04:56:02 UTC, 4 replies.
- [PR] [CELEBORN-1024] Thread factory should set UncaughtExceptionHandler to handle uncaught exception [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/09 07:48:14 UTC, 14 replies.
- [PR] [CELEBORN-1026] Optimize registerShuffle fallback log [incubator-celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/09 10:40:14 UTC, 3 replies.
- [PR] [CELEBORN-688] Add JVM metrics grafana template [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/09 10:43:47 UTC, 14 replies.
- [PR] [CELEBORN-1028] Make prometheus path configurable [incubator-celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/09 14:02:23 UTC, 7 replies.
- [PR] [CELEBORN-1030] Improve the logic of delete md5 files when initializing SimpleStateMachineStorage [incubator-celeborn] - posted by "xleoken (via GitHub)" <gi...@apache.org> on 2023/10/10 02:19:26 UTC, 19 replies.
- [PR] [CELEBORN-1031] SBT correct the LICENSE and NOTICE for shaded client jars [incubator-celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/10 04:43:20 UTC, 15 replies.
- [PR] [CELEBORN-1019] Avoid magic strings copy from Spark SQLConf [incubator-celeborn] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/10 04:55:04 UTC, 7 replies.
- [PR] [CELEBORN-1021] Celeborn support arbitary ratis configs and client rpc timeout [incubator-celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2023/10/10 07:22:46 UTC, 0 replies.
- [PR] [CELEBORN-1032][WORKER] Use scheduleWithFixedDelay instead of scheduleAtFixedRate in worker timeout check threads pool [incubator-celeborn] - posted by "zwangsheng (via GitHub)" <gi...@apache.org> on 2023/10/10 08:06:35 UTC, 6 replies.
- Re: [PR] [CELEBORN-1021] Celeborn support arbitary Ratis configs and client rpc timeout [incubator-celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2023/10/10 08:11:02 UTC, 9 replies.
- [PR] [MINOR] Fix typo in CelebornConf [incubator-celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/10 08:28:20 UTC, 2 replies.
- Re: [PR] [CELEBORN-955] Re-run Spark Stage for Celeborn Shuffle Fetch Failure [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/10 08:54:36 UTC, 60 replies.
- [PR] [CELEBORN-1033] MasterNotLeaderException should provide the cause of exception [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/10 09:53:39 UTC, 12 replies.
- [PR] [CELEBORN-665] Skip empty app snapshot logs [incubator-celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/10 11:06:55 UTC, 2 replies.
- [PR] [CELEBORN-1028][FOLLOWUP][DOCS] Make prometheus path configurable [incubator-celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/10 12:56:43 UTC, 3 replies.
- [PR] [CELEBORN-1034] Offer slots uses random range of available workers instead of shuffling [incubator-celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2023/10/10 14:19:19 UTC, 5 replies.
- [PR] [CELEBORN-1035] Expose ApplicationCount, PartitionWritten and PartitionFileCount metric by Celeborn master [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/11 10:10:15 UTC, 14 replies.
- Re: [PR] [CELEBORN-970][HELM] Centralize Celeborn labels definition [incubator-celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2023/10/11 11:37:45 UTC, 0 replies.
- [PR] [MINOR] Improve HttpRequestHandler handle HTTP request with base, master and worker [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/12 02:42:52 UTC, 1 replies.
- Re: [PR] [CELEBORN-973] Improve HttpRequestHandler handle HTTP request with base, master and worker [incubator-celeborn] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2023/10/12 03:14:14 UTC, 4 replies.
- [PR] [CELEBORN-1036] Map task hangs at limitZeroInFlight due to duplicate onFailure called [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/12 03:29:37 UTC, 9 replies.
- Re: [PR] [CELEBORN-1007] Improve JVM metrics naming and add ThreadStates metrics [incubator-celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2023/10/12 03:40:37 UTC, 0 replies.
- [PR] [MINOR] Fix wrong description about app list [incubator-celeborn] - posted by "xleoken (via GitHub)" <gi...@apache.org> on 2023/10/12 08:42:25 UTC, 2 replies.
- [PR] [CELEBORN-1038] Clean up deprecated api [incubator-celeborn] - posted by "zml1206 (via GitHub)" <gi...@apache.org> on 2023/10/12 08:43:50 UTC, 4 replies.
- [PR] [CELEBORN-1037] Incorrect output for metrics of Prometheus [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/12 09:22:05 UTC, 6 replies.
- [PR] [CELEBORN-772] Convert StreamChunkSlice, ChunkFetchRequest, TransportableError to PB [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/12 10:19:08 UTC, 5 replies.
- [PR] [MINOR] Fix some typos [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/12 10:45:56 UTC, 2 replies.
- [PR] [HOTFIX][CELEBORN-1033] MasterNotLeaderException should provide the cause of exception [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/12 12:35:13 UTC, 0 replies.
- Re: [PR] [CELEBORN-1033][FOLLOWUP] MasterNotLeaderException should provide the cause of exception [incubator-celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2023/10/12 12:47:25 UTC, 1 replies.
- [PR] [CELEBORN-987][DOC] README#Build should extend to Java8/11/17 [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/12 13:32:24 UTC, 5 replies.
- [PR] [CELEBORN-829] Improve response message of invalid HTTP request [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/13 06:11:16 UTC, 9 replies.
- [PR] [CELEBORN-987][FOLLOWUP][DOC] README#Build and sbt#System Requirements should extend to Scala 2.13 [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/13 08:30:21 UTC, 4 replies.
- Re: [I] Please open new issues in JIRA [incubator-celeborn] - posted by "woshiwuxiaofei (via GitHub)" <gi...@apache.org> on 2023/10/13 10:05:11 UTC, 1 replies.
- [PR] [CELEBORN-1040] Adjust local read logs and refine createReader [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/13 10:37:32 UTC, 2 replies.
- Re: [PR] [CELEBORN-987][FOLLOWUP][DOC] README#Build and sbt#System Requirements should extend to Scala 2.13 and Spark 3.5 [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/14 01:53:02 UTC, 1 replies.
- [PR] [CELEBORN-1041] Improve the implementation for get the PartitionIdPassthrough class [incubator-celeborn] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/16 03:55:40 UTC, 5 replies.
- [PR] [CELEBORN-1019] Remove duplicate line [incubator-celeborn] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/16 04:20:58 UTC, 0 replies.
- Re: [PR] [CELEBORN-1019][FOLLOWUP] Remove duplicate line [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/16 05:47:49 UTC, 2 replies.
- [I] [Suggestion] Startup master/worker listen on 0.0.0.0 by default [incubator-celeborn] - posted by "xleoken (via GitHub)" <gi...@apache.org> on 2023/10/16 06:26:18 UTC, 4 replies.
- [PR] [CELEBORN-255] Add counter of outstandingFetches, outstandingRpcs and outstandingPushes to metrics [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/16 08:08:11 UTC, 7 replies.
- Re: [PR] [CELEBORN-915][WIP][NOT-MERGE] Add labeler for celeborn ci [incubator-celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/16 08:33:49 UTC, 0 replies.
- Re: [PR] [CELEBORN-759] Multi thread sort a large shuffle file when worker open stream [incubator-celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2023/10/16 08:33:51 UTC, 0 replies.
- [PR] [CELEBORN-299] Deprecate `celeborn.worker.storage.baseDir.prefix` and `celeborn.worker.storage.baseDir.number` [incubator-celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/16 10:35:24 UTC, 2 replies.
- [PR] [CELEBORN-1042] Calculate duration using nanotime in CelebornInputStream [incubator-celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/16 10:46:31 UTC, 2 replies.
- [PR] [CELEBORN-1044] Enhance the check of parameter array length [incubator-celeborn] - posted by "xleoken (via GitHub)" <gi...@apache.org> on 2023/10/17 03:46:28 UTC, 4 replies.
- [PR] [CELEBORN-1043] Convert variable ‘metric’ from String to StringBuilder in toMetric method [incubator-celeborn] - posted by "jiaoqingbo (via GitHub)" <gi...@apache.org> on 2023/10/17 04:05:37 UTC, 2 replies.
- [PR] [CELEBORN-448] Support exclude worker manually [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/17 07:45:56 UTC, 30 replies.
- [PR] [CELEBORN-1046] Add an expiration time configuration for app director… [incubator-celeborn] - posted by "wilsonjie (via GitHub)" <gi...@apache.org> on 2023/10/17 08:52:26 UTC, 1 replies.
- Re: [PR] [CELEBORN-1046] Add an expiration time configuration for app directory to clean up [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/17 09:02:48 UTC, 13 replies.
- [PR] [CELEBORN-1047] Remove conf `celeborn.worker.sortPartition.eagerlyRemoveOriginalFiles.enabled` [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/18 07:05:33 UTC, 2 replies.
- [PR] [WIP]Align fetchWaitTime metrics to spark implementation [incubator-celeborn] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2023/10/18 10:47:04 UTC, 0 replies.
- Re: [PR] [CELEBORN-1048] Align fetchWaitTime metrics to spark implementation [incubator-celeborn] - posted by "TongWei1105 (via GitHub)" <gi...@apache.org> on 2023/10/18 10:57:53 UTC, 4 replies.
- Re: [PR] [CELEBORN-1035] Expose RunningApplicationCount, PartitionWritten and PartitionFileCount metric by Celeborn master [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/19 03:48:08 UTC, 5 replies.
- Re: [PR] [WIP][CELEBORN-1048] Align fetchWaitTime metrics to spark implementation [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/19 03:57:50 UTC, 0 replies.
- [PR] [MINOR] Delete redundant Loggers [incubator-celeborn] - posted by "jiaoqingbo (via GitHub)" <gi...@apache.org> on 2023/10/19 06:21:17 UTC, 2 replies.
- [PR] [CELEBORN-1057] Introduce /partitionStatistics API provider of Celeborn Master for Rest API [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/19 08:22:03 UTC, 2 replies.
- [PR] [CELEBORN-1058] Support specifying the number of dispatcher threads for each role [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/19 10:46:17 UTC, 5 replies.
- [PR] [MINOR] Fix ShutdownHookManager#shutdownExecutor log's unit [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/19 10:54:12 UTC, 2 replies.
- [PR] [CELEBORN-1059] Fix callback not update if push worker excluded during retry [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/20 04:06:27 UTC, 2 replies.
- [PR] fix: quote image tag [incubator-celeborn] - posted by "wusphinx (via GitHub)" <gi...@apache.org> on 2023/10/20 06:03:18 UTC, 0 replies.
- [PR] [MINOR] Adjust log level for `PushDataHandler#checkDiskFullAndSplit` from debug to trace [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/20 07:08:42 UTC, 2 replies.
- Re: [PR] [HELM] Fix: quote image tag [incubator-celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2023/10/20 07:47:55 UTC, 3 replies.
- [PR] [CELEBORN-1060] Fix the master's http port in celeborn default template file [incubator-celeborn] - posted by "xleoken (via GitHub)" <gi...@apache.org> on 2023/10/20 10:09:31 UTC, 0 replies.
- Re: [PR] [CELEBORN-1060] Fix the master's http port conflicts with rpc port in celeborn default template file [incubator-celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2023/10/20 10:23:34 UTC, 1 replies.
- [PR] [CELEBORN-916] Add new metric about active shuffle file count in worker [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/20 11:37:38 UTC, 4 replies.
- Re: [PR] [WIP][CELEBORN-1059] Fix callback not update if push worker excluded during retry [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/20 13:02:39 UTC, 0 replies.
- [PR] [CELEBORN-1061] Fix the bug if shuffle.writer is sort and celeborn.client.spark.push.sort.pipeline.enabled is false [incubator-celeborn] - posted by "beliefer (via GitHub)" <gi...@apache.org> on 2023/10/21 10:08:59 UTC, 0 replies.
- Re: [PR] [CELEBORN-1061] Fix the bug if `celeborn.client.spark.shuffle.writer` is sort and `celeborn.client.spark.push.sort.pipeline.enabled` is false [incubator-celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2023/10/21 10:21:38 UTC, 6 replies.
- [PR] [METRICS] Return metrics snapshot with line delimiter [incubator-celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2023/10/21 14:39:17 UTC, 0 replies.
- Re: [PR] [METRICS] Return metrics snapshot separated by new line [incubator-celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2023/10/21 14:52:14 UTC, 4 replies.
- Re: [PR] [CELEBORN-1062][HELM] Fix: quote image tag [incubator-celeborn] - posted by "wusphinx (via GitHub)" <gi...@apache.org> on 2023/10/21 15:16:37 UTC, 0 replies.
- [PR] Prevent Local variable 'time' declared in one 'switch' branch and used in another [incubator-celeborn] - posted by "bowenliang123 (via GitHub)" <gi...@apache.org> on 2023/10/22 01:14:26 UTC, 0 replies.
- [PR] Minor improvement in numShuffleSteams of ChunkStreamManager [incubator-celeborn] - posted by "bowenliang123 (via GitHub)" <gi...@apache.org> on 2023/10/22 01:23:11 UTC, 2 replies.
- Re: [PR] Prevent the local variable 'time' declared in one 'switch' branch and used in another [incubator-celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2023/10/22 01:26:26 UTC, 1 replies.
- [PR] Using text/plain content type for prometheus metrics [incubator-celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2023/10/22 02:04:41 UTC, 2 replies.
- [PR] [CELEBORN-1064] Rename client module to client-base [incubator-celeborn] - posted by "xleoken (via GitHub)" <gi...@apache.org> on 2023/10/22 06:05:48 UTC, 4 replies.
- Re: [PR] [CELEBORN-1065] Prevent the local variable 'time' declared in one 'switch' branch and used in another [incubator-celeborn] - posted by "bowenliang123 (via GitHub)" <gi...@apache.org> on 2023/10/22 08:31:28 UTC, 2 replies.
- [PR] CELEBORN-1070: Add error-prone to pom.xml. [incubator-celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/22 09:13:13 UTC, 28 replies.
- [PR] CELEBORN-1068: Fix hashCode computation [incubator-celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/22 09:19:22 UTC, 3 replies.
- [PR] CELEBORN-1071: Ensure guardedBy is satisfied, fix DCL bugs as well [incubator-celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/22 09:29:14 UTC, 8 replies.
- [PR] CELEBORN-1072: Fix misc error prone reports found [incubator-celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/22 10:12:36 UTC, 3 replies.
- [PR] CELEBORN-1069: Avoid double brace initialization [incubator-celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/22 10:17:35 UTC, 2 replies.
- Re: [PR] [CELEBORN-1066] Skip looping streamimg sets in numShuffleSteams of ChunkStreamManager [incubator-celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2023/10/22 14:58:20 UTC, 0 replies.
- [PR] [CELEBORN-1073] Use CompositeByteBuf and wrappedBuffer in TransportMessage to skip redundant copying [incubator-celeborn] - posted by "bowenliang123 (via GitHub)" <gi...@apache.org> on 2023/10/22 15:06:47 UTC, 0 replies.
- Re: [PR] [CELEBORN-1073] Prevent redundant byte copying in TransportMessage by using CompositeByteBuf [incubator-celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2023/10/22 15:45:57 UTC, 0 replies.
- [PR] [CELEBORN-1074] Bump Guava from 14.0.1 to 32.1.3 [incubator-celeborn] - posted by "bowenliang123 (via GitHub)" <gi...@apache.org> on 2023/10/23 02:36:26 UTC, 4 replies.
- [PR] [CELEBORN-1075] Refactor `MetricsSystem` and `AbstractSource` to use synchronized blocks [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/23 02:55:24 UTC, 9 replies.
- Re: [PR] [CELEBORN-1076] Using text/plain content type for prometheus metrics [incubator-celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2023/10/23 08:51:27 UTC, 2 replies.
- [PR] [CELEBORN-1007][FOLLOWUP] Exclude unsupported prometheus gauge metrics for jvm thread state [incubator-celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2023/10/23 09:18:55 UTC, 5 replies.
- [PR] [MINOR] Remove unnecessary increment index of Master#timeoutDeadWorkers [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/23 12:12:18 UTC, 5 replies.
- [PR] [CELEBORN-1077] Support to apply basic legend format for all grafana metrics [incubator-celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2023/10/23 13:29:34 UTC, 1 replies.
- Re: [PR] [CELEBORN-1077] Support to apply base legend format for all grafana metrics [incubator-celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2023/10/23 13:39:04 UTC, 0 replies.
- Re: [PR] [CELEBORN-1077][METRICS] Support to apply base legend format for all grafana metrics [incubator-celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2023/10/23 13:51:31 UTC, 1 replies.
- [PR] CELEBORN-1079: Fix use of GuardedBy in client-flink/common [incubator-celeborn] - posted by "mridulm (via GitHub)" <gi...@apache.org> on 2023/10/23 16:41:12 UTC, 4 replies.
- Re: [PR] [CELEBORN-1070] Add error-prone to pom.xml. [incubator-celeborn] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2023/10/24 03:44:50 UTC, 4 replies.
- [PR] [MINOR] Flink shuffle client should close transport client quietly when clean up [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/24 06:20:04 UTC, 9 replies.
- [PR] [CELEBORN-1082] Fixing partition sorter task failures due to duplicate sorting [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/24 07:06:26 UTC, 4 replies.
- [PR] Revert "[CELEBORN-255] Add counter of outstandingFetches, outstanding… [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/24 08:51:34 UTC, 6 replies.
- [PR] [CELEBORN-1083] Refine TimeSlidingHub code [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/24 09:01:33 UTC, 7 replies.
- [PR] [CELEBORN-1084] Initialize `workerSource` member to prevent `NullPointException` [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/24 11:23:05 UTC, 2 replies.
- [PR] [CELEBORN-1085] Update metrics doc [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/24 11:37:18 UTC, 2 replies.
- [PR] Fix JVM metrics grafana [incubator-celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2023/10/24 12:14:47 UTC, 0 replies.
- Re: [PR] [CELEBORN-1086] Fix JVM metrics grafana expression issue [incubator-celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2023/10/24 12:20:29 UTC, 4 replies.
- [PR] [CELEBORN-1087] Remove SimpleStateMachineStorageUtil in master module [incubator-celeborn] - posted by "xleoken (via GitHub)" <gi...@apache.org> on 2023/10/24 12:49:22 UTC, 3 replies.
- Re: [PR] [CELEBORN-1073] Avoid memory copying in TransportMessage.toByteBuffer by using wrapping payload into CompositeByteBuf [incubator-celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2023/10/24 14:53:45 UTC, 7 replies.
- [PR] [CELEBORN-1088] Define baseLegend variable for jvm grafana dashboard [incubator-celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2023/10/24 15:28:22 UTC, 0 replies.
- [PR] Revert "[CELEBORN-255] Add counter of outstandingFetches, outstandingRpcs and outstandingPushes to metrics" [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/24 15:44:24 UTC, 3 replies.
- Re: [PR] [CELEBORN-1088] Define `baseLegend` variable for JVM Metrics dashboard [incubator-celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2023/10/24 16:37:21 UTC, 1 replies.
- [PR] [CELEBORN-1084][FOLLOWUP][0.3] Import `mock` method to restore CI [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/25 02:15:10 UTC, 1 replies.
- Re: [PR] [CELEBORN-1084][FOLLOWUP][0.3] Import `mock` method to recover CI [incubator-celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2023/10/25 02:42:53 UTC, 1 replies.
- [PR] [CELEBORN-1089] Seperate overHighWatermark check to a dedicated thread [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/25 02:56:04 UTC, 1 replies.
- [PR] [CELEBORN-255][FOLLOWUP] Add counter of outstandingFetches, outstandingRpcs and outstandingPushes to metrics [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/25 07:12:00 UTC, 7 replies.
- [I] [FEATURE] support configurable checksum in Lz4Decompressor [incubator-celeborn] - posted by "shuai-xu (via GitHub)" <gi...@apache.org> on 2023/10/25 08:07:03 UTC, 6 replies.
- [PR] [CELEBORN-1090] Remove un-used HashedWheelTimer [incubator-celeborn] - posted by "zwangsheng (via GitHub)" <gi...@apache.org> on 2023/10/25 09:08:46 UTC, 1 replies.
- [PR] [CELEBORN-1081] Client support `celeborn.storage.activeTypes` config [incubator-celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2023/10/25 09:12:59 UTC, 0 replies.
- [PR] [CELEBORN-665][FOLLOWUP] Skip empty app snapshot logs [incubator-celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/25 09:52:23 UTC, 2 replies.
- [PR] [CELEBORN-1091] Update docs about how to use error-prone plugin in IDEA [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/25 13:36:29 UTC, 2 replies.
- [PR] [CELEBORN-1032][FOLLOWUP] Use scheduleWithFixedDelay instead of scheduleAtFixedRate in threads pool of master and worker [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/26 11:24:49 UTC, 2 replies.
- [PR] [CELEBORN-1093] Improve setup endpoint [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/27 03:26:43 UTC, 2 replies.
- [PR] [CELEBORN-1095] Support configuration of fastest available XXHashFactory instance for checksum of Lz4Decompressor [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/28 11:15:20 UTC, 6 replies.
- Re: [I] [FEATURE] Split maxReqsInFlight limitation into level of target worker [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/28 11:19:28 UTC, 0 replies.
- [PR] [CELEBORN-1096] Avoid initializing SortShuffleManager when stop [incubator-celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/30 04:34:56 UTC, 2 replies.
- [PR] [CELEBORN-1094] Optimize mechanism of ChunkManager expired shuffle key cleanup to avoid memory leak [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/30 07:41:55 UTC, 1 replies.
- [PR] [CELEBORN-1098] Logging worker address when CommitFiles fails [incubator-celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2023/10/30 08:18:00 UTC, 2 replies.
- [PR] [CELEBORN-1097] Optimize the retrieval of configuration in the internalCreateClient [incubator-celeborn] - posted by "kerwin-zk (via GitHub)" <gi...@apache.org> on 2023/10/30 08:57:02 UTC, 7 replies.
- [PR] [CELEBORN-1099] Check register when handleGetReducerFileGroup [incubator-celeborn] - posted by "onebox-li (via GitHub)" <gi...@apache.org> on 2023/10/30 12:51:55 UTC, 2 replies.
- [PR] [CELEBORN-1101] Update metrics doc to add necessary configuration steps [incubator-celeborn] - posted by "jiaoqingbo (via GitHub)" <gi...@apache.org> on 2023/10/31 02:58:35 UTC, 3 replies.
- [PR] [CELEBORN-1102] Optimize the performance of getAllPrimaryLocationsWithMinEpoch [incubator-celeborn] - posted by "kerwin-zk (via GitHub)" <gi...@apache.org> on 2023/10/31 03:05:16 UTC, 2 replies.
- [PR] [CELEBORN-247][FOLLOWUP] Add metrics for each user's quota usage of Celeborn Worker [incubator-celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/10/31 07:11:53 UTC, 6 replies.
- [PR] [CELEBORN-1103][BUG] only clean up expire data from good disks [incubator-celeborn] - posted by "suizhe007 (via GitHub)" <gi...@apache.org> on 2023/10/31 10:57:32 UTC, 2 replies.
- Re: [PR] [CELEBORN-1098] Logging worker address with worker failure log [incubator-celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2023/10/31 13:30:16 UTC, 0 replies.
- Re: [PR] [CELEBORN-1103][BUG] only clean up expire data for good disks [incubator-celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2023/10/31 13:52:54 UTC, 0 replies.