You are viewing a plain text version of this content. The canonical link for it is here.
- Re: [PR] [CELEBORN-1440] Support baseline implementation of Celeborn Dashboard Server [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/01 08:32:33 UTC, 1 replies.
- Re: [PR] [CELEBORN-1470] CelebornInputStream should retry to get next chunk starting from returned chunk for no replication [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/01 08:32:35 UTC, 1 replies.
- Re: [PR] [CELEBORN-1574] Speed up unregister shuffle by batch processing [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2024/09/02 02:27:37 UTC, 21 replies.
- Re: [PR] [CELEBORN-1496][0.4] Differentiate map results with only different stageAttemptId [celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2024/09/02 02:57:54 UTC, 1 replies.
- Re: [PR] [CELEBORN-1544][0.4] ShuffleWriter needs to call close finally to avoid memory leaks [celeborn] - posted by "cfmcgrady (via GitHub)" <gi...@apache.org> on 2024/09/02 05:49:49 UTC, 1 replies.
- [PR] [WIP][CELEBORN-1490][CIP-6] Enrich register shuffle method [celeborn] - posted by "reswqa (via GitHub)" <gi...@apache.org> on 2024/09/02 07:15:36 UTC, 0 replies.
- Re: [PR] [CELEBORN-1572] Celeborn CLI initial REST API support [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/09/02 07:52:31 UTC, 17 replies.
- Re: [PR] [CELEBORN-1513] Support wildcard bind in dual stack environments [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/09/02 07:58:03 UTC, 16 replies.
- [PR] [CELEBORN-1585] Remove updateMapStatus in HashBasedShuffleWriter [celeborn] - posted by "jiang13021 (via GitHub)" <gi...@apache.org> on 2024/09/02 13:36:28 UTC, 0 replies.
- [PR] [CELEBORN-1490][CIP-6] Introduce tier factory and master agent in flink hybrid shuffle [celeborn] - posted by "reswqa (via GitHub)" <gi...@apache.org> on 2024/09/03 02:26:29 UTC, 6 replies.
- [PR] [CELEBORN-1586] Add available workers Metrics in AbstractMetaManager [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2024/09/03 05:55:02 UTC, 1 replies.
- [PR] [CELEBORN-1586]Add available workers Metrics [celeborn] - posted by "zaynt4606 (via GitHub)" <gi...@apache.org> on 2024/09/03 06:27:54 UTC, 0 replies.
- Re: [PR] [CELEBORN-1501] Introduce application dimension resource consumption metrics of Worker [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/03 08:08:46 UTC, 1 replies.
- Re: [PR] [CELEBORN-1582] Publish metric for unreleased shuffle count when worker was decommissioned [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/09/03 09:22:53 UTC, 20 replies.
- Re: [PR] [CELEBORN-1553] Using the request base url as swagger server [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/09/03 14:27:15 UTC, 1 replies.
- Re: [PR] [CELEBORN-1490][CIP-6] Extends FileMeta to support hybrid shuffle [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/09/03 14:54:16 UTC, 16 replies.
- Re: [PR] [CELEBORN-1585] Remove updateRecordsWrittenMetrics in HashBasedShuffleWriter [celeborn] - posted by "jiang13021 (via GitHub)" <gi...@apache.org> on 2024/09/04 03:02:46 UTC, 7 replies.
- [I] [DOC] how to config and use web ui [celeborn] - posted by "RaoZhiRou-Z (via GitHub)" <gi...@apache.org> on 2024/09/04 09:06:31 UTC, 2 replies.
- Re: [PR] [CELEBORN-1586] Add available workers Metrics [celeborn] - posted by "RexXiong (via GitHub)" <gi...@apache.org> on 2024/09/05 05:35:02 UTC, 1 replies.
- Re: [PR] [CELEBORN-912][FOLLOWUP] Support columnar shuffle for Spark 3.5 [celeborn] - posted by "kerwin-zk (via GitHub)" <gi...@apache.org> on 2024/09/05 06:27:26 UTC, 2 replies.
- [PR] [CELEBORN-1506] totalInflightReqs should decrement when inflightBatchesPerAddress isn't empty to avoid negative totalInflightReqs for limitZeroInFlight [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/05 07:00:30 UTC, 0 replies.
- Re: [PR] [CELEBORN-1490][CIP-6] Enrich register shuffle method [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/05 07:20:06 UTC, 8 replies.
- Re: [PR] [WIP][CELEBORN-1540] Support tez [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/09/05 09:20:19 UTC, 0 replies.
- Re: [PR] [CELEBORN-1506][FOLLOWUP] InFlightRequestTracker should decrement totalInflightReqs when inflightBatchesPerAddress isn't empty to avoid negative totalInflightReqs for limitZeroInFlight [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/09/05 13:15:41 UTC, 5 replies.
- Re: [PR] [CELEBORN-1036][FOLLOWUP] When inflightBatchesPerAddress clear, totalInflightReqs should reset [celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2024/09/05 13:53:53 UTC, 0 replies.
- [PR] Support quota low watermark for checking quota available [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/09/05 14:12:41 UTC, 1 replies.
- Re: [PR] [CELEBORN-1506][FOLLOWUP] InFlightRequestTracker should not reset totalInflightReqs for cleaning up to avoid negative totalInflightReqs for limitZeroInFlight [celeborn] - posted by "waitinfuture (via GitHub)" <gi...@apache.org> on 2024/09/06 05:17:57 UTC, 4 replies.
- [PR] [CELEBORN-1587] Change to debug logging on client side for SortBasedPusher trigger push [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/09/06 05:45:14 UTC, 2 replies.
- [PR] [CELEBORN-1588] Use Platform.allocateDirectBuffer instead of ByteBuffer.allocateDirect [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/06 08:15:01 UTC, 3 replies.
- Re: [PR] [CELEBORN-1477][FOLLOWUP] Upgrade openapi-generator to 7.8.0 [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/09 08:34:41 UTC, 3 replies.
- [PR] [CELEBORN-1589] Ensure master is leader for some POST request APIs [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2024/09/10 06:46:46 UTC, 14 replies.
- [PR] [CELEBORN-932][FOLLOWUP] Remove WorkerRemove to avoid duplicated behavior in RegisterWorker [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/11 03:41:15 UTC, 3 replies.
- Re: [PR] [CELEBORN-1536] Add option to toggle between human friendly vs single line logging [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/11 08:34:15 UTC, 5 replies.
- Re: [PR] [CELEBORN-1510] Partial task unable to switch to the replica [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/11 08:34:17 UTC, 1 replies.
- [PR] [CELEBORN-1477] /api/v1/workers/events should support None eventType to align /sendWorkerEvent [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/11 12:35:12 UTC, 1 replies.
- Re: [PR] [CELEBORN-1477][FOLLOWUP] /api/v1/workers/events should support None eventType to align /sendWorkerEvent [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/11 12:37:22 UTC, 6 replies.
- [PR] [CELEBORN-1490][CIP-6] Introduce tier producer in celeborn flink client [celeborn] - posted by "reswqa (via GitHub)" <gi...@apache.org> on 2024/09/12 02:11:14 UTC, 1 replies.
- [PR] [CELEBORN-1572][FOLLOWUP] master --send-worker-event should support RECOMMISSION and NONE event type [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/12 07:01:49 UTC, 5 replies.
- [PR] [CELEBORN-1593][FOLLOWUP] Add CLI support for removeWorkersUnavailabeInfo [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2024/09/12 07:28:15 UTC, 5 replies.
- [PR] [CELEBORN-1513][FOLLOWUP] Enrich doc for wildcard address [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2024/09/12 21:22:47 UTC, 4 replies.
- [PR] Dynamic config [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/13 05:56:03 UTC, 0 replies.
- Re: [PR] [CELEBORN-1594] Remove unused conf template [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/13 06:00:43 UTC, 4 replies.
- Re: [PR] [CELEBORN-1327][FOLLOWUP] Simplify DirectByteBuffer constructor lookup logic [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/09/13 14:14:56 UTC, 3 replies.
- Re: [PR] [CELEBORN-1595] Support quota low watermark for checking quota available [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/09/13 17:12:52 UTC, 2 replies.
- [PR] tolerate [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/13 18:50:18 UTC, 0 replies.
- Re: [PR] [CELEBORN-1596] Tolerate empty config field in dynamicConfig.yaml [celeborn] - posted by "codecov[bot] (via GitHub)" <gi...@apache.org> on 2024/09/13 19:06:15 UTC, 1 replies.
- [PR] [CELEBORN-1597][CIP-11] Implement TagsManager [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/09/13 20:08:17 UTC, 25 replies.
- Re: [PR] [CELEBORN-1594] Remove unused conf template and prevent NPE with empty dynamic config [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/13 21:25:32 UTC, 0 replies.
- Re: [PR] [CELEBORN-1594] Refine dynamicConfig template and prevent NPE [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/13 22:13:31 UTC, 2 replies.
- Re: [PR] [CELEBORN-1593][FOLLOWUP] Add CLI support for some missing HTTP APIs [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2024/09/14 07:16:24 UTC, 6 replies.
- Re: [PR] [CELEBORN-1521][FOLLOWUP] Using AuthenticationException instead of SecurityException [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/14 08:33:31 UTC, 2 replies.
- Re: [PR] [CELEBORN-1233] Add unit test to verify data correctness [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/16 08:34:41 UTC, 2 replies.
- Re: [PR] [WIP][CELEBORN-1319] Optimize skew partition logic for Reduce Mode to avoid sorting shuffle files [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/16 08:34:42 UTC, 0 replies.
- [PR] [CELEBORN-1297][FOLLOWUP] Fix DB config service SQL file [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/09/17 10:04:02 UTC, 2 replies.
- Re: [PR] [CELEBORN-932][FOLLOWUP] Remove StatusSystem#handleWorkerRemove from RegisterWorker to avoid duplicated behavior in RegisterWorker [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/09/18 06:53:16 UTC, 0 replies.
- [PR] [CELEBORN-1490][CIP-6] Impl worker write process for Flink Hybrid Shuffle [celeborn] - posted by "reswqa (via GitHub)" <gi...@apache.org> on 2024/09/18 08:13:31 UTC, 20 replies.
- [PR] Enable maven check server dependencies [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/09/18 10:28:51 UTC, 4 replies.
- [I] [DOC] Build docker image error [celeborn] - posted by "aagumin (via GitHub)" <gi...@apache.org> on 2024/09/18 12:14:42 UTC, 1 replies.
- [I] [BUG] default chart image doesn't work [celeborn] - posted by "aagumin (via GitHub)" <gi...@apache.org> on 2024/09/18 13:26:08 UTC, 4 replies.
- [PR] feat: custom image name for init container [celeborn] - posted by "aagumin (via GitHub)" <gi...@apache.org> on 2024/09/18 13:27:50 UTC, 2 replies.
- Re: [PR] [CELEBORN-1534] Order the API v1 response sequences filed [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/19 08:34:26 UTC, 0 replies.
- Re: [PR] [CELEBORN-1532][HELM] Make helm charts more customizable [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/19 08:34:27 UTC, 1 replies.
- Re: [PR] [CELEBORN-1528][HELM] Use volumeClaimTemplates to support various storage backend [celeborn] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2024/09/19 08:34:29 UTC, 0 replies.
- [PR] [CELEBORN-1600] Support revise lost shuffles [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/09/19 08:54:54 UTC, 0 replies.
- Re: [PR] [CELEBORN-1600] Enable check server dependencies [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/09/19 10:35:10 UTC, 2 replies.
- [PR] [CELEBORN-1602] do hard split for push merged data RPC with disk full [celeborn] - posted by "ErikFang (via GitHub)" <gi...@apache.org> on 2024/09/20 03:27:12 UTC, 2 replies.
- Re: [PR] [CELEBORN-1601] Support revise lost shuffles [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/20 03:48:50 UTC, 12 replies.
- Re: [PR] [CELEBORN-1603] parameterize init container image [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/09/20 07:07:36 UTC, 0 replies.
- [PR] [CELEBORN-1466][FOLLOWUP] Fix RaftPeerId generated by command of raftMetaConf to use real PeerId in celeborn_ratis_shell.md [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/20 07:30:07 UTC, 2 replies.
- [PR] [CELEBORN-1604] Bump rocksdbjni version from 8.11.3 to 9.5.2 [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/09/20 07:36:56 UTC, 1 replies.
- [PR] [CELEBORN-1605] Bump commons-lang3 version from 3.13.0 to 3.17.0 [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/09/20 07:59:26 UTC, 1 replies.
- [PR] [CELEBORN-1606] Generate dependencies-client-flink-1.16 [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/09/20 08:23:45 UTC, 2 replies.
- [PR] [MINOR] Delete DEPLOY_ON_K8S.md [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/20 09:58:47 UTC, 3 replies.
- [PR] using string [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/21 00:03:08 UTC, 0 replies.
- Re: [PR] [CELEBORN-1607] Fix openapi-client send worker event issue [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/21 00:35:19 UTC, 6 replies.
- Re: [PR] [CELEBORN-1607] Enable `useEnumCaseInsensitive` for openapi-generator [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/21 03:03:25 UTC, 1 replies.
- [PR] reduce resp size [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/21 07:39:36 UTC, 0 replies.
- [PR] [CELEBORN-1609] Support HTTP SSL connection [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/21 17:36:04 UTC, 0 replies.
- Re: [PR] [CELEBORN-1609] Support SSL for celeborn RESTful service [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/21 17:39:28 UTC, 5 replies.
- [PR] [CELEBORN-1497] Optimize read buffer dispatcher to retain buffers until worker has memory pressure [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/09/23 11:39:06 UTC, 0 replies.
- Re: [PR] [CELEBORN-1608] Reduce redundant response for RESTful api [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/09/23 12:47:49 UTC, 0 replies.
- [PR] [CELEBORN-1540] Add patch to customize tez main class. [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/09/24 03:13:36 UTC, 0 replies.
- [PR] [CELEBORN-1599] Container Info REST API [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2024/09/24 05:58:03 UTC, 7 replies.
- [PR] [CELEBORN-1525] Bump Ratis version from 3.1.0 to 3.1.1 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/24 07:02:32 UTC, 9 replies.
- [PR] [CELEBORN-1613] Bump Spark from 3.5.2 to 3.5.3 [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/25 03:28:07 UTC, 1 replies.
- [PR] [CELEBORN-1437][FOLLOWUP] Update metrics document link of README.md [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/25 06:50:19 UTC, 2 replies.
- [PR] [CELEBORN-1486][FOLLOWUP] Update document link of Get Started With Velox and Get Started With ClickHouse in glutensupport.md [celeborn] - posted by "SteNicholas (via GitHub)" <gi...@apache.org> on 2024/09/25 12:11:37 UTC, 2 replies.
- [PR] Skip docs [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/25 16:39:02 UTC, 0 replies.
- [PR] fix metrics api not found [celeborn] - posted by "turboFei (via GitHub)" <gi...@apache.org> on 2024/09/25 18:32:11 UTC, 0 replies.
- [PR] [CELEBORN-1616] Shade com.google.thirdparty to prevent dependency conflicts [celeborn] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2024/09/26 07:32:05 UTC, 2 replies.
- [PR] [CELEBORN-1617] Support workers tags in FS Config Service [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/09/26 12:01:41 UTC, 0 replies.
- Re: [PR] [CELEBORN-1617][CIP-11] Support workers tags in FS Config Service [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/09/26 12:16:07 UTC, 0 replies.
- [PR] Add tez shade module [celeborn] - posted by "Jay-ju (via GitHub)" <gi...@apache.org> on 2024/09/26 13:07:29 UTC, 0 replies.
- [PR] Support am custom main class with Apache Tez [celeborn] - posted by "Jay-ju (via GitHub)" <gi...@apache.org> on 2024/09/26 13:16:01 UTC, 2 replies.
- Re: [PR] [CELEBORN-1624] Refine tez client shade package [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/09/27 03:38:47 UTC, 0 replies.
- Re: [PR] [CELEBORN-1615] Fix metrics api not found issue [celeborn] - posted by "FMX (via GitHub)" <gi...@apache.org> on 2024/09/27 08:07:32 UTC, 2 replies.
- [PR] [CELEBORN-1625] Add new parameters to the pushOrMergeData method for gluten [celeborn] - posted by "kerwin-zk (via GitHub)" <gi...@apache.org> on 2024/09/27 08:18:30 UTC, 1 replies.
- Re: [PR] [CELEBORN-1571] Fix flaky test - pushdata timeout will add to pushExcludedWorker [celeborn] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2024/09/27 09:17:07 UTC, 0 replies.
- [PR] [CELEBORN-1620][CIP-11] Support passing worker tags via RequestSlots message [celeborn] - posted by "s0nskar (via GitHub)" <gi...@apache.org> on 2024/09/27 10:43:24 UTC, 1 replies.